2024-09-14T05:44:53.957 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T05:44:53.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T05:44:54.060 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900350 branch: main description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough} email: ceph-qa@ceph.com first_in_suite: false job_id: '7900350' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: rbd cache: true rbd cache max dirty: 0 global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 5839 sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 sleep_before_teardown: 0 subset: 99/128 suite: rbd suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLsoP8rfyoD0dlxqawnMdY6tN3N39/ZdWjxv0q+uqxNIey4oFjlsu9bqRMupf5t1Dx1RZ5uL34HupN0zUHn2mIs= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMnohTmW/73xAa0iq7bL6LORs+diqQ1pJazHExdebokfy5hp1jB4LKX6IFzRoWo3KWHQqp4lyNr+uUhnRErCbVY= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_20:16:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T05:44:54.061 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa; will attempt to use it 2024-09-14T05:44:54.061 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa/tasks 2024-09-14T05:44:54.062 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T05:44:54.063 INFO:teuthology.task.internal:Checking packages... 2024-09-14T05:44:54.085 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7f24e589328ae9e639c0009d93340e5b235d0a47' 2024-09-14T05:44:54.086 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T05:44:54.086 INFO:teuthology.packaging:ref: None 2024-09-14T05:44:54.086 INFO:teuthology.packaging:tag: None 2024-09-14T05:44:54.086 INFO:teuthology.packaging:branch: main 2024-09-14T05:44:54.086 INFO:teuthology.packaging:sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T05:44:54.086 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-09-14T05:44:54.385 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4907-ga2782315-1jammy 2024-09-14T05:44:54.386 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T05:44:54.393 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T05:44:54.393 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T05:44:54.414 INFO:teuthology.task.internal:Saving configuration 2024-09-14T05:44:54.428 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T05:44:54.435 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T05:44:54.461 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900350', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 05:39:00.003752', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBhTXGSw+nVK7uvNJ/gBmDp73ZgRRwViIBMXMqXDZAve'} 2024-09-14T05:44:54.484 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900350', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 05:39:00.001982', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJ0Yh+lvzDsucH1ScsWCnxnRiQ6XduowRofvwtzTrJH9'} 2024-09-14T05:44:54.484 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T05:44:54.491 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T05:44:54.491 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T05:44:54.491 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T05:44:54.550 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4da5377400>, signals=[15]) 2024-09-14T05:44:54.551 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T05:44:54.557 INFO:teuthology.task.internal:Opening connections... 2024-09-14T05:44:54.557 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2024-09-14T05:44:54.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:44:54.641 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T05:44:54.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:44:54.719 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T05:44:54.726 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-09-14T05:44:54.731 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-09-14T05:44:54.731 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-09-14T05:44:54.780 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T05:44:54.781 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2024-09-14T05:44:54.781 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="22.04" 2024-09-14T05:44:54.781 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T05:44:54.781 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=jammy 2024-09-14T05:44:54.781 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2024-09-14T05:44:54.781 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2024-09-14T05:44:54.781 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T05:44:54.781 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T05:44:54.782 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T05:44:54.782 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T05:44:54.782 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=jammy 2024-09-14T05:44:54.782 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-09-14T05:44:54.811 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-09-14T05:44:54.817 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-09-14T05:44:54.817 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-09-14T05:44:54.862 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T05:44:54.863 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2024-09-14T05:44:54.863 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="22.04" 2024-09-14T05:44:54.863 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T05:44:54.863 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=jammy 2024-09-14T05:44:54.863 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2024-09-14T05:44:54.863 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2024-09-14T05:44:54.863 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T05:44:54.863 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T05:44:54.863 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T05:44:54.863 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T05:44:54.863 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=jammy 2024-09-14T05:44:54.864 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-09-14T05:44:54.886 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T05:44:54.896 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T05:44:54.901 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T05:44:54.902 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2024-09-14T05:44:54.904 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-09-14T05:44:54.912 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T05:44:54.918 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T05:44:54.918 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2024-09-14T05:44:54.951 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-09-14T05:44:55.041 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T05:44:55.100 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T05:44:55.115 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T05:44:55.115 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T05:44:55.115 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T05:44:55.116 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T05:44:55.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:44:55.121 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-09-14T05:44:55.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:44:55.122 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-14T05:44:55.166 INFO:teuthology.orchestra.run.smithi006.stdout:5.15.0-56-generic 2024-09-14T05:44:55.167 INFO:teuthology.task.kernel:Running kernel on smithi006: 5.15.0-56-generic 2024-09-14T05:44:55.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get clean 2024-09-14T05:44:55.168 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-56-generic 2024-09-14T05:44:55.168 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.15.0-56-generic 2024-09-14T05:44:55.168 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-09-14T05:44:55.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get update 2024-09-14T05:44:55.308 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-14T05:44:55.421 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T05:44:55.449 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T05:44:55.530 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T05:44:55.561 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T05:44:55.612 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T05:44:55.621 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T05:44:55.643 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T05:44:55.667 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T05:44:55.724 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T05:44:55.728 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T05:44:55.730 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T05:44:55.730 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T05:44:55.731 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T05:44:55.751 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T05:44:55.754 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T05:44:55.754 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T05:44:55.760 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T05:44:55.765 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T05:44:55.766 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T05:44:55.766 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T05:44:55.767 INFO:teuthology.orchestra.run.smithi006.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T05:44:55.767 INFO:teuthology.orchestra.run.smithi006.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T05:44:55.769 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T05:44:55.773 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T05:44:55.775 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T05:44:55.775 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T05:44:55.776 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T05:44:55.782 INFO:teuthology.orchestra.run.smithi006.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T05:44:55.796 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T05:44:55.800 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T05:44:55.801 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T05:44:55.808 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T05:44:55.815 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T05:44:55.816 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T05:44:55.817 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T05:44:55.817 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T05:44:55.817 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T05:44:55.850 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T05:44:55.968 INFO:teuthology.orchestra.run.smithi006.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T05:44:55.999 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T05:44:56.106 INFO:teuthology.orchestra.run.smithi006.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T05:44:56.139 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T05:44:56.300 INFO:teuthology.orchestra.run.smithi006.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T05:44:56.457 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T05:44:56.459 INFO:teuthology.orchestra.run.smithi006.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T05:44:56.473 INFO:teuthology.orchestra.run.smithi006.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T05:44:56.474 INFO:teuthology.orchestra.run.smithi006.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T05:44:56.475 INFO:teuthology.orchestra.run.smithi006.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T05:44:56.492 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T05:44:56.506 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T05:44:56.507 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T05:44:56.509 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T05:44:56.544 INFO:teuthology.orchestra.run.smithi006.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T05:44:56.561 INFO:teuthology.orchestra.run.smithi006.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T05:44:56.561 INFO:teuthology.orchestra.run.smithi006.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T05:44:56.578 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T05:44:56.592 INFO:teuthology.orchestra.run.smithi006.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T05:44:56.595 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T05:44:56.596 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T05:44:56.612 INFO:teuthology.orchestra.run.smithi006.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T05:44:56.614 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T05:44:56.620 INFO:teuthology.orchestra.run.smithi006.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T05:44:56.624 INFO:teuthology.orchestra.run.smithi006.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T05:44:56.625 INFO:teuthology.orchestra.run.smithi006.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T05:44:56.625 INFO:teuthology.orchestra.run.smithi006.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T05:44:56.645 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T05:44:56.651 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T05:44:56.652 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T05:44:56.652 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T05:44:56.653 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T05:44:56.700 INFO:teuthology.orchestra.run.smithi006.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T05:44:56.701 INFO:teuthology.orchestra.run.smithi006.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T05:44:56.702 INFO:teuthology.orchestra.run.smithi006.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T05:44:56.703 INFO:teuthology.orchestra.run.smithi006.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T05:44:56.704 INFO:teuthology.orchestra.run.smithi006.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T05:44:56.705 INFO:teuthology.orchestra.run.smithi006.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T05:44:56.706 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T05:44:56.706 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T05:44:56.706 INFO:teuthology.orchestra.run.smithi006.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T05:44:56.707 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T05:44:56.708 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T05:44:56.786 INFO:teuthology.orchestra.run.smithi006.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T05:44:56.787 INFO:teuthology.orchestra.run.smithi006.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T05:44:56.787 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T05:44:56.787 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T05:44:56.788 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T05:44:56.789 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T05:44:56.789 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T05:45:02.165 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 16.0 MB in 2s (7,487 kB/s) 2024-09-14T05:45:02.671 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 16.0 MB in 2s (7,118 kB/s) 2024-09-14T05:45:03.515 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-14T05:45:03.533 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T05:45:03.628 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-14T05:45:03.814 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-14T05:45:03.815 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-14T05:45:03.985 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T05:45:03.986 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T05:45:03.986 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T05:45:03.986 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T05:45:03.986 INFO:teuthology.orchestra.run.smithi154.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T05:45:03.986 INFO:teuthology.orchestra.run.smithi154.stdout: python2.7-minimal 2024-09-14T05:45:03.986 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T05:45:03.988 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-09-14T05:45:03.988 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T05:45:03.988 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T05:45:03.988 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T05:45:03.989 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-09-14T05:45:03.990 INFO:teuthology.orchestra.run.smithi154.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T05:45:03.990 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-09-14T05:45:03.990 INFO:teuthology.orchestra.run.smithi154.stdout: thermald 2024-09-14T05:45:04.026 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-09-14T05:45:04.026 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T05:45:04.026 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T05:45:04.027 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T05:45:04.028 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2024-09-14T05:45:04.028 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T05:45:04.051 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-09-14T05:45:04.069 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T05:45:04.078 INFO:teuthology.orchestra.run.smithi154.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T05:45:04.078 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 113 MB of archives. 2024-09-14T05:45:04.079 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T05:45:04.079 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T05:45:04.135 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-09-14T05:45:04.349 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2024-09-14T05:45:04.350 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2024-09-14T05:45:04.437 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T05:45:04.527 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T05:45:04.543 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T05:45:04.544 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T05:45:04.544 INFO:teuthology.orchestra.run.smithi006.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T05:45:04.544 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T05:45:04.544 INFO:teuthology.orchestra.run.smithi006.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T05:45:04.544 INFO:teuthology.orchestra.run.smithi006.stdout: python2.7-minimal 2024-09-14T05:45:04.545 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T05:45:04.546 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2024-09-14T05:45:04.546 INFO:teuthology.orchestra.run.smithi006.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T05:45:04.546 INFO:teuthology.orchestra.run.smithi006.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T05:45:04.546 INFO:teuthology.orchestra.run.smithi006.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T05:45:04.548 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2024-09-14T05:45:04.548 INFO:teuthology.orchestra.run.smithi006.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T05:45:04.548 INFO:teuthology.orchestra.run.smithi006.stdout:Recommended packages: 2024-09-14T05:45:04.548 INFO:teuthology.orchestra.run.smithi006.stdout: thermald 2024-09-14T05:45:04.608 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2024-09-14T05:45:04.609 INFO:teuthology.orchestra.run.smithi006.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T05:45:04.609 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T05:45:04.609 INFO:teuthology.orchestra.run.smithi006.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T05:45:04.610 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages will be upgraded: 2024-09-14T05:45:04.611 INFO:teuthology.orchestra.run.smithi006.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T05:45:04.791 INFO:teuthology.orchestra.run.smithi006.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T05:45:04.791 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 113 MB of archives. 2024-09-14T05:45:04.791 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T05:45:04.791 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T05:45:05.349 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T05:45:05.349 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T05:45:05.349 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T05:45:05.475 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T05:45:05.495 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T05:45:05.873 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 113 MB in 1s (77.6 MB/s) 2024-09-14T05:45:06.069 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T05:45:06.169 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T05:45:06.520 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T05:45:08.108 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T05:45:08.113 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T05:45:08.200 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:08.818 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T05:45:08.818 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T05:45:08.819 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T05:45:09.171 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T05:45:09.252 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T05:45:09.677 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 113 MB in 5s (24.4 MB/s) 2024-09-14T05:45:09.841 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T05:45:10.276 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T05:45:10.297 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T05:45:10.378 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:10.838 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T05:45:10.858 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T05:45:10.896 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:11.811 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T05:45:11.815 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T05:45:11.880 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:13.923 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T05:45:13.945 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T05:45:14.053 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:14.468 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T05:45:14.490 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T05:45:14.526 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:17.792 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T05:45:17.916 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T05:45:18.257 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T05:45:18.378 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T05:45:18.673 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T05:45:18.695 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T05:45:18.739 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T05:45:20.995 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T05:45:21.129 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T05:45:21.446 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T05:45:21.558 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T05:45:21.869 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T05:45:21.892 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T05:45:21.936 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T05:45:24.086 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T05:45:24.123 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T05:45:24.161 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:27.421 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T05:45:27.546 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T05:45:27.758 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T05:45:27.795 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T05:45:27.832 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:27.896 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T05:45:28.001 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:28.127 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T05:45:28.255 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:29.593 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T05:45:29.594 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T05:45:29.594 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T05:45:29.594 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T05:45:29.767 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:30.530 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T05:45:30.653 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T05:45:31.785 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:32.029 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T05:45:32.167 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:32.293 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T05:45:32.412 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:33.186 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T05:45:33.311 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T05:45:33.438 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:33.499 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T05:45:33.499 INFO:teuthology.orchestra.run.smithi154.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T05:45:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T05:45:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T05:45:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T05:45:33.746 INFO:teuthology.orchestra.run.smithi006.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T05:45:33.899 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:35.350 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:36.760 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T05:45:36.861 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T05:45:37.229 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T05:45:37.781 INFO:teuthology.orchestra.run.smithi006.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T05:45:37.781 INFO:teuthology.orchestra.run.smithi006.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T05:45:48.361 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T05:45:48.362 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub' 2024-09-14T05:45:48.382 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T05:45:48.399 INFO:teuthology.orchestra.run.smithi154.stdout:Generating grub configuration file ... 2024-09-14T05:45:48.707 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T05:45:48.731 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T05:45:49.023 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T05:45:49.029 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T05:45:49.092 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T05:45:49.097 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T05:45:49.262 INFO:teuthology.orchestra.run.smithi154.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T05:45:49.262 INFO:teuthology.orchestra.run.smithi154.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T05:45:49.262 INFO:teuthology.orchestra.run.smithi154.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T05:45:49.300 INFO:teuthology.orchestra.run.smithi154.stdout:done 2024-09-14T05:45:49.722 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-09-14T05:45:49.748 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-09-14T05:45:49.748 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-09-14T05:45:49.748 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-09-14T05:45:49.748 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-09-14T05:45:49.748 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 21 2024-09-14T05:45:49.749 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T05:45:49.749 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-09-14T05:45:49.749 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-09-14T05:45:49.749 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.121.121 2024-09-14T05:45:49.749 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T05:45:49.749 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T05:45:49.749 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-09-14T05:45:49.749 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-09-14T05:45:49.749 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-09-14T05:45:49.749 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-09-14T05:45:49.749 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T05:45:49.750 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T05:45:49.750 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T05:45:49.750 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T05:45:49.750 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T05:45:49.750 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-09-14T05:45:49.930 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-14T05:45:50.051 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T05:45:50.191 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T05:45:50.282 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T05:45:50.353 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T05:45:51.532 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-14T05:45:51.550 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T05:45:51.613 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-14T05:45:51.825 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-14T05:45:51.825 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-14T05:45:52.010 INFO:teuthology.orchestra.run.smithi154.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T05:45:52.010 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T05:45:52.010 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T05:45:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T05:45:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T05:45:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T05:45:52.011 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T05:45:52.011 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T05:45:52.052 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T05:45:52.054 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-09-14T05:45:52.065 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-09-14T05:45:52.066 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-09-14T05:45:52.066 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-09-14T05:45:52.066 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-09-14T05:45:52.066 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 21 2024-09-14T05:45:52.066 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T05:45:52.066 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-09-14T05:45:52.066 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-09-14T05:45:52.066 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.121.121 2024-09-14T05:45:52.066 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T05:45:52.066 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T05:45:52.066 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-09-14T05:45:52.067 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-09-14T05:45:52.067 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-09-14T05:45:52.067 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-09-14T05:45:52.067 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-14T05:45:52.110 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.NLWJcIOjHW 2024-09-14T05:45:52.110 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub/grub.cfg /tmp/tmp.NLWJcIOjHW 2024-09-14T05:45:52.166 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.NLWJcIOjHW 2024-09-14T05:45:52.213 INFO:teuthology.orchestra.run.smithi006.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T05:45:52.213 INFO:teuthology.orchestra.run.smithi006.stdout:Sourcing file `/etc/default/grub' 2024-09-14T05:45:52.221 INFO:teuthology.orchestra.run.smithi006.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T05:45:52.239 INFO:teuthology.orchestra.run.smithi006.stdout:Generating grub configuration file ... 2024-09-14T05:45:52.283 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.NLWJcIOjHW is 10KB 2024-09-14T05:45:52.295 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.NLWJcIOjHW 2024-09-14T05:45:52.300 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T05:45:52.354 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:45:52.354 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T05:45:52.354 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T05:45:52.421 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T05:45:52.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo update-grub 2024-09-14T05:45:52.574 INFO:teuthology.orchestra.run.smithi006.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T05:45:52.594 INFO:teuthology.orchestra.run.smithi006.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T05:45:52.978 INFO:teuthology.orchestra.run.smithi006.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T05:45:52.984 INFO:teuthology.orchestra.run.smithi006.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T05:45:53.060 INFO:teuthology.orchestra.run.smithi006.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T05:45:53.066 INFO:teuthology.orchestra.run.smithi006.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T05:45:53.234 INFO:teuthology.orchestra.run.smithi006.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T05:45:53.234 INFO:teuthology.orchestra.run.smithi006.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T05:45:53.234 INFO:teuthology.orchestra.run.smithi006.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T05:45:53.281 INFO:teuthology.orchestra.run.smithi006.stdout:done 2024-09-14T05:45:53.681 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub' 2024-09-14T05:45:53.682 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T05:45:53.693 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2024-09-14T05:45:53.733 DEBUG:teuthology.orchestra.run.smithi006:> dpkg -s linux-image-generic 2024-09-14T05:45:53.756 INFO:teuthology.orchestra.run.smithi006.stdout:Package: linux-image-generic 2024-09-14T05:45:53.756 INFO:teuthology.orchestra.run.smithi006.stdout:Status: install ok installed 2024-09-14T05:45:53.756 INFO:teuthology.orchestra.run.smithi006.stdout:Priority: optional 2024-09-14T05:45:53.756 INFO:teuthology.orchestra.run.smithi006.stdout:Section: kernel 2024-09-14T05:45:53.756 INFO:teuthology.orchestra.run.smithi006.stdout:Installed-Size: 21 2024-09-14T05:45:53.756 INFO:teuthology.orchestra.run.smithi006.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T05:45:53.757 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: amd64 2024-09-14T05:45:53.757 INFO:teuthology.orchestra.run.smithi006.stdout:Source: linux-meta 2024-09-14T05:45:53.757 INFO:teuthology.orchestra.run.smithi006.stdout:Version: 5.15.0.121.121 2024-09-14T05:45:53.757 INFO:teuthology.orchestra.run.smithi006.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T05:45:53.757 INFO:teuthology.orchestra.run.smithi006.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T05:45:53.757 INFO:teuthology.orchestra.run.smithi006.stdout:Recommends: thermald 2024-09-14T05:45:53.757 INFO:teuthology.orchestra.run.smithi006.stdout:Description: Generic Linux kernel image 2024-09-14T05:45:53.757 INFO:teuthology.orchestra.run.smithi006.stdout: This package will always depend on the latest generic kernel image 2024-09-14T05:45:53.757 INFO:teuthology.orchestra.run.smithi006.stdout: available. 2024-09-14T05:45:53.757 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T05:45:53.757 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T05:45:53.758 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T05:45:53.758 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T05:45:53.758 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T05:45:53.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get clean 2024-09-14T05:45:53.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get update 2024-09-14T05:45:53.897 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T05:45:53.900 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T05:45:54.131 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T05:45:54.136 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T05:45:54.142 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T05:45:54.142 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T05:45:54.179 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T05:45:54.184 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T05:45:54.214 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T05:45:54.296 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T05:45:54.308 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T05:45:54.308 INFO:teuthology.orchestra.run.smithi154.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T05:45:54.308 INFO:teuthology.orchestra.run.smithi154.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T05:45:54.319 INFO:teuthology.orchestra.run.smithi154.stderr:done 2024-09-14T05:45:54.322 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2024-09-14T05:45:55.590 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-09-14T05:45:55.611 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T05:45:55.676 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-09-14T05:45:55.890 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2024-09-14T05:45:55.890 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2024-09-14T05:45:56.093 INFO:teuthology.orchestra.run.smithi006.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T05:45:56.093 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T05:45:56.094 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T05:45:56.094 INFO:teuthology.orchestra.run.smithi006.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T05:45:56.094 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T05:45:56.094 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T05:45:56.094 INFO:teuthology.orchestra.run.smithi006.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T05:45:56.094 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T05:45:56.140 INFO:teuthology.orchestra.run.smithi006.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T05:45:56.142 DEBUG:teuthology.orchestra.run.smithi006:> dpkg -s linux-image-generic 2024-09-14T05:45:56.155 INFO:teuthology.orchestra.run.smithi006.stdout:Package: linux-image-generic 2024-09-14T05:45:56.155 INFO:teuthology.orchestra.run.smithi006.stdout:Status: install ok installed 2024-09-14T05:45:56.155 INFO:teuthology.orchestra.run.smithi006.stdout:Priority: optional 2024-09-14T05:45:56.155 INFO:teuthology.orchestra.run.smithi006.stdout:Section: kernel 2024-09-14T05:45:56.155 INFO:teuthology.orchestra.run.smithi006.stdout:Installed-Size: 21 2024-09-14T05:45:56.155 INFO:teuthology.orchestra.run.smithi006.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T05:45:56.155 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: amd64 2024-09-14T05:45:56.155 INFO:teuthology.orchestra.run.smithi006.stdout:Source: linux-meta 2024-09-14T05:45:56.155 INFO:teuthology.orchestra.run.smithi006.stdout:Version: 5.15.0.121.121 2024-09-14T05:45:56.156 INFO:teuthology.orchestra.run.smithi006.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T05:45:56.156 INFO:teuthology.orchestra.run.smithi006.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T05:45:56.156 INFO:teuthology.orchestra.run.smithi006.stdout:Recommends: thermald 2024-09-14T05:45:56.156 INFO:teuthology.orchestra.run.smithi006.stdout:Description: Generic Linux kernel image 2024-09-14T05:45:56.156 INFO:teuthology.orchestra.run.smithi006.stdout: This package will always depend on the latest generic kernel image 2024-09-14T05:45:56.156 INFO:teuthology.orchestra.run.smithi006.stdout: available. 2024-09-14T05:45:56.156 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-09-14T05:45:56.202 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.3d8spIr7GK 2024-09-14T05:45:56.203 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub/grub.cfg /tmp/tmp.3d8spIr7GK 2024-09-14T05:45:56.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.3d8spIr7GK 2024-09-14T05:45:56.373 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.3d8spIr7GK is 10KB 2024-09-14T05:45:56.386 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.3d8spIr7GK 2024-09-14T05:45:56.391 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T05:45:56.446 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:45:56.446 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T05:45:56.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T05:45:56.514 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T05:45:56.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo update-grub 2024-09-14T05:45:57.744 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub' 2024-09-14T05:45:57.745 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T05:45:57.748 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2024-09-14T05:45:58.002 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T05:45:58.009 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T05:45:58.291 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T05:45:58.297 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T05:45:58.339 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T05:45:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T05:45:58.467 INFO:teuthology.orchestra.run.smithi006.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T05:45:58.467 INFO:teuthology.orchestra.run.smithi006.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T05:45:58.467 INFO:teuthology.orchestra.run.smithi006.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T05:45:58.479 INFO:teuthology.orchestra.run.smithi006.stderr:done 2024-09-14T05:45:58.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2024-09-14T05:46:24.348 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T05:46:24.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-14T05:46:24.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:46:28.493 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T05:46:28.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-14T05:46:28.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:46:42.877 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-14T05:46:51.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-14T05:46:51.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:46:54.941 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-14T05:47:06.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-14T05:47:06.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:47:28.517 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T05:47:37.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-14T05:47:37.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:47:53.216 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-09-14T05:47:53.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-14T05:47:53.823 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-14T05:47:53.823 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-09-14T05:47:53.867 INFO:teuthology.orchestra.run.smithi006.stdout:5.15.0-121-generic 2024-09-14T05:47:53.868 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T05:47:53.868 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T05:47:53.868 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T05:47:54.868 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T05:47:54.869 DEBUG:teuthology.orchestra.run.smithi006:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T05:47:54.948 INFO:teuthology.orchestra.run.smithi006.stdout:ttyS1 2024-09-14T05:47:54.985 DEBUG:teuthology.parallel:result is None 2024-09-14T05:48:06.957 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T05:48:21.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-14T05:48:21.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:48:22.188 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-14T05:48:22.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-14T05:48:22.835 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-14T05:48:22.835 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-14T05:48:22.882 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-121-generic 2024-09-14T05:48:22.882 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T05:48:22.882 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T05:48:22.882 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T05:48:23.883 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T05:48:23.884 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T05:48:24.237 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2024-09-14T05:48:24.267 DEBUG:teuthology.parallel:result is None 2024-09-14T05:48:24.268 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T05:48:24.275 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T05:48:24.275 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T05:48:24.277 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T05:48:24.283 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T05:48:24.291 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T05:48:24.297 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T05:48:24.297 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T05:48:24.325 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T05:48:24.347 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T05:48:24.353 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T05:48:24.353 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T05:48:24.385 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T05:48:24.400 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T05:48:24.406 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T05:48:24.409 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T05:48:24.415 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T05:48:24.416 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T05:48:24.423 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T05:48:24.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T05:48:24.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T05:48:24.474 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T05:48:24.483 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T05:48:24.483 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T05:48:24.517 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T05:48:24.522 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T05:48:24.568 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T05:48:24.616 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:48:24.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T05:48:24.681 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T05:48:24.687 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T05:48:24.734 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:48:24.734 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T05:48:24.806 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2024-09-14T05:48:24.809 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-09-14T05:48:24.882 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T05:48:24.890 INFO:teuthology.task.internal:Starting timer... 2024-09-14T05:48:24.890 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T05:48:24.900 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T05:48:24.909 DEBUG:teuthology.task.selinux:Excluding smithi006: OS 'ubuntu' does not support SELinux 2024-09-14T05:48:24.909 DEBUG:teuthology.task.selinux:Excluding smithi154: OS 'ubuntu' does not support SELinux 2024-09-14T05:48:24.909 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T05:48:24.909 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-14T05:48:24.909 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T05:48:24.909 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T05:48:24.918 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T05:48:24.930 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T05:48:24.931 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T05:56:00.308 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2024-09-14T05:56:00.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-14T05:56:00.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:56:00.394 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-09-14T05:56:00.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-09-14T05:56:00.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-14T05:56:00.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:56:00.550 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-14T05:56:00.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-14T05:56:00.625 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T05:56:00.635 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T05:56:00.635 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T05:56:00.636 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T05:56:00.638 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T05:56:00.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T05:56:00.667 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T05:56:00.667 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: Command line: ntpd -gq 2024-09-14T05:56:00.668 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: ---------------------------------------------------- 2024-09-14T05:56:00.668 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T05:56:00.668 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T05:56:00.668 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: corporation. Support and training for ntp-4 are 2024-09-14T05:56:00.668 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: available at https://www.nwtime.org/support 2024-09-14T05:56:00.668 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: ---------------------------------------------------- 2024-09-14T05:56:00.668 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: proto: precision = 0.071 usec (-24) 2024-09-14T05:56:00.669 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: basedate set to 2022-02-04 2024-09-14T05:56:00.669 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: gps base set to 2022-02-06 (week 2196) 2024-09-14T05:56:00.669 INFO:teuthology.orchestra.run.smithi006.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T05:56:00.669 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T05:56:00.669 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T05:56:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T05:56:00.671 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T05:56:00.671 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T05:56:00.671 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T05:56:00.671 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: Listen normally on 3 ens1f0 172.21.15.6:123 2024-09-14T05:56:00.671 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: Listen normally on 4 lo [::1]:123 2024-09-14T05:56:00.671 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15e4%4]:123 2024-09-14T05:56:00.671 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:00 ntpd[18400]: Listening on routing socket on fd #22 for interface updates 2024-09-14T05:56:00.699 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T05:56:00.699 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: Command line: ntpd -gq 2024-09-14T05:56:00.699 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: ---------------------------------------------------- 2024-09-14T05:56:00.699 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T05:56:00.700 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T05:56:00.700 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: corporation. Support and training for ntp-4 are 2024-09-14T05:56:00.700 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: available at https://www.nwtime.org/support 2024-09-14T05:56:00.700 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: ---------------------------------------------------- 2024-09-14T05:56:00.700 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: proto: precision = 0.061 usec (-24) 2024-09-14T05:56:00.700 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: basedate set to 2022-02-04 2024-09-14T05:56:00.701 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: gps base set to 2022-02-06 (week 2196) 2024-09-14T05:56:00.701 INFO:teuthology.orchestra.run.smithi154.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T05:56:00.701 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T05:56:00.701 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T05:56:00.702 INFO:teuthology.orchestra.run.smithi154.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T05:56:00.702 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T05:56:00.703 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T05:56:00.703 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T05:56:00.703 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: Listen normally on 3 enp3s0f1 172.21.15.154:123 2024-09-14T05:56:00.703 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: Listen normally on 4 lo [::1]:123 2024-09-14T05:56:00.703 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7761%5]:123 2024-09-14T05:56:00.703 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:00 ntpd[18528]: Listening on routing socket on fd #22 for interface updates 2024-09-14T05:56:01.669 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:01.669 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:01.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:01.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:01 ntpd[18400]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:01.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:01 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:01.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:01 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:01.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:01 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:01.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:01 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:01.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:01 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:01.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:01 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:01.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:01 ntpd[18528]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:01.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:01 ntpd[18528]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:01.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:01 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:01.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:01 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:01.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:01 ntpd[18528]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:01.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:01 ntpd[18528]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:02.668 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:02 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:02.668 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:02 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:02.700 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:02 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:02.700 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:02 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:02.700 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:02 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:02.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:02 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:02.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:02 ntpd[18528]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:02.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:02 ntpd[18528]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:03 ntpd[18400]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:03.700 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:03 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:03.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:03 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:03.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:03 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:03.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:03 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:03.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:03 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:03.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:03 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:03.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:03 ntpd[18528]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:03.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:03 ntpd[18528]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:03.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:03 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:03.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:03 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:03.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:03 ntpd[18528]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:03.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:03 ntpd[18528]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:04.700 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:04 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:04.700 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:04 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:04.700 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:04 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:04.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:04 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:04.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:04 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:04.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:04 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:04.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:04 ntpd[18528]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:04.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:04 ntpd[18528]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:05 ntpd[18400]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:05.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:05 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:05.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:05 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:05.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:05 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:05.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:05 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:05.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:05 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:05.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:05 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:05.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:05 ntpd[18528]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:05.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:05 ntpd[18528]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:05.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:05 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:05.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:05 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:05.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:05 ntpd[18528]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:05.702 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:05 ntpd[18528]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:06.700 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:06 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:06.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:06 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:06.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:06 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:06.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:06 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:06.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:06 ntpd[18528]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:06.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:06 ntpd[18528]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:07 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:07 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:07 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:07 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:07 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:07 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:07 ntpd[18400]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:07 ntpd[18400]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:07 ntpd[18400]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:07 ntpd[18400]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:07.670 INFO:teuthology.orchestra.run.smithi006.stdout:14 Sep 05:56:07 ntpd[18400]: ntpd: time slew +0.000295 s 2024-09-14T05:56:07.670 INFO:teuthology.orchestra.run.smithi006.stdout:ntpd: time slew +0.000295s 2024-09-14T05:56:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:07 ntpd[18400]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T05:56:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:14 Sep 05:56:07 ntpd[18400]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T05:56:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:07 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:07 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:07 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:07 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:07.700 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:07 ntpd[18528]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T05:56:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:07 ntpd[18528]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T05:56:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:07 ntpd[18528]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T05:56:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:07 ntpd[18528]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T05:56:07.701 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 05:56:07 ntpd[18528]: ntpd: time slew -0.000936 s 2024-09-14T05:56:07.701 INFO:teuthology.orchestra.run.smithi154.stdout:ntpd: time slew -0.000936s 2024-09-14T05:56:07.701 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:07 ntpd[18528]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T05:56:07.702 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 05:56:07 ntpd[18528]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T05:56:07.718 INFO:teuthology.orchestra.run.smithi006.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T05:56:07.718 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================== 2024-09-14T05:56:07.718 INFO:teuthology.orchestra.run.smithi006.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T05:56:07.718 INFO:teuthology.orchestra.run.smithi006.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T05:56:07.718 INFO:teuthology.orchestra.run.smithi006.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T05:56:07.718 INFO:teuthology.orchestra.run.smithi006.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T05:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T05:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-09-14T05:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T05:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T05:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T05:56:07.752 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T05:56:07.753 INFO:teuthology.run_tasks:Running task install... 2024-09-14T05:56:07.761 DEBUG:teuthology.task.install:project ceph 2024-09-14T05:56:07.761 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}} 2024-09-14T05:56:07.761 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'} 2024-09-14T05:56:07.761 INFO:teuthology.task.install:Using flavor: default 2024-09-14T05:56:07.767 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T05:56:07.767 INFO:teuthology.task.install:extra packages: [] 2024-09-14T05:56:07.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-key list | grep Ceph 2024-09-14T05:56:07.768 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-key list | grep Ceph 2024-09-14T05:56:07.825 INFO:teuthology.orchestra.run.smithi006.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T05:56:07.853 INFO:teuthology.orchestra.run.smithi006.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T05:56:07.853 INFO:teuthology.orchestra.run.smithi006.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T05:56:07.854 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-14T05:56:07.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T05:56:07.860 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T05:56:07.890 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T05:56:07.890 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T05:56:07.890 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-14T05:56:07.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T05:56:07.995 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default/ 2024-09-14T05:56:07.996 INFO:teuthology.task.install.deb:Package version is 19.3.0-4775-g7f24e589-1jammy 2024-09-14T05:56:08.036 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default/ 2024-09-14T05:56:08.036 INFO:teuthology.task.install.deb:Package version is 19.3.0-4775-g7f24e589-1jammy 2024-09-14T05:56:08.106 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:56:08.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T05:56:08.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get update 2024-09-14T05:56:08.142 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:56:08.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T05:56:08.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-14T05:56:08.291 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T05:56:08.301 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T05:56:08.318 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T05:56:08.346 INFO:teuthology.orchestra.run.smithi006.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T05:56:08.366 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T05:56:08.376 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T05:56:08.393 INFO:teuthology.orchestra.run.smithi006.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T05:56:08.397 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T05:56:08.413 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-09-14T05:56:08.420 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T05:56:08.432 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T05:56:08.440 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T05:56:08.441 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-09-14T05:56:08.461 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T05:56:08.461 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T05:56:08.482 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T05:56:08.525 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T05:56:08.606 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T05:56:08.654 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 29.3 kB in 0s (83.7 kB/s) 2024-09-14T05:56:08.824 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 29.3 kB in 0s (59.9 kB/s) 2024-09-14T05:56:09.687 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-09-14T05:56:09.705 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4775-g7f24e589-1jammy cephadm=19.3.0-4775-g7f24e589-1jammy ceph-mds=19.3.0-4775-g7f24e589-1jammy ceph-mgr=19.3.0-4775-g7f24e589-1jammy ceph-common=19.3.0-4775-g7f24e589-1jammy ceph-fuse=19.3.0-4775-g7f24e589-1jammy ceph-test=19.3.0-4775-g7f24e589-1jammy ceph-volume=19.3.0-4775-g7f24e589-1jammy radosgw=19.3.0-4775-g7f24e589-1jammy python3-rados=19.3.0-4775-g7f24e589-1jammy python3-rgw=19.3.0-4775-g7f24e589-1jammy python3-cephfs=19.3.0-4775-g7f24e589-1jammy python3-rbd=19.3.0-4775-g7f24e589-1jammy libcephfs2=19.3.0-4775-g7f24e589-1jammy libcephfs-dev=19.3.0-4775-g7f24e589-1jammy librados2=19.3.0-4775-g7f24e589-1jammy librbd1=19.3.0-4775-g7f24e589-1jammy rbd-fuse=19.3.0-4775-g7f24e589-1jammy 2024-09-14T05:56:09.771 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2024-09-14T05:56:09.797 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-14T05:56:09.813 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4775-g7f24e589-1jammy cephadm=19.3.0-4775-g7f24e589-1jammy ceph-mds=19.3.0-4775-g7f24e589-1jammy ceph-mgr=19.3.0-4775-g7f24e589-1jammy ceph-common=19.3.0-4775-g7f24e589-1jammy ceph-fuse=19.3.0-4775-g7f24e589-1jammy ceph-test=19.3.0-4775-g7f24e589-1jammy ceph-volume=19.3.0-4775-g7f24e589-1jammy radosgw=19.3.0-4775-g7f24e589-1jammy python3-rados=19.3.0-4775-g7f24e589-1jammy python3-rgw=19.3.0-4775-g7f24e589-1jammy python3-cephfs=19.3.0-4775-g7f24e589-1jammy python3-rbd=19.3.0-4775-g7f24e589-1jammy libcephfs2=19.3.0-4775-g7f24e589-1jammy libcephfs-dev=19.3.0-4775-g7f24e589-1jammy librados2=19.3.0-4775-g7f24e589-1jammy librbd1=19.3.0-4775-g7f24e589-1jammy rbd-fuse=19.3.0-4775-g7f24e589-1jammy 2024-09-14T05:56:09.867 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-14T05:56:09.983 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2024-09-14T05:56:09.984 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2024-09-14T05:56:10.059 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-14T05:56:10.059 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-14T05:56:10.201 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T05:56:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T05:56:10.201 INFO:teuthology.orchestra.run.smithi006.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T05:56:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T05:56:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T05:56:10.202 INFO:teuthology.orchestra.run.smithi006.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T05:56:10.202 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T05:56:10.203 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2024-09-14T05:56:10.203 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T05:56:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T05:56:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T05:56:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T05:56:10.204 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T05:56:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T05:56:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T05:56:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T05:56:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T05:56:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T05:56:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T05:56:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T05:56:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T05:56:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T05:56:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T05:56:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T05:56:10.205 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T05:56:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T05:56:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T05:56:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T05:56:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T05:56:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T05:56:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T05:56:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet zip 2024-09-14T05:56:10.206 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2024-09-14T05:56:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T05:56:10.206 INFO:teuthology.orchestra.run.smithi006.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T05:56:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T05:56:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T05:56:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T05:56:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T05:56:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T05:56:10.207 INFO:teuthology.orchestra.run.smithi006.stdout:Recommended packages: 2024-09-14T05:56:10.207 INFO:teuthology.orchestra.run.smithi006.stdout: btrfs-tools 2024-09-14T05:56:10.247 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T05:56:10.247 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T05:56:10.247 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T05:56:10.247 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T05:56:10.248 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T05:56:10.248 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T05:56:10.248 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T05:56:10.249 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-09-14T05:56:10.249 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T05:56:10.249 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T05:56:10.249 INFO:teuthology.orchestra.run.smithi154.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T05:56:10.249 INFO:teuthology.orchestra.run.smithi154.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T05:56:10.249 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T05:56:10.250 INFO:teuthology.orchestra.run.smithi154.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T05:56:10.250 INFO:teuthology.orchestra.run.smithi154.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T05:56:10.250 INFO:teuthology.orchestra.run.smithi154.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T05:56:10.250 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T05:56:10.251 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet zip 2024-09-14T05:56:10.252 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-09-14T05:56:10.252 INFO:teuthology.orchestra.run.smithi154.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T05:56:10.252 INFO:teuthology.orchestra.run.smithi154.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T05:56:10.252 INFO:teuthology.orchestra.run.smithi154.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T05:56:10.252 INFO:teuthology.orchestra.run.smithi154.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T05:56:10.252 INFO:teuthology.orchestra.run.smithi154.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T05:56:10.252 INFO:teuthology.orchestra.run.smithi154.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T05:56:10.252 INFO:teuthology.orchestra.run.smithi154.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T05:56:10.252 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-09-14T05:56:10.252 INFO:teuthology.orchestra.run.smithi154.stdout: btrfs-tools 2024-09-14T05:56:10.315 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2024-09-14T05:56:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T05:56:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T05:56:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T05:56:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T05:56:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T05:56:10.316 INFO:teuthology.orchestra.run.smithi006.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T05:56:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T05:56:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T05:56:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T05:56:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T05:56:10.317 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T05:56:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T05:56:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T05:56:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T05:56:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T05:56:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T05:56:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T05:56:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T05:56:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T05:56:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T05:56:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T05:56:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T05:56:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T05:56:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T05:56:10.318 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T05:56:10.319 INFO:teuthology.orchestra.run.smithi006.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-14T05:56:10.355 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-09-14T05:56:10.355 INFO:teuthology.orchestra.run.smithi154.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T05:56:10.355 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T05:56:10.355 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T05:56:10.356 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T05:56:10.356 INFO:teuthology.orchestra.run.smithi154.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T05:56:10.356 INFO:teuthology.orchestra.run.smithi154.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T05:56:10.356 INFO:teuthology.orchestra.run.smithi154.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T05:56:10.357 INFO:teuthology.orchestra.run.smithi154.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T05:56:10.357 INFO:teuthology.orchestra.run.smithi154.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T05:56:10.357 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T05:56:10.357 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T05:56:10.357 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T05:56:10.357 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T05:56:10.357 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T05:56:10.357 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T05:56:10.357 INFO:teuthology.orchestra.run.smithi154.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T05:56:10.357 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T05:56:10.357 INFO:teuthology.orchestra.run.smithi154.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T05:56:10.357 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T05:56:10.357 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T05:56:10.357 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T05:56:10.358 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T05:56:10.358 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T05:56:10.358 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T05:56:10.358 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T05:56:10.358 INFO:teuthology.orchestra.run.smithi154.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi006.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 251 MB of archives. 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T05:56:10.457 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4775-g7f24e589-1jammy [3,631 kB] 2024-09-14T05:56:10.465 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T05:56:10.467 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T05:56:10.483 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T05:56:10.501 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T05:56:10.501 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 251 MB of archives. 2024-09-14T05:56:10.501 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T05:56:10.501 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4775-g7f24e589-1jammy [3,631 kB] 2024-09-14T05:56:10.543 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T05:56:10.546 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T05:56:10.547 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T05:56:10.561 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T05:56:10.565 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T05:56:10.566 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T05:56:10.567 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T05:56:10.567 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T05:56:10.576 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T05:56:10.579 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T05:56:10.581 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T05:56:10.587 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T05:56:10.588 INFO:teuthology.orchestra.run.smithi006.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T05:56:10.590 INFO:teuthology.orchestra.run.smithi006.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T05:56:10.592 INFO:teuthology.orchestra.run.smithi006.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T05:56:10.594 INFO:teuthology.orchestra.run.smithi006.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T05:56:10.604 INFO:teuthology.orchestra.run.smithi006.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T05:56:10.605 INFO:teuthology.orchestra.run.smithi006.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T05:56:10.606 INFO:teuthology.orchestra.run.smithi006.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T05:56:10.606 INFO:teuthology.orchestra.run.smithi006.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T05:56:10.607 INFO:teuthology.orchestra.run.smithi006.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T05:56:10.621 INFO:teuthology.orchestra.run.smithi006.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T05:56:10.621 INFO:teuthology.orchestra.run.smithi006.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T05:56:10.622 INFO:teuthology.orchestra.run.smithi006.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T05:56:10.622 INFO:teuthology.orchestra.run.smithi006.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T05:56:10.625 INFO:teuthology.orchestra.run.smithi006.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T05:56:10.638 INFO:teuthology.orchestra.run.smithi006.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T05:56:10.639 INFO:teuthology.orchestra.run.smithi006.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T05:56:10.639 INFO:teuthology.orchestra.run.smithi006.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T05:56:10.640 INFO:teuthology.orchestra.run.smithi006.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T05:56:10.641 INFO:teuthology.orchestra.run.smithi006.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T05:56:10.643 INFO:teuthology.orchestra.run.smithi006.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4775-g7f24e589-1jammy [3,330 kB] 2024-09-14T05:56:10.657 INFO:teuthology.orchestra.run.smithi006.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T05:56:10.657 INFO:teuthology.orchestra.run.smithi006.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T05:56:10.657 INFO:teuthology.orchestra.run.smithi006.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T05:56:10.658 INFO:teuthology.orchestra.run.smithi006.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T05:56:10.663 INFO:teuthology.orchestra.run.smithi006.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T05:56:10.672 INFO:teuthology.orchestra.run.smithi006.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T05:56:10.673 INFO:teuthology.orchestra.run.smithi006.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T05:56:10.673 INFO:teuthology.orchestra.run.smithi006.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T05:56:10.675 INFO:teuthology.orchestra.run.smithi006.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T05:56:10.677 INFO:teuthology.orchestra.run.smithi006.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T05:56:10.689 INFO:teuthology.orchestra.run.smithi006.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T05:56:10.691 INFO:teuthology.orchestra.run.smithi006.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T05:56:10.691 INFO:teuthology.orchestra.run.smithi006.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T05:56:10.694 INFO:teuthology.orchestra.run.smithi006.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T05:56:10.694 INFO:teuthology.orchestra.run.smithi006.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T05:56:10.706 INFO:teuthology.orchestra.run.smithi006.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T05:56:10.707 INFO:teuthology.orchestra.run.smithi006.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4775-g7f24e589-1jammy [722 kB] 2024-09-14T05:56:10.709 INFO:teuthology.orchestra.run.smithi006.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T05:56:10.720 INFO:teuthology.orchestra.run.smithi006.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4775-g7f24e589-1jammy [356 kB] 2024-09-14T05:56:10.726 INFO:teuthology.orchestra.run.smithi006.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4775-g7f24e589-1jammy [32.8 kB] 2024-09-14T05:56:10.727 INFO:teuthology.orchestra.run.smithi006.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4775-g7f24e589-1jammy [180 kB] 2024-09-14T05:56:10.730 INFO:teuthology.orchestra.run.smithi006.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4775-g7f24e589-1jammy [71.2 kB] 2024-09-14T05:56:10.737 INFO:teuthology.orchestra.run.smithi006.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4775-g7f24e589-1jammy [338 kB] 2024-09-14T05:56:10.743 INFO:teuthology.orchestra.run.smithi006.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4775-g7f24e589-1jammy [7,984 kB] 2024-09-14T05:56:10.764 INFO:teuthology.orchestra.run.smithi006.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T05:56:10.765 INFO:teuthology.orchestra.run.smithi006.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T05:56:10.766 INFO:teuthology.orchestra.run.smithi006.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T05:56:10.766 INFO:teuthology.orchestra.run.smithi006.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T05:56:10.767 INFO:teuthology.orchestra.run.smithi006.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T05:56:10.785 INFO:teuthology.orchestra.run.smithi006.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T05:56:10.787 INFO:teuthology.orchestra.run.smithi006.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T05:56:10.787 INFO:teuthology.orchestra.run.smithi006.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T05:56:10.801 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4775-g7f24e589-1jammy [3,330 kB] 2024-09-14T05:56:10.802 INFO:teuthology.orchestra.run.smithi006.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T05:56:10.802 INFO:teuthology.orchestra.run.smithi006.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T05:56:10.802 INFO:teuthology.orchestra.run.smithi006.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T05:56:10.803 INFO:teuthology.orchestra.run.smithi006.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T05:56:10.803 INFO:teuthology.orchestra.run.smithi006.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T05:56:10.804 INFO:teuthology.orchestra.run.smithi006.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T05:56:10.839 INFO:teuthology.orchestra.run.smithi006.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T05:56:10.839 INFO:teuthology.orchestra.run.smithi006.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T05:56:10.842 INFO:teuthology.orchestra.run.smithi006.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T05:56:10.844 INFO:teuthology.orchestra.run.smithi006.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T05:56:10.845 INFO:teuthology.orchestra.run.smithi006.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T05:56:10.846 INFO:teuthology.orchestra.run.smithi006.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T05:56:10.849 INFO:teuthology.orchestra.run.smithi006.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T05:56:10.851 INFO:teuthology.orchestra.run.smithi006.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T05:56:10.857 INFO:teuthology.orchestra.run.smithi006.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T05:56:10.869 INFO:teuthology.orchestra.run.smithi006.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T05:56:10.877 INFO:teuthology.orchestra.run.smithi006.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T05:56:10.877 INFO:teuthology.orchestra.run.smithi006.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T05:56:10.877 INFO:teuthology.orchestra.run.smithi006.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T05:56:10.877 INFO:teuthology.orchestra.run.smithi006.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T05:56:10.878 INFO:teuthology.orchestra.run.smithi006.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T05:56:10.878 INFO:teuthology.orchestra.run.smithi006.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T05:56:10.879 INFO:teuthology.orchestra.run.smithi006.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T05:56:10.879 INFO:teuthology.orchestra.run.smithi006.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T05:56:10.891 INFO:teuthology.orchestra.run.smithi006.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T05:56:10.908 INFO:teuthology.orchestra.run.smithi006.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T05:56:10.908 INFO:teuthology.orchestra.run.smithi006.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T05:56:10.911 INFO:teuthology.orchestra.run.smithi006.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi006.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi006.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4775-g7f24e589-1jammy [112 kB] 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi006.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4775-g7f24e589-1jammy [473 kB] 2024-09-14T05:56:10.922 INFO:teuthology.orchestra.run.smithi006.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4775-g7f24e589-1jammy [28.3 MB] 2024-09-14T05:56:10.967 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T05:56:10.981 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T05:56:10.993 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4775-g7f24e589-1jammy [722 kB] 2024-09-14T05:56:11.041 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4775-g7f24e589-1jammy [356 kB] 2024-09-14T05:56:11.061 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T05:56:11.086 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4775-g7f24e589-1jammy [32.8 kB] 2024-09-14T05:56:11.087 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4775-g7f24e589-1jammy [180 kB] 2024-09-14T05:56:11.091 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4775-g7f24e589-1jammy [71.2 kB] 2024-09-14T05:56:11.093 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4775-g7f24e589-1jammy [338 kB] 2024-09-14T05:56:11.100 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4775-g7f24e589-1jammy [7,984 kB] 2024-09-14T05:56:11.293 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T05:56:11.305 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T05:56:11.334 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T05:56:11.343 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T05:56:11.345 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T05:56:11.346 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T05:56:11.348 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T05:56:11.365 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T05:56:11.369 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T05:56:11.375 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T05:56:11.455 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T05:56:11.456 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T05:56:11.461 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T05:56:11.465 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T05:56:11.469 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T05:56:11.470 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T05:56:11.471 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T05:56:11.473 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T05:56:11.474 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T05:56:11.538 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T05:56:11.557 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T05:56:11.557 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T05:56:11.558 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T05:56:11.559 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T05:56:11.564 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T05:56:11.565 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T05:56:11.612 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4775-g7f24e589-1jammy [112 kB] 2024-09-14T05:56:11.615 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4775-g7f24e589-1jammy [473 kB] 2024-09-14T05:56:11.620 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T05:56:11.620 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T05:56:11.622 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T05:56:11.634 INFO:teuthology.orchestra.run.smithi154.stdout:Get:45 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4775-g7f24e589-1jammy [28.3 MB] 2024-09-14T05:56:11.701 INFO:teuthology.orchestra.run.smithi154.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T05:56:11.701 INFO:teuthology.orchestra.run.smithi154.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T05:56:11.704 INFO:teuthology.orchestra.run.smithi154.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T05:56:11.705 INFO:teuthology.orchestra.run.smithi154.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T05:56:11.706 INFO:teuthology.orchestra.run.smithi154.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T05:56:11.709 INFO:teuthology.orchestra.run.smithi006.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4775-g7f24e589-1jammy [5,206 kB] 2024-09-14T05:56:11.717 INFO:teuthology.orchestra.run.smithi154.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T05:56:11.782 INFO:teuthology.orchestra.run.smithi154.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T05:56:11.783 INFO:teuthology.orchestra.run.smithi154.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T05:56:11.784 INFO:teuthology.orchestra.run.smithi154.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T05:56:11.787 INFO:teuthology.orchestra.run.smithi154.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T05:56:11.793 INFO:teuthology.orchestra.run.smithi006.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4775-g7f24e589-1jammy [251 kB] 2024-09-14T05:56:11.796 INFO:teuthology.orchestra.run.smithi006.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4775-g7f24e589-1jammy [124 kB] 2024-09-14T05:56:11.798 INFO:teuthology.orchestra.run.smithi006.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4775-g7f24e589-1jammy [1,561 kB] 2024-09-14T05:56:11.839 INFO:teuthology.orchestra.run.smithi006.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4775-g7f24e589-1jammy [6,311 kB] 2024-09-14T05:56:11.864 INFO:teuthology.orchestra.run.smithi154.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T05:56:11.865 INFO:teuthology.orchestra.run.smithi154.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T05:56:11.868 INFO:teuthology.orchestra.run.smithi154.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T05:56:11.869 INFO:teuthology.orchestra.run.smithi154.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T05:56:11.874 INFO:teuthology.orchestra.run.smithi154.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T05:56:11.875 INFO:teuthology.orchestra.run.smithi154.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T05:56:11.945 INFO:teuthology.orchestra.run.smithi154.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T05:56:11.950 INFO:teuthology.orchestra.run.smithi154.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T05:56:12.087 INFO:teuthology.orchestra.run.smithi006.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4775-g7f24e589-1jammy [23.1 MB] 2024-09-14T05:56:12.113 INFO:teuthology.orchestra.run.smithi154.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T05:56:12.114 INFO:teuthology.orchestra.run.smithi154.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T05:56:12.116 INFO:teuthology.orchestra.run.smithi154.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T05:56:12.117 INFO:teuthology.orchestra.run.smithi154.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T05:56:12.119 INFO:teuthology.orchestra.run.smithi154.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T05:56:12.151 INFO:teuthology.orchestra.run.smithi154.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T05:56:12.154 INFO:teuthology.orchestra.run.smithi154.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T05:56:12.155 INFO:teuthology.orchestra.run.smithi154.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T05:56:12.215 INFO:teuthology.orchestra.run.smithi154.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T05:56:12.215 INFO:teuthology.orchestra.run.smithi154.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T05:56:12.279 INFO:teuthology.orchestra.run.smithi154.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T05:56:12.280 INFO:teuthology.orchestra.run.smithi154.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T05:56:12.281 INFO:teuthology.orchestra.run.smithi154.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T05:56:12.282 INFO:teuthology.orchestra.run.smithi154.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T05:56:12.283 INFO:teuthology.orchestra.run.smithi154.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T05:56:12.284 INFO:teuthology.orchestra.run.smithi154.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T05:56:12.290 INFO:teuthology.orchestra.run.smithi154.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T05:56:12.360 INFO:teuthology.orchestra.run.smithi154.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T05:56:12.363 INFO:teuthology.orchestra.run.smithi154.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T05:56:12.365 INFO:teuthology.orchestra.run.smithi154.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T05:56:12.442 INFO:teuthology.orchestra.run.smithi154.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T05:56:12.448 INFO:teuthology.orchestra.run.smithi154.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T05:56:12.450 INFO:teuthology.orchestra.run.smithi154.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T05:56:12.451 INFO:teuthology.orchestra.run.smithi154.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T05:56:12.463 INFO:teuthology.orchestra.run.smithi154.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T05:56:12.464 INFO:teuthology.orchestra.run.smithi154.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T05:56:12.471 INFO:teuthology.orchestra.run.smithi154.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T05:56:12.523 INFO:teuthology.orchestra.run.smithi154.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T05:56:12.524 INFO:teuthology.orchestra.run.smithi154.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T05:56:12.525 INFO:teuthology.orchestra.run.smithi154.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T05:56:12.605 INFO:teuthology.orchestra.run.smithi154.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T05:56:12.619 INFO:teuthology.orchestra.run.smithi154.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T05:56:12.696 INFO:teuthology.orchestra.run.smithi154.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T05:56:12.696 INFO:teuthology.orchestra.run.smithi154.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4775-g7f24e589-1jammy [5,206 kB] 2024-09-14T05:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T05:56:12.697 INFO:teuthology.orchestra.run.smithi154.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T05:56:12.702 INFO:teuthology.orchestra.run.smithi154.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T05:56:12.704 INFO:teuthology.orchestra.run.smithi154.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T05:56:12.765 INFO:teuthology.orchestra.run.smithi006.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4775-g7f24e589-1jammy [14.1 kB] 2024-09-14T05:56:12.765 INFO:teuthology.orchestra.run.smithi006.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4775-g7f24e589-1jammy [880 kB] 2024-09-14T05:56:12.776 INFO:teuthology.orchestra.run.smithi154.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4775-g7f24e589-1jammy [251 kB] 2024-09-14T05:56:12.779 INFO:teuthology.orchestra.run.smithi154.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4775-g7f24e589-1jammy [124 kB] 2024-09-14T05:56:12.780 INFO:teuthology.orchestra.run.smithi154.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4775-g7f24e589-1jammy [1,561 kB] 2024-09-14T05:56:12.781 INFO:teuthology.orchestra.run.smithi006.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4775-g7f24e589-1jammy [2,452 kB] 2024-09-14T05:56:12.822 INFO:teuthology.orchestra.run.smithi006.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4775-g7f24e589-1jammy [812 kB] 2024-09-14T05:56:12.823 INFO:teuthology.orchestra.run.smithi154.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4775-g7f24e589-1jammy [6,311 kB] 2024-09-14T05:56:12.832 INFO:teuthology.orchestra.run.smithi006.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4775-g7f24e589-1jammy [160 kB] 2024-09-14T05:56:12.835 INFO:teuthology.orchestra.run.smithi006.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4775-g7f24e589-1jammy [61.4 MB] 2024-09-14T05:56:13.059 INFO:teuthology.orchestra.run.smithi154.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4775-g7f24e589-1jammy [23.1 MB] 2024-09-14T05:56:14.038 INFO:teuthology.orchestra.run.smithi154.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4775-g7f24e589-1jammy [14.1 kB] 2024-09-14T05:56:14.039 INFO:teuthology.orchestra.run.smithi154.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4775-g7f24e589-1jammy [880 kB] 2024-09-14T05:56:14.056 INFO:teuthology.orchestra.run.smithi154.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4775-g7f24e589-1jammy [2,452 kB] 2024-09-14T05:56:14.097 INFO:teuthology.orchestra.run.smithi154.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4775-g7f24e589-1jammy [812 kB] 2024-09-14T05:56:14.107 INFO:teuthology.orchestra.run.smithi154.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4775-g7f24e589-1jammy [160 kB] 2024-09-14T05:56:14.141 INFO:teuthology.orchestra.run.smithi154.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4775-g7f24e589-1jammy [61.4 MB] 2024-09-14T05:56:14.897 INFO:teuthology.orchestra.run.smithi006.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4775-g7f24e589-1jammy [8,625 kB] 2024-09-14T05:56:15.075 INFO:teuthology.orchestra.run.smithi006.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4775-g7f24e589-1jammy [14.2 kB] 2024-09-14T05:56:15.076 INFO:teuthology.orchestra.run.smithi006.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4775-g7f24e589-1jammy [55.8 MB] 2024-09-14T05:56:16.467 INFO:teuthology.orchestra.run.smithi154.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4775-g7f24e589-1jammy [8,625 kB] 2024-09-14T05:56:16.659 INFO:teuthology.orchestra.run.smithi154.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4775-g7f24e589-1jammy [14.2 kB] 2024-09-14T05:56:16.659 INFO:teuthology.orchestra.run.smithi154.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4775-g7f24e589-1jammy [55.8 MB] 2024-09-14T05:56:16.810 INFO:teuthology.orchestra.run.smithi006.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4775-g7f24e589-1jammy [130 kB] 2024-09-14T05:56:16.813 INFO:teuthology.orchestra.run.smithi006.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4775-g7f24e589-1jammy [39.0 kB] 2024-09-14T05:56:16.814 INFO:teuthology.orchestra.run.smithi006.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4775-g7f24e589-1jammy [15.9 MB] 2024-09-14T05:56:17.266 INFO:teuthology.orchestra.run.smithi006.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4775-g7f24e589-1jammy [91.3 kB] 2024-09-14T05:56:17.868 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 251 MB in 7s (36.2 MB/s) 2024-09-14T05:56:18.005 INFO:teuthology.orchestra.run.smithi154.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4775-g7f24e589-1jammy [130 kB] 2024-09-14T05:56:18.007 INFO:teuthology.orchestra.run.smithi154.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4775-g7f24e589-1jammy [39.0 kB] 2024-09-14T05:56:18.011 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T05:56:18.072 INFO:teuthology.orchestra.run.smithi154.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4775-g7f24e589-1jammy [15.9 MB] 2024-09-14T05:56:18.110 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T05:56:18.115 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T05:56:18.226 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T05:56:18.384 INFO:teuthology.orchestra.run.smithi154.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4775-g7f24e589-1jammy [91.3 kB] 2024-09-14T05:56:18.496 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T05:56:18.512 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T05:56:18.546 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T05:56:18.891 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T05:56:18.918 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T05:56:18.957 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T05:56:18.958 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 251 MB in 8s (31.3 MB/s) 2024-09-14T05:56:19.125 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T05:56:19.222 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T05:56:19.228 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T05:56:19.314 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T05:56:19.403 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T05:56:19.430 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T05:56:19.628 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T05:56:19.651 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T05:56:19.678 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T05:56:19.718 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T05:56:20.038 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T05:56:20.055 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T05:56:20.064 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T05:56:20.467 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T05:56:20.493 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T05:56:20.533 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T05:56:20.550 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T05:56:20.576 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T05:56:20.624 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T05:56:20.895 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T05:56:20.921 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T05:56:20.961 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T05:56:21.054 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T05:56:21.094 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T05:56:21.264 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librados2. 2024-09-14T05:56:21.291 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../007-librados2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:21.322 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librados2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:21.448 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T05:56:21.474 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T05:56:21.514 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T05:56:21.792 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libnbd0. 2024-09-14T05:56:21.819 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T05:56:21.834 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T05:56:21.849 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T05:56:21.858 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T05:56:21.909 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T05:56:22.195 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librbd1. 2024-09-14T05:56:22.220 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librados2. 2024-09-14T05:56:22.221 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../009-librbd1_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:22.247 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../007-librados2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:22.261 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librbd1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:22.287 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librados2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:22.697 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T05:56:22.724 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:22.764 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcephfs2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:22.781 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libnbd0. 2024-09-14T05:56:22.808 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T05:56:22.848 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T05:56:23.016 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rados. 2024-09-14T05:56:23.032 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:23.074 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rados (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:23.142 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librbd1. 2024-09-14T05:56:23.169 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../009-librbd1_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:23.201 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librbd1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:23.411 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T05:56:23.438 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:56:23.477 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-ceph-argparse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:23.729 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T05:56:23.745 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:23.788 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cephfs (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:23.862 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:24.107 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T05:56:24.134 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:56:24.173 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:24.265 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rados. 2024-09-14T05:56:24.291 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:24.331 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rados (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:24.493 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T05:56:24.510 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T05:56:24.547 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T05:56:24.659 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T05:56:24.685 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:56:24.725 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-argparse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:24.953 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T05:56:24.969 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:25.003 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cephfs (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:25.096 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T05:56:25.123 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T05:56:25.163 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T05:56:25.323 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T05:56:25.349 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:56:25.389 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:25.423 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T05:56:25.450 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:25.490 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:25.692 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T05:56:25.719 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T05:56:25.750 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T05:56:25.868 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T05:56:25.895 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T05:56:25.935 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T05:56:26.012 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T05:56:26.039 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T05:56:26.078 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T05:56:26.229 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T05:56:26.245 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T05:56:26.279 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T05:56:26.381 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T05:56:26.408 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:26.448 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:26.548 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T05:56:26.564 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T05:56:26.608 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T05:56:26.801 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T05:56:26.827 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T05:56:26.867 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T05:56:26.952 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua5.1. 2024-09-14T05:56:26.978 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T05:56:27.020 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T05:56:27.128 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T05:56:27.144 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T05:56:27.178 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T05:56:27.338 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua-any. 2024-09-14T05:56:27.364 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T05:56:27.404 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T05:56:27.473 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T05:56:27.488 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T05:56:27.531 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T05:56:27.615 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package zip. 2024-09-14T05:56:27.631 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T05:56:27.665 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T05:56:27.851 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua5.1. 2024-09-14T05:56:27.878 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T05:56:27.918 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T05:56:27.994 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package unzip. 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T05:56:28.060 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T05:56:28.229 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-any. 2024-09-14T05:56:28.245 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T05:56:28.279 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T05:56:28.464 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package luarocks. 2024-09-14T05:56:28.490 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T05:56:28.498 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package zip. 2024-09-14T05:56:28.514 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T05:56:28.530 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T05:56:28.557 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T05:56:28.902 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package unzip. 2024-09-14T05:56:28.928 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T05:56:28.968 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T05:56:28.991 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librgw2. 2024-09-14T05:56:29.018 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../026-librgw2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:29.195 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librgw2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:29.389 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package luarocks. 2024-09-14T05:56:29.416 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T05:56:29.464 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T05:56:29.830 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librgw2. 2024-09-14T05:56:29.857 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../026-librgw2_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:29.896 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librgw2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:30.016 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T05:56:30.043 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:30.082 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:30.410 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T05:56:30.437 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T05:56:30.476 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T05:56:30.516 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T05:56:30.531 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:30.574 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:30.796 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T05:56:30.823 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:30.862 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libradosstriper1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:30.902 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T05:56:30.929 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T05:56:30.968 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T05:56:31.233 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-common. 2024-09-14T05:56:31.246 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T05:56:31.259 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:31.273 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:31.290 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:31.313 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libradosstriper1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:31.758 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-common. 2024-09-14T05:56:31.785 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:31.825 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:32.837 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-base. 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-base (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:33.280 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-base. 2024-09-14T05:56:33.307 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:33.356 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-base (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:33.492 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T05:56:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T05:56:33.566 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T05:56:33.853 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T05:56:33.880 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T05:56:33.919 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T05:56:34.072 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T05:56:34.099 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T05:56:34.176 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T05:56:34.239 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T05:56:34.478 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T05:56:34.505 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T05:56:34.545 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T05:56:34.608 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T05:56:34.635 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T05:56:34.675 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T05:56:34.848 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T05:56:34.875 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T05:56:34.915 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T05:56:34.928 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T05:56:34.954 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T05:56:34.994 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T05:56:35.218 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T05:56:35.244 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T05:56:35.284 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T05:56:35.314 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T05:56:35.340 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T05:56:35.380 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T05:56:35.537 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T05:56:35.563 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T05:56:35.595 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T05:56:35.683 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-portend. 2024-09-14T05:56:35.710 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T05:56:35.749 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T05:56:35.890 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T05:56:35.916 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T05:56:35.957 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T05:56:36.036 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T05:56:36.062 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T05:56:36.102 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T05:56:36.259 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-portend. 2024-09-14T05:56:36.286 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T05:56:36.326 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T05:56:36.338 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T05:56:36.354 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T05:56:36.388 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T05:56:36.604 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T05:56:36.630 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T05:56:36.662 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T05:56:36.750 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T05:56:36.777 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T05:56:36.825 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T05:56:36.932 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T05:56:36.958 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T05:56:36.998 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T05:56:37.137 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T05:56:37.163 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T05:56:37.203 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T05:56:37.352 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T05:56:37.379 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T05:56:37.419 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T05:56:37.489 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T05:56:37.516 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T05:56:37.555 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T05:56:37.705 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T05:56:37.731 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T05:56:37.771 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T05:56:37.817 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-mako. 2024-09-14T05:56:37.843 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T05:56:37.883 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T05:56:38.066 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T05:56:38.093 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T05:56:38.134 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T05:56:38.239 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T05:56:38.279 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T05:56:38.436 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-mako. 2024-09-14T05:56:38.462 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T05:56:38.502 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T05:56:38.589 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T05:56:38.616 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T05:56:38.656 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T05:56:38.831 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T05:56:38.857 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T05:56:38.906 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T05:56:38.959 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-webob. 2024-09-14T05:56:38.985 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T05:56:39.184 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T05:56:39.210 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T05:56:39.242 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T05:56:39.353 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T05:56:39.380 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T05:56:39.415 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T05:56:39.703 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webob. 2024-09-14T05:56:39.706 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T05:56:39.729 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T05:56:39.733 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T05:56:39.769 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T05:56:39.772 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T05:56:40.075 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-paste. 2024-09-14T05:56:40.102 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T05:56:40.114 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T05:56:40.141 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T05:56:40.142 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T05:56:40.193 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T05:56:40.484 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T05:56:40.510 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T05:56:40.550 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T05:56:40.653 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T05:56:40.681 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T05:56:40.720 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T05:56:40.853 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-paste. 2024-09-14T05:56:40.880 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T05:56:40.920 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T05:56:40.965 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T05:56:40.991 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T05:56:41.031 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T05:56:41.249 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T05:56:41.275 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T05:56:41.315 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T05:56:41.359 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T05:56:41.386 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T05:56:41.427 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T05:56:41.618 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T05:56:41.644 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T05:56:41.684 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T05:56:41.764 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T05:56:41.790 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T05:56:41.830 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T05:56:41.986 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T05:56:42.168 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T05:56:42.195 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T05:56:42.234 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T05:56:42.326 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T05:56:42.352 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T05:56:42.392 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T05:56:42.529 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-idna. 2024-09-14T05:56:42.557 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T05:56:42.596 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T05:56:42.747 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T05:56:42.774 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T05:56:42.813 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T05:56:42.915 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T05:56:42.942 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T05:56:42.982 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T05:56:43.142 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-idna. 2024-09-14T05:56:43.168 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T05:56:43.217 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T05:56:43.285 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-requests. 2024-09-14T05:56:43.312 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T05:56:43.351 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T05:56:43.511 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T05:56:43.538 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T05:56:43.578 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T05:56:44.556 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T05:56:44.583 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T05:56:44.622 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T05:56:44.789 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests. 2024-09-14T05:56:44.816 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T05:56:44.856 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T05:56:44.908 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T05:56:44.924 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:56:44.966 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:45.167 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T05:56:45.194 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T05:56:45.234 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T05:56:45.355 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T05:56:45.382 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:45.413 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:45.503 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T05:56:45.519 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:56:45.562 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:45.707 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T05:56:45.735 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T05:56:45.774 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T05:56:45.942 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T05:56:45.968 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:46.017 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:46.077 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T05:56:46.104 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T05:56:46.143 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T05:56:46.286 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T05:56:46.301 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T05:56:46.345 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T05:56:46.496 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T05:56:46.523 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:46.562 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T05:56:46.714 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T05:56:46.916 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T05:56:46.944 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:46.974 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mon (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T05:56:47.102 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:47.512 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T05:56:47.538 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:47.577 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T05:56:47.578 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mon (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:47.605 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:47.644 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-osd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:48.173 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T05:56:48.200 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:48.240 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-osd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:48.731 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph. 2024-09-14T05:56:48.758 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../067-ceph_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:48.797 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:49.116 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T05:56:49.143 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:49.182 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:49.335 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph. 2024-09-14T05:56:49.361 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../067-ceph_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:49.410 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:49.502 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T05:56:49.530 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:49.610 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mds (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:49.771 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T05:56:49.797 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:49.979 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:50.030 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephadm. 2024-09-14T05:56:50.057 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../070-cephadm_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:50.096 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:50.341 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T05:56:50.367 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:50.407 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mds (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:50.416 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T05:56:50.443 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T05:56:50.482 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T05:56:50.819 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T05:56:50.844 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephadm. 2024-09-14T05:56:50.846 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T05:56:50.870 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../070-cephadm_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:56:50.885 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T05:56:50.918 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:51.271 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T05:56:51.298 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T05:56:51.337 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T05:56:51.709 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T05:56:51.757 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T05:56:51.965 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-babel. 2024-09-14T05:56:51.993 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T05:56:52.031 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T05:56:52.368 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T05:56:52.396 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T05:56:52.434 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T05:56:52.737 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-babel. 2024-09-14T05:56:52.753 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T05:56:52.787 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T05:56:52.821 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T05:56:52.848 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:56:52.887 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:53.090 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T05:56:53.117 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T05:56:53.148 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T05:56:53.199 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T05:56:53.226 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T05:56:53.265 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T05:56:53.476 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T05:56:53.503 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:56:53.543 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:53.543 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-routes. 2024-09-14T05:56:53.570 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T05:56:53.601 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T05:56:53.880 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T05:56:53.907 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T05:56:53.930 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T05:56:53.946 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T05:56:53.957 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:56:53.996 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:54.199 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-routes. 2024-09-14T05:56:54.226 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T05:56:54.257 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T05:56:54.561 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T05:56:54.588 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:56:54.619 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:57.026 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T05:56:57.045 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T05:56:57.084 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T05:56:57.449 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T05:56:57.466 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T05:56:57.507 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T05:56:57.604 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T05:56:57.632 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T05:56:57.670 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T05:56:58.010 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T05:56:58.016 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T05:56:58.038 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T05:56:58.044 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T05:56:58.077 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T05:56:58.082 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T05:56:58.335 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T05:56:58.363 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T05:56:58.422 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T05:56:58.450 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T05:56:58.488 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T05:56:58.495 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T05:56:58.791 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T05:56:58.819 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T05:56:58.952 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T05:56:59.229 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T05:56:59.258 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:56:59.296 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:56:59.703 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T05:56:59.731 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:56:59.769 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T05:57:00.382 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T05:57:00.785 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T05:57:00.881 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T05:57:00.909 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T05:57:00.947 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T05:57:01.189 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T05:57:01.263 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T05:57:01.275 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T05:57:01.621 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T05:57:01.641 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T05:57:01.648 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T05:57:01.670 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T05:57:01.687 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T05:57:01.716 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T05:57:01.974 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T05:57:02.001 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T05:57:02.040 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T05:57:02.120 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T05:57:02.148 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T05:57:02.195 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T05:57:02.370 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T05:57:02.397 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T05:57:02.435 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T05:57:02.540 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T05:57:02.568 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T05:57:02.606 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T05:57:02.764 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T05:57:02.791 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T05:57:02.830 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T05:57:02.876 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T05:57:02.892 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T05:57:02.926 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T05:57:03.108 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T05:57:03.124 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T05:57:03.158 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T05:57:03.204 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T05:57:03.232 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T05:57:03.279 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T05:57:03.461 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T05:57:03.489 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T05:57:03.528 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:57:03.976 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:04.158 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T05:57:04.175 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:57:04.217 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:04.329 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T05:57:04.357 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T05:57:04.545 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T05:57:04.573 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T05:57:04.611 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T05:57:04.657 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T05:57:04.685 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T05:57:04.715 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T05:57:04.984 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T05:57:04.992 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package jq. 2024-09-14T05:57:05.021 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T05:57:05.022 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T05:57:05.167 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T05:57:05.436 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package socat. 2024-09-14T05:57:05.450 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package jq. 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T05:57:05.478 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T05:57:05.516 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T05:57:05.807 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T05:57:05.811 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package socat. 2024-09-14T05:57:05.835 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T05:57:05.839 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T05:57:05.873 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T05:57:05.877 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T05:57:06.181 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T05:57:06.197 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T05:57:06.211 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-test. 2024-09-14T05:57:06.239 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T05:57:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:57:06.268 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-test (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:06.585 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-test. 2024-09-14T05:57:06.602 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:57:06.643 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-test (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:08.923 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T05:57:08.952 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:57:08.990 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-volume (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:09.181 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T05:57:09.209 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4775-g7f24e589-1jammy_all.deb ... 2024-09-14T05:57:09.247 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-volume (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:09.310 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T05:57:09.327 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:57:09.369 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcephfs-dev (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:09.552 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T05:57:09.580 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs-dev (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:09.671 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T05:57:09.699 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T05:57:09.729 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T05:57:09.937 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T05:57:09.966 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T05:57:10.025 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T05:57:10.026 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T05:57:10.043 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T05:57:10.075 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T05:57:10.342 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T05:57:10.370 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T05:57:10.399 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T05:57:10.446 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T05:57:10.474 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T05:57:10.512 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T05:57:10.771 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T05:57:10.799 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T05:57:10.837 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T05:57:10.942 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package pkg-config. 2024-09-14T05:57:10.971 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T05:57:11.008 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T05:57:11.253 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T05:57:11.259 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package pkg-config. 2024-09-14T05:57:11.271 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T05:57:11.287 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T05:57:11.311 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T05:57:11.334 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T05:57:11.595 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T05:57:11.611 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T05:57:11.653 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T05:57:12.065 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T05:57:12.073 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T05:57:12.093 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T05:57:12.101 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T05:57:12.131 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T05:57:12.139 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T05:57:12.409 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T05:57:12.425 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T05:57:12.437 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T05:57:12.454 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T05:57:12.467 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T05:57:12.484 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T05:57:12.762 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T05:57:12.779 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T05:57:12.790 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T05:57:12.807 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T05:57:12.828 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T05:57:12.845 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T05:57:13.148 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T05:57:13.157 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T05:57:13.176 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T05:57:13.185 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T05:57:13.542 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-py. 2024-09-14T05:57:13.560 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-py. 2024-09-14T05:57:13.571 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T05:57:13.576 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T05:57:13.609 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T05:57:13.618 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T05:57:13.929 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T05:57:13.938 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T05:57:13.957 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T05:57:13.966 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T05:57:13.995 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T05:57:14.004 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T05:57:14.466 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T05:57:14.495 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T05:57:14.508 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T05:57:14.532 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T05:57:14.536 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T05:57:14.591 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-toml. 2024-09-14T05:57:14.881 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T05:57:14.886 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-toml. 2024-09-14T05:57:14.914 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T05:57:14.918 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T05:57:14.944 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T05:57:15.180 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T05:57:15.208 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T05:57:15.214 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T05:57:15.238 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T05:57:15.242 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T05:57:15.280 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T05:57:15.583 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T05:57:15.600 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T05:57:15.612 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T05:57:15.628 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T05:57:15.649 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T05:57:15.667 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T05:57:15.952 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T05:57:15.981 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T05:57:16.018 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T05:57:16.203 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T05:57:16.231 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T05:57:16.261 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T05:57:16.689 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package radosgw. 2024-09-14T05:57:16.718 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../117-radosgw_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:57:16.747 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking radosgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:16.957 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package radosgw. 2024-09-14T05:57:16.974 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../117-radosgw_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:57:17.006 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking radosgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:57:17.742 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking rbd-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:17.902 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T05:57:17.930 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4775-g7f24e589-1jammy_amd64.deb ... 2024-09-14T05:57:17.968 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:18.047 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T05:57:18.265 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T05:57:18.364 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T05:57:18.490 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T05:57:18.523 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T05:57:18.649 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T05:57:18.766 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T05:57:19.118 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T05:57:19.242 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T05:57:19.540 INFO:teuthology.orchestra.run.smithi006.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T05:57:19.625 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:19.646 INFO:teuthology.orchestra.run.smithi154.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T05:57:19.701 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:20.091 INFO:teuthology.orchestra.run.smithi006.stdout:Adding system user cephadm....done 2024-09-14T05:57:20.218 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user cephadm....done 2024-09-14T05:57:20.247 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T05:57:20.374 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T05:57:20.515 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T05:57:20.658 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T05:57:20.766 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T05:57:20.876 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T05:57:20.893 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T05:57:21.011 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T05:57:21.127 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T05:57:21.262 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T05:57:21.378 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T05:57:21.504 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T05:57:21.538 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T05:57:21.664 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T05:57:21.865 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T05:57:21.974 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T05:57:22.224 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T05:57:22.318 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T05:57:22.476 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T05:57:22.553 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T05:57:22.752 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T05:57:22.829 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T05:57:23.105 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T05:57:23.233 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T05:57:23.365 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T05:57:23.506 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T05:57:23.624 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T05:57:23.765 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-ceph-argparse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:23.867 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-argparse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:24.099 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T05:57:24.233 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T05:57:24.243 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T05:57:24.351 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T05:57:24.369 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T05:57:24.460 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T05:57:24.495 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T05:57:24.561 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T05:57:24.621 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T05:57:24.747 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T05:57:24.821 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T05:57:25.006 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T05:57:25.180 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T05:57:25.211 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T05:57:25.266 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T05:57:25.367 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T05:57:25.379 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T05:57:25.415 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T05:57:25.478 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T05:57:25.604 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T05:57:25.759 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T05:57:25.869 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T05:57:25.964 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T05:57:26.090 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T05:57:26.120 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T05:57:26.365 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T05:57:26.396 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T05:57:26.600 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T05:57:26.732 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T05:57:26.858 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T05:57:26.893 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T05:57:27.552 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T05:57:27.713 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T05:57:27.811 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T05:57:27.921 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T05:57:27.972 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T05:57:28.098 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T05:57:28.224 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T05:57:28.373 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T05:57:28.517 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T05:57:28.766 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T05:57:28.885 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T05:57:29.017 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T05:57:29.128 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T05:57:29.435 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T05:57:29.504 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T05:57:29.711 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T05:57:29.797 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T05:57:30.046 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T05:57:30.157 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T05:57:30.306 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T05:57:30.416 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T05:57:30.431 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:30.525 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:30.758 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T05:57:30.811 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T05:57:31.093 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T05:57:31.128 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T05:57:32.342 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T05:57:32.357 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T05:57:32.584 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T05:57:32.619 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T05:57:32.718 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T05:57:32.753 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T05:57:32.986 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T05:57:33.021 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T05:57:33.112 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T05:57:33.147 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T05:57:33.273 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T05:57:33.573 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T05:57:33.583 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T05:57:33.816 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T05:57:33.825 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T05:57:34.058 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T05:57:34.085 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T05:57:34.184 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T05:57:34.211 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T05:57:34.494 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T05:57:34.513 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T05:57:34.745 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T05:57:34.772 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T05:57:35.013 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T05:57:35.031 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T05:57:35.272 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T05:57:35.274 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T05:57:35.508 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T05:57:35.532 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T05:57:35.760 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T05:57:35.791 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T05:57:35.886 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T05:57:35.917 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T05:57:36.218 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T05:57:36.296 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T05:57:36.344 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T05:57:36.589 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T05:57:36.646 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T05:57:36.890 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T05:57:36.955 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T05:57:37.214 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T05:57:37.250 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T05:57:37.316 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T05:57:37.360 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T05:57:37.417 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T05:57:37.458 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T05:57:37.497 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T05:57:37.695 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T05:57:37.743 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T05:57:37.821 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T05:57:37.844 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T05:57:38.206 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T05:57:38.229 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T05:57:38.474 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T05:57:38.489 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T05:57:38.591 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T05:57:38.614 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T05:57:38.842 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T05:57:38.866 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T05:57:38.968 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T05:57:38.992 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T05:57:39.278 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T05:57:39.309 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T05:57:39.579 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T05:57:39.602 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T05:57:39.855 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T05:57:39.870 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T05:57:39.981 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T05:57:39.996 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T05:57:40.257 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T05:57:40.602 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T05:57:40.634 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T05:57:40.887 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T05:57:40.901 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T05:57:41.295 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T05:57:41.548 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T05:57:41.580 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T05:57:41.924 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T05:57:42.002 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librados2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:42.034 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librados2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:42.128 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:42.160 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:42.254 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T05:57:42.590 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:42.614 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcephfs2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:42.708 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libradosstriper1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:42.765 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libradosstriper1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:42.818 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T05:57:42.891 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T05:57:43.078 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librbd1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:43.168 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librbd1 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:43.204 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-modules-core (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:43.294 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-modules-core (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:43.330 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:43.428 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:43.546 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T05:57:43.546 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T05:57:43.655 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T05:57:43.655 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T05:57:44.048 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs-dev (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:44.146 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcephfs-dev (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:44.173 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rados (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:44.272 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rados (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:44.291 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librgw2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:44.398 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librgw2 (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:44.409 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T05:57:44.541 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T05:57:45.613 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:45.739 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:45.803 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rbd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:45.856 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up rbd-fuse (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:45.965 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cephfs (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:46.047 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:46.066 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:46.173 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cephfs (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:46.299 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-common (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:46.609 INFO:teuthology.orchestra.run.smithi154.stdout:Adding group ceph....done 2024-09-14T05:57:46.859 INFO:teuthology.orchestra.run.smithi006.stdout:Adding group ceph....done 2024-09-14T05:57:47.003 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user ceph....done 2024-09-14T05:57:47.171 INFO:teuthology.orchestra.run.smithi154.stdout:Setting system user ceph properties....done 2024-09-14T05:57:47.184 INFO:teuthology.orchestra.run.smithi154.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T05:57:47.235 INFO:teuthology.orchestra.run.smithi006.stdout:Adding system user ceph....done 2024-09-14T05:57:47.322 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T05:57:47.404 INFO:teuthology.orchestra.run.smithi006.stdout:Setting system user ceph properties....done 2024-09-14T05:57:47.420 INFO:teuthology.orchestra.run.smithi006.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T05:57:47.565 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T05:57:47.651 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T05:57:47.915 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T05:57:48.101 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-test (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:48.236 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up radosgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:48.434 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-test (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:48.552 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up radosgw (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:48.698 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T05:57:48.698 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T05:57:49.138 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-base (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:49.284 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T05:57:49.284 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T05:57:49.510 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T05:57:49.746 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-base (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:49.981 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mds (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:50.099 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T05:57:50.212 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T05:57:50.213 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T05:57:50.556 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mds (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:50.674 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:50.769 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T05:57:50.769 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T05:57:50.880 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T05:57:50.880 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T05:57:51.241 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:51.336 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-osd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:51.446 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T05:57:51.446 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T05:57:51.595 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T05:57:51.596 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T05:57:51.926 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-osd (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:52.220 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T05:57:52.220 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T05:57:52.372 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:52.506 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:52.657 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mon (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:52.694 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:52.795 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:52.864 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T05:57:52.865 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T05:57:53.236 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mon (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:53.350 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:53.443 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T05:57:53.443 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T05:57:53.493 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:53.644 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-dashboard (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:53.795 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-volume (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:53.933 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-cephadm (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:54.076 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:54.164 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T05:57:54.235 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-dashboard (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:54.265 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T05:57:54.386 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-volume (19.3.0-4775-g7f24e589-1jammy) ... 2024-09-14T05:57:54.409 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T05:57:54.764 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T05:57:54.873 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T05:57:55.017 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T05:57:55.527 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T05:57:56.052 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T05:57:56.164 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T05:57:56.170 DEBUG:teuthology.parallel:result is None 2024-09-14T05:57:56.721 INFO:teuthology.orchestra.run.smithi006.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T05:57:56.726 DEBUG:teuthology.parallel:result is None 2024-09-14T05:57:56.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T05:57:56.870 DEBUG:teuthology.orchestra.run.smithi006:> dpkg-query -W -f '${Version}' ceph 2024-09-14T05:57:56.890 INFO:teuthology.orchestra.run.smithi006.stdout:19.3.0-4775-g7f24e589-1jammy 2024-09-14T05:57:56.890 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4775-g7f24e589-1jammy 2024-09-14T05:57:56.890 INFO:teuthology.task.install:The correct ceph version 19.3.0-4775-g7f24e589-1jammy is installed. 2024-09-14T05:57:56.892 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T05:57:57.030 DEBUG:teuthology.orchestra.run.smithi154:> dpkg-query -W -f '${Version}' ceph 2024-09-14T05:57:57.049 INFO:teuthology.orchestra.run.smithi154.stdout:19.3.0-4775-g7f24e589-1jammy 2024-09-14T05:57:57.049 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4775-g7f24e589-1jammy 2024-09-14T05:57:57.049 INFO:teuthology.task.install:The correct ceph version 19.3.0-4775-g7f24e589-1jammy is installed. 2024-09-14T05:57:57.051 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T05:57:57.051 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:57:57.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T05:57:57.065 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:57:57.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T05:57:57.106 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T05:57:57.106 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:57:57.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T05:57:57.124 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T05:57:57.178 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:57:57.179 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T05:57:57.192 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T05:57:57.248 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T05:57:57.248 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:57:57.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T05:57:57.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T05:57:57.314 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:57:57.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T05:57:57.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T05:57:57.382 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T05:57:57.382 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:57:57.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T05:57:57.396 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T05:57:57.455 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:57:57.455 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T05:57:57.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T05:57:57.524 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T05:57:57.595 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T05:57:57.595 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2024-09-14T05:57:57.598 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2024-09-14T05:57:57.610 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T05:57:57.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T05:57:57.652 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T05:57:57.664 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T05:57:57.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T05:57:57.712 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T05:57:57.734 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T05:57:57.734 INFO:tasks.ceph:config {'conf': {'client': {'rbd cache': True, 'rbd cache max dirty': 0}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T05:57:57.734 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900350', 'branch': 'main', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7900350', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache max dirty': 0}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 5839, 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47', 'sleep_before_teardown': 0, 'subset': '99/128', 'suite': 'rbd', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'targets': {'smithi006.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLsoP8rfyoD0dlxqawnMdY6tN3N39/ZdWjxv0q+uqxNIey4oFjlsu9bqRMupf5t1Dx1RZ5uL34HupN0zUHn2mIs=', 'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMnohTmW/73xAa0iq7bL6LORs+diqQ1pJazHExdebokfy5hp1jB4LKX6IFzRoWo3KWHQqp4lyNr+uUhnRErCbVY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_20:16:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T05:57:57.735 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T05:57:57.768 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T05:57:57.773 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T05:57:57.816 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T05:57:57.829 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:57:57.829 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T05:57:57.875 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T05:57:57.876 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2024-09-14T05:57:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T05:57:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:57:57.924 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-14T05:57:57.924 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:57:57.924 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-14 05:52:25.834214989 +0000 2024-09-14T05:57:57.924 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-14 05:52:25.594217132 +0000 2024-09-14T05:57:57.924 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-14 05:52:25.594217132 +0000 2024-09-14T05:57:57.924 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-09-14T05:57:57.925 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T05:57:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-14T05:57:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-14T05:57:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000444556 s, 1.2 MB/s 2024-09-14T05:57:57.980 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T05:57:58.029 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2024-09-14T05:57:58.075 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T05:57:58.076 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:57:58.076 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-14T05:57:58.076 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:57:58.076 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-14 05:52:26.326210593 +0000 2024-09-14T05:57:58.076 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-14 05:52:26.094212666 +0000 2024-09-14T05:57:58.076 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-14 05:52:26.094212666 +0000 2024-09-14T05:57:58.076 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-09-14T05:57:58.076 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T05:57:58.130 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-14T05:57:58.130 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-14T05:57:58.130 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000419921 s, 1.2 MB/s 2024-09-14T05:57:58.131 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T05:57:58.181 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2024-09-14T05:57:58.227 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T05:57:58.227 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:57:58.228 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 919 Links: 1 2024-09-14T05:57:58.228 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:57:58.228 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-14 05:52:26.806206306 +0000 2024-09-14T05:57:58.228 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-14 05:52:26.562208486 +0000 2024-09-14T05:57:58.228 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-14 05:52:26.562208486 +0000 2024-09-14T05:57:58.228 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-09-14T05:57:58.228 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T05:57:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-14T05:57:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-14T05:57:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000318625 s, 1.6 MB/s 2024-09-14T05:57:58.284 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T05:57:58.334 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2024-09-14T05:57:58.380 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T05:57:58.380 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:57:58.380 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-09-14T05:57:58.381 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:57:58.381 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-09-14 05:52:27.278202090 +0000 2024-09-14T05:57:58.381 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-09-14 05:52:27.030204305 +0000 2024-09-14T05:57:58.381 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-09-14 05:52:27.030204305 +0000 2024-09-14T05:57:58.381 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-09-14T05:57:58.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T05:57:58.434 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-09-14T05:57:58.434 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-09-14T05:57:58.434 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.00039987 s, 1.3 MB/s 2024-09-14T05:57:58.436 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T05:57:58.485 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T05:57:58.485 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:57:58.485 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T05:57:58.491 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T05:57:58.491 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-09-14T05:57:58.537 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T05:57:58.537 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:57:58.538 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-09-14T05:57:58.538 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:57:58.538 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-14 05:52:25.840167531 +0000 2024-09-14T05:57:58.538 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-14 05:52:25.592169746 +0000 2024-09-14T05:57:58.538 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-14 05:52:25.592169746 +0000 2024-09-14T05:57:58.538 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-14T05:57:58.538 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T05:57:58.592 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-14T05:57:58.592 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-14T05:57:58.592 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000464337 s, 1.1 MB/s 2024-09-14T05:57:58.593 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T05:57:58.642 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-09-14T05:57:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T05:57:58.693 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:57:58.693 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-09-14T05:57:58.693 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:57:58.693 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-14 05:52:26.308163351 +0000 2024-09-14T05:57:58.693 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-14 05:52:26.076165423 +0000 2024-09-14T05:57:58.693 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-14 05:52:26.076165423 +0000 2024-09-14T05:57:58.694 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-14T05:57:58.694 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T05:57:58.747 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-14T05:57:58.747 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-14T05:57:58.747 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000370236 s, 1.4 MB/s 2024-09-14T05:57:58.748 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T05:57:58.798 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-09-14T05:57:58.845 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T05:57:58.846 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:57:58.846 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-09-14T05:57:58.846 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:57:58.846 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-14 05:52:26.552161172 +0000 2024-09-14T05:57:58.846 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-14 05:52:26.548161208 +0000 2024-09-14T05:57:58.846 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-14 05:52:26.548161208 +0000 2024-09-14T05:57:58.846 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-14T05:57:58.846 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T05:57:58.899 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-14T05:57:58.899 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-14T05:57:58.899 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000370144 s, 1.4 MB/s 2024-09-14T05:57:58.901 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T05:57:58.950 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-09-14T05:57:58.997 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T05:57:58.997 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:57:58.997 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-09-14T05:57:58.997 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:57:58.997 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-14 05:52:27.260154848 +0000 2024-09-14T05:57:58.997 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-14 05:52:27.000157170 +0000 2024-09-14T05:57:58.997 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-14 05:52:27.000157170 +0000 2024-09-14T05:57:58.997 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-14T05:57:58.997 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T05:57:59.051 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-14T05:57:59.051 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-14T05:57:59.051 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.0003991 s, 1.3 MB/s 2024-09-14T05:57:59.052 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T05:57:59.103 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T05:57:59.103 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T05:57:59.103 INFO:tasks.ceph:Generating config... 2024-09-14T05:57:59.104 INFO:tasks.ceph:[client] rbd cache = True 2024-09-14T05:57:59.104 INFO:tasks.ceph:[client] rbd cache max dirty = 0 2024-09-14T05:57:59.104 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T05:57:59.104 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-14T05:57:59.104 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T05:57:59.105 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T05:57:59.105 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T05:57:59.105 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T05:57:59.105 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T05:57:59.105 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T05:57:59.105 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T05:57:59.105 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T05:57:59.105 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T05:57:59.105 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T05:57:59.105 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T05:57:59.105 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T05:57:59.106 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T05:57:59.106 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T05:57:59.106 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T05:57:59.106 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T05:57:59.106 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T05:57:59.106 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T05:57:59.106 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T05:57:59.106 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-14T05:57:59.106 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T05:57:59.106 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-14T05:57:59.106 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T05:57:59.106 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T05:57:59.107 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T05:57:59.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T05:57:59.141 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T05:57:59.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T05:57:59.234 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T05:57:59.287 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.c', '[v2:172.21.15.6:3301,v1:172.21.15.6:6790]'), ('mon.b', '172.21.15.154')] 2024-09-14T05:57:59.287 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790],172.21.15.154', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd cache': True, 'rbd cache max dirty': 0}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T05:57:59.288 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:57:59.288 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T05:57:59.335 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --addv c '[v2:172.21.15.6:3301,v1:172.21.15.6:6790]' --add b 172.21.15.154 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:57:59.424 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:57:59.424 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid 8db933fa-392d-4966-864a-b73b8a91dd2d 2024-09-14T05:57:59.424 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = quincy 2024-09-14T05:57:59.424 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2024-09-14T05:57:59.424 INFO:teuthology.orchestra.run.smithi006.stdout:fsid 8db933fa-392d-4966-864a-b73b8a91dd2d 2024-09-14T05:57:59.424 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2024-09-14T05:57:59.424657+0000 2024-09-14T05:57:59.425 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-09-14T05:57:59.424657+0000 2024-09-14T05:57:59.425 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 17 (quincy) 2024-09-14T05:57:59.425 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 1 2024-09-14T05:57:59.425 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2024-09-14T05:57:59.425 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T05:57:59.425 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] mon.c 2024-09-14T05:57:59.425 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T05:57:59.426 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T05:57:59.432 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8db933fa-392d-4966-864a-b73b8a91dd2d... 2024-09-14T05:57:59.432 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T05:57:59.476 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T05:57:59.501 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2024-09-14T05:57:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2024-09-14T05:57:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T05:57:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2024-09-14T05:57:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2024-09-14T05:57:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2024-09-14T05:57:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2024-09-14T05:57:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2024-09-14T05:57:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2024-09-14T05:57:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2024-09-14T05:57:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T05:57:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2024-09-14T05:57:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T05:57:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T05:57:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2024-09-14T05:57:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2024-09-14T05:57:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2024-09-14T05:57:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2024-09-14T05:57:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2024-09-14T05:57:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2024-09-14T05:57:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2024-09-14T05:57:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2024-09-14T05:57:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T05:57:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T05:57:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2024-09-14T05:57:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T05:57:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2024-09-14T05:57:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2024-09-14T05:57:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2024-09-14T05:57:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2024-09-14T05:57:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2024-09-14T05:57:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790],172.21.15.154" 2024-09-14T05:57:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: mon client directed command retry = 5 2024-09-14T05:57:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on pool no app = False 2024-09-14T05:57:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: ms inject socket failures = 5000 2024-09-14T05:57:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 8db933fa-392d-4966-864a-b73b8a91dd2d 2024-09-14T05:57:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.505 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2024-09-14T05:57:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2024-09-14T05:57:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2024-09-14T05:57:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2024-09-14T05:57:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: osd mclock profile = high_recovery_ops 2024-09-14T05:57:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2024-09-14T05:57:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2024-09-14T05:57:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2024-09-14T05:57:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2024-09-14T05:57:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2024-09-14T05:57:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug trim objects = true 2024-09-14T05:57:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2024-09-14T05:57:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2024-09-14T05:57:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2024-09-14T05:57:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2024-09-14T05:57:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2024-09-14T05:57:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2024-09-14T05:57:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2024-09-14T05:57:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2024-09-14T05:57:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2024-09-14T05:57:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: bdev async discard = True 2024-09-14T05:57:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: bdev enable discard = True 2024-09-14T05:57:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore allocator = bitmap 2024-09-14T05:57:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2024-09-14T05:57:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2024-09-14T05:57:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 1/20 2024-09-14T05:57:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 1/20 2024-09-14T05:57:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-09-14T05:57:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2024-09-14T05:57:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 4/10 2024-09-14T05:57:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T05:57:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2024-09-14T05:57:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2024-09-14T05:57:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: osd blocked scrub grace period = 3600 2024-09-14T05:57:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 0.95 2024-09-14T05:57:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: osd max markdown count = 1000 2024-09-14T05:57:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = bluestore 2024-09-14T05:57:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: osd shutdown pgref assert = True 2024-09-14T05:57:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.509 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2024-09-14T05:57:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-09-14T05:57:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2024-09-14T05:57:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2024-09-14T05:57:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2024-09-14T05:57:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2024-09-14T05:57:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2024-09-14T05:57:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2024-09-14T05:57:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.509 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2024-09-14T05:57:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2024-09-14T05:57:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2024-09-14T05:57:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2024-09-14T05:57:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2024-09-14T05:57:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2024-09-14T05:57:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2024-09-14T05:57:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2024-09-14T05:57:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2024-09-14T05:57:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2024-09-14T05:57:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2024-09-14T05:57:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T05:57:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T05:57:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T05:57:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T05:57:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T05:57:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T05:57:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2024-09-14T05:57:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2024-09-14T05:57:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2024-09-14T05:57:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:57:59.511 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2024-09-14T05:57:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2024-09-14T05:57:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2024-09-14T05:57:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2024-09-14T05:57:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T05:57:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T05:57:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: rbd cache = True 2024-09-14T05:57:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: rbd cache max dirty = 0 2024-09-14T05:57:59.512 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2024-09-14T05:57:59.512 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2024-09-14T05:57:59.512 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2024-09-14T05:57:59.513 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-09-14T05:57:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-09-14T05:57:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T05:57:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-09-14T05:57:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-09-14T05:57:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-09-14T05:57:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-09-14T05:57:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-09-14T05:57:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-09-14T05:57:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-09-14T05:57:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T05:57:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-09-14T05:57:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T05:57:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T05:57:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-09-14T05:57:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-09-14T05:57:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-09-14T05:57:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-09-14T05:57:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-09-14T05:57:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-09-14T05:57:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-09-14T05:57:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-09-14T05:57:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T05:57:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T05:57:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-09-14T05:57:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T05:57:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-09-14T05:57:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-09-14T05:57:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-09-14T05:57:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-09-14T05:57:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-09-14T05:57:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790],172.21.15.154" 2024-09-14T05:57:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: mon client directed command retry = 5 2024-09-14T05:57:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on pool no app = False 2024-09-14T05:57:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject socket failures = 5000 2024-09-14T05:57:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 8db933fa-392d-4966-864a-b73b8a91dd2d 2024-09-14T05:57:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.516 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-09-14T05:57:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-09-14T05:57:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-09-14T05:57:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-09-14T05:57:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-09-14T05:57:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-09-14T05:57:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-09-14T05:57:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-09-14T05:57:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-09-14T05:57:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-09-14T05:57:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2024-09-14T05:57:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-09-14T05:57:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-09-14T05:57:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-09-14T05:57:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-09-14T05:57:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-09-14T05:57:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-09-14T05:57:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-09-14T05:57:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-09-14T05:57:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-09-14T05:57:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2024-09-14T05:57:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2024-09-14T05:57:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2024-09-14T05:57:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-09-14T05:57:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-09-14T05:57:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2024-09-14T05:57:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2024-09-14T05:57:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-14T05:57:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-09-14T05:57:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2024-09-14T05:57:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T05:57:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-09-14T05:57:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-09-14T05:57:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: osd blocked scrub grace period = 3600 2024-09-14T05:57:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-09-14T05:57:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: osd max markdown count = 1000 2024-09-14T05:57:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-09-14T05:57:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: osd shutdown pgref assert = True 2024-09-14T05:57:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.520 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-09-14T05:57:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-14T05:57:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-09-14T05:57:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-09-14T05:57:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-09-14T05:57:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-09-14T05:57:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-09-14T05:57:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-09-14T05:57:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.521 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-09-14T05:57:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-14T05:57:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-09-14T05:57:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-09-14T05:57:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-09-14T05:57:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-09-14T05:57:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-09-14T05:57:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-09-14T05:57:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-09-14T05:57:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-09-14T05:57:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-09-14T05:57:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T05:57:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T05:57:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T05:57:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T05:57:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T05:57:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T05:57:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-09-14T05:57:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-09-14T05:57:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-09-14T05:57:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T05:57:59.524 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-09-14T05:57:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-09-14T05:57:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-09-14T05:57:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-09-14T05:57:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T05:57:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T05:57:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: rbd cache = True 2024-09-14T05:57:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: rbd cache max dirty = 0 2024-09-14T05:57:59.525 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-09-14T05:57:59.525 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-09-14T05:57:59.525 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-09-14T05:57:59.527 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T05:57:59.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T05:57:59.608 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T05:57:59.608 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:57:59.608 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T05:57:59.655 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:57:59.655 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T05:57:59.704 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2024-09-14T05:57:59.704 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:57:59.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T05:57:59.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T05:57:59.769 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:57:59.769 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:57:59.816 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T05:57:59.816 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:57:59.816 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T05:57:59.816 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T05:57:59.839 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:57:59.839 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:57:59.885 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T05:57:59.885 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T05:57:59.885 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T05:57:59.930 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T05:57:59.934 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T05:57:59.977 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T05:57:59.997 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T05:57:59.997 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T05:57:59.997 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T05:58:00.029 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T05:58:00.038 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T05:58:00.071 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T05:58:00.081 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T05:58:00.081 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T05:58:00.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T05:58:00.092 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T05:58:00.092 INFO:tasks.ceph:role: osd.0 2024-09-14T05:58:00.093 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-14T05:58:00.093 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T05:58:00.154 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T05:58:00.154 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T05:58:00.154 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T05:58:00.154 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T05:58:00.154 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T05:58:00.154 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-09-14T05:58:00.154 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T05:58:00.154 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T05:58:00.154 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T05:58:00.154 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T05:58:00.631 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-09-14T05:58:00.633 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-09-14T05:58:00.633 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T05:58:00.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T05:58:00.793 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T05:58:00.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:58:00.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T05:58:00.847 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T05:58:00.847 INFO:tasks.ceph:role: osd.1 2024-09-14T05:58:00.847 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-14T05:58:00.848 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T05:58:00.911 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T05:58:00.911 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T05:58:00.911 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T05:58:00.912 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T05:58:00.912 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T05:58:00.912 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-09-14T05:58:00.912 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T05:58:00.912 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T05:58:00.912 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T05:58:00.912 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T05:58:01.361 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-09-14T05:58:01.363 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-09-14T05:58:01.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T05:58:01.455 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T05:58:01.464 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T05:58:01.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:58:01.465 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T05:58:01.517 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T05:58:01.517 INFO:tasks.ceph:role: osd.2 2024-09-14T05:58:01.518 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-14T05:58:01.518 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T05:58:01.579 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T05:58:01.580 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T05:58:01.580 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T05:58:01.580 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T05:58:01.580 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T05:58:01.580 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-09-14T05:58:01.580 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T05:58:01.580 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T05:58:01.580 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T05:58:01.580 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T05:58:02.032 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-09-14T05:58:02.035 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-09-14T05:58:02.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T05:58:02.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T05:58:02.165 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T05:58:02.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:58:02.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T05:58:02.223 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T05:58:02.223 INFO:tasks.ceph:role: osd.3 2024-09-14T05:58:02.223 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-14T05:58:02.223 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T05:58:02.288 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T05:58:02.288 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T05:58:02.288 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T05:58:02.288 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T05:58:02.288 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T05:58:02.288 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2024-09-14T05:58:02.288 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T05:58:02.288 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T05:58:02.288 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T05:58:02.288 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T05:58:02.782 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2024-09-14T05:58:02.783 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2024-09-14T05:58:02.784 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T05:58:02.933 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T05:58:02.941 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T05:58:02.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:58:02.942 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:58:03.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:03.066+0000 7ff27395c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T05:58:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:03.074+0000 7ff27395c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T05:58:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:03.074+0000 7ff27395c7c0 -1 bdev(0x555f052c1800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T05:58:03.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:03.074+0000 7ff27395c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T05:58:06.213 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T05:58:06.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:58:06.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:06.310+0000 7f0a722687c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T05:58:06.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:06.314+0000 7f0a722687c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T05:58:06.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:06.314+0000 7f0a722687c0 -1 bdev(0x55c555571800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T05:58:06.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:06.314+0000 7f0a722687c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T05:58:09.461 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T05:58:09.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:58:09.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:09.598+0000 7fd8640a77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T05:58:09.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:09.598+0000 7fd8640a77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T05:58:09.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:09.598+0000 7fd8640a77c0 -1 bdev(0x55f420b53800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T05:58:09.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:09.598+0000 7fd8640a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T05:58:12.766 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T05:58:12.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:58:12.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:12.898+0000 7f435f47c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T05:58:12.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:12.902+0000 7f435f47c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T05:58:12.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:12.902+0000 7f435f47c7c0 -1 bdev(0x559170885800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T05:58:12.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T05:58:12.902+0000 7f435f47c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T05:58:16.062 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T05:58:16.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T05:58:16.133 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T05:58:16.134 INFO:tasks.ceph:role: osd.4 2024-09-14T05:58:16.134 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T05:58:16.134 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T05:58:16.196 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T05:58:16.196 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T05:58:16.196 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T05:58:16.196 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T05:58:16.196 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T05:58:16.196 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-14T05:58:16.196 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T05:58:16.196 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T05:58:16.197 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T05:58:16.197 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T05:58:16.674 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-14T05:58:16.676 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-14T05:58:16.676 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T05:58:16.763 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T05:58:16.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:58:16.814 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T05:58:16.814 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T05:58:16.868 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T05:58:16.868 INFO:tasks.ceph:role: osd.5 2024-09-14T05:58:16.868 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T05:58:16.868 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T05:58:16.931 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T05:58:16.932 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T05:58:16.932 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T05:58:16.932 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T05:58:16.932 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T05:58:16.932 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-14T05:58:16.932 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T05:58:16.932 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T05:58:16.932 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T05:58:16.932 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T05:58:17.416 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-14T05:58:17.418 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-14T05:58:17.418 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T05:58:17.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T05:58:17.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:58:17.578 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T05:58:17.578 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T05:58:17.632 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T05:58:17.632 INFO:tasks.ceph:role: osd.6 2024-09-14T05:58:17.632 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T05:58:17.632 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T05:58:17.695 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T05:58:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T05:58:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T05:58:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T05:58:17.695 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T05:58:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-14T05:58:17.696 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T05:58:17.696 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T05:58:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T05:58:17.696 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T05:58:18.172 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-14T05:58:18.174 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-14T05:58:18.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T05:58:18.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T05:58:18.325 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T05:58:18.326 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:58:18.326 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T05:58:18.380 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T05:58:18.380 INFO:tasks.ceph:role: osd.7 2024-09-14T05:58:18.380 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T05:58:18.380 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T05:58:18.444 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T05:58:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T05:58:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T05:58:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T05:58:18.445 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T05:58:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-14T05:58:18.445 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T05:58:18.445 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T05:58:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T05:58:18.445 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T05:58:18.870 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-14T05:58:18.872 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-14T05:58:18.872 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T05:58:18.965 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T05:58:18.974 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T05:58:18.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:58:18.975 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:58:19.079 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:19.075+0000 7f4a20ea27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T05:58:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:19.075+0000 7f4a20ea27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T05:58:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:19.079+0000 7f4a20ea27c0 -1 bdev(0x560ac5139800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T05:58:19.080 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:19.079+0000 7f4a20ea27c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T05:58:22.242 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T05:58:22.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:58:22.342 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:22.339+0000 7f2d59f397c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T05:58:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:22.339+0000 7f2d59f397c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T05:58:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:22.339+0000 7f2d59f397c0 -1 bdev(0x560993a09800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T05:58:22.343 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:22.339+0000 7f2d59f397c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T05:58:25.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T05:58:25.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:58:25.638 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:25.635+0000 7fdaca2117c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T05:58:25.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:25.635+0000 7fdaca2117c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T05:58:25.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:25.635+0000 7fdaca2117c0 -1 bdev(0x55945f25d800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T05:58:25.745 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:25.635+0000 7fdaca2117c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T05:58:28.784 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T05:58:28.841 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:58:28.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:28.919+0000 7f140943e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T05:58:28.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:28.919+0000 7f140943e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T05:58:28.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:28.919+0000 7f140943e7c0 -1 bdev(0x556719c1b800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T05:58:28.924 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T05:58:28.919+0000 7f140943e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T05:58:32.101 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T05:58:32.157 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T05:58:32.157 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:58:32.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T05:58:32.172 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:58:32.172 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T05:58:32.227 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:58:32.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T05:58:32.283 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:58:32.283 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T05:58:32.338 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:58:32.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T05:58:32.396 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:58:32.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T05:58:32.410 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:58:32.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T05:58:32.468 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:58:32.468 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T05:58:32.524 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:58:32.524 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T05:58:32.580 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:58:32.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T05:58:32.635 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:58:32.636 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T05:58:32.643 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:58:32.643 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T05:58:32.684 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T05:58:32.684 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T05:58:32.688 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T05:58:32.730 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2024-09-14T05:58:32.730 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDnJeVmTniDNxAArvNvWbePlSHfHcl7gl7ieg== 2024-09-14T05:58:32.730 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2024-09-14T05:58:32.730 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDrJeVmwJI2BBAAZClROTQt+hEhLT1K/UK1XQ== 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDuJeVmodfJEhAA1akj3XQ5HiAU8t4rQ/yfkA== 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDxJeVm4LTZIxAAO/hQLty1br9+zhcoQSyXeA== 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQD0JeVm0RvZNRAAotU0gUoKPqv5o62CCzAHyA== 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDnJeVmLb5mOhAA7quBdQoQjIeEGO7s8CxOGw== 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.4] 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQD7JeVmRZLfBBAAD2zgJwAhn6VcWnmPVassIg== 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.5] 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQD+JeVmlTOVFBAAI3WvJ0qMmIMJ67h2rdhAsQ== 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.6] 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQABJuVmTlE4JhAAgKl2oDTTWFETVezqZkpmVA== 2024-09-14T05:58:32.731 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.7] 2024-09-14T05:58:32.732 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAEJuVmrk8uNxAAnJgyhHRcLCFyobWk0krJ4g== 2024-09-14T05:58:32.732 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-09-14T05:58:32.732 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDoJeVmO3vCARAAEPUTsat3ToWY36g3U7CsrA== 2024-09-14T05:58:32.732 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2024-09-14T05:58:32.732 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDoJeVmlLZeBBAAh7IxbcuwaBR7Zf5oHnE5Tg== 2024-09-14T05:58:32.738 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.y] 2024-09-14T05:58:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDnJeVmTniDNxAArvNvWbePlSHfHcl7gl7ieg== 2024-09-14T05:58:32.738 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2024-09-14T05:58:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDrJeVmwJI2BBAAZClROTQt+hEhLT1K/UK1XQ== 2024-09-14T05:58:32.738 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2024-09-14T05:58:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDuJeVmodfJEhAA1akj3XQ5HiAU8t4rQ/yfkA== 2024-09-14T05:58:32.738 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2024-09-14T05:58:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDxJeVm4LTZIxAAO/hQLty1br9+zhcoQSyXeA== 2024-09-14T05:58:32.739 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2024-09-14T05:58:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD0JeVm0RvZNRAAotU0gUoKPqv5o62CCzAHyA== 2024-09-14T05:58:32.739 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2024-09-14T05:58:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDnJeVmLb5mOhAA7quBdQoQjIeEGO7s8CxOGw== 2024-09-14T05:58:32.739 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.4] 2024-09-14T05:58:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD7JeVmRZLfBBAAD2zgJwAhn6VcWnmPVassIg== 2024-09-14T05:58:32.739 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.5] 2024-09-14T05:58:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD+JeVmlTOVFBAAI3WvJ0qMmIMJ67h2rdhAsQ== 2024-09-14T05:58:32.739 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.6] 2024-09-14T05:58:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQABJuVmTlE4JhAAgKl2oDTTWFETVezqZkpmVA== 2024-09-14T05:58:32.739 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.7] 2024-09-14T05:58:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAEJuVmrk8uNxAAnJgyhHRcLCFyobWk0krJ4g== 2024-09-14T05:58:32.739 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-09-14T05:58:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDoJeVmO3vCARAAEPUTsat3ToWY36g3U7CsrA== 2024-09-14T05:58:32.740 INFO:teuthology.orchestra.run.smithi154.stdout:[client.1] 2024-09-14T05:58:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQDoJeVmlLZeBBAAh7IxbcuwaBR7Zf5oHnE5Tg== 2024-09-14T05:58:32.740 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T05:58:32.776 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T05:58:32.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:32.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:32.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:32.960 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:33.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:33.048 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:33.092 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:33.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:33.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T05:58:33.216 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T05:58:33.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:33.300 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:33.341 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:33.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:33.429 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:33.431 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:33.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:33.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:58:33.596 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T05:58:33.600 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T05:58:33.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T05:58:33.645 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T05:58:33.730 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T05:58:33.731 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T05:58:33.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T05:58:33.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T05:58:33.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T05:58:33.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T05:58:33.993 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T05:58:34.004 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T05:58:34.017 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T05:58:34.113 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T05:58:34.124 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:58:34.126 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:58:34.176 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T05:58:34.176 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T05:58:34.176 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T05:58:34.178 INFO:tasks.ceph.mon.a:Started 2024-09-14T05:58:34.178 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T05:58:34.178 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T05:58:34.180 INFO:tasks.ceph.mon.c:Started 2024-09-14T05:58:34.180 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T05:58:34.180 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T05:58:34.221 INFO:tasks.ceph.mon.b:Started 2024-09-14T05:58:34.221 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T05:58:34.222 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T05:58:34.222 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T05:58:34.224 INFO:tasks.ceph.mgr.y:Started 2024-09-14T05:58:34.224 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T05:58:34.224 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T05:58:34.226 INFO:tasks.ceph.mgr.x:Started 2024-09-14T05:58:34.226 DEBUG:tasks.ceph:set 0 configs 2024-09-14T05:58:34.226 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T05:58:34.226 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T05:58:34.677 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2024-09-14T05:58:34.697 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T05:58:34.698 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T05:58:34.698 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:58:34.698 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T05:58:34.710 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:58:34.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T05:58:34.763 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:58:34.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T05:58:34.817 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-09-14T05:58:34.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T05:58:34.869 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:58:34.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T05:58:34.883 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:58:34.883 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T05:58:34.936 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:58:34.936 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T05:58:34.991 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T05:58:34.991 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T05:58:35.048 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 9ef61ed5-359d-4de3-be54-41d3a66c393a 0 2024-09-14T05:58:35.312 INFO:teuthology.orchestra.run.smithi154.stdout:0 2024-09-14T05:58:35.330 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new f180c483-9b53-4808-b5ec-537bf956087d 1 2024-09-14T05:58:35.536 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-09-14T05:58:35.553 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new bc59bb00-b3b0-4483-a5b1-cc5907cf660a 2 2024-09-14T05:58:35.749 INFO:teuthology.orchestra.run.smithi154.stdout:2 2024-09-14T05:58:35.765 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 7aa9fc3b-29c5-4e9a-a894-e2abfb586263 3 2024-09-14T05:58:35.962 INFO:teuthology.orchestra.run.smithi154.stdout:3 2024-09-14T05:58:35.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new a0665f54-f53d-4536-a322-4974c2f23aa1 4 2024-09-14T05:58:36.180 INFO:teuthology.orchestra.run.smithi154.stdout:4 2024-09-14T05:58:36.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 302ab31c-c228-44da-a0d2-58505ad571cf 5 2024-09-14T05:58:36.396 INFO:teuthology.orchestra.run.smithi154.stdout:5 2024-09-14T05:58:36.413 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 1adbca34-daef-4229-b25e-40dec6800f85 6 2024-09-14T05:58:36.619 INFO:teuthology.orchestra.run.smithi154.stdout:6 2024-09-14T05:58:36.635 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new a75d9794-68bf-4e8c-bf75-448a7a783769 7 2024-09-14T05:58:36.845 INFO:teuthology.orchestra.run.smithi154.stdout:7 2024-09-14T05:58:36.862 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T05:58:36.862 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T05:58:36.864 INFO:tasks.ceph.osd.0:Started 2024-09-14T05:58:36.864 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T05:58:36.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T05:58:36.867 INFO:tasks.ceph.osd.1:Started 2024-09-14T05:58:36.867 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T05:58:36.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T05:58:36.869 INFO:tasks.ceph.osd.2:Started 2024-09-14T05:58:36.869 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T05:58:36.870 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T05:58:36.871 INFO:tasks.ceph.osd.3:Started 2024-09-14T05:58:36.872 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T05:58:36.872 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T05:58:36.874 INFO:tasks.ceph.osd.4:Started 2024-09-14T05:58:36.874 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T05:58:36.874 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T05:58:36.876 INFO:tasks.ceph.osd.5:Started 2024-09-14T05:58:36.876 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T05:58:36.876 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T05:58:36.878 INFO:tasks.ceph.osd.6:Started 2024-09-14T05:58:36.878 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T05:58:36.878 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T05:58:36.880 INFO:tasks.ceph.osd.7:Started 2024-09-14T05:58:36.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T05:58:37.076 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:58:37.076 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"fsid":"8db933fa-392d-4966-864a-b73b8a91dd2d","created":"2024-09-14T05:58:34.536616+0000","modified":"2024-09-14T05:58:36.841702+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T05:58:36.841702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9ef61ed5-359d-4de3-be54-41d3a66c393a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f180c483-9b53-4808-b5ec-537bf956087d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bc59bb00-b3b0-4483-a5b1-cc5907cf660a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7aa9fc3b-29c5-4e9a-a894-e2abfb586263","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a0665f54-f53d-4536-a322-4974c2f23aa1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"302ab31c-c228-44da-a0d2-58505ad571cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1adbca34-daef-4229-b25e-40dec6800f85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a75d9794-68bf-4e8c-bf75-448a7a783769","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:58:37.093 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T05:58:37.093 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T05:58:37.559 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-14T05:58:37.559 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-14T05:58:37.559 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2024-09-14T05:58:37.598 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-14T05:58:37.598 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-14T05:58:37.598 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2024-09-14T05:58:37.899 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T05:58:37.985 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:58:37.983+0000 7f4f531817c0 -1 Falling back to public interface 2024-09-14T05:58:38.088 INFO:teuthology.misc.health.smithi006.stdout: 2024-09-14T05:58:38.088 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":10,"fsid":"8db933fa-392d-4966-864a-b73b8a91dd2d","created":"2024-09-14T05:58:34.536616+0000","modified":"2024-09-14T05:58:36.841702+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T05:58:36.841702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9ef61ed5-359d-4de3-be54-41d3a66c393a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f180c483-9b53-4808-b5ec-537bf956087d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bc59bb00-b3b0-4483-a5b1-cc5907cf660a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7aa9fc3b-29c5-4e9a-a894-e2abfb586263","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a0665f54-f53d-4536-a322-4974c2f23aa1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"302ab31c-c228-44da-a0d2-58505ad571cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1adbca34-daef-4229-b25e-40dec6800f85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a75d9794-68bf-4e8c-bf75-448a7a783769","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:58:38.104 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T05:58:38.277 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:58:38.275+0000 7f881ae8a7c0 -1 Falling back to public interface 2024-09-14T05:58:38.279 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:58:38.278+0000 7f1b86ac27c0 -1 Falling back to public interface 2024-09-14T05:58:38.521 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:58:38.519+0000 7f2a2b82d7c0 -1 Falling back to public interface 2024-09-14T05:58:38.543 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:58:38.542+0000 7fcea47fd7c0 -1 Falling back to public interface 2024-09-14T05:58:38.544 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:58:38.542+0000 7f2db49247c0 -1 Falling back to public interface 2024-09-14T05:58:38.553 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:58:38.551+0000 7ff7a52c47c0 -1 Falling back to public interface 2024-09-14T05:58:38.569 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:58:38.566+0000 7feccdffe7c0 -1 Falling back to public interface 2024-09-14T05:58:40.477 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-14T05:58:40.475+0000 7fc3e6ff0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T05:58:40.481 INFO:tasks.ceph.mgr.x.smithi154.stderr:2024-09-14T05:58:40.479+0000 7fc3e6ff0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T05:58:42.056 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:58:42.055+0000 7f4f531817c0 -1 osd.7 0 log_to_monitors true 2024-09-14T05:58:42.336 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:58:42.335+0000 7f881ae8a7c0 -1 osd.5 0 log_to_monitors true 2024-09-14T05:58:42.353 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:58:42.350+0000 7f1b86ac27c0 -1 osd.3 0 log_to_monitors true 2024-09-14T05:58:42.499 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:58:42.495+0000 7f2a2b82d7c0 -1 osd.6 0 log_to_monitors true 2024-09-14T05:58:42.526 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:58:42.522+0000 7f2db49247c0 -1 osd.1 0 log_to_monitors true 2024-09-14T05:58:42.684 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:58:42.678+0000 7fcea47fd7c0 -1 osd.2 0 log_to_monitors true 2024-09-14T05:58:42.685 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:58:42.679+0000 7ff7a52c47c0 -1 osd.4 0 log_to_monitors true 2024-09-14T05:58:42.804 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:58:42.802+0000 7feccdffe7c0 -1 osd.0 0 log_to_monitors true 2024-09-14T05:58:44.911 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T05:58:45.017 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:58:45.014+0000 7f2db08cd640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T05:58:45.066 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:58:45.062+0000 7f2da86ff640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:58:45.103 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:58:45.102+0000 7f1b8327d640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T05:58:45.140 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:58:45.138+0000 7f1b7a89d640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:58:45.290 INFO:teuthology.misc.health.smithi006.stdout: 2024-09-14T05:58:45.290 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":13,"fsid":"8db933fa-392d-4966-864a-b73b8a91dd2d","created":"2024-09-14T05:58:34.536616+0000","modified":"2024-09-14T05:58:44.588243+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T05:58:36.841702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9ef61ed5-359d-4de3-be54-41d3a66c393a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f180c483-9b53-4808-b5ec-537bf956087d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"bc59bb00-b3b0-4483-a5b1-cc5907cf660a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7aa9fc3b-29c5-4e9a-a894-e2abfb586263","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a0665f54-f53d-4536-a322-4974c2f23aa1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"302ab31c-c228-44da-a0d2-58505ad571cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1adbca34-daef-4229-b25e-40dec6800f85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a75d9794-68bf-4e8c-bf75-448a7a783769","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:58:45.310 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T05:58:45.402 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:58:45.399+0000 7f2a277d6640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T05:58:45.424 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:58:45.423+0000 7f2a1f608640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:58:45.463 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:58:45.459+0000 7f4f4f93c640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T05:58:45.489 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:58:45.487+0000 7f8817645640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T05:58:45.492 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:58:45.491+0000 7f4f46f5c640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:58:45.520 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:58:45.519+0000 7f880ec65640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:58:45.822 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:58:45.819+0000 7ff7a126d640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T05:58:45.849 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:58:45.847+0000 7ff79909f640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:58:45.986 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:58:45.982+0000 7fecc9fa7640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T05:58:46.013 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:58:46.010+0000 7fcea07a6640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T05:58:46.015 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:58:46.014+0000 7fecc1dd9640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:58:46.043 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:58:46.042+0000 7fce985d8640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:58:52.117 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T05:58:52.434 INFO:teuthology.misc.health.smithi006.stdout: 2024-09-14T05:58:52.435 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":18,"fsid":"8db933fa-392d-4966-864a-b73b8a91dd2d","created":"2024-09-14T05:58:34.536616+0000","modified":"2024-09-14T05:58:50.048744+0000","last_up_change":"2024-09-14T05:58:47.027158+0000","last_in_change":"2024-09-14T05:58:36.841702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T05:58:47.505149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ef61ed5-359d-4de3-be54-41d3a66c393a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":4023034827},{"type":"v1","addr":"172.21.15.6:6825","nonce":4023034827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4023034827},{"type":"v1","addr":"172.21.15.6:6827","nonce":4023034827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4023034827},{"type":"v1","addr":"172.21.15.6:6831","nonce":4023034827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4023034827},{"type":"v1","addr":"172.21.15.6:6829","nonce":4023034827}]},"public_addr":"172.21.15.6:6825/4023034827","cluster_addr":"172.21.15.6:6827/4023034827","heartbeat_back_addr":"172.21.15.6:6831/4023034827","heartbeat_front_addr":"172.21.15.6:6829/4023034827","state":["exists","up"]},{"osd":1,"uuid":"f180c483-9b53-4808-b5ec-537bf956087d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6815","nonce":1278360579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6819","nonce":1278360579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6823","nonce":1278360579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6821","nonce":1278360579}]},"public_addr":"172.21.15.6:6815/1278360579","cluster_addr":"172.21.15.6:6819/1278360579","heartbeat_back_addr":"172.21.15.6:6823/1278360579","heartbeat_front_addr":"172.21.15.6:6821/1278360579","state":["exists","up"]},{"osd":2,"uuid":"bc59bb00-b3b0-4483-a5b1-cc5907cf660a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6809","nonce":4171349592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6811","nonce":4171349592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6817","nonce":4171349592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6814","nonce":4171349592}]},"public_addr":"172.21.15.6:6809/4171349592","cluster_addr":"172.21.15.6:6811/4171349592","heartbeat_back_addr":"172.21.15.6:6817/4171349592","heartbeat_front_addr":"172.21.15.6:6814/4171349592","state":["exists","up"]},{"osd":3,"uuid":"7aa9fc3b-29c5-4e9a-a894-e2abfb586263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6801","nonce":3999210088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6803","nonce":3999210088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6807","nonce":3999210088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6805","nonce":3999210088}]},"public_addr":"172.21.15.6:6801/3999210088","cluster_addr":"172.21.15.6:6803/3999210088","heartbeat_back_addr":"172.21.15.6:6807/3999210088","heartbeat_front_addr":"172.21.15.6:6805/3999210088","state":["exists","up"]},{"osd":4,"uuid":"a0665f54-f53d-4536-a322-4974c2f23aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6825","nonce":575863621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6827","nonce":575863621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6831","nonce":575863621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6829","nonce":575863621}]},"public_addr":"172.21.15.154:6825/575863621","cluster_addr":"172.21.15.154:6827/575863621","heartbeat_back_addr":"172.21.15.154:6831/575863621","heartbeat_front_addr":"172.21.15.154:6829/575863621","state":["exists","up"]},{"osd":5,"uuid":"302ab31c-c228-44da-a0d2-58505ad571cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6809","nonce":2498345645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6811","nonce":2498345645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6815","nonce":2498345645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6813","nonce":2498345645}]},"public_addr":"172.21.15.154:6809/2498345645","cluster_addr":"172.21.15.154:6811/2498345645","heartbeat_back_addr":"172.21.15.154:6815/2498345645","heartbeat_front_addr":"172.21.15.154:6813/2498345645","state":["exists","up"]},{"osd":6,"uuid":"1adbca34-daef-4229-b25e-40dec6800f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6817","nonce":267756224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6819","nonce":267756224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6823","nonce":267756224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6821","nonce":267756224}]},"public_addr":"172.21.15.154:6817/267756224","cluster_addr":"172.21.15.154:6819/267756224","heartbeat_back_addr":"172.21.15.154:6823/267756224","heartbeat_front_addr":"172.21.15.154:6821/267756224","state":["exists","up"]},{"osd":7,"uuid":"a75d9794-68bf-4e8c-bf75-448a7a783769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6801","nonce":4119173763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6803","nonce":4119173763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6807","nonce":4119173763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6805","nonce":4119173763}]},"public_addr":"172.21.15.154:6801/4119173763","cluster_addr":"172.21.15.154:6803/4119173763","heartbeat_back_addr":"172.21.15.154:6807/4119173763","heartbeat_front_addr":"172.21.15.154:6805/4119173763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.791330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.526550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.664242+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.327736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.687393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.487578+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.106833+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:58:52.452 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T05:58:52.453 INFO:tasks.ceph:Creating RBD pool 2024-09-14T05:58:52.453 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T05:58:53.086 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'rbd' created 2024-09-14T05:58:53.114 DEBUG:teuthology.orchestra.run.smithi006:> rbd --cluster ceph pool init rbd 2024-09-14T05:58:56.117 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T05:58:56.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T05:58:56.118 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T05:58:56.440 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:58:56.459 INFO:teuthology.orchestra.run.smithi006.stdout:[{"version":9,"timestamp":"2024-09-14T05:58:46.015082+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"5407.913956"}]}] 2024-09-14T05:58:56.460 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T05:58:56.460 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T05:58:56.460 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T05:58:56.460 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T05:58:56.817 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:58:56.832 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2798703284},{"type":"v1","addr":"172.21.15.154:6833","nonce":2798703284}]},"active_addr":"172.21.15.154:6833/2798703284","active_change":"2024-09-14T05:58:39.451723+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4100,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":4143145111}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":740275942}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":1832129965}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":2584786687}]}]} 2024-09-14T05:58:56.836 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T05:58:56.836 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T05:58:56.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T05:58:57.145 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:58:57.146 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"fsid":"8db933fa-392d-4966-864a-b73b8a91dd2d","created":"2024-09-14T05:58:34.536616+0000","modified":"2024-09-14T05:58:56.083727+0000","last_up_change":"2024-09-14T05:58:47.027158+0000","last_in_change":"2024-09-14T05:58:36.841702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T05:58:47.505149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T05:58:52.779258+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ef61ed5-359d-4de3-be54-41d3a66c393a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":4023034827},{"type":"v1","addr":"172.21.15.6:6825","nonce":4023034827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4023034827},{"type":"v1","addr":"172.21.15.6:6827","nonce":4023034827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4023034827},{"type":"v1","addr":"172.21.15.6:6831","nonce":4023034827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4023034827},{"type":"v1","addr":"172.21.15.6:6829","nonce":4023034827}]},"public_addr":"172.21.15.6:6825/4023034827","cluster_addr":"172.21.15.6:6827/4023034827","heartbeat_back_addr":"172.21.15.6:6831/4023034827","heartbeat_front_addr":"172.21.15.6:6829/4023034827","state":["exists","up"]},{"osd":1,"uuid":"f180c483-9b53-4808-b5ec-537bf956087d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6815","nonce":1278360579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6819","nonce":1278360579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6823","nonce":1278360579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6821","nonce":1278360579}]},"public_addr":"172.21.15.6:6815/1278360579","cluster_addr":"172.21.15.6:6819/1278360579","heartbeat_back_addr":"172.21.15.6:6823/1278360579","heartbeat_front_addr":"172.21.15.6:6821/1278360579","state":["exists","up"]},{"osd":2,"uuid":"bc59bb00-b3b0-4483-a5b1-cc5907cf660a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6809","nonce":4171349592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6811","nonce":4171349592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6817","nonce":4171349592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6814","nonce":4171349592}]},"public_addr":"172.21.15.6:6809/4171349592","cluster_addr":"172.21.15.6:6811/4171349592","heartbeat_back_addr":"172.21.15.6:6817/4171349592","heartbeat_front_addr":"172.21.15.6:6814/4171349592","state":["exists","up"]},{"osd":3,"uuid":"7aa9fc3b-29c5-4e9a-a894-e2abfb586263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6801","nonce":3999210088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6803","nonce":3999210088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6807","nonce":3999210088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6805","nonce":3999210088}]},"public_addr":"172.21.15.6:6801/3999210088","cluster_addr":"172.21.15.6:6803/3999210088","heartbeat_back_addr":"172.21.15.6:6807/3999210088","heartbeat_front_addr":"172.21.15.6:6805/3999210088","state":["exists","up"]},{"osd":4,"uuid":"a0665f54-f53d-4536-a322-4974c2f23aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6825","nonce":575863621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6827","nonce":575863621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6831","nonce":575863621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6829","nonce":575863621}]},"public_addr":"172.21.15.154:6825/575863621","cluster_addr":"172.21.15.154:6827/575863621","heartbeat_back_addr":"172.21.15.154:6831/575863621","heartbeat_front_addr":"172.21.15.154:6829/575863621","state":["exists","up"]},{"osd":5,"uuid":"302ab31c-c228-44da-a0d2-58505ad571cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6809","nonce":2498345645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6811","nonce":2498345645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6815","nonce":2498345645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6813","nonce":2498345645}]},"public_addr":"172.21.15.154:6809/2498345645","cluster_addr":"172.21.15.154:6811/2498345645","heartbeat_back_addr":"172.21.15.154:6815/2498345645","heartbeat_front_addr":"172.21.15.154:6813/2498345645","state":["exists","up"]},{"osd":6,"uuid":"1adbca34-daef-4229-b25e-40dec6800f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6817","nonce":267756224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6819","nonce":267756224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6823","nonce":267756224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6821","nonce":267756224}]},"public_addr":"172.21.15.154:6817/267756224","cluster_addr":"172.21.15.154:6819/267756224","heartbeat_back_addr":"172.21.15.154:6823/267756224","heartbeat_front_addr":"172.21.15.154:6821/267756224","state":["exists","up"]},{"osd":7,"uuid":"a75d9794-68bf-4e8c-bf75-448a7a783769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6801","nonce":4119173763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6803","nonce":4119173763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6807","nonce":4119173763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6805","nonce":4119173763}]},"public_addr":"172.21.15.154:6801/4119173763","cluster_addr":"172.21.15.154:6803/4119173763","heartbeat_back_addr":"172.21.15.154:6807/4119173763","heartbeat_front_addr":"172.21.15.154:6805/4119173763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.791330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.526550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.664242+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.327736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.687393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.487578+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.106833+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:58:57.164 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T05:58:57.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T05:58:57.456 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:58:57.456 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"fsid":"8db933fa-392d-4966-864a-b73b8a91dd2d","created":"2024-09-14T05:58:34.536616+0000","modified":"2024-09-14T05:58:56.083727+0000","last_up_change":"2024-09-14T05:58:47.027158+0000","last_in_change":"2024-09-14T05:58:36.841702+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T05:58:47.505149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T05:58:52.779258+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ef61ed5-359d-4de3-be54-41d3a66c393a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":4023034827},{"type":"v1","addr":"172.21.15.6:6825","nonce":4023034827}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":4023034827},{"type":"v1","addr":"172.21.15.6:6827","nonce":4023034827}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":4023034827},{"type":"v1","addr":"172.21.15.6:6831","nonce":4023034827}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":4023034827},{"type":"v1","addr":"172.21.15.6:6829","nonce":4023034827}]},"public_addr":"172.21.15.6:6825/4023034827","cluster_addr":"172.21.15.6:6827/4023034827","heartbeat_back_addr":"172.21.15.6:6831/4023034827","heartbeat_front_addr":"172.21.15.6:6829/4023034827","state":["exists","up"]},{"osd":1,"uuid":"f180c483-9b53-4808-b5ec-537bf956087d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6815","nonce":1278360579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6819","nonce":1278360579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6823","nonce":1278360579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6821","nonce":1278360579}]},"public_addr":"172.21.15.6:6815/1278360579","cluster_addr":"172.21.15.6:6819/1278360579","heartbeat_back_addr":"172.21.15.6:6823/1278360579","heartbeat_front_addr":"172.21.15.6:6821/1278360579","state":["exists","up"]},{"osd":2,"uuid":"bc59bb00-b3b0-4483-a5b1-cc5907cf660a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6809","nonce":4171349592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6811","nonce":4171349592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6817","nonce":4171349592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6814","nonce":4171349592}]},"public_addr":"172.21.15.6:6809/4171349592","cluster_addr":"172.21.15.6:6811/4171349592","heartbeat_back_addr":"172.21.15.6:6817/4171349592","heartbeat_front_addr":"172.21.15.6:6814/4171349592","state":["exists","up"]},{"osd":3,"uuid":"7aa9fc3b-29c5-4e9a-a894-e2abfb586263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6801","nonce":3999210088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6803","nonce":3999210088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6807","nonce":3999210088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6805","nonce":3999210088}]},"public_addr":"172.21.15.6:6801/3999210088","cluster_addr":"172.21.15.6:6803/3999210088","heartbeat_back_addr":"172.21.15.6:6807/3999210088","heartbeat_front_addr":"172.21.15.6:6805/3999210088","state":["exists","up"]},{"osd":4,"uuid":"a0665f54-f53d-4536-a322-4974c2f23aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6825","nonce":575863621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6827","nonce":575863621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6831","nonce":575863621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6829","nonce":575863621}]},"public_addr":"172.21.15.154:6825/575863621","cluster_addr":"172.21.15.154:6827/575863621","heartbeat_back_addr":"172.21.15.154:6831/575863621","heartbeat_front_addr":"172.21.15.154:6829/575863621","state":["exists","up"]},{"osd":5,"uuid":"302ab31c-c228-44da-a0d2-58505ad571cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6809","nonce":2498345645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6811","nonce":2498345645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6815","nonce":2498345645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6813","nonce":2498345645}]},"public_addr":"172.21.15.154:6809/2498345645","cluster_addr":"172.21.15.154:6811/2498345645","heartbeat_back_addr":"172.21.15.154:6815/2498345645","heartbeat_front_addr":"172.21.15.154:6813/2498345645","state":["exists","up"]},{"osd":6,"uuid":"1adbca34-daef-4229-b25e-40dec6800f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6817","nonce":267756224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6819","nonce":267756224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6823","nonce":267756224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6821","nonce":267756224}]},"public_addr":"172.21.15.154:6817/267756224","cluster_addr":"172.21.15.154:6819/267756224","heartbeat_back_addr":"172.21.15.154:6823/267756224","heartbeat_front_addr":"172.21.15.154:6821/267756224","state":["exists","up"]},{"osd":7,"uuid":"a75d9794-68bf-4e8c-bf75-448a7a783769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6801","nonce":4119173763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6803","nonce":4119173763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6807","nonce":4119173763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6805","nonce":4119173763}]},"public_addr":"172.21.15.154:6801/4119173763","cluster_addr":"172.21.15.154:6803/4119173763","heartbeat_back_addr":"172.21.15.154:6807/4119173763","heartbeat_front_addr":"172.21.15.154:6805/4119173763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.791330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.526550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.664242+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.327736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.687393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.487578+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.106833+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:58:57.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T05:58:57.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T05:58:57.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T05:58:57.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T05:58:57.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T05:58:57.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T05:58:57.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T05:58:57.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T05:58:57.741 INFO:teuthology.orchestra.run.smithi006.stdout:60129542151 2024-09-14T05:58:57.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T05:58:57.742 INFO:teuthology.orchestra.run.smithi006.stdout:60129542149 2024-09-14T05:58:57.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T05:58:57.747 INFO:teuthology.orchestra.run.smithi006.stdout:60129542150 2024-09-14T05:58:57.747 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T05:58:57.750 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2024-09-14T05:58:57.750 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T05:58:57.752 INFO:teuthology.orchestra.run.smithi006.stdout:60129542148 2024-09-14T05:58:57.753 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T05:58:57.757 INFO:teuthology.orchestra.run.smithi006.stdout:60129542150 2024-09-14T05:58:57.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T05:58:57.758 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2024-09-14T05:58:57.759 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T05:58:57.763 INFO:teuthology.orchestra.run.smithi006.stdout:60129542149 2024-09-14T05:58:57.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T05:58:58.285 INFO:teuthology.orchestra.run.smithi006.stdout:60129542148 2024-09-14T05:58:58.295 INFO:teuthology.orchestra.run.smithi006.stdout:60129542149 2024-09-14T05:58:58.295 INFO:teuthology.orchestra.run.smithi006.stdout:60129542150 2024-09-14T05:58:58.309 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2024-09-14T05:58:58.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.3 2024-09-14T05:58:58.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.6 2024-09-14T05:58:58.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.4 2024-09-14T05:58:58.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.0 2024-09-14T05:58:58.338 INFO:teuthology.orchestra.run.smithi006.stdout:60129542149 2024-09-14T05:58:58.341 INFO:teuthology.orchestra.run.smithi006.stdout:60129542148 2024-09-14T05:58:58.345 INFO:teuthology.orchestra.run.smithi006.stdout:60129542147 2024-09-14T05:58:58.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-14T05:58:58.364 INFO:teuthology.orchestra.run.smithi006.stdout:64424509443 2024-09-14T05:58:58.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-14T05:58:58.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.1 2024-09-14T05:58:58.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.2 2024-09-14T05:58:59.315 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T05:58:59.323 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T05:58:59.324 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T05:58:59.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T05:58:59.362 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T05:58:59.368 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T05:58:59.374 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T05:58:59.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T05:58:59.848 INFO:teuthology.orchestra.run.smithi006.stdout:60129542148 2024-09-14T05:58:59.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.3 2024-09-14T05:58:59.898 INFO:teuthology.orchestra.run.smithi006.stdout:60129542150 2024-09-14T05:58:59.907 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2024-09-14T05:58:59.924 INFO:teuthology.orchestra.run.smithi006.stdout:60129542149 2024-09-14T05:58:59.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.6 2024-09-14T05:58:59.926 INFO:teuthology.orchestra.run.smithi006.stdout:60129542149 2024-09-14T05:58:59.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.0 2024-09-14T05:58:59.947 INFO:teuthology.orchestra.run.smithi006.stdout:60129542147 2024-09-14T05:58:59.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-14T05:58:59.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.4 2024-09-14T05:58:59.956 INFO:teuthology.orchestra.run.smithi006.stdout:64424509443 2024-09-14T05:58:59.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.1 2024-09-14T05:58:59.973 INFO:teuthology.orchestra.run.smithi006.stdout:60129542148 2024-09-14T05:58:59.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.2 2024-09-14T05:58:59.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-14T05:59:00.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T05:59:00.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T05:59:00.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T05:59:00.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T05:59:00.953 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T05:59:00.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T05:59:00.981 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T05:59:00.992 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T05:59:01.378 INFO:teuthology.orchestra.run.smithi006.stdout:60129542149 2024-09-14T05:59:01.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-09-14T05:59:01.403 DEBUG:teuthology.parallel:result is None 2024-09-14T05:59:01.471 INFO:teuthology.orchestra.run.smithi006.stdout:60129542151 2024-09-14T05:59:01.481 INFO:teuthology.orchestra.run.smithi006.stdout:60129542148 2024-09-14T05:59:01.495 INFO:teuthology.orchestra.run.smithi006.stdout:60129542150 2024-09-14T05:59:01.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2024-09-14T05:59:01.498 DEBUG:teuthology.parallel:result is None 2024-09-14T05:59:01.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2024-09-14T05:59:01.507 DEBUG:teuthology.parallel:result is None 2024-09-14T05:59:01.521 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2024-09-14T05:59:01.521 INFO:teuthology.orchestra.run.smithi006.stdout:60129542150 2024-09-14T05:59:01.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-14T05:59:01.523 DEBUG:teuthology.parallel:result is None 2024-09-14T05:59:01.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.2 2024-09-14T05:59:01.541 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2024-09-14T05:59:01.541 DEBUG:teuthology.parallel:result is None 2024-09-14T05:59:01.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-09-14T05:59:01.549 DEBUG:teuthology.parallel:result is None 2024-09-14T05:59:01.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-09-14T05:59:01.560 DEBUG:teuthology.parallel:result is None 2024-09-14T05:59:01.563 INFO:teuthology.orchestra.run.smithi006.stdout:60129542149 2024-09-14T05:59:01.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-14T05:59:01.580 DEBUG:teuthology.parallel:result is None 2024-09-14T05:59:01.580 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T05:59:01.580 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:59:01.922 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:59:01.922 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T05:59:01.939 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T05:59:01.465917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223328,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751392,"statfs":{"total":773094113280,"available":772865425408,"internally_reserved":0,"allocated":2965504,"data_stored":1790070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.380682"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.312544+0000","last_change":"2024-09-14T05:58:56.312544+0000","last_active":"2024-09-14T05:58:56.312544+0000","last_peered":"2024-09-14T05:58:56.312544+0000","last_clean":"2024-09-14T05:58:56.312544+0000","last_became_active":"2024-09-14T05:58:54.103612+0000","last_became_peered":"2024-09-14T05:58:54.103612+0000","last_unstale":"2024-09-14T05:58:56.312544+0000","last_undegraded":"2024-09-14T05:58:56.312544+0000","last_fullsized":"2024-09-14T05:58:56.312544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:08.678742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.095887+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T05:58:56.095887+0000","last_peered":"2024-09-14T05:58:56.095887+0000","last_clean":"2024-09-14T05:58:56.095887+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T05:58:56.095887+0000","last_undegraded":"2024-09-14T05:58:56.095887+0000","last_fullsized":"2024-09-14T05:58:56.095887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.593450+0000","last_change":"2024-09-14T05:58:56.593450+0000","last_active":"2024-09-14T05:58:56.593450+0000","last_peered":"2024-09-14T05:58:56.593450+0000","last_clean":"2024-09-14T05:58:56.593450+0000","last_became_active":"2024-09-14T05:58:54.097887+0000","last_became_peered":"2024-09-14T05:58:54.097887+0000","last_unstale":"2024-09-14T05:58:56.593450+0000","last_undegraded":"2024-09-14T05:58:56.593450+0000","last_fullsized":"2024-09-14T05:58:56.593450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:36.399077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.095812+0000","last_change":"2024-09-14T05:58:56.095812+0000","last_active":"2024-09-14T05:58:56.095812+0000","last_peered":"2024-09-14T05:58:56.095812+0000","last_clean":"2024-09-14T05:58:56.095812+0000","last_became_active":"2024-09-14T05:58:54.089784+0000","last_became_peered":"2024-09-14T05:58:54.089784+0000","last_unstale":"2024-09-14T05:58:56.095812+0000","last_undegraded":"2024-09-14T05:58:56.095812+0000","last_fullsized":"2024-09-14T05:58:56.095812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:00.829944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.105967+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T05:58:56.105967+0000","last_peered":"2024-09-14T05:58:56.105967+0000","last_clean":"2024-09-14T05:58:56.105967+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T05:58:56.105967+0000","last_undegraded":"2024-09-14T05:58:56.105967+0000","last_fullsized":"2024-09-14T05:58:56.105967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.096637+0000","last_change":"2024-09-14T05:58:56.096637+0000","last_active":"2024-09-14T05:58:56.096637+0000","last_peered":"2024-09-14T05:58:56.096637+0000","last_clean":"2024-09-14T05:58:56.096637+0000","last_became_active":"2024-09-14T05:58:54.356560+0000","last_became_peered":"2024-09-14T05:58:54.356560+0000","last_unstale":"2024-09-14T05:58:56.096637+0000","last_undegraded":"2024-09-14T05:58:56.096637+0000","last_fullsized":"2024-09-14T05:58:56.096637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:10.136136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012156140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.593338+0000","last_change":"2024-09-14T05:58:56.593338+0000","last_active":"2024-09-14T05:58:56.593338+0000","last_peered":"2024-09-14T05:58:56.593338+0000","last_clean":"2024-09-14T05:58:56.593338+0000","last_became_active":"2024-09-14T05:58:54.099699+0000","last_became_peered":"2024-09-14T05:58:54.099699+0000","last_unstale":"2024-09-14T05:58:56.593338+0000","last_undegraded":"2024-09-14T05:58:56.593338+0000","last_fullsized":"2024-09-14T05:58:56.593338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:40.481832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.102386+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T05:58:56.102386+0000","last_peered":"2024-09-14T05:58:56.102386+0000","last_clean":"2024-09-14T05:58:56.102386+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T05:58:56.102386+0000","last_undegraded":"2024-09-14T05:58:56.102386+0000","last_fullsized":"2024-09-14T05:58:56.102386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.592191+0000","last_change":"2024-09-14T05:58:49.056297+0000","last_active":"2024-09-14T05:58:56.592191+0000","last_peered":"2024-09-14T05:58:56.592191+0000","last_clean":"2024-09-14T05:58:56.592191+0000","last_became_active":"2024-09-14T05:58:49.055520+0000","last_became_peered":"2024-09-14T05:58:49.055520+0000","last_unstale":"2024-09-14T05:58:56.592191+0000","last_undegraded":"2024-09-14T05:58:56.592191+0000","last_fullsized":"2024-09-14T05:58:56.592191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:35.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":815104,"data_stored":666530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":666530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:59:01.939 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:59:02.238 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:59:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T05:59:02.255 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T05:59:01.465917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223328,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751392,"statfs":{"total":773094113280,"available":772865425408,"internally_reserved":0,"allocated":2965504,"data_stored":1790070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.380682"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.312544+0000","last_change":"2024-09-14T05:58:56.312544+0000","last_active":"2024-09-14T05:58:56.312544+0000","last_peered":"2024-09-14T05:58:56.312544+0000","last_clean":"2024-09-14T05:58:56.312544+0000","last_became_active":"2024-09-14T05:58:54.103612+0000","last_became_peered":"2024-09-14T05:58:54.103612+0000","last_unstale":"2024-09-14T05:58:56.312544+0000","last_undegraded":"2024-09-14T05:58:56.312544+0000","last_fullsized":"2024-09-14T05:58:56.312544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:08.678742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.095887+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T05:58:56.095887+0000","last_peered":"2024-09-14T05:58:56.095887+0000","last_clean":"2024-09-14T05:58:56.095887+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T05:58:56.095887+0000","last_undegraded":"2024-09-14T05:58:56.095887+0000","last_fullsized":"2024-09-14T05:58:56.095887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.593450+0000","last_change":"2024-09-14T05:58:56.593450+0000","last_active":"2024-09-14T05:58:56.593450+0000","last_peered":"2024-09-14T05:58:56.593450+0000","last_clean":"2024-09-14T05:58:56.593450+0000","last_became_active":"2024-09-14T05:58:54.097887+0000","last_became_peered":"2024-09-14T05:58:54.097887+0000","last_unstale":"2024-09-14T05:58:56.593450+0000","last_undegraded":"2024-09-14T05:58:56.593450+0000","last_fullsized":"2024-09-14T05:58:56.593450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:36.399077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.095812+0000","last_change":"2024-09-14T05:58:56.095812+0000","last_active":"2024-09-14T05:58:56.095812+0000","last_peered":"2024-09-14T05:58:56.095812+0000","last_clean":"2024-09-14T05:58:56.095812+0000","last_became_active":"2024-09-14T05:58:54.089784+0000","last_became_peered":"2024-09-14T05:58:54.089784+0000","last_unstale":"2024-09-14T05:58:56.095812+0000","last_undegraded":"2024-09-14T05:58:56.095812+0000","last_fullsized":"2024-09-14T05:58:56.095812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:00.829944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.105967+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T05:58:56.105967+0000","last_peered":"2024-09-14T05:58:56.105967+0000","last_clean":"2024-09-14T05:58:56.105967+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T05:58:56.105967+0000","last_undegraded":"2024-09-14T05:58:56.105967+0000","last_fullsized":"2024-09-14T05:58:56.105967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.096637+0000","last_change":"2024-09-14T05:58:56.096637+0000","last_active":"2024-09-14T05:58:56.096637+0000","last_peered":"2024-09-14T05:58:56.096637+0000","last_clean":"2024-09-14T05:58:56.096637+0000","last_became_active":"2024-09-14T05:58:54.356560+0000","last_became_peered":"2024-09-14T05:58:54.356560+0000","last_unstale":"2024-09-14T05:58:56.096637+0000","last_undegraded":"2024-09-14T05:58:56.096637+0000","last_fullsized":"2024-09-14T05:58:56.096637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:10.136136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012156140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.593338+0000","last_change":"2024-09-14T05:58:56.593338+0000","last_active":"2024-09-14T05:58:56.593338+0000","last_peered":"2024-09-14T05:58:56.593338+0000","last_clean":"2024-09-14T05:58:56.593338+0000","last_became_active":"2024-09-14T05:58:54.099699+0000","last_became_peered":"2024-09-14T05:58:54.099699+0000","last_unstale":"2024-09-14T05:58:56.593338+0000","last_undegraded":"2024-09-14T05:58:56.593338+0000","last_fullsized":"2024-09-14T05:58:56.593338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:40.481832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.102386+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T05:58:56.102386+0000","last_peered":"2024-09-14T05:58:56.102386+0000","last_clean":"2024-09-14T05:58:56.102386+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T05:58:56.102386+0000","last_undegraded":"2024-09-14T05:58:56.102386+0000","last_fullsized":"2024-09-14T05:58:56.102386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.592191+0000","last_change":"2024-09-14T05:58:49.056297+0000","last_active":"2024-09-14T05:58:56.592191+0000","last_peered":"2024-09-14T05:58:56.592191+0000","last_clean":"2024-09-14T05:58:56.592191+0000","last_became_active":"2024-09-14T05:58:49.055520+0000","last_became_peered":"2024-09-14T05:58:49.055520+0000","last_unstale":"2024-09-14T05:58:56.592191+0000","last_undegraded":"2024-09-14T05:58:56.592191+0000","last_fullsized":"2024-09-14T05:58:56.592191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:35.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":815104,"data_stored":666530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":666530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:59:02.256 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T05:59:02.256 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T05:59:02.257 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T05:59:02.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T05:59:02.589 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:59:02.589 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T05:59:02.606 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T05:59:02.607 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-14T05:59:02.618 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-14T05:59:02.618 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache max dirty': 0}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}} 2024-09-14T05:59:02.618 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-14T05:59:02.619 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-14T05:59:02.940 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-14T05:59:02.941 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T05:59:02.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:59:03.246 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:59:03.246 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T05:59:03.265 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T05:59:01.465917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223328,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751392,"statfs":{"total":773094113280,"available":772865425408,"internally_reserved":0,"allocated":2965504,"data_stored":1790070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.380682"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.312544+0000","last_change":"2024-09-14T05:58:56.312544+0000","last_active":"2024-09-14T05:58:56.312544+0000","last_peered":"2024-09-14T05:58:56.312544+0000","last_clean":"2024-09-14T05:58:56.312544+0000","last_became_active":"2024-09-14T05:58:54.103612+0000","last_became_peered":"2024-09-14T05:58:54.103612+0000","last_unstale":"2024-09-14T05:58:56.312544+0000","last_undegraded":"2024-09-14T05:58:56.312544+0000","last_fullsized":"2024-09-14T05:58:56.312544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:08.678742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.095887+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T05:58:56.095887+0000","last_peered":"2024-09-14T05:58:56.095887+0000","last_clean":"2024-09-14T05:58:56.095887+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T05:58:56.095887+0000","last_undegraded":"2024-09-14T05:58:56.095887+0000","last_fullsized":"2024-09-14T05:58:56.095887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.593450+0000","last_change":"2024-09-14T05:58:56.593450+0000","last_active":"2024-09-14T05:58:56.593450+0000","last_peered":"2024-09-14T05:58:56.593450+0000","last_clean":"2024-09-14T05:58:56.593450+0000","last_became_active":"2024-09-14T05:58:54.097887+0000","last_became_peered":"2024-09-14T05:58:54.097887+0000","last_unstale":"2024-09-14T05:58:56.593450+0000","last_undegraded":"2024-09-14T05:58:56.593450+0000","last_fullsized":"2024-09-14T05:58:56.593450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:36.399077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.095812+0000","last_change":"2024-09-14T05:58:56.095812+0000","last_active":"2024-09-14T05:58:56.095812+0000","last_peered":"2024-09-14T05:58:56.095812+0000","last_clean":"2024-09-14T05:58:56.095812+0000","last_became_active":"2024-09-14T05:58:54.089784+0000","last_became_peered":"2024-09-14T05:58:54.089784+0000","last_unstale":"2024-09-14T05:58:56.095812+0000","last_undegraded":"2024-09-14T05:58:56.095812+0000","last_fullsized":"2024-09-14T05:58:56.095812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:00.829944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.105967+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T05:58:56.105967+0000","last_peered":"2024-09-14T05:58:56.105967+0000","last_clean":"2024-09-14T05:58:56.105967+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T05:58:56.105967+0000","last_undegraded":"2024-09-14T05:58:56.105967+0000","last_fullsized":"2024-09-14T05:58:56.105967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.096637+0000","last_change":"2024-09-14T05:58:56.096637+0000","last_active":"2024-09-14T05:58:56.096637+0000","last_peered":"2024-09-14T05:58:56.096637+0000","last_clean":"2024-09-14T05:58:56.096637+0000","last_became_active":"2024-09-14T05:58:54.356560+0000","last_became_peered":"2024-09-14T05:58:54.356560+0000","last_unstale":"2024-09-14T05:58:56.096637+0000","last_undegraded":"2024-09-14T05:58:56.096637+0000","last_fullsized":"2024-09-14T05:58:56.096637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:10.136136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012156140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.593338+0000","last_change":"2024-09-14T05:58:56.593338+0000","last_active":"2024-09-14T05:58:56.593338+0000","last_peered":"2024-09-14T05:58:56.593338+0000","last_clean":"2024-09-14T05:58:56.593338+0000","last_became_active":"2024-09-14T05:58:54.099699+0000","last_became_peered":"2024-09-14T05:58:54.099699+0000","last_unstale":"2024-09-14T05:58:56.593338+0000","last_undegraded":"2024-09-14T05:58:56.593338+0000","last_fullsized":"2024-09-14T05:58:56.593338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:40.481832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.102386+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T05:58:56.102386+0000","last_peered":"2024-09-14T05:58:56.102386+0000","last_clean":"2024-09-14T05:58:56.102386+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T05:58:56.102386+0000","last_undegraded":"2024-09-14T05:58:56.102386+0000","last_fullsized":"2024-09-14T05:58:56.102386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.592191+0000","last_change":"2024-09-14T05:58:49.056297+0000","last_active":"2024-09-14T05:58:56.592191+0000","last_peered":"2024-09-14T05:58:56.592191+0000","last_clean":"2024-09-14T05:58:56.592191+0000","last_became_active":"2024-09-14T05:58:49.055520+0000","last_became_peered":"2024-09-14T05:58:49.055520+0000","last_unstale":"2024-09-14T05:58:56.592191+0000","last_undegraded":"2024-09-14T05:58:56.592191+0000","last_fullsized":"2024-09-14T05:58:56.592191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:35.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":815104,"data_stored":666530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":666530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:59:03.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:59:03.563 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:59:03.564 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T05:59:03.581 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-14T05:59:03.466481+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223328,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751392,"statfs":{"total":773094113280,"available":772865425408,"internally_reserved":0,"allocated":2965504,"data_stored":1790070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.379097"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.312544+0000","last_change":"2024-09-14T05:58:56.312544+0000","last_active":"2024-09-14T05:58:56.312544+0000","last_peered":"2024-09-14T05:58:56.312544+0000","last_clean":"2024-09-14T05:58:56.312544+0000","last_became_active":"2024-09-14T05:58:54.103612+0000","last_became_peered":"2024-09-14T05:58:54.103612+0000","last_unstale":"2024-09-14T05:58:56.312544+0000","last_undegraded":"2024-09-14T05:58:56.312544+0000","last_fullsized":"2024-09-14T05:58:56.312544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:08.678742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.095887+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T05:58:56.095887+0000","last_peered":"2024-09-14T05:58:56.095887+0000","last_clean":"2024-09-14T05:58:56.095887+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T05:58:56.095887+0000","last_undegraded":"2024-09-14T05:58:56.095887+0000","last_fullsized":"2024-09-14T05:58:56.095887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.593450+0000","last_change":"2024-09-14T05:58:56.593450+0000","last_active":"2024-09-14T05:58:56.593450+0000","last_peered":"2024-09-14T05:58:56.593450+0000","last_clean":"2024-09-14T05:58:56.593450+0000","last_became_active":"2024-09-14T05:58:54.097887+0000","last_became_peered":"2024-09-14T05:58:54.097887+0000","last_unstale":"2024-09-14T05:58:56.593450+0000","last_undegraded":"2024-09-14T05:58:56.593450+0000","last_fullsized":"2024-09-14T05:58:56.593450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:36.399077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.095812+0000","last_change":"2024-09-14T05:58:56.095812+0000","last_active":"2024-09-14T05:58:56.095812+0000","last_peered":"2024-09-14T05:58:56.095812+0000","last_clean":"2024-09-14T05:58:56.095812+0000","last_became_active":"2024-09-14T05:58:54.089784+0000","last_became_peered":"2024-09-14T05:58:54.089784+0000","last_unstale":"2024-09-14T05:58:56.095812+0000","last_undegraded":"2024-09-14T05:58:56.095812+0000","last_fullsized":"2024-09-14T05:58:56.095812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:00.829944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.105967+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T05:58:56.105967+0000","last_peered":"2024-09-14T05:58:56.105967+0000","last_clean":"2024-09-14T05:58:56.105967+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T05:58:56.105967+0000","last_undegraded":"2024-09-14T05:58:56.105967+0000","last_fullsized":"2024-09-14T05:58:56.105967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.096637+0000","last_change":"2024-09-14T05:58:56.096637+0000","last_active":"2024-09-14T05:58:56.096637+0000","last_peered":"2024-09-14T05:58:56.096637+0000","last_clean":"2024-09-14T05:58:56.096637+0000","last_became_active":"2024-09-14T05:58:54.356560+0000","last_became_peered":"2024-09-14T05:58:54.356560+0000","last_unstale":"2024-09-14T05:58:56.096637+0000","last_undegraded":"2024-09-14T05:58:56.096637+0000","last_fullsized":"2024-09-14T05:58:56.096637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:10.136136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012156140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.593338+0000","last_change":"2024-09-14T05:58:56.593338+0000","last_active":"2024-09-14T05:58:56.593338+0000","last_peered":"2024-09-14T05:58:56.593338+0000","last_clean":"2024-09-14T05:58:56.593338+0000","last_became_active":"2024-09-14T05:58:54.099699+0000","last_became_peered":"2024-09-14T05:58:54.099699+0000","last_unstale":"2024-09-14T05:58:56.593338+0000","last_undegraded":"2024-09-14T05:58:56.593338+0000","last_fullsized":"2024-09-14T05:58:56.593338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:40.481832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.102386+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T05:58:56.102386+0000","last_peered":"2024-09-14T05:58:56.102386+0000","last_clean":"2024-09-14T05:58:56.102386+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T05:58:56.102386+0000","last_undegraded":"2024-09-14T05:58:56.102386+0000","last_fullsized":"2024-09-14T05:58:56.102386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T05:58:56.592191+0000","last_change":"2024-09-14T05:58:49.056297+0000","last_active":"2024-09-14T05:58:56.592191+0000","last_peered":"2024-09-14T05:58:56.592191+0000","last_clean":"2024-09-14T05:58:56.592191+0000","last_became_active":"2024-09-14T05:58:49.055520+0000","last_became_peered":"2024-09-14T05:58:49.055520+0000","last_unstale":"2024-09-14T05:58:56.592191+0000","last_undegraded":"2024-09-14T05:58:56.592191+0000","last_fullsized":"2024-09-14T05:58:56.592191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:35.956200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":815104,"data_stored":666530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":666530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:59:03.582 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T05:59:03.582 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-14T05:59:03.874 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 22 2024-09-14T05:59:03.874 INFO:teuthology.orchestra.run.smithi006.stdout:fsid 8db933fa-392d-4966-864a-b73b8a91dd2d 2024-09-14T05:59:03.874 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-09-14T05:58:34.536616+0000 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-09-14T05:58:56.083727+0000 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:crush_version 5 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:full_ratio 0.95 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:backfillfull_ratio 0.9 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:nearfull_ratio 0.85 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:require_min_compat_client luminous 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:min_compat_client jewel 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:require_osd_release squid 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:stretch_mode_enabled false 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 22 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout: removed_snaps_queue [2~1] 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:max_osd 8 2024-09-14T05:59:03.875 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6824/4023034827,v1:172.21.15.6:6825/4023034827] [v2:172.21.15.6:6826/4023034827,v1:172.21.15.6:6827/4023034827] exists,up 9ef61ed5-359d-4de3-be54-41d3a66c393a 2024-09-14T05:59:03.876 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6812/1278360579,v1:172.21.15.6:6815/1278360579] [v2:172.21.15.6:6818/1278360579,v1:172.21.15.6:6819/1278360579] exists,up f180c483-9b53-4808-b5ec-537bf956087d 2024-09-14T05:59:03.876 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 up in weight 1 up_from 15 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6808/4171349592,v1:172.21.15.6:6809/4171349592] [v2:172.21.15.6:6810/4171349592,v1:172.21.15.6:6811/4171349592] exists,up bc59bb00-b3b0-4483-a5b1-cc5907cf660a 2024-09-14T05:59:03.876 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6800/3999210088,v1:172.21.15.6:6801/3999210088] [v2:172.21.15.6:6802/3999210088,v1:172.21.15.6:6803/3999210088] exists,up 7aa9fc3b-29c5-4e9a-a894-e2abfb586263 2024-09-14T05:59:03.876 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6824/575863621,v1:172.21.15.154:6825/575863621] [v2:172.21.15.154:6826/575863621,v1:172.21.15.154:6827/575863621] exists,up a0665f54-f53d-4536-a322-4974c2f23aa1 2024-09-14T05:59:03.876 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6808/2498345645,v1:172.21.15.154:6809/2498345645] [v2:172.21.15.154:6810/2498345645,v1:172.21.15.154:6811/2498345645] exists,up 302ab31c-c228-44da-a0d2-58505ad571cf 2024-09-14T05:59:03.876 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6816/267756224,v1:172.21.15.154:6817/267756224] [v2:172.21.15.154:6818/267756224,v1:172.21.15.154:6819/267756224] exists,up 1adbca34-daef-4229-b25e-40dec6800f85 2024-09-14T05:59:03.876 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/4119173763,v1:172.21.15.154:6801/4119173763] [v2:172.21.15.154:6802/4119173763,v1:172.21.15.154:6803/4119173763] exists,up a75d9794-68bf-4e8c-bf75-448a7a783769 2024-09-14T05:59:03.892 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6824/4023034827,v1:172.21.15.6:6825/4023034827] [v2:172.21.15.6:6826/4023034827,v1:172.21.15.6:6827/4023034827] exists,up 9ef61ed5-359d-4de3-be54-41d3a66c393a', 'osd.1 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6812/1278360579,v1:172.21.15.6:6815/1278360579] [v2:172.21.15.6:6818/1278360579,v1:172.21.15.6:6819/1278360579] exists,up f180c483-9b53-4808-b5ec-537bf956087d', 'osd.2 up in weight 1 up_from 15 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6808/4171349592,v1:172.21.15.6:6809/4171349592] [v2:172.21.15.6:6810/4171349592,v1:172.21.15.6:6811/4171349592] exists,up bc59bb00-b3b0-4483-a5b1-cc5907cf660a', 'osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6800/3999210088,v1:172.21.15.6:6801/3999210088] [v2:172.21.15.6:6802/3999210088,v1:172.21.15.6:6803/3999210088] exists,up 7aa9fc3b-29c5-4e9a-a894-e2abfb586263', 'osd.4 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6824/575863621,v1:172.21.15.154:6825/575863621] [v2:172.21.15.154:6826/575863621,v1:172.21.15.154:6827/575863621] exists,up a0665f54-f53d-4536-a322-4974c2f23aa1', 'osd.5 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6808/2498345645,v1:172.21.15.154:6809/2498345645] [v2:172.21.15.154:6810/2498345645,v1:172.21.15.154:6811/2498345645] exists,up 302ab31c-c228-44da-a0d2-58505ad571cf', 'osd.6 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6816/267756224,v1:172.21.15.154:6817/267756224] [v2:172.21.15.154:6818/267756224,v1:172.21.15.154:6819/267756224] exists,up 1adbca34-daef-4229-b25e-40dec6800f85', 'osd.7 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/4119173763,v1:172.21.15.154:6801/4119173763] [v2:172.21.15.154:6802/4119173763,v1:172.21.15.154:6803/4119173763] exists,up a75d9794-68bf-4e8c-bf75-448a7a783769'] 2024-09-14T05:59:03.892 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-14T05:59:04.003 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:04.003 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mon.a", 2024-09-14T05:59:04.003 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster": "ceph", 2024-09-14T05:59:04.003 INFO:teuthology.orchestra.run.smithi006.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-14T05:59:04.003 INFO:teuthology.orchestra.run.smithi006.stdout: "admin_socket_mode": "", 2024-09-14T05:59:04.003 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-14T05:59:04.003 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_client_required": "cephx, none", 2024-09-14T05:59:04.003 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_cluster_required": "cephx", 2024-09-14T05:59:04.003 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_debug": "true", 2024-09-14T05:59:04.004 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-14T05:59:04.004 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-14T05:59:04.004 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_service_required": "cephx", 2024-09-14T05:59:04.004 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-14T05:59:04.004 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_supported": "cephx", 2024-09-14T05:59:04.004 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_aio": "true", 2024-09-14T05:59:04.004 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-14T05:59:04.004 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_aio_poll_ms": "250", 2024-09-14T05:59:04.004 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_aio_reap_max": "16", 2024-09-14T05:59:04.004 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_async_discard_threads": "0", 2024-09-14T05:59:04.004 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_block_size": "4096", 2024-09-14T05:59:04.004 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_debug_aio": "false", 2024-09-14T05:59:04.004 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-14T05:59:04.004 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-14T05:59:04.005 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_debug_inflight_ios": "false", 2024-09-14T05:59:04.005 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_enable_discard": "false", 2024-09-14T05:59:04.005 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_flock_retry": "3", 2024-09-14T05:59:04.005 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-14T05:59:04.005 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_inject_crash": "0", 2024-09-14T05:59:04.005 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-14T05:59:04.005 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_ioring": "false", 2024-09-14T05:59:04.005 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_ioring_hipri": "false", 2024-09-14T05:59:04.005 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-14T05:59:04.005 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-14T05:59:04.005 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-14T05:59:04.005 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-14T05:59:04.006 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-14T05:59:04.006 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-14T05:59:04.006 INFO:teuthology.orchestra.run.smithi006.stdout: "bdev_type": "", 2024-09-14T05:59:04.006 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_alloc_size": "1048576", 2024-09-14T05:59:04.006 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_allocator": "hybrid", 2024-09-14T05:59:04.006 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_buffered_io": "true", 2024-09-14T05:59:04.006 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_check_for_zeros": "false", 2024-09-14T05:59:04.006 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-14T05:59:04.006 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-14T05:59:04.006 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_compact_log_sync": "false", 2024-09-14T05:59:04.006 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-14T05:59:04.006 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-14T05:59:04.007 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-14T05:59:04.007 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-14T05:59:04.007 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_max_log_runway": "4194304", 2024-09-14T05:59:04.007 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_max_prefetch": "1048576", 2024-09-14T05:59:04.007 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_min_flush_size": "524288", 2024-09-14T05:59:04.007 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_min_log_runway": "1048576", 2024-09-14T05:59:04.007 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_replay_recovery": "false", 2024-09-14T05:59:04.007 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-14T05:59:04.007 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-14T05:59:04.007 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_sync_write": "false", 2024-09-14T05:59:04.007 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-14T05:59:04.007 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-14T05:59:04.007 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-14T05:59:04.008 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_allocation_from_file": "true", 2024-09-14T05:59:04.008 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_allocator": "hybrid", 2024-09-14T05:59:04.008 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_async_db_compaction": "true", 2024-09-14T05:59:04.008 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-14T05:59:04.008 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-14T05:59:04.008 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-14T05:59:04.008 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-14T05:59:04.008 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bdev_label_multi": "true", 2024-09-14T05:59:04.008 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-14T05:59:04.008 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-14T05:59:04.008 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-14T05:59:04.008 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-14T05:59:04.008 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-14T05:59:04.008 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_create": "true", 2024-09-14T05:59:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_db_create": "false", 2024-09-14T05:59:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_db_path": "", 2024-09-14T05:59:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_db_size": "0", 2024-09-14T05:59:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_path": "", 2024-09-14T05:59:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_preallocate_file": "false", 2024-09-14T05:59:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_size": "107374182400", 2024-09-14T05:59:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_wal_create": "false", 2024-09-14T05:59:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_wal_path": "", 2024-09-14T05:59:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_block_wal_size": "100663296", 2024-09-14T05:59:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bluefs": "true", 2024-09-14T05:59:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-14T05:59:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-14T05:59:04.009 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-14T05:59:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-14T05:59:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-14T05:59:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T05:59:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T05:59:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-14T05:59:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T05:59:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_autotune": "true", 2024-09-14T05:59:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-14T05:59:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-14T05:59:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-14T05:59:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-14T05:59:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_size": "0", 2024-09-14T05:59:04.010 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-14T05:59:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-14T05:59:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-14T05:59:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-14T05:59:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_type": "2q", 2024-09-14T05:59:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-14T05:59:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_clone_cow": "true", 2024-09-14T05:59:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-14T05:59:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-14T05:59:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-14T05:59:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-14T05:59:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-14T05:59:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-14T05:59:04.011 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-14T05:59:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_mode": "none", 2024-09-14T05:59:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-14T05:59:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_csum_type": "crc32c", 2024-09-14T05:59:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-14T05:59:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-14T05:59:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_freelist": "false", 2024-09-14T05:59:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-14T05:59:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-14T05:59:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-14T05:59:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-14T05:59:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-14T05:59:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-14T05:59:04.012 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-14T05:59:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-14T05:59:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-14T05:59:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-14T05:59:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-14T05:59:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-14T05:59:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_small_allocations": "0", 2024-09-14T05:59:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-14T05:59:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_default_buffered_read": "true", 2024-09-14T05:59:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_default_buffered_write": "false", 2024-09-14T05:59:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-14T05:59:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-14T05:59:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-14T05:59:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-14T05:59:04.013 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-14T05:59:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-14T05:59:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-14T05:59:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-14T05:59:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-14T05:59:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fail_eio": "false", 2024-09-14T05:59:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-14T05:59:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-14T05:59:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-14T05:59:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-14T05:59:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-14T05:59:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-14T05:59:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_on_mount": "false", 2024-09-14T05:59:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-14T05:59:04.014 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_on_umount": "false", 2024-09-14T05:59:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-14T05:59:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-14T05:59:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-14T05:59:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-14T05:59:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-14T05:59:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-14T05:59:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-14T05:59:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-14T05:59:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_ignore_data_csum": "false", 2024-09-14T05:59:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-14T05:59:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-14T05:59:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-14T05:59:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-14T05:59:04.015 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_log_op_age": "5.000000", 2024-09-14T05:59:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_max_alloc_size": "0", 2024-09-14T05:59:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_max_blob_size": "0", 2024-09-14T05:59:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-14T05:59:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-14T05:59:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-14T05:59:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_max_deferred_txc": "32", 2024-09-14T05:59:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_min_alloc_size": "0", 2024-09-14T05:59:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-14T05:59:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-14T05:59:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_nid_prealloc": "1024", 2024-09-14T05:59:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-14T05:59:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-14T05:59:04.016 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-14T05:59:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-14T05:59:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_retry_disk_reads": "3", 2024-09-14T05:59:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_rocksdb_cf": "true", 2024-09-14T05:59:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-14T05:59:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-14T05:59:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-14T05:59:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-14T05:59:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-14T05:59:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-14T05:59:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-14T05:59:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-14T05:59:04.017 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_spdk_mem": "512", 2024-09-14T05:59:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-14T05:59:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-14T05:59:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-14T05:59:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-14T05:59:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-14T05:59:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-14T05:59:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-14T05:59:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_tracing": "false", 2024-09-14T05:59:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-14T05:59:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-14T05:59:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-14T05:59:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-14T05:59:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-14T05:59:04.018 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-14T05:59:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-14T05:59:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-14T05:59:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-14T05:59:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_write_v2": "false", 2024-09-14T05:59:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_write_v2_random": "false", 2024-09-14T05:59:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_zero_block_detection": "false", 2024-09-14T05:59:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-14T05:59:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-14T05:59:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-14T05:59:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-14T05:59:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-14T05:59:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-14T05:59:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-14T05:59:04.019 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-14T05:59:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-14T05:59:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-14T05:59:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-14T05:59:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-14T05:59:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-14T05:59:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-14T05:59:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "cephx_cluster_require_signatures": "false", 2024-09-14T05:59:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "cephx_cluster_require_version": "2", 2024-09-14T05:59:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "cephx_require_signatures": "false", 2024-09-14T05:59:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "cephx_require_version": "2", 2024-09-14T05:59:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "cephx_service_require_signatures": "false", 2024-09-14T05:59:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "cephx_service_require_version": "2", 2024-09-14T05:59:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "cephx_sign_messages": "true", 2024-09-14T05:59:04.020 INFO:teuthology.orchestra.run.smithi006.stdout: "chdir": "", 2024-09-14T05:59:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_acl_type": "", 2024-09-14T05:59:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_asio_thread_count": "2", 2024-09-14T05:59:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_cache_mid": "0.750000", 2024-09-14T05:59:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_cache_size": "16384", 2024-09-14T05:59:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_caps_release_delay": "5", 2024-09-14T05:59:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_check_pool_perm": "true", 2024-09-14T05:59:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-14T05:59:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_debug_force_sync_read": "false", 2024-09-14T05:59:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_debug_getattr_caps": "false", 2024-09-14T05:59:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_debug_inject_features": "", 2024-09-14T05:59:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_debug_inject_tick_delay": "0", 2024-09-14T05:59:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-14T05:59:04.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_die_on_failed_remount": "false", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_dirsize_rbytes": "true", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_force_lazyio": "false", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_fs": "", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_inject_release_failure": "false", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_max_inline_size": "4096", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_mds_namespace": "", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_metadata": "", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_mount_gid": "-1", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_mount_timeout": "300", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_mount_uid": "-1", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_mountpoint": "/", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_notify_timeout": "10", 2024-09-14T05:59:04.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_oc": "true", 2024-09-14T05:59:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_oc_max_dirty": "104857600", 2024-09-14T05:59:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-14T05:59:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_oc_max_objects": "1000", 2024-09-14T05:59:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_oc_size": "209715200", 2024-09-14T05:59:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_oc_target_dirty": "8388608", 2024-09-14T05:59:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_permissions": "true", 2024-09-14T05:59:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_quota": "true", 2024-09-14T05:59:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_quota_df": "true", 2024-09-14T05:59:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_readahead_max_bytes": "0", 2024-09-14T05:59:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_readahead_max_periods": "4", 2024-09-14T05:59:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_readahead_min": "131072", 2024-09-14T05:59:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_reconnect_stale": "false", 2024-09-14T05:59:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_shutdown_timeout": "30", 2024-09-14T05:59:04.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_snapdir": ".snap", 2024-09-14T05:59:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "client_tick_interval": "1", 2024-09-14T05:59:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "client_trace": "", 2024-09-14T05:59:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "client_try_dentry_invalidate": "false", 2024-09-14T05:59:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "client_use_faked_inos": "false", 2024-09-14T05:59:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "client_use_random_mds": "false", 2024-09-14T05:59:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "clog_to_graylog": "false", 2024-09-14T05:59:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-14T05:59:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "clog_to_graylog_port": "12201", 2024-09-14T05:59:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "clog_to_monitors": "default=true", 2024-09-14T05:59:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "clog_to_syslog": "false", 2024-09-14T05:59:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-14T05:59:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "clog_to_syslog_level": "info", 2024-09-14T05:59:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "-", 2024-09-14T05:59:04.024 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_network": "", 2024-09-14T05:59:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_network_interface": "", 2024-09-14T05:59:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "compressor_zlib_isal": "false", 2024-09-14T05:59:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "compressor_zlib_level": "5", 2024-09-14T05:59:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "compressor_zlib_winsize": "-15", 2024-09-14T05:59:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "compressor_zstd_level": "1", 2024-09-14T05:59:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-14T05:59:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-14T05:59:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "crimson_alien_op_num_threads": "6", 2024-09-14T05:59:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-14T05:59:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-14T05:59:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-14T05:59:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "crimson_osd_stat_interval": "0", 2024-09-14T05:59:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "crimson_seastar_cpu_cores": "", 2024-09-14T05:59:04.025 INFO:teuthology.orchestra.run.smithi006.stdout: "crimson_seastar_num_threads": "0", 2024-09-14T05:59:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_location": "", 2024-09-14T05:59:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_location_hook": "", 2024-09-14T05:59:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_location_hook_timeout": "10", 2024-09-14T05:59:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "daemonize": "false", 2024-09-14T05:59:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "daos_pool": "tank", 2024-09-14T05:59:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-14T05:59:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-14T05:59:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-14T05:59:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_alienstore": "0/5", 2024-09-14T05:59:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_allow_any_pool_priority": "false", 2024-09-14T05:59:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_asok": "1/5", 2024-09-14T05:59:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_asok_assert_abort": "false", 2024-09-14T05:59:04.026 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_asserts_on_shutdown": "true", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_auth": "20/20", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_bdev": "1/3", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_bluefs": "1/5", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_bluestore": "1/5", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_buffer": "0/1", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_ceph_dedup": "0/5", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_ceph_exporter": "1/5", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_cephfs_mirror": "0/5", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_cephsqlite": "0/5", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_client": "0/5", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_compressor": "1/5", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_context": "0/1", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_crimson_interrupt": "0/5", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_crush": "1/1", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_crypto": "1/5", 2024-09-14T05:59:04.027 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_cyanstore": "0/5", 2024-09-14T05:59:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_deliberately_leak_memory": "false", 2024-09-14T05:59:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_disable_randomized_ping": "false", 2024-09-14T05:59:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_dpdk": "1/5", 2024-09-14T05:59:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_eventtrace": "1/5", 2024-09-14T05:59:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_filer": "0/1", 2024-09-14T05:59:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_filestore": "1/3", 2024-09-14T05:59:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_finisher": "1/1", 2024-09-14T05:59:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_fuse": "1/5", 2024-09-14T05:59:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_heartbeat_testing_span": "0", 2024-09-14T05:59:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_heartbeatmap": "1/5", 2024-09-14T05:59:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-14T05:59:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_javaclient": "1/5", 2024-09-14T05:59:04.028 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_journal": "1/3", 2024-09-14T05:59:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_journaler": "0/5", 2024-09-14T05:59:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_kstore": "1/5", 2024-09-14T05:59:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_lockdep": "0/1", 2024-09-14T05:59:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mclock": "1/5", 2024-09-14T05:59:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mds": "1/5", 2024-09-14T05:59:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mds_balancer": "1/5", 2024-09-14T05:59:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mds_locker": "1/5", 2024-09-14T05:59:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mds_log": "1/5", 2024-09-14T05:59:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mds_log_expire": "1/5", 2024-09-14T05:59:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mds_migrator": "1/5", 2024-09-14T05:59:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mds_quiesce": "3/5", 2024-09-14T05:59:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_memstore": "1/5", 2024-09-14T05:59:04.029 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mgr": "2/5", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mgrc": "1/5", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_mon": "20/20", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_monc": "0/10", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_ms": "1/1", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_none": "0/5", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_objclass": "0/5", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_objectcacher": "0/5", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_objecter": "0/1", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_optracker": "0/5", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_osd": "1/5", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_paxos": "20/20", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_perfcounter": "1/5", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_prioritycache": "1/5", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rados": "0/5", 2024-09-14T05:59:04.030 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rbd": "0/5", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rbd_mirror": "0/5", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rbd_pwl": "0/5", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rbd_replay": "0/5", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_refs": "0/0", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_reserver": "1/1", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rgw": "1/5", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rgw_access": "1/5", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rgw_datacache": "1/5", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rgw_dbstore": "1/5", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rgw_flight": "1/5", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rgw_notification": "1/5", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rgw_sync": "1/5", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_rocksdb": "4/5", 2024-09-14T05:59:04.031 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore": "0/5", 2024-09-14T05:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_backref": "0/5", 2024-09-14T05:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_cache": "0/5", 2024-09-14T05:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_cleaner": "0/5", 2024-09-14T05:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_device": "0/5", 2024-09-14T05:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_epm": "0/5", 2024-09-14T05:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-14T05:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_journal": "0/5", 2024-09-14T05:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_lba": "0/5", 2024-09-14T05:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_odata": "0/5", 2024-09-14T05:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_omap": "0/5", 2024-09-14T05:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_onode": "0/5", 2024-09-14T05:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_t": "0/5", 2024-09-14T05:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_seastore_tm": "0/5", 2024-09-14T05:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_striper": "0/1", 2024-09-14T05:59:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_test": "0/5", 2024-09-14T05:59:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_throttle": "1/1", 2024-09-14T05:59:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_timer": "0/1", 2024-09-14T05:59:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_tp": "0/5", 2024-09-14T05:59:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "debug_trace": "1/5", 2024-09-14T05:59:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-14T05:59:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "device_failure_prediction_mode": "none", 2024-09-14T05:59:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-14T05:59:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-14T05:59:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "err_to_graylog": "false", 2024-09-14T05:59:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "err_to_journald": "false", 2024-09-14T05:59:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "err_to_stderr": "true", 2024-09-14T05:59:04.033 INFO:teuthology.orchestra.run.smithi006.stdout: "err_to_syslog": "false", 2024-09-14T05:59:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "event_tracing": "false", 2024-09-14T05:59:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "exporter_addr": "0.0.0.0", 2024-09-14T05:59:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "exporter_cert_file": "", 2024-09-14T05:59:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "exporter_http_port": "9926", 2024-09-14T05:59:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "exporter_key_file": "", 2024-09-14T05:59:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "exporter_prio_limit": "5", 2024-09-14T05:59:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-14T05:59:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "exporter_sort_metrics": "true", 2024-09-14T05:59:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "exporter_stats_period": "5", 2024-09-14T05:59:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "fake_statfs_for_testing": "0", 2024-09-14T05:59:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "fatal_signal_handlers": "true", 2024-09-14T05:59:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "filer_max_purge_ops": "10", 2024-09-14T05:59:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "filer_max_truncate_ops": "128", 2024-09-14T05:59:04.034 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_apply_finisher_threads": "1", 2024-09-14T05:59:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_blackhole": "false", 2024-09-14T05:59:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_btrfs_clone_range": "true", 2024-09-14T05:59:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_btrfs_snap": "true", 2024-09-14T05:59:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_caller_concurrency": "10", 2024-09-14T05:59:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_collect_device_partition_information": "true", 2024-09-14T05:59:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_commit_timeout": "600.000000", 2024-09-14T05:59:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_debug_inject_read_err": "false", 2024-09-14T05:59:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_debug_omap_check": "false", 2024-09-14T05:59:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_debug_verify_split": "false", 2024-09-14T05:59:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_dump_file": "", 2024-09-14T05:59:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-14T05:59:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-14T05:59:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_fadvise": "true", 2024-09-14T05:59:04.035 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_fail_eio": "true", 2024-09-14T05:59:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_fd_cache_shards": "16", 2024-09-14T05:59:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_fd_cache_size": "128", 2024-09-14T05:59:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_fiemap": "false", 2024-09-14T05:59:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_fiemap_threshold": "4096", 2024-09-14T05:59:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-14T05:59:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-14T05:59:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_inject_stall": "0", 2024-09-14T05:59:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_journal_parallel": "false", 2024-09-14T05:59:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_journal_trailing": "false", 2024-09-14T05:59:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_journal_writeahead": "false", 2024-09-14T05:59:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_kill_at": "0", 2024-09-14T05:59:04.036 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-14T05:59:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-14T05:59:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-14T05:59:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-14T05:59:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-14T05:59:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattrs": "0", 2024-09-14T05:59:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-14T05:59:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-14T05:59:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-14T05:59:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-14T05:59:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_xattr_value_size": "0", 2024-09-14T05:59:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-14T05:59:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-14T05:59:04.037 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_merge_threshold": "-10", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_odsync_write": "false", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_omap_backend": "rocksdb", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_omap_backend_path": "", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_op_thread_timeout": "60", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_op_threads": "2", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_punch_hole": "false", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-14T05:59:04.038 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-14T05:59:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-14T05:59:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-14T05:59:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-14T05:59:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-14T05:59:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-14T05:59:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_queue_max_ops": "50", 2024-09-14T05:59:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-14T05:59:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_seek_data_hole": "false", 2024-09-14T05:59:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_sloppy_crc": "false", 2024-09-14T05:59:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-14T05:59:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_splice": "false", 2024-09-14T05:59:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_split_multiple": "2", 2024-09-14T05:59:04.039 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_split_rand_factor": "20", 2024-09-14T05:59:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_update_to": "1000", 2024-09-14T05:59:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-14T05:59:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-14T05:59:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-14T05:59:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-14T05:59:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-14T05:59:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-14T05:59:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_enable": "true", 2024-09-14T05:59:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-14T05:59:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-14T05:59:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-14T05:59:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-14T05:59:04.040 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-14T05:59:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-14T05:59:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_xfs_extsize": "false", 2024-09-14T05:59:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "filestore_zfs_snap": "false", 2024-09-14T05:59:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "fio_dir": "/tmp/fio", 2024-09-14T05:59:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "8db933fa-392d-4966-864a-b73b8a91dd2d", 2024-09-14T05:59:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_allow_other": "true", 2024-09-14T05:59:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_atomic_o_trunc": "true", 2024-09-14T05:59:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_big_writes": "true", 2024-09-14T05:59:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_debug": "false", 2024-09-14T05:59:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_default_permissions": "false", 2024-09-14T05:59:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_disable_pagecache": "false", 2024-09-14T05:59:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_max_write": "0", 2024-09-14T05:59:04.041 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_multithreaded": "true", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_require_active_mds": "true", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_set_user_groups": "true", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_splice_move": "true", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_splice_read": "true", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_splice_write": "true", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "fuse_use_invalidate_cb": "true", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "gss_target_name": "ceph", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_file": "", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_inject_failure": "0", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_interval": "5", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "host": "smithi006", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-14T05:59:04.042 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "inject_early_sigterm": "false", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "jaeger_agent_port": "6799", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "jaeger_tracing_enable": "false", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_aio": "true", 2024-09-14T05:59:04.043 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_align_min_size": "65536", 2024-09-14T05:59:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_block_align": "true", 2024-09-14T05:59:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_block_size": "4096", 2024-09-14T05:59:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_dio": "true", 2024-09-14T05:59:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_discard": "false", 2024-09-14T05:59:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_force_aio": "false", 2024-09-14T05:59:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_ignore_corruption": "false", 2024-09-14T05:59:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_max_write_bytes": "10485760", 2024-09-14T05:59:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_max_write_entries": "100", 2024-09-14T05:59:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_replay_from": "0", 2024-09-14T05:59:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-14T05:59:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-14T05:59:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-14T05:59:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-14T05:59:04.044 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_write_header_frequency": "0", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "journal_zero_on_create": "false", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "journaler_prefetch_periods": "10", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "journaler_prezero_periods": "5", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "journaler_write_head_interval": "15", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "keyfile": "", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_backend": "rocksdb", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_default_stripe_size": "65536", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_fsck_on_mount": "false", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_max_bytes": "67108864", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_max_ops": "512", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_nid_prealloc": "1024", 2024-09-14T05:59:04.045 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_onode_map_size": "1024", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_sync_submit_transaction": "false", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "kstore_sync_transaction": "false", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "librados_thread_count": "2", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "lockdep": "false", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "lockdep_force_backtrace": "false", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "log_coarse_timestamps": "true", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "log_flush_on_exit": "false", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "log_graylog_host": "127.0.0.1", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "log_graylog_port": "12201", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "log_max_new": "1000", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "log_max_recent": "10000", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "log_stderr_prefix": "", 2024-09-14T05:59:04.046 INFO:teuthology.orchestra.run.smithi006.stdout: "log_stop_at_utilization": "0.970000", 2024-09-14T05:59:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": "true", 2024-09-14T05:59:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_graylog": "false", 2024-09-14T05:59:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_journald": "false", 2024-09-14T05:59:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_stderr": "false", 2024-09-14T05:59:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_syslog": "false", 2024-09-14T05:59:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "max_rotating_auth_attempts": "10", 2024-09-14T05:59:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-14T05:59:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_action_on_write_error": "1", 2024-09-14T05:59:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_alternate_name_max": "8192", 2024-09-14T05:59:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_asio_thread_count": "2", 2024-09-14T05:59:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_export_pin": "true", 2024-09-14T05:59:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_fragment_dirs": "true", 2024-09-14T05:59:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-14T05:59:04.047 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_fragment_interval": "5", 2024-09-14T05:59:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-14T05:59:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-14T05:59:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_interval": "10", 2024-09-14T05:59:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_max": "-1", 2024-09-14T05:59:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_max_until": "-1", 2024-09-14T05:59:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_merge_size": "50", 2024-09-14T05:59:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_midchunk": "0.300000", 2024-09-14T05:59:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-14T05:59:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_min_start": "0.200000", 2024-09-14T05:59:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_minchunk": "0.001000", 2024-09-14T05:59:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_mode": "0", 2024-09-14T05:59:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_need_max": "1.200000", 2024-09-14T05:59:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_need_min": "0.800000", 2024-09-14T05:59:04.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_overload_epochs": "2", 2024-09-14T05:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-14T05:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-14T05:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_split_bits": "3", 2024-09-14T05:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-14T05:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_split_size": "10000", 2024-09-14T05:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-14T05:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_target_decay": "10.000000", 2024-09-14T05:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-14T05:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_beacon_grace": "15.000000", 2024-09-14T05:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_beacon_interval": "4.000000", 2024-09-14T05:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-14T05:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-14T05:59:04.049 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_mid": "0.700000", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_quiesce_delay": "0", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_release_free_interval": "10", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_reservation": "0.050000", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_trim_interval": "1", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache_trim_threshold": "262144", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_client_prealloc_inos": "1000", 2024-09-14T05:59:04.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-14T05:59:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_connect_bootstrapping": "false", 2024-09-14T05:59:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_damage_table_max_entries": "10000", 2024-09-14T05:59:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-14T05:59:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_debug_auth_pins": "false", 2024-09-14T05:59:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_debug_frag": "false", 2024-09-14T05:59:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_debug_scatterstat": "false", 2024-09-14T05:59:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_debug_subtrees": "false", 2024-09-14T05:59:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_decay_halflife": "5.000000", 2024-09-14T05:59:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_default_dir_hash": "2", 2024-09-14T05:59:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_defer_session_stale": "true", 2024-09-14T05:59:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_deny_all_reconnect": "false", 2024-09-14T05:59:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dir_keys_per_op": "16384", 2024-09-14T05:59:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dir_max_commit_size": "10", 2024-09-14T05:59:04.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dir_max_entries": "0", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dir_prefetch": "true", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dump_cache_on_map": "false", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_early_reply": "true", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_enable_op_tracker": "true", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_enforce_unique_name": "true", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_export_ephemeral_random": "true", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-14T05:59:04.052 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-14T05:59:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-14T05:59:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-14T05:59:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-14T05:59:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-14T05:59:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-14T05:59:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_health_summarize_threshold": "10", 2024-09-14T05:59:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-14T05:59:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-14T05:59:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_inject_health_dummy": "false", 2024-09-14T05:59:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-14T05:59:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_inject_migrator_session_race": "false", 2024-09-14T05:59:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-14T05:59:04.053 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-14T05:59:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-14T05:59:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_join_fs": "", 2024-09-14T05:59:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_journal_format": "1", 2024-09-14T05:59:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-14T05:59:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_create_at": "0", 2024-09-14T05:59:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_dirfrag_at": "0", 2024-09-14T05:59:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_export_at": "0", 2024-09-14T05:59:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_import_at": "0", 2024-09-14T05:59:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_journal_at": "0", 2024-09-14T05:59:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_journal_expire_at": "0", 2024-09-14T05:59:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_journal_replay_at": "0", 2024-09-14T05:59:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_link_at": "0", 2024-09-14T05:59:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_mdstable_at": "0", 2024-09-14T05:59:04.054 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_openc_at": "0", 2024-09-14T05:59:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_rename_at": "0", 2024-09-14T05:59:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_kill_shutdown_at": "0", 2024-09-14T05:59:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_event_large_threshold": "524288", 2024-09-14T05:59:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_events_per_segment": "1024", 2024-09-14T05:59:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-14T05:59:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_max_events": "-1", 2024-09-14T05:59:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_max_segments": "128", 2024-09-14T05:59:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_pause": "false", 2024-09-14T05:59:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_segment_size": "0", 2024-09-14T05:59:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-14T05:59:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-14T05:59:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-14T05:59:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_trim_threshold": "128", 2024-09-14T05:59:04.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-14T05:59:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log_warn_factor": "2.000000", 2024-09-14T05:59:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_caps_per_client": "1048576", 2024-09-14T05:59:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_completed_flushes": "100000", 2024-09-14T05:59:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_completed_requests": "100000", 2024-09-14T05:59:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_export_size": "20971520", 2024-09-14T05:59:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_file_recover": "32", 2024-09-14T05:59:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_purge_files": "64", 2024-09-14T05:59:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_purge_ops": "8192", 2024-09-14T05:59:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-14T05:59:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-14T05:59:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_max_snaps_per_dir": "100", 2024-09-14T05:59:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_metrics_update_interval": "2", 2024-09-14T05:59:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_min_caps_per_client": "100", 2024-09-14T05:59:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_min_caps_working_set": "10000", 2024-09-14T05:59:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-14T05:59:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_numa_node": "-1", 2024-09-14T05:59:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-14T05:59:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_op_complaint_time": "30.000000", 2024-09-14T05:59:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_op_history_duration": "600", 2024-09-14T05:59:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_op_history_size": "20", 2024-09-14T05:59:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_op_history_slow_op_size": "20", 2024-09-14T05:59:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-14T05:59:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_op_log_threshold": "5", 2024-09-14T05:59:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_ping_grace": "15", 2024-09-14T05:59:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_ping_interval": "5", 2024-09-14T05:59:04.057 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-14T05:59:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-14T05:59:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_recall_max_caps": "30000", 2024-09-14T05:59:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-14T05:59:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-14T05:59:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-14T05:59:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_recall_warning_threshold": "262144", 2024-09-14T05:59:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-14T05:59:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_replay_interval": "1.000000", 2024-09-14T05:59:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-14T05:59:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-14T05:59:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_root_ino_gid": "0", 2024-09-14T05:59:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_root_ino_uid": "0", 2024-09-14T05:59:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-14T05:59:04.058 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_scrub_stats_review_period": "1", 2024-09-14T05:59:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-14T05:59:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-14T05:59:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-14T05:59:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-14T05:59:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-14T05:59:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-14T05:59:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-14T05:59:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-14T05:59:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-14T05:59:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-14T05:59:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-14T05:59:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_shutdown_check": "0", 2024-09-14T05:59:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_skip_ino": "0", 2024-09-14T05:59:04.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-14T05:59:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_snap_max_uid": "4294967294", 2024-09-14T05:59:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_snap_min_uid": "0", 2024-09-14T05:59:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_snap_rstat": "false", 2024-09-14T05:59:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_standby_replay_damaged": "false", 2024-09-14T05:59:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_symlink_recovery": "true", 2024-09-14T05:59:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-14T05:59:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_thrash_exports": "0", 2024-09-14T05:59:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_thrash_fragments": "0", 2024-09-14T05:59:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_tick_interval": "5.000000", 2024-09-14T05:59:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_valgrind_exit": "false", 2024-09-14T05:59:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_verify_backtrace": "1", 2024-09-14T05:59:04.060 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_verify_scatter": "false", 2024-09-14T05:59:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-14T05:59:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_wipe_sessions": "false", 2024-09-14T05:59:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool_debug": "false", 2024-09-14T05:59:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-14T05:59:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "memstore_device_bytes": "1073741824", 2024-09-14T05:59:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "memstore_page_set": "false", 2024-09-14T05:59:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "memstore_page_size": "65536", 2024-09-14T05:59:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_client_bytes": "134217728", 2024-09-14T05:59:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_client_messages": "512", 2024-09-14T05:59:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-14T05:59:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-14T05:59:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-14T05:59:04.061 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-14T05:59:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_disabled_modules": "", 2024-09-14T05:59:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_enable_op_tracker": "true", 2024-09-14T05:59:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-14T05:59:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_max_pg_creating": "1024", 2024-09-14T05:59:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_max_pg_num_change": "128", 2024-09-14T05:59:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_mds_bytes": "134217728", 2024-09-14T05:59:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_mds_messages": "128", 2024-09-14T05:59:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-14T05:59:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_mon_bytes": "134217728", 2024-09-14T05:59:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_mon_messages": "128", 2024-09-14T05:59:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-14T05:59:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-14T05:59:04.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_op_history_duration": "600", 2024-09-14T05:59:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_op_history_size": "20", 2024-09-14T05:59:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-14T05:59:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-14T05:59:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_op_log_threshold": "5", 2024-09-14T05:59:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_osd_bytes": "536870912", 2024-09-14T05:59:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_osd_messages": "8192", 2024-09-14T05:59:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_pool": "true", 2024-09-14T05:59:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-14T05:59:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_standby_modules": "true", 2024-09-14T05:59:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_stats_period": "5", 2024-09-14T05:59:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_stats_threshold": "5", 2024-09-14T05:59:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_tick_period": "2", 2024-09-14T05:59:04.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-14T05:59:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-14T05:59:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_allow_pool_delete": "true", 2024-09-14T05:59:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_allow_pool_size_one": "true", 2024-09-14T05:59:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_auth_validate_all_caps": "true", 2024-09-14T05:59:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-14T05:59:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-14T05:59:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_bytes": "104857600", 2024-09-14T05:59:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_directed_command_retry": "5", 2024-09-14T05:59:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-14T05:59:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-14T05:59:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-14T05:59:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-14T05:59:04.064 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_hunt_parallel": "3", 2024-09-14T05:59:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_log_interval": "1.000000", 2024-09-14T05:59:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-14T05:59:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_ping_interval": "10.000000", 2024-09-14T05:59:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-14T05:59:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_client_target_rank": "-1", 2024-09-14T05:59:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-14T05:59:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-14T05:59:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-14T05:59:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_level": "debug", 2024-09-14T05:59:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_file": "true", 2024-09-14T05:59:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-14T05:59:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-14T05:59:04.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-14T05:59:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_journald": "false", 2024-09-14T05:59:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-14T05:59:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-14T05:59:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-14T05:59:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_compact_on_bootstrap": "false", 2024-09-14T05:59:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_compact_on_start": "false", 2024-09-14T05:59:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_compact_on_trim": "true", 2024-09-14T05:59:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-14T05:59:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-14T05:59:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-14T05:59:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_cpu_threads": "4", 2024-09-14T05:59:04.066 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_crush_min_required_version": "hammer", 2024-09-14T05:59:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_daemon_bytes": "419430400", 2024-09-14T05:59:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-14T05:59:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_data_avail_crit": "5", 2024-09-14T05:59:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_data_avail_warn": "5", 2024-09-14T05:59:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_data_size_warn": "16106127360", 2024-09-14T05:59:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-14T05:59:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-14T05:59:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_dump_json": "false", 2024-09-14T05:59:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-14T05:59:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_dump_transactions": "false", 2024-09-14T05:59:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_extra_checks": "false", 2024-09-14T05:59:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-14T05:59:04.067 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-14T05:59:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_no_require_reef": "false", 2024-09-14T05:59:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_no_require_squid": "false", 2024-09-14T05:59:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-14T05:59:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-14T05:59:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-14T05:59:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_down_mkfs_grace": "120", 2024-09-14T05:59:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_down_uptime_grace": "60", 2024-09-14T05:59:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_election_default_strategy": "1", 2024-09-14T05:59:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_election_timeout": "5.000000", 2024-09-14T05:59:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-14T05:59:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_elector_ping_divisor": "2", 2024-09-14T05:59:04.068 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-14T05:59:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_enable_op_tracker": "true", 2024-09-14T05:59:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_fake_pool_delete": "false", 2024-09-14T05:59:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_force_quorum_join": "false", 2024-09-14T05:59:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-14T05:59:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_globalid_prealloc": "10000", 2024-09-14T05:59:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_health_detail_to_clog": "false", 2024-09-14T05:59:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_health_log_update_period": "5", 2024-09-14T05:59:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_health_max_detail": "50", 2024-09-14T05:59:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_health_to_clog": "true", 2024-09-14T05:59:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_health_to_clog_interval": "600", 2024-09-14T05:59:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-14T05:59:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_host": "172.21.15.6,[v2:172.21.15.6:3301,v1:172.21.15.6:6790],172.21.15.154", 2024-09-14T05:59:04.069 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_host_override": "", 2024-09-14T05:59:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_initial_members": "", 2024-09-14T05:59:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-14T05:59:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-14T05:59:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-14T05:59:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-14T05:59:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-14T05:59:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_lease": "5.000000", 2024-09-14T05:59:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-14T05:59:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-14T05:59:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_log_full_interval": "50", 2024-09-14T05:59:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_log_max": "10000", 2024-09-14T05:59:04.070 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_log_max_summary": "50", 2024-09-14T05:59:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-14T05:59:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_log_epochs": "500", 2024-09-14T05:59:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-14T05:59:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-14T05:59:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-14T05:59:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_osd": "10000", 2024-09-14T05:59:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_pg_per_osd": "10000", 2024-09-14T05:59:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_pool_pg_num": "65536", 2024-09-14T05:59:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-14T05:59:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-14T05:59:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mds_force_trim_to": "0", 2024-09-14T05:59:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mds_skip_sanity": "false", 2024-09-14T05:59:04.071 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_memory_autotune": "true", 2024-09-14T05:59:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_memory_target": "2147483648", 2024-09-14T05:59:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mgr_beacon_grace": "30", 2024-09-14T05:59:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-14T05:59:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mgr_digest_period": "5", 2024-09-14T05:59:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mgr_inactive_grace": "60", 2024-09-14T05:59:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-14T05:59:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-14T05:59:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_min_osdmap_epochs": "500", 2024-09-14T05:59:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-14T05:59:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-14T05:59:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_op_complaint_time": "30", 2024-09-14T05:59:04.072 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_op_history_duration": "600", 2024-09-14T05:59:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_op_history_size": "20", 2024-09-14T05:59:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_op_history_slow_op_size": "20", 2024-09-14T05:59:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-14T05:59:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_op_log_threshold": "5", 2024-09-14T05:59:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-14T05:59:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-14T05:59:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-14T05:59:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_auto_mark_in": "false", 2024-09-14T05:59:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-14T05:59:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-14T05:59:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-14T05:59:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_cache_size": "500", 2024-09-14T05:59:04.073 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-14T05:59:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-14T05:59:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-14T05:59:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_down_out_interval": "600", 2024-09-14T05:59:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-14T05:59:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-14T05:59:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_force_trim_to": "0", 2024-09-14T05:59:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-14T05:59:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-14T05:59:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-14T05:59:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-14T05:59:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-14T05:59:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-14T05:59:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-14T05:59:04.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_min_down_reporters": "2", 2024-09-14T05:59:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-14T05:59:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-14T05:59:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-14T05:59:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-14T05:59:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-14T05:59:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-14T05:59:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_report_timeout": "900", 2024-09-14T05:59:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-14T05:59:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-14T05:59:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-14T05:59:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-14T05:59:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-14T05:59:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-14T05:59:04.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-14T05:59:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-14T05:59:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-14T05:59:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pg_stuck_threshold": "60", 2024-09-14T05:59:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-14T05:59:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-14T05:59:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-14T05:59:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-14T05:59:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-14T05:59:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-14T05:59:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_probe_timeout": "2.000000", 2024-09-14T05:59:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_reweight_max_change": "0.050000", 2024-09-14T05:59:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_reweight_max_osds": "4", 2024-09-14T05:59:04.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-14T05:59:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-14T05:59:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-14T05:59:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-14T05:59:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-14T05:59:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_scrub_interval": "86400", 2024-09-14T05:59:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_scrub_max_keys": "100", 2024-09-14T05:59:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_scrub_timeout": "300", 2024-09-14T05:59:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_session_timeout": "300", 2024-09-14T05:59:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_smart_report_timeout": "5", 2024-09-14T05:59:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_stat_smooth_intervals": "6", 2024-09-14T05:59:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-14T05:59:04.077 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_stretch_pool_min_size": "2", 2024-09-14T05:59:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_stretch_pool_size": "4", 2024-09-14T05:59:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-14T05:59:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-14T05:59:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_sync_debug": "false", 2024-09-14T05:59:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-14T05:59:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-14T05:59:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_sync_provider_kill_at": "0", 2024-09-14T05:59:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_sync_requester_kill_at": "0", 2024-09-14T05:59:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_sync_timeout": "60.000000", 2024-09-14T05:59:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_target_pg_per_osd": "100", 2024-09-14T05:59:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_tick_interval": "5", 2024-09-14T05:59:04.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_timecheck_interval": "300.000000", 2024-09-14T05:59:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-14T05:59:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_use_min_delay_socket": "false", 2024-09-14T05:59:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_older_version_delay": "604800", 2024-09-14T05:59:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-14T05:59:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-14T05:59:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-14T05:59:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-14T05:59:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-14T05:59:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-14T05:59:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-14T05:59:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_misplaced": "false", 2024-09-14T05:59:04.079 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-14T05:59:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_older_version": "true", 2024-09-14T05:59:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-14T05:59:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-14T05:59:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-14T05:59:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-14T05:59:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-14T05:59:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-14T05:59:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-14T05:59:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-14T05:59:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-14T05:59:04.080 INFO:teuthology.orchestra.run.smithi006.stdout: "monmap": "", 2024-09-14T05:59:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-14T05:59:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-14T05:59:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-14T05:59:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-14T05:59:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-14T05:59:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-14T05:59:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "motr_tracing_enabled": "false", 2024-09-14T05:59:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_op_threads": "3", 2024-09-14T05:59:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-14T05:59:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_cm": "false", 2024-09-14T05:59:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_device_name": "", 2024-09-14T05:59:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_dscp": "96", 2024-09-14T05:59:04.081 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-14T05:59:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-14T05:59:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_local_gid": "", 2024-09-14T05:59:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-14T05:59:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_port_num": "1", 2024-09-14T05:59:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-14T05:59:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-14T05:59:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-14T05:59:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-14T05:59:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_sl": "3", 2024-09-14T05:59:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_support_srq": "true", 2024-09-14T05:59:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_rdma_type": "ib", 2024-09-14T05:59:04.082 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_async_reap_threshold": "5", 2024-09-14T05:59:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_before_connect": "false", 2024-09-14T05:59:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_ipv4": "true", 2024-09-14T05:59:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_ipv6": "false", 2024-09-14T05:59:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_msgr1": "true", 2024-09-14T05:59:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_msgr2": "true", 2024-09-14T05:59:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_port_max": "7568", 2024-09-14T05:59:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_port_min": "6800", 2024-09-14T05:59:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-14T05:59:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_retry_count": "3", 2024-09-14T05:59:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_bind_retry_delay": "5", 2024-09-14T05:59:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_blackhole_client": "false", 2024-09-14T05:59:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_blackhole_mds": "false", 2024-09-14T05:59:04.083 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_blackhole_mgr": "false", 2024-09-14T05:59:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_blackhole_mon": "false", 2024-09-14T05:59:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_blackhole_osd": "false", 2024-09-14T05:59:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_client_mode": "crc secure", 2024-09-14T05:59:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-14T05:59:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_cluster_mode": "crc secure", 2024-09-14T05:59:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_cluster_type": "", 2024-09-14T05:59:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_compress_secure": "false", 2024-09-14T05:59:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_connection_idle_timeout": "900", 2024-09-14T05:59:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_connection_ready_timeout": "10", 2024-09-14T05:59:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_crc_data": "true", 2024-09-14T05:59:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_crc_header": "true", 2024-09-14T05:59:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_die_on_bad_msg": "false", 2024-09-14T05:59:04.084 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_die_on_bug": "true", 2024-09-14T05:59:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_die_on_old_message": "true", 2024-09-14T05:59:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_die_on_skipped_message": "false", 2024-09-14T05:59:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-14T05:59:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-14T05:59:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_coremask": "0xF", 2024-09-14T05:59:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-14T05:59:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-14T05:59:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_enable_tso": "true", 2024-09-14T05:59:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-14T05:59:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-14T05:59:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_hugepages": "", 2024-09-14T05:59:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-14T05:59:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-14T05:59:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_lro": "true", 2024-09-14T05:59:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_memory_channel": "4", 2024-09-14T05:59:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-14T05:59:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_pmd": "", 2024-09-14T05:59:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_port_id": "0", 2024-09-14T05:59:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-14T05:59:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-14T05:59:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_dump_on_send": "false", 2024-09-14T05:59:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_initial_backoff": "0.200000", 2024-09-14T05:59:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_inject_delay_max": "1.000000", 2024-09-14T05:59:04.086 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-14T05:59:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_inject_delay_type": "", 2024-09-14T05:59:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-14T05:59:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_inject_network_congestion": "0", 2024-09-14T05:59:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_inject_socket_failures": "5000", 2024-09-14T05:59:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_learn_addr_from_peer": "true", 2024-09-14T05:59:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_max_accept_failures": "4", 2024-09-14T05:59:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_max_backoff": "15.000000", 2024-09-14T05:59:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_mon_client_mode": "secure crc", 2024-09-14T05:59:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-14T05:59:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_mon_service_mode": "secure crc", 2024-09-14T05:59:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_osd_compress_min_size": "1024", 2024-09-14T05:59:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_osd_compress_mode": "none", 2024-09-14T05:59:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-14T05:59:04.087 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-14T05:59:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_pq_min_cost": "65536", 2024-09-14T05:59:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_public_type": "", 2024-09-14T05:59:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_service_mode": "crc secure", 2024-09-14T05:59:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_tcp_listen_backlog": "512", 2024-09-14T05:59:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_tcp_nodelay": "true", 2024-09-14T05:59:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-14T05:59:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_tcp_rcvbuf": "0", 2024-09-14T05:59:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-14T05:59:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "ms_type": "async+posix", 2024-09-14T05:59:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "no_config_file": "false", 2024-09-14T05:59:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-14T05:59:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-14T05:59:04.088 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_completion_locks_per_session": "32", 2024-09-14T05:59:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-14T05:59:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-14T05:59:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_inflight_ops": "1024", 2024-09-14T05:59:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-14T05:59:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-14T05:59:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_tick_interval": "5.000000", 2024-09-14T05:59:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter_timeout": "10.000000", 2024-09-14T05:59:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "objectstore_blackhole": "false", 2024-09-14T05:59:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-14T05:59:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "openssl_engine_opts": "", 2024-09-14T05:59:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_agent_delay_time": "5.000000", 2024-09-14T05:59:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_agent_hist_halflife": "1000", 2024-09-14T05:59:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_agent_max_low_ops": "2", 2024-09-14T05:59:04.089 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_agent_max_ops": "4", 2024-09-14T05:59:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-14T05:59:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-14T05:59:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_agent_slop": "0.020000", 2024-09-14T05:59:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-14T05:59:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-14T05:59:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_asio_thread_count": "2", 2024-09-14T05:59:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_async_recovery_min_cost": "100", 2024-09-14T05:59:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-14T05:59:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-14T05:59:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_backfill_scan_max": "512", 2024-09-14T05:59:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_backfill_scan_min": "64", 2024-09-14T05:59:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_backoff_on_degraded": "false", 2024-09-14T05:59:04.090 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_backoff_on_peering": "false", 2024-09-14T05:59:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_backoff_on_unfound": "true", 2024-09-14T05:59:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_beacon_report_interval": "300", 2024-09-14T05:59:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bench_duration": "30", 2024-09-14T05:59:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-14T05:59:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bench_max_block_size": "67108864", 2024-09-14T05:59:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-14T05:59:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_blkin_trace_all": "false", 2024-09-14T05:59:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-14T05:59:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-14T05:59:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-14T05:59:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-14T05:59:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_check_for_log_corruption": "false", 2024-09-14T05:59:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-14T05:59:04.091 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-14T05:59:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-14T05:59:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-14T05:59:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_class_update_on_start": "true", 2024-09-14T05:59:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_client_message_cap": "256", 2024-09-14T05:59:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_client_message_size_cap": "524288000", 2024-09-14T05:59:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_client_op_priority": "63", 2024-09-14T05:59:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_client_watch_timeout": "30", 2024-09-14T05:59:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_command_max_records": "256", 2024-09-14T05:59:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_compact_on_start": "false", 2024-09-14T05:59:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-14T05:59:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-14T05:59:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-14T05:59:04.092 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_crush_update_on_start": "true", 2024-09-14T05:59:04.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_crush_update_weight_set": "true", 2024-09-14T05:59:04.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-14T05:59:04.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-14T05:59:04.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-14T05:59:04.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-14T05:59:04.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-14T05:59:04.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_feed_pullee": "-1", 2024-09-14T05:59:04.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-14T05:59:04.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-14T05:59:04.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-14T05:59:04.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_misdirected_ops": "false", 2024-09-14T05:59:04.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_no_acting_change": "false", 2024-09-14T05:59:04.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_no_purge_strays": "false", 2024-09-14T05:59:04.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_op_order": "false", 2024-09-14T05:59:04.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-14T05:59:04.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-14T05:59:04.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-14T05:59:04.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-14T05:59:04.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_shutdown": "false", 2024-09-14T05:59:04.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-14T05:59:04.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-14T05:59:04.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_trim_objects": "false", 2024-09-14T05:59:04.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-14T05:59:04.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-14T05:59:04.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_verify_snaps": "false", 2024-09-14T05:59:04.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-14T05:59:04.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-14T05:59:04.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_deep_scrub_keys": "1024", 2024-09-14T05:59:04.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-14T05:59:04.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-14T05:59:04.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-14T05:59:04.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_deep_scrub_stride": "524288", 2024-09-14T05:59:04.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-14T05:59:04.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-14T05:59:04.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_default_notify_timeout": "30", 2024-09-14T05:59:04.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_delete_sleep": "0.000000", 2024-09-14T05:59:04.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-14T05:59:04.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-14T05:59:04.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-14T05:59:04.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_discard_disconnected_ops": "true", 2024-09-14T05:59:04.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ec_partial_reads": "true", 2024-09-14T05:59:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_enable_op_tracker": "true", 2024-09-14T05:59:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-14T05:59:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-14T05:59:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-14T05:59:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-14T05:59:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_fast_info": "true", 2024-09-14T05:59:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_fast_shutdown": "true", 2024-09-14T05:59:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-14T05:59:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-14T05:59:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-14T05:59:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-14T05:59:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-14T05:59:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_function_tracing": "false", 2024-09-14T05:59:04.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_heartbeat_grace": "20", 2024-09-14T05:59:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_heartbeat_interval": "6", 2024-09-14T05:59:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-14T05:59:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_heartbeat_min_peers": "10", 2024-09-14T05:59:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_heartbeat_min_size": "2000", 2024-09-14T05:59:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_heartbeat_stale": "600", 2024-09-14T05:59:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-14T05:59:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_hit_set_max_size": "100000", 2024-09-14T05:59:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_hit_set_min_size": "1000", 2024-09-14T05:59:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-14T05:59:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-14T05:59:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-14T05:59:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-14T05:59:04.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-14T05:59:04.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-14T05:59:04.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_journal_size": "5120", 2024-09-14T05:59:04.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_kill_backfill_at": "0", 2024-09-14T05:59:04.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-14T05:59:04.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_map_cache_size": "50", 2024-09-14T05:59:04.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_map_dedup": "true", 2024-09-14T05:59:04.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_map_message_max": "40", 2024-09-14T05:59:04.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-14T05:59:04.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_map_share_max_epochs": "40", 2024-09-14T05:59:04.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_attr_name_len": "100", 2024-09-14T05:59:04.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_attr_size": "0", 2024-09-14T05:59:04.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_backfills": "1", 2024-09-14T05:59:04.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_markdown_count": "5", 2024-09-14T05:59:04.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_markdown_period": "600", 2024-09-14T05:59:04.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_object_name_len": "2048", 2024-09-14T05:59:04.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_object_namespace_len": "256", 2024-09-14T05:59:04.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_object_size": "134217728", 2024-09-14T05:59:04.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-14T05:59:04.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-14T05:59:04.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_pg_blocked_by": "16", 2024-09-14T05:59:04.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_pg_log_entries": "10000", 2024-09-14T05:59:04.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-14T05:59:04.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_pgls": "1024", 2024-09-14T05:59:04.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_push_cost": "8388608", 2024-09-14T05:59:04.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_push_objects": "10", 2024-09-14T05:59:04.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_scrubs": "3", 2024-09-14T05:59:04.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-14T05:59:04.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_trimming_pgs": "2", 2024-09-14T05:59:04.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_write_op_reply_len": "64", 2024-09-14T05:59:04.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_max_write_size": "90", 2024-09-14T05:59:04.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-14T05:59:04.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-14T05:59:04.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-14T05:59:04.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-14T05:59:04.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-14T05:59:04.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-14T05:59:04.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-14T05:59:04.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-14T05:59:04.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_profile": "balanced", 2024-09-14T05:59:04.100 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-14T05:59:04.101 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-14T05:59:04.101 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-14T05:59:04.101 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-14T05:59:04.101 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-14T05:59:04.101 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-14T05:59:04.101 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-14T05:59:04.101 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-14T05:59:04.101 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-14T05:59:04.101 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-14T05:59:04.101 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-14T05:59:04.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_memory_base": "805306368", 2024-09-14T05:59:04.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_memory_cache_min": "134217728", 2024-09-14T05:59:04.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-14T05:59:04.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-14T05:59:04.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_memory_target": "4294967296", 2024-09-14T05:59:04.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_memory_target_autotune": "false", 2024-09-14T05:59:04.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-14T05:59:04.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_min_pg_log_entries": "250", 2024-09-14T05:59:04.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_min_recovery_priority": "0", 2024-09-14T05:59:04.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-14T05:59:04.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-14T05:59:04.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mon_report_interval": "5", 2024-09-14T05:59:04.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-14T05:59:04.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-14T05:59:04.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_num_cache_shards": "32", 2024-09-14T05:59:04.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_num_op_tracker_shard": "32", 2024-09-14T05:59:04.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_numa_auto_affinity": "true", 2024-09-14T05:59:04.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_numa_node": "-1", 2024-09-14T05:59:04.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_numa_prefer_iface": "true", 2024-09-14T05:59:04.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-14T05:59:04.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_objecter_finishers": "1", 2024-09-14T05:59:04.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_objectstore": "bluestore", 2024-09-14T05:59:04.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_objectstore_fuse": "false", 2024-09-14T05:59:04.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-14T05:59:04.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_objectstore_tracing": "false", 2024-09-14T05:59:04.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_complaint_time": "30.000000", 2024-09-14T05:59:04.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_history_duration": "600", 2024-09-14T05:59:04.103 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_history_size": "20", 2024-09-14T05:59:04.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_history_slow_op_size": "20", 2024-09-14T05:59:04.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-14T05:59:04.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_log_threshold": "5", 2024-09-14T05:59:04.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_num_shards": "0", 2024-09-14T05:59:04.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_num_shards_hdd": "5", 2024-09-14T05:59:04.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_num_shards_ssd": "8", 2024-09-14T05:59:04.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-14T05:59:04.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-14T05:59:04.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-14T05:59:04.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-14T05:59:04.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_pq_min_cost": "65536", 2024-09-14T05:59:04.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-14T05:59:04.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_queue_cut_off": "high", 2024-09-14T05:59:04.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-14T05:59:04.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_op_thread_timeout": "15", 2024-09-14T05:59:04.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_open_classes_on_start": "true", 2024-09-14T05:59:04.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_os_flags": "0", 2024-09-14T05:59:04.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_peering_op_priority": "255", 2024-09-14T05:59:04.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_delete_cost": "1048576", 2024-09-14T05:59:04.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_delete_priority": "5", 2024-09-14T05:59:04.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-14T05:59:04.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-14T05:59:04.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-14T05:59:04.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_log_trim_max": "10000", 2024-09-14T05:59:04.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_log_trim_min": "100", 2024-09-14T05:59:04.105 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-14T05:59:04.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-14T05:59:04.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-14T05:59:04.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-14T05:59:04.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-14T05:59:04.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-14T05:59:04.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-14T05:59:04.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-14T05:59:04.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-14T05:59:04.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-14T05:59:04.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_crimson": "false", 2024-09-14T05:59:04.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-14T05:59:04.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-14T05:59:04.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-14T05:59:04.107 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-14T05:59:04.107 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-14T05:59:04.107 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-14T05:59:04.107 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-14T05:59:04.107 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-14T05:59:04.107 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_flags": "0", 2024-09-14T05:59:04.107 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-14T05:59:04.107 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_min_size": "0", 2024-09-14T05:59:04.107 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-14T05:59:04.107 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_pg_num": "32", 2024-09-14T05:59:04.107 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_pgp_num": "0", 2024-09-14T05:59:04.107 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-14T05:59:04.107 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_read_ratio": "70", 2024-09-14T05:59:04.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_size": "2", 2024-09-14T05:59:04.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_default_type": "replicated", 2024-09-14T05:59:04.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-14T05:59:04.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-14T05:59:04.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_push_per_object_cost": "1000", 2024-09-14T05:59:04.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-14T05:59:04.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recover_clone_overlap": "true", 2024-09-14T05:59:04.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-14T05:59:04.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_cost": "20971520", 2024-09-14T05:59:04.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-14T05:59:04.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_max_active": "0", 2024-09-14T05:59:04.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-14T05:59:04.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-14T05:59:04.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-14T05:59:04.109 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-14T05:59:04.109 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_max_single_start": "1", 2024-09-14T05:59:04.109 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_op_priority": "3", 2024-09-14T05:59:04.109 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-14T05:59:04.109 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_priority": "5", 2024-09-14T05:59:04.109 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-14T05:59:04.109 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_sleep": "0.000000", 2024-09-14T05:59:04.109 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-14T05:59:04.109 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-14T05:59:04.109 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-14T05:59:04.109 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_repair_during_recovery": "false", 2024-09-14T05:59:04.109 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_requested_scrub_priority": "120", 2024-09-14T05:59:04.109 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-14T05:59:04.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-14T05:59:04.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_auto_repair": "false", 2024-09-14T05:59:04.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-14T05:59:04.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-14T05:59:04.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_begin_hour": "0", 2024-09-14T05:59:04.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_begin_week_day": "0", 2024-09-14T05:59:04.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_chunk_max": "25", 2024-09-14T05:59:04.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_chunk_min": "5", 2024-09-14T05:59:04.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_cost": "52428800", 2024-09-14T05:59:04.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-14T05:59:04.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_during_recovery": "false", 2024-09-14T05:59:04.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_end_hour": "0", 2024-09-14T05:59:04.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_end_week_day": "0", 2024-09-14T05:59:04.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_event_cost": "4096", 2024-09-14T05:59:04.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-14T05:59:04.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-14T05:59:04.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_invalid_stats": "true", 2024-09-14T05:59:04.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-14T05:59:04.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-14T05:59:04.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_max_preemptions": "5", 2024-09-14T05:59:04.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-14T05:59:04.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_priority": "5", 2024-09-14T05:59:04.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_scrub_sleep": "0.000000", 2024-09-14T05:59:04.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-14T05:59:04.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-14T05:59:04.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-14T05:59:04.112 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-14T05:59:04.112 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_skip_data_digest": "false", 2024-09-14T05:59:04.112 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_smart_report_timeout": "5", 2024-09-14T05:59:04.112 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_snap_trim_cost": "1048576", 2024-09-14T05:59:04.112 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_snap_trim_priority": "5", 2024-09-14T05:59:04.112 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-14T05:59:04.112 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-14T05:59:04.112 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-14T05:59:04.112 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-14T05:59:04.112 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-14T05:59:04.112 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-14T05:59:04.112 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-14T05:59:04.112 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_target_transaction_size": "30", 2024-09-14T05:59:04.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-14T05:59:04.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-14T05:59:04.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-14T05:59:04.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-14T05:59:04.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-14T05:59:04.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-14T05:59:04.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-14T05:59:04.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-14T05:59:04.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-14T05:59:04.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-14T05:59:04.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_tracing": "false", 2024-09-14T05:59:04.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_use_stale_snap": "false", 2024-09-14T05:59:04.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-14T05:59:04.114 INFO:teuthology.orchestra.run.smithi006.stdout: "osdc_blkin_trace_all": "false", 2024-09-14T05:59:04.114 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_kill_at": "0", 2024-09-14T05:59:04.114 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_max_join_drift": "10", 2024-09-14T05:59:04.114 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_min": "500", 2024-09-14T05:59:04.114 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_min_wait": "0.050000", 2024-09-14T05:59:04.114 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_propose_interval": "1.000000", 2024-09-14T05:59:04.114 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_service_trim_max": "500", 2024-09-14T05:59:04.114 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-14T05:59:04.114 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_service_trim_min": "250", 2024-09-14T05:59:04.114 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_stash_full_interval": "25", 2024-09-14T05:59:04.114 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_trim_max": "500", 2024-09-14T05:59:04.114 INFO:teuthology.orchestra.run.smithi006.stdout: "paxos_trim_min": "250", 2024-09-14T05:59:04.114 INFO:teuthology.orchestra.run.smithi006.stdout: "perf": "true", 2024-09-14T05:59:04.114 INFO:teuthology.orchestra.run.smithi006.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-14T05:59:04.115 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-14T05:59:04.115 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-14T05:59:04.115 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "-", 2024-09-14T05:59:04.115 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrv": "", 2024-09-14T05:59:04.115 INFO:teuthology.orchestra.run.smithi006.stdout: "public_bind_addr": "-", 2024-09-14T05:59:04.115 INFO:teuthology.orchestra.run.smithi006.stdout: "public_network": "", 2024-09-14T05:59:04.115 INFO:teuthology.orchestra.run.smithi006.stdout: "public_network_interface": "", 2024-09-14T05:59:04.115 INFO:teuthology.orchestra.run.smithi006.stdout: "qat_compressor_busy_polling": "false", 2024-09-14T05:59:04.115 INFO:teuthology.orchestra.run.smithi006.stdout: "qat_compressor_enabled": "false", 2024-09-14T05:59:04.115 INFO:teuthology.orchestra.run.smithi006.stdout: "qat_compressor_session_max_number": "256", 2024-09-14T05:59:04.115 INFO:teuthology.orchestra.run.smithi006.stdout: "rados_mon_op_timeout": "0", 2024-09-14T05:59:04.115 INFO:teuthology.orchestra.run.smithi006.stdout: "rados_osd_op_timeout": "0", 2024-09-14T05:59:04.115 INFO:teuthology.orchestra.run.smithi006.stdout: "rados_tracing": "false", 2024-09-14T05:59:04.115 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_atime_update_interval": "60", 2024-09-14T05:59:04.116 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-14T05:59:04.116 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_balance_parent_reads": "false", 2024-09-14T05:59:04.116 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_balance_snap_reads": "false", 2024-09-14T05:59:04.116 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_blkin_trace_all": "false", 2024-09-14T05:59:04.116 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-14T05:59:04.116 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-14T05:59:04.116 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache": "true", 2024-09-14T05:59:04.116 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-14T05:59:04.116 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-14T05:59:04.116 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-14T05:59:04.116 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-14T05:59:04.116 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_policy": "writearound", 2024-09-14T05:59:04.116 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_size": "33554432", 2024-09-14T05:59:04.117 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-14T05:59:04.117 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-14T05:59:04.117 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_clone_copy_on_read": "false", 2024-09-14T05:59:04.117 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_compression_hint": "none", 2024-09-14T05:59:04.117 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_concurrent_management_ops": "10", 2024-09-14T05:59:04.117 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-14T05:59:04.117 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_clone_format": "auto", 2024-09-14T05:59:04.117 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_data_pool": "", 2024-09-14T05:59:04.117 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_features": "61", 2024-09-14T05:59:04.117 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_format": "2", 2024-09-14T05:59:04.117 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_map_options": "", 2024-09-14T05:59:04.117 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_order": "22", 2024-09-14T05:59:04.117 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_pool": "rbd", 2024-09-14T05:59:04.118 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-14T05:59:04.118 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_stripe_count": "0", 2024-09-14T05:59:04.118 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_default_stripe_unit": "0", 2024-09-14T05:59:04.118 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-14T05:59:04.118 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-14T05:59:04.118 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-14T05:59:04.118 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_enable_alloc_hint": "true", 2024-09-14T05:59:04.118 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-14T05:59:04.118 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_io_scheduler": "simple", 2024-09-14T05:59:04.118 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-14T05:59:04.118 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-14T05:59:04.118 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-14T05:59:04.118 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_order": "24", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_pool": "", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_journal_splay_width": "4", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_localize_parent_reads": "false", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_localize_snap_reads": "false", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-14T05:59:04.119 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-14T05:59:04.120 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-14T05:59:04.120 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-14T05:59:04.120 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-14T05:59:04.120 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-14T05:59:04.120 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-14T05:59:04.120 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-14T05:59:04.120 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-14T05:59:04.120 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-14T05:59:04.120 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-14T05:59:04.120 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-14T05:59:04.120 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-14T05:59:04.120 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-14T05:59:04.120 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-14T05:59:04.121 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-14T05:59:04.121 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-14T05:59:04.121 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-14T05:59:04.121 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-14T05:59:04.121 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-14T05:59:04.121 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-14T05:59:04.121 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-14T05:59:04.121 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-14T05:59:04.121 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-14T05:59:04.121 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-14T05:59:04.121 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-14T05:59:04.121 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-14T05:59:04.122 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-14T05:59:04.122 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_mtime_update_interval": "60", 2024-09-14T05:59:04.122 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_non_blocking_aio": "true", 2024-09-14T05:59:04.122 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_op_thread_timeout": "60", 2024-09-14T05:59:04.122 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_op_threads": "1", 2024-09-14T05:59:04.122 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_parent_cache_enabled": "false", 2024-09-14T05:59:04.122 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-14T05:59:04.122 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-14T05:59:04.122 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-14T05:59:04.122 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_plugins": "", 2024-09-14T05:59:04.122 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_bps_burst": "0", 2024-09-14T05:59:04.122 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-14T05:59:04.122 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_bps_limit": "0", 2024-09-14T05:59:04.122 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_exclude_ops": "0", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_iops_burst": "0", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_iops_limit": "0", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-14T05:59:04.123 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-14T05:59:04.124 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-14T05:59:04.124 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-14T05:59:04.124 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_read_from_replica_policy": "default", 2024-09-14T05:59:04.124 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-14T05:59:04.124 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-14T05:59:04.124 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-14T05:59:04.124 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-14T05:59:04.124 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_skip_partial_discard": "true", 2024-09-14T05:59:04.124 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-14T05:59:04.124 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_tracing": "false", 2024-09-14T05:59:04.124 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_validate_names": "true", 2024-09-14T05:59:04.124 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_validate_pool": "true", 2024-09-14T05:59:04.124 INFO:teuthology.orchestra.run.smithi006.stdout: "restapi_base_url": "", 2024-09-14T05:59:04.125 INFO:teuthology.orchestra.run.smithi006.stdout: "restapi_log_level": "", 2024-09-14T05:59:04.125 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-14T05:59:04.125 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-14T05:59:04.125 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_acl_grants_max_num": "100", 2024-09-14T05:59:04.125 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_admin_entry": "admin", 2024-09-14T05:59:04.125 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-14T05:59:04.125 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_asio_assert_yielding": "false", 2024-09-14T05:59:04.125 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_backend_store": "rados", 2024-09-14T05:59:04.125 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_barbican_url": "", 2024-09-14T05:59:04.125 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_beast_enable_async": "true", 2024-09-14T05:59:04.125 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_bucket_counters_cache": "false", 2024-09-14T05:59:04.125 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-14T05:59:04.125 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_cache_enabled": "true", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_cache_expiry_interval": "900", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_cache_lru_size": "25000", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_config_store": "rados", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_content_length_compat": "false", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_copy_obj_progress": "true", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_cors_rules_max_num": "100", 2024-09-14T05:59:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_cross_domain_policy": "", 2024-09-14T05:59:04.127 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-14T05:59:04.127 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_addr": "", 2024-09-14T05:59:04.127 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-14T05:59:04.127 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-14T05:59:04.127 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-14T05:59:04.127 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-14T05:59:04.127 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_password": "", 2024-09-14T05:59:04.127 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-14T05:59:04.127 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_kmip_username": "", 2024-09-14T05:59:04.127 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_require_ssl": "true", 2024-09-14T05:59:04.127 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-14T05:59:04.127 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-14T05:59:04.127 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-14T05:59:04.127 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-14T05:59:04.128 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-14T05:59:04.128 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-14T05:59:04.128 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-14T05:59:04.128 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-14T05:59:04.128 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-14T05:59:04.128 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-14T05:59:04.128 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-14T05:59:04.128 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-14T05:59:04.128 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-14T05:59:04.128 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-14T05:59:04.128 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-14T05:59:04.128 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_addr": "", 2024-09-14T05:59:04.128 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_auth": "token", 2024-09-14T05:59:04.128 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_namespace": "", 2024-09-14T05:59:04.129 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_prefix": "", 2024-09-14T05:59:04.129 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-14T05:59:04.129 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-14T05:59:04.129 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-14T05:59:04.129 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-14T05:59:04.129 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_token_file": "", 2024-09-14T05:59:04.129 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-14T05:59:04.129 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_curl_buffersize": "524288", 2024-09-14T05:59:04.129 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-14T05:59:04.129 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_curl_low_speed_time": "300", 2024-09-14T05:59:04.129 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-14T05:59:04.129 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-14T05:59:04.129 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-14T05:59:04.130 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_data_log_changes_size": "1000", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_data_log_num_shards": "128", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_data_log_window": "30", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-14T05:59:04.131 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_disable_s3select": "false", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-14T05:59:04.132 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-14T05:59:04.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-14T05:59:04.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dns_name": "", 2024-09-14T05:59:04.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dns_s3website_name": "", 2024-09-14T05:59:04.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dynamic_resharding": "true", 2024-09-14T05:59:04.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-14T05:59:04.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-14T05:59:04.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-14T05:59:04.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_gc_threads": "true", 2024-09-14T05:59:04.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_lc_threads": "true", 2024-09-14T05:59:04.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_mdsearch": "true", 2024-09-14T05:59:04.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_ops_log": "false", 2024-09-14T05:59:04.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_quota_threads": "true", 2024-09-14T05:59:04.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_static_website": "false", 2024-09-14T05:59:04.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enable_usage_log": "false", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_enforce_swift_acls": "true", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_exit_timeout_secs": "120", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_expose_bucket": "false", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_extended_http_attrs": "", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_filter": "none", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_frontends": "beast port=7480", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_max_deferred": "50", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_max_objs": "32", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-14T05:59:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_gc_processor_period": "3600", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_init_timeout": "300", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_kafka_connection_idle": "300", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-14T05:59:04.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_domain": "", 2024-09-14T05:59:04.136 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_password": "", 2024-09-14T05:59:04.136 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_password_path": "", 2024-09-14T05:59:04.136 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_project": "", 2024-09-14T05:59:04.136 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_tenant": "", 2024-09-14T05:59:04.136 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_token": "", 2024-09-14T05:59:04.136 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_token_path": "", 2024-09-14T05:59:04.136 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_admin_user": "", 2024-09-14T05:59:04.136 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_barbican_domain": "", 2024-09-14T05:59:04.136 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_barbican_password": "", 2024-09-14T05:59:04.136 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_barbican_project": "", 2024-09-14T05:59:04.136 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-14T05:59:04.136 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_barbican_user": "", 2024-09-14T05:59:04.136 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-14T05:59:04.136 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-14T05:59:04.137 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-14T05:59:04.137 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-14T05:59:04.137 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-14T05:59:04.137 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_url": "", 2024-09-14T05:59:04.137 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-14T05:59:04.137 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lc_debug_interval": "-1", 2024-09-14T05:59:04.137 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lc_lock_max_time": "90", 2024-09-14T05:59:04.137 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lc_max_objs": "32", 2024-09-14T05:59:04.137 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lc_max_rules": "1000", 2024-09-14T05:59:04.137 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lc_max_worker": "3", 2024-09-14T05:59:04.137 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-14T05:59:04.137 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lc_thread_delay": "0", 2024-09-14T05:59:04.137 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-14T05:59:04.138 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ldap_dnattr": "uid", 2024-09-14T05:59:04.138 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-14T05:59:04.138 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ldap_searchfilter": "", 2024-09-14T05:59:04.138 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-14T05:59:04.138 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ldap_uri": "", 2024-09-14T05:59:04.138 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-14T05:59:04.138 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-14T05:59:04.138 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-14T05:59:04.138 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-14T05:59:04.138 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_log_http_headers": "", 2024-09-14T05:59:04.138 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-14T05:59:04.138 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-14T05:59:04.138 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_log_object_name_utc": "false", 2024-09-14T05:59:04.139 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-14T05:59:04.139 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-14T05:59:04.139 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_attr_name_len": "0", 2024-09-14T05:59:04.139 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_attr_size": "0", 2024-09-14T05:59:04.139 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-14T05:59:04.139 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_chunk_size": "4194304", 2024-09-14T05:59:04.139 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-14T05:59:04.139 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-14T05:59:04.139 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-14T05:59:04.139 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_listing_results": "1000", 2024-09-14T05:59:04.139 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_notify_retries": "10", 2024-09-14T05:59:04.139 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-14T05:59:04.139 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_put_param_size": "1048576", 2024-09-14T05:59:04.139 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_put_size": "5368709120", 2024-09-14T05:59:04.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_max_slo_entries": "1000", 2024-09-14T05:59:04.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_md_log_max_shards": "64", 2024-09-14T05:59:04.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-14T05:59:04.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-14T05:59:04.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-14T05:59:04.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-14T05:59:04.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_mp_lock_max_time": "600", 2024-09-14T05:59:04.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-14T05:59:04.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-14T05:59:04.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-14T05:59:04.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-14T05:59:04.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-14T05:59:04.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-14T05:59:04.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-14T05:59:04.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-14T05:59:04.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_max_gc": "300", 2024-09-14T05:59:04.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-14T05:59:04.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-14T05:59:04.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-14T05:59:04.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-14T05:59:04.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-14T05:59:04.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-14T05:59:04.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-14T05:59:04.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_num_async_rados_threads": "32", 2024-09-14T05:59:04.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_num_control_oids": "8", 2024-09-14T05:59:04.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_numa_node": "-1", 2024-09-14T05:59:04.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-14T05:59:04.141 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_objexp_chunk_size": "100", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_objexp_gc_interval": "600", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_op_thread_timeout": "600", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_op_tracing": "false", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_opa_token": "", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_opa_url": "", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_opa_verify_ssl": "true", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ops_log_rados": "false", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_ops_log_socket_path": "", 2024-09-14T05:59:04.142 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-14T05:59:04.143 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-14T05:59:04.143 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-14T05:59:04.143 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_period_push_interval": "2.000000", 2024-09-14T05:59:04.143 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-14T05:59:04.143 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-14T05:59:04.143 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-14T05:59:04.143 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-14T05:59:04.143 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_posix_cache_lanes": "3", 2024-09-14T05:59:04.143 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-14T05:59:04.143 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-14T05:59:04.143 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_posix_cache_partitions": "3", 2024-09-14T05:59:04.143 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-14T05:59:04.143 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_print_continue": "true", 2024-09-14T05:59:04.143 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_rados_tracing": "false", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_realm": "", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_realm_id": "", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_region": "", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_request_uri": "", 2024-09-14T05:59:04.144 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_reshard_batch_size": "64", 2024-09-14T05:59:04.145 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-14T05:59:04.145 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-14T05:59:04.145 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_reshard_max_aio": "128", 2024-09-14T05:59:04.145 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_reshard_num_logs": "16", 2024-09-14T05:59:04.145 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-14T05:59:04.145 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-14T05:59:04.145 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_reshard_thread_interval": "600", 2024-09-14T05:59:04.145 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-14T05:59:04.145 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_resolve_cname": "false", 2024-09-14T05:59:04.145 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-14T05:59:04.145 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_run_sync_thread": "true", 2024-09-14T05:59:04.145 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-14T05:59:04.145 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-14T05:59:04.145 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_scheduler_type": "throttler", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_script_uri": "", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_service_provider_name": "", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sts_client_id": "", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sts_client_secret": "", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sts_entry": "sts", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sts_key": "sts", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-14T05:59:04.146 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sts_min_session_duration": "900", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sts_token_introspection_url": "", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_account_in_url": "false", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_auth_entry": "auth", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_auth_url": "", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_custom_header": "", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_need_stats": "true", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_tenant_name": "", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_token_expiration": "86400", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_url": "", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_url_prefix": "swift", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-14T05:59:04.147 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_lease_period": "120", 2024-09-14T05:59:04.148 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-14T05:59:04.148 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-14T05:59:04.148 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-14T05:59:04.148 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-14T05:59:04.148 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-14T05:59:04.148 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-14T05:59:04.148 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-14T05:59:04.148 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-14T05:59:04.148 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-14T05:59:04.148 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_thread_pool_size": "512", 2024-09-14T05:59:04.148 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-14T05:59:04.148 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-14T05:59:04.148 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-14T05:59:04.148 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-14T05:59:04.149 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_comment": "", 2024-09-14T05:59:04.149 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_createby": "", 2024-09-14T05:59:04.149 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_encoding": "", 2024-09-14T05:59:04.149 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_flag": "false", 2024-09-14T05:59:04.149 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-14T05:59:04.149 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_origin": "", 2024-09-14T05:59:04.149 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-14T05:59:04.149 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_torrent_tracker": "", 2024-09-14T05:59:04.149 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_trust_forwarded_https": "false", 2024-09-14T05:59:04.149 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-14T05:59:04.149 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-14T05:59:04.149 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_usage_max_shards": "32", 2024-09-14T05:59:04.149 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_usage_max_user_shards": "1", 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_use_opa_authz": "false", 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_counters_cache": "false", 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_max_buckets": "1000", 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_policies_max_num": "100", 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_user_unique_email": "true", 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_verify_ssl": "true", 2024-09-14T05:59:04.150 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_zone": "", 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_zone_id": "", 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_zonegroup": "", 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_zonegroup_id": "", 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: "rgwlc_auto_session_clear": "true", 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_block_size": "4096", 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-14T05:59:04.151 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-14T05:59:04.152 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cache_size": "536870912", 2024-09-14T05:59:04.152 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-14T05:59:04.152 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-14T05:59:04.152 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-14T05:59:04.152 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-14T05:59:04.152 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-14T05:59:04.152 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-14T05:59:04.152 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-14T05:59:04.152 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-14T05:59:04.152 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_index_type": "binary_search", 2024-09-14T05:59:04.152 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-14T05:59:04.152 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-14T05:59:04.152 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_partition_filters": "false", 2024-09-14T05:59:04.152 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_perf": "false", 2024-09-14T05:59:04.153 INFO:teuthology.orchestra.run.smithi006.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-14T05:59:04.153 INFO:teuthology.orchestra.run.smithi006.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-14T05:59:04.153 INFO:teuthology.orchestra.run.smithi006.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-14T05:59:04.153 INFO:teuthology.orchestra.run.smithi006.stdout: "run_dir": "/var/run/ceph", 2024-09-14T05:59:04.153 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_block_create": "true", 2024-09-14T05:59:04.153 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_cache_lru_size": "67108864", 2024-09-14T05:59:04.153 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-14T05:59:04.153 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-14T05:59:04.153 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_default_max_object_size": "16777216", 2024-09-14T05:59:04.153 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-14T05:59:04.153 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_device_size": "53687091200", 2024-09-14T05:59:04.153 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-14T05:59:04.153 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_full_integrity_check": "false", 2024-09-14T05:59:04.154 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_journal_batch_capacity": "16", 2024-09-14T05:59:04.154 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-14T05:59:04.154 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-14T05:59:04.154 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-14T05:59:04.154 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_main_device_type": "SSD", 2024-09-14T05:59:04.154 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-14T05:59:04.154 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-14T05:59:04.154 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-14T05:59:04.154 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-14T05:59:04.154 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-14T05:59:04.154 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-14T05:59:04.154 INFO:teuthology.orchestra.run.smithi006.stdout: "seastore_segment_size": "67108864", 2024-09-14T05:59:04.154 INFO:teuthology.orchestra.run.smithi006.stdout: "set_keepcaps": "false", 2024-09-14T05:59:04.155 INFO:teuthology.orchestra.run.smithi006.stdout: "setgroup": "", 2024-09-14T05:59:04.155 INFO:teuthology.orchestra.run.smithi006.stdout: "setuser": "", 2024-09-14T05:59:04.155 INFO:teuthology.orchestra.run.smithi006.stdout: "setuser_match_path": "", 2024-09-14T05:59:04.155 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-14T05:59:04.155 INFO:teuthology.orchestra.run.smithi006.stdout: "thp": "false", 2024-09-14T05:59:04.155 INFO:teuthology.orchestra.run.smithi006.stdout: "threadpool_default_timeout": "60", 2024-09-14T05:59:04.155 INFO:teuthology.orchestra.run.smithi006.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-14T05:59:04.155 INFO:teuthology.orchestra.run.smithi006.stdout: "throttler_perf_counter": "true", 2024-09-14T05:59:04.155 INFO:teuthology.orchestra.run.smithi006.stdout: "tmp_dir": "/tmp", 2024-09-14T05:59:04.155 INFO:teuthology.orchestra.run.smithi006.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-14T05:59:04.155 INFO:teuthology.orchestra.run.smithi006.stdout: "uadk_compressor_enabled": "false", 2024-09-14T05:59:04.155 INFO:teuthology.orchestra.run.smithi006.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-14T05:59:04.155 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:04.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-14T05:59:04.308 INFO:teuthology.orchestra.run.smithi006.stdout:mon.a: {} 2024-09-14T05:59:04.308 INFO:teuthology.orchestra.run.smithi006.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T05:59:04.321 INFO:teuthology.orchestra.run.smithi006.stdout:mon.b: {} 2024-09-14T05:59:04.322 INFO:teuthology.orchestra.run.smithi006.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T05:59:04.331 INFO:teuthology.orchestra.run.smithi006.stdout:mon.c: {} 2024-09-14T05:59:04.331 INFO:teuthology.orchestra.run.smithi006.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T05:59:04.347 DEBUG:teuthology.orchestra.run.smithi006:> type ceph-objectstore-tool 2024-09-14T05:59:04.351 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T05:59:04.351 DEBUG:teuthology.orchestra.run.smithi154:> type ceph-objectstore-tool 2024-09-14T05:59:04.357 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T05:59:04.357 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-14T05:59:04.367 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-14T05:59:04.367 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-14T05:59:04.367 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-14T05:59:04.367 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:59:04.367 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-14T05:59:04.368 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T05:59:04.368 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T05:59:04.368 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-14T05:59:04.368 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-14T05:59:04.368 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-14T05:59:04.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:59:04.369 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-14T05:59:04.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:59:04.369 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-14T05:59:04.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:59:04.370 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 pool_client.0 image_client.0 2024-09-14T05:59:04.400 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:04.399+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:04.415 INFO:teuthology.orchestra.run.smithi006.stdout:mapped writes DISABLED 2024-09-14T05:59:04.415 INFO:teuthology.orchestra.run.smithi006.stdout:mapped reads DISABLED 2024-09-14T05:59:04.415 INFO:teuthology.orchestra.run.smithi006.stdout:Seed set to 3012 2024-09-14T05:59:04.471 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:04.467+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:04.520 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:04.520 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:04.520 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:04.520 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:04.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:59:04.584 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:04.584 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T05:59:04.584 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:04.584 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:04.582+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:04.589 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T05:59:04.589 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:59:04.607 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:04.607 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:04.622 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:04.638 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:04.638 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:04.659 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:04.659 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:04.672 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:04.671+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:04.679 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:04.679 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:04.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:59:04.699 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:04.699 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:04.720 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:04.779 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:04.778+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:04.808 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:04.808 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:04.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:59:04.907 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:04.906+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:04.975 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:04.973+0000 7feccafba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26385) UID: 0 2024-09-14T05:59:04.981 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:04.981 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:04.994 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:59:05.076 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:05.079+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:05.146 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:05.146 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:05.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:59:05.207 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:05.205+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:05.274 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2024-09-14T05:59:05.279 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:05.275+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:05.288 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:05.289 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:05.303 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:59:05.379 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:05.379+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:05.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:59:05.480 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:05.477+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:05.581 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:05.577+0000 7feccafba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26385) UID: 0 2024-09-14T05:59:05.601 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:05.602 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:05.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:59:05.703 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:05.701+0000 7feccafba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26385) UID: 0 2024-09-14T05:59:05.776 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:05.776 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:05.783 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:05.779+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:05.790 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:59:05.883 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:05.881+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:05.953 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:05.953 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:05.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:59:06.011 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:06.009+0000 7feccafba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26385) UID: 0 2024-09-14T05:59:06.086 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:06.087+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:06.138 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:06.138 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:06.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:59:06.199 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:06.197+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:06.285 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:06.286 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:06.288 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:06.285+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:06.309 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:59:06.388 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:06.385+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:06.439 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:06.439 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:06.454 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:59:06.499 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:06.499+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:06.576 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:06.576 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:06.590 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:59:06.590 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:06.585+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:06.691 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:06.687+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:06.737 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:59:06.755 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:06.755 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:06.769 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:59:06.792 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:06.789+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:06.892 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:06.889+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:06.895 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T05:59:06.895 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:59:06.911 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:06.929 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:06.929 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:06.936 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:06.936 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:06.946 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:06.946 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:06.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:59:06.965 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:06.983 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:06.983 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:06.995 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:06.995+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:07.002 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:07.002 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:07.020 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:07.021 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:07.069 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:07.070 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:07.070 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:07.070 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:07.070 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:07.085 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:59:07.131 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:07.131+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:07.194 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:07.189+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:07.255 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:07.255 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:07.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:07.255 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:07.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.255 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4208.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:59:07.255 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:54.096849+0000", 2024-09-14T05:59:07.255 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.160467769, 2024-09-14T05:59:07.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011093360999999999, 2024-09-14T05:59:07.255 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:07.255 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:07.255 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:07.255 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:07.256 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4208", 2024-09-14T05:59:07.256 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3821154366", 2024-09-14T05:59:07.256 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 1 2024-09-14T05:59:07.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.256 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:07.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:07.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.096849+0000", 2024-09-14T05:59:07.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:07.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.096849+0000", 2024-09-14T05:59:07.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.096859+0000", 2024-09-14T05:59:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8900000000000002e-06 2024-09-14T05:59:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.096873+0000", 2024-09-14T05:59:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4409999999999999e-05 2024-09-14T05:59:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.096903+0000", 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9623000000000001e-05 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.096921+0000", 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8349999999999999e-05 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.097103+0000", 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000181435 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T05:59:07.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.097127+0000", 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4865999999999999e-05 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.101679+0000", 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045512219999999997 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.101911+0000", 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023241099999999999 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:07.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.102371+0000", 2024-09-14T05:59:07.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00045972299999999999 2024-09-14T05:59:07.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:07.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.104531+0000", 2024-09-14T05:59:07.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021601010000000002 2024-09-14T05:59:07.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:07.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.107716+0000", 2024-09-14T05:59:07.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003185289 2024-09-14T05:59:07.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:07.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.107797+0000", 2024-09-14T05:59:07.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1326e-05 2024-09-14T05:59:07.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:07.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.107942+0000", 2024-09-14T05:59:07.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014471500000000001 2024-09-14T05:59:07.261 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.261 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:07.261 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4208.0:1 2.3 e20/19 ondisk, result = 0)", 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:54.104287+0000", 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.153029513, 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026657800000000001, 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.104287+0000", 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:07.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.104287+0000", 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.104289+0000", 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5200000000000001e-06 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.104299+0000", 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9059999999999997e-06 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.104325+0000", 2024-09-14T05:59:07.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.652e-05 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.104343+0000", 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7906000000000001e-05 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.104483+0000", 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000139973 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.104511+0000", 2024-09-14T05:59:07.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.794e-05 2024-09-14T05:59:07.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:07.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.104554+0000", 2024-09-14T05:59:07.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2812999999999998e-05 2024-09-14T05:59:07.265 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.265 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:07.265 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.265 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4208.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:59:07.265 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:54.112305+0000", 2024-09-14T05:59:07.265 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.145012058000001, 2024-09-14T05:59:07.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00042783300000000002, 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4208", 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3821154366", 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 2 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.112305+0000", 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:07.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.112305+0000", 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.112307+0000", 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.616e-06 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.112319+0000", 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2320000000000001e-05 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.112351+0000", 2024-09-14T05:59:07.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1810000000000002e-05 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.112373+0000", 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2203000000000001e-05 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.112514+0000", 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000140619 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.112732+0000", 2024-09-14T05:59:07.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021826500000000001 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4208.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:54.113250+0000", 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.144066272, 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030444400000000001, 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4208", 2024-09-14T05:59:07.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3821154366", 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 3 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.113250+0000", 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.113250+0000", 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:07.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.113253+0000", 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.413e-06 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.113271+0000", 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8450000000000001e-05 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.113303+0000", 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1606000000000002e-05 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:07.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.113318+0000", 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4790000000000001e-05 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.113415+0000", 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7658999999999995e-05 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:54.113555+0000", 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013952600000000001 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4208.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:55.094459+0000", 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.162857627999999, 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0063864639999999997, 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4208", 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3821154366", 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:07.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.094459+0000", 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.094459+0000", 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.094462+0000", 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9670000000000001e-06 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.094475+0000", 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2840000000000001e-05 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.094507+0000", 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2583000000000003e-05 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.094525+0000", 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7924e-05 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:07.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.094654+0000", 2024-09-14T05:59:07.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012901500000000001 2024-09-14T05:59:07.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-14T05:59:07.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.094666+0000", 2024-09-14T05:59:07.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1773000000000001e-05 2024-09-14T05:59:07.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:07.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.097801+0000", 2024-09-14T05:59:07.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031351389999999999 2024-09-14T05:59:07.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.098003+0000", 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000201452 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.098241+0000", 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023783800000000001 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.099699+0000", 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014584019999999999 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:07.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.100649+0000", 2024-09-14T05:59:07.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00094980599999999998 2024-09-14T05:59:07.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:07.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.100733+0000", 2024-09-14T05:59:07.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4635999999999994e-05 2024-09-14T05:59:07.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:07.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.100845+0000", 2024-09-14T05:59:07.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112089 2024-09-14T05:59:07.278 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.278 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4208.0:5 2.2 e21/19 ondisk, result = 0)", 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:55.100468+0000", 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.156848348, 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039194700000000002, 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.100468+0000", 2024-09-14T05:59:07.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:07.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.100468+0000", 2024-09-14T05:59:07.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:07.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.100470+0000", 2024-09-14T05:59:07.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.72e-06 2024-09-14T05:59:07.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:07.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.100478+0000", 2024-09-14T05:59:07.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2169999999999994e-06 2024-09-14T05:59:07.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:07.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.100504+0000", 2024-09-14T05:59:07.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6282999999999999e-05 2024-09-14T05:59:07.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:07.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.100526+0000", 2024-09-14T05:59:07.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1977e-05 2024-09-14T05:59:07.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.100628+0000", 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101505 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.100641+0000", 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2799999999999999e-05 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:55.100860+0000", 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000219445 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:07.282 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4208.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:56.101341+0000", 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.155975808999999, 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046965540000000004, 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4208", 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3821154366", 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 7 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.283 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.101341+0000", 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.101341+0000", 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.101344+0000", 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2899999999999998e-06 2024-09-14T05:59:07.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:07.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.101360+0000", 2024-09-14T05:59:07.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5713999999999999e-05 2024-09-14T05:59:07.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:07.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.101399+0000", 2024-09-14T05:59:07.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9545999999999997e-05 2024-09-14T05:59:07.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:07.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.101427+0000", 2024-09-14T05:59:07.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7846000000000001e-05 2024-09-14T05:59:07.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:07.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.101718+0000", 2024-09-14T05:59:07.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029032100000000001 2024-09-14T05:59:07.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:07.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.101942+0000", 2024-09-14T05:59:07.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000224968 2024-09-14T05:59:07.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.102441+0000", 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049891300000000003 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.105167+0000", 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00272543 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.105870+0000", 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00070343100000000002 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:07.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.105963+0000", 2024-09-14T05:59:07.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3109000000000006e-05 2024-09-14T05:59:07.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:07.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.106037+0000", 2024-09-14T05:59:07.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3986000000000006e-05 2024-09-14T05:59:07.288 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.288 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:07.288 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.288 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4208.0:7 2.2 e22/19 ondisk, result = 0)", 2024-09-14T05:59:07.288 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:56.104965+0000", 2024-09-14T05:59:07.288 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.152351803, 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021385100000000001, 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.104965+0000", 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.104965+0000", 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:07.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:07.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.104967+0000", 2024-09-14T05:59:07.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0600000000000002e-06 2024-09-14T05:59:07.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:07.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.104976+0000", 2024-09-14T05:59:07.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8459999999999997e-06 2024-09-14T05:59:07.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:07.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.105002+0000", 2024-09-14T05:59:07.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6636999999999999e-05 2024-09-14T05:59:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.105023+0000", 2024-09-14T05:59:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0792999999999999e-05 2024-09-14T05:59:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.105144+0000", 2024-09-14T05:59:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000121109 2024-09-14T05:59:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:07.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.105158+0000", 2024-09-14T05:59:07.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.381e-05 2024-09-14T05:59:07.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:07.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:07.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:07.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:56.105179+0000", 2024-09-14T05:59:07.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0596000000000001e-05 2024-09-14T05:59:07.292 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.292 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:07.292 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.292 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:07.292 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:07.292 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:07.293 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T05:59:07.295 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:07.293+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:07.298 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:59:07.396 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:07.395+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:07.419 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:07.419 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:07.419 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:07.419 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:07.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T05:59:07.497 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:07.493+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:07.598 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:07.595+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:07.604 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:07.604 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:07.605 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:07.605 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:07.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T05:59:07.699 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:07.697+0000 7feccafba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26385) UID: 0 2024-09-14T05:59:07.789 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:07.789 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [] 2024-09-14T05:59:07.789 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:07.800 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:07.797+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:07.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T05:59:07.901 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:07.897+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:07.920 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:07.920 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:07.921 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:07.921 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:07.935 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T05:59:08.002 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:07.999+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:08.056 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:08.057 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:08.057 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:08.057 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:08.057 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:08.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T05:59:08.112 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:08.111+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:08.204 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:08.203+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:08.238 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:08.238 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:08.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:08.238 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:08.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.238 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.238 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.197632+0000", 2024-09-14T05:59:08.238 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.039755604, 2024-09-14T05:59:08.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012882944, 2024-09-14T05:59:08.239 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.239 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.239 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.239 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.239 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.239 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.239 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 42 2024-09-14T05:59:08.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.239 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.197632+0000", 2024-09-14T05:59:08.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.197632+0000", 2024-09-14T05:59:08.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.197633+0000", 2024-09-14T05:59:08.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6199999999999999e-06 2024-09-14T05:59:08.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.197646+0000", 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2874000000000001e-05 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.197679+0000", 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3256000000000001e-05 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.197694+0000", 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5057e-05 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.202161+0000", 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044662850000000004 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.202438+0000", 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027702500000000003 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.202643+0000", 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020561099999999999 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.204411+0000", 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0017682189999999999 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210328+0000", 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059166710000000001 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210405+0000", 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6379999999999997e-05 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210514+0000", 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010994599999999999 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198145+0000", 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.039242183999999, 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012555759, 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.244 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 43 2024-09-14T05:59:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198145+0000", 2024-09-14T05:59:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198145+0000", 2024-09-14T05:59:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198147+0000", 2024-09-14T05:59:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1129999999999999e-06 2024-09-14T05:59:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198161+0000", 2024-09-14T05:59:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.431e-05 2024-09-14T05:59:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198196+0000", 2024-09-14T05:59:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4943000000000001e-05 2024-09-14T05:59:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198215+0000", 2024-09-14T05:59:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9117e-05 2024-09-14T05:59:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.203318+0000", 2024-09-14T05:59:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051027169999999997 2024-09-14T05:59:08.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.203446+0000", 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012750200000000001 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.203639+0000", 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019343799999999999 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.207678+0000", 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040387959999999999 2024-09-14T05:59:08.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210540+0000", 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028623440000000002 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210606+0000", 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5573000000000004e-05 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210701+0000", 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4906000000000002e-05 2024-09-14T05:59:08.249 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.250 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.250 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.250 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.250 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198301+0000", 2024-09-14T05:59:08.250 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.039085934999999, 2024-09-14T05:59:08.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017830464000000001, 2024-09-14T05:59:08.250 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.250 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.250 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.250 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.250 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.251 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.251 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 44 2024-09-14T05:59:08.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.251 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198301+0000", 2024-09-14T05:59:08.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198301+0000", 2024-09-14T05:59:08.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198303+0000", 2024-09-14T05:59:08.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2029999999999999e-06 2024-09-14T05:59:08.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198425+0000", 2024-09-14T05:59:08.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012151599999999999 2024-09-14T05:59:08.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198448+0000", 2024-09-14T05:59:08.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3485999999999998e-05 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198470+0000", 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1433e-05 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.204821+0000", 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0063514239999999996 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.205111+0000", 2024-09-14T05:59:08.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000289711 2024-09-14T05:59:08.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.205413+0000", 2024-09-14T05:59:08.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030177099999999999 2024-09-14T05:59:08.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.207849+0000", 2024-09-14T05:59:08.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024361510000000001 2024-09-14T05:59:08.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.215901+0000", 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0080523179999999993 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.215987+0000", 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6201999999999999e-05 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216132+0000", 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014424899999999999 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.255 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.256 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.256 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198525+0000", 2024-09-14T05:59:08.256 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.038862050999999, 2024-09-14T05:59:08.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017790258999999999, 2024-09-14T05:59:08.256 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.256 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.256 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.256 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.256 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.256 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.256 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198525+0000", 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198525+0000", 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198527+0000", 2024-09-14T05:59:08.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.77e-06 2024-09-14T05:59:08.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198539+0000", 2024-09-14T05:59:08.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2634e-05 2024-09-14T05:59:08.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198560+0000", 2024-09-14T05:59:08.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0656e-05 2024-09-14T05:59:08.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198575+0000", 2024-09-14T05:59:08.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4756999999999999e-05 2024-09-14T05:59:08.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.206367+0000", 2024-09-14T05:59:08.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0077922160000000002 2024-09-14T05:59:08.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.206499+0000", 2024-09-14T05:59:08.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000132349 2024-09-14T05:59:08.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.206710+0000", 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021102100000000001 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210809+0000", 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040987649999999999 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216150+0000", 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053402520000000002 2024-09-14T05:59:08.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216218+0000", 2024-09-14T05:59:08.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8539000000000002e-05 2024-09-14T05:59:08.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216315+0000", 2024-09-14T05:59:08.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7299999999999993e-05 2024-09-14T05:59:08.261 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.261 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.261 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198609+0000", 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.038778525000001, 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017922038000000001, 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 46 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198609+0000", 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198609+0000", 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198610+0000", 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.474e-06 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198621+0000", 2024-09-14T05:59:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0696000000000001e-05 2024-09-14T05:59:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198635+0000", 2024-09-14T05:59:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4042999999999999e-05 2024-09-14T05:59:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198643+0000", 2024-09-14T05:59:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0099999999999995e-06 2024-09-14T05:59:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.208126+0000", 2024-09-14T05:59:08.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094826830000000004 2024-09-14T05:59:08.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.208257+0000", 2024-09-14T05:59:08.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013192600000000001 2024-09-14T05:59:08.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.208469+0000", 2024-09-14T05:59:08.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000211342 2024-09-14T05:59:08.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210935+0000", 2024-09-14T05:59:08.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002466261 2024-09-14T05:59:08.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216348+0000", 2024-09-14T05:59:08.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054124840000000004 2024-09-14T05:59:08.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216433+0000", 2024-09-14T05:59:08.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5515999999999999e-05 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216531+0000", 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7602999999999994e-05 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198662+0000", 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.038725348, 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018079332, 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.267 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 47 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198662+0000", 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198662+0000", 2024-09-14T05:59:08.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198663+0000", 2024-09-14T05:59:08.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8000000000000004e-07 2024-09-14T05:59:08.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198767+0000", 2024-09-14T05:59:08.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104262 2024-09-14T05:59:08.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198780+0000", 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3253e-05 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198789+0000", 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8570000000000001e-06 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.209052+0000", 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010262817 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.209186+0000", 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013397499999999999 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.209407+0000", 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022110899999999999 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.213132+0000", 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037247270000000002 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216548+0000", 2024-09-14T05:59:08.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034159839999999999 2024-09-14T05:59:08.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216641+0000", 2024-09-14T05:59:08.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3548999999999995e-05 2024-09-14T05:59:08.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216741+0000", 2024-09-14T05:59:08.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9919000000000003e-05 2024-09-14T05:59:08.272 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.272 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.273 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.273 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.273 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198807+0000", 2024-09-14T05:59:08.273 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.038580372999999, 2024-09-14T05:59:08.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018163529000000001, 2024-09-14T05:59:08.273 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.273 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.273 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.273 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.273 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.273 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.273 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198807+0000", 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198807+0000", 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198808+0000", 2024-09-14T05:59:08.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0640000000000001e-06 2024-09-14T05:59:08.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198826+0000", 2024-09-14T05:59:08.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8165999999999999e-05 2024-09-14T05:59:08.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198837+0000", 2024-09-14T05:59:08.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1073999999999999e-05 2024-09-14T05:59:08.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198847+0000", 2024-09-14T05:59:08.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4760000000000004e-06 2024-09-14T05:59:08.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.211015+0000", 2024-09-14T05:59:08.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012168442 2024-09-14T05:59:08.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.211140+0000", 2024-09-14T05:59:08.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000125346 2024-09-14T05:59:08.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.211348+0000", 2024-09-14T05:59:08.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020795399999999999 2024-09-14T05:59:08.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.213283+0000", 2024-09-14T05:59:08.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0019344690000000001 2024-09-14T05:59:08.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216755+0000", 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034720060000000001 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216864+0000", 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010964299999999999 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216970+0000", 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105889 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.278 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198860+0000", 2024-09-14T05:59:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.038527197000001, 2024-09-14T05:59:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019221714000000001, 2024-09-14T05:59:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 49 2024-09-14T05:59:08.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198860+0000", 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198860+0000", 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198877+0000", 2024-09-14T05:59:08.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7254000000000001e-05 2024-09-14T05:59:08.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198884+0000", 2024-09-14T05:59:08.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8129999999999998e-06 2024-09-14T05:59:08.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198895+0000", 2024-09-14T05:59:08.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0536e-05 2024-09-14T05:59:08.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198902+0000", 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4739999999999999e-06 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.211923+0000", 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013020959 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.212065+0000", 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000141605 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.212258+0000", 2024-09-14T05:59:08.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000193065 2024-09-14T05:59:08.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.215745+0000", 2024-09-14T05:59:08.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034873259999999998 2024-09-14T05:59:08.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.217915+0000", 2024-09-14T05:59:08.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021705069999999999 2024-09-14T05:59:08.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.217983+0000", 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7465999999999994e-05 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218082+0000", 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8709000000000006e-05 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.284 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198940+0000", 2024-09-14T05:59:08.285 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.038446820000001, 2024-09-14T05:59:08.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019336696, 2024-09-14T05:59:08.285 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.285 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.285 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.285 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.285 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.285 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.285 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 50 2024-09-14T05:59:08.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.285 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198940+0000", 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198940+0000", 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198941+0000", 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.06e-06 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199017+0000", 2024-09-14T05:59:08.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5825e-05 2024-09-14T05:59:08.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199034+0000", 2024-09-14T05:59:08.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6990000000000002e-05 2024-09-14T05:59:08.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199043+0000", 2024-09-14T05:59:08.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.02e-06 2024-09-14T05:59:08.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.213411+0000", 2024-09-14T05:59:08.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014367988 2024-09-14T05:59:08.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.213628+0000", 2024-09-14T05:59:08.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021679199999999999 2024-09-14T05:59:08.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.213836+0000", 2024-09-14T05:59:08.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020794499999999999 2024-09-14T05:59:08.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.215878+0000", 2024-09-14T05:59:08.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002041738 2024-09-14T05:59:08.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218095+0000", 2024-09-14T05:59:08.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022170890000000002 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218183+0000", 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8115999999999995e-05 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218277+0000", 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4133000000000002e-05 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.291 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.291 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.199060+0000", 2024-09-14T05:59:08.291 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.038327495000001, 2024-09-14T05:59:08.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019363086000000002, 2024-09-14T05:59:08.291 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.291 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.291 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.291 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.291 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.292 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 51 2024-09-14T05:59:08.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.292 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199060+0000", 2024-09-14T05:59:08.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199060+0000", 2024-09-14T05:59:08.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199061+0000", 2024-09-14T05:59:08.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8700000000000004e-07 2024-09-14T05:59:08.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199067+0000", 2024-09-14T05:59:08.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3430000000000001e-06 2024-09-14T05:59:08.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199082+0000", 2024-09-14T05:59:08.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4749999999999999e-05 2024-09-14T05:59:08.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199090+0000", 2024-09-14T05:59:08.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7770000000000002e-06 2024-09-14T05:59:08.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.214757+0000", 2024-09-14T05:59:08.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015667441000000001 2024-09-14T05:59:08.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.214899+0000", 2024-09-14T05:59:08.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014178899999999999 2024-09-14T05:59:08.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.215109+0000", 2024-09-14T05:59:08.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021052199999999999 2024-09-14T05:59:08.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.217893+0000", 2024-09-14T05:59:08.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0027838350000000001 2024-09-14T05:59:08.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218287+0000", 2024-09-14T05:59:08.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039345299999999999 2024-09-14T05:59:08.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218359+0000", 2024-09-14T05:59:08.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2773000000000003e-05 2024-09-14T05:59:08.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218423+0000", 2024-09-14T05:59:08.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3416000000000004e-05 2024-09-14T05:59:08.297 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.297 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.297 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.297 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.297 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.199101+0000", 2024-09-14T05:59:08.297 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.038285731999999, 2024-09-14T05:59:08.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020142773999999999, 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 52 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199101+0000", 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199101+0000", 2024-09-14T05:59:08.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199102+0000", 2024-09-14T05:59:08.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2999999999999999e-07 2024-09-14T05:59:08.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199109+0000", 2024-09-14T05:59:08.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2069999999999998e-06 2024-09-14T05:59:08.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199145+0000", 2024-09-14T05:59:08.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5138999999999997e-05 2024-09-14T05:59:08.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199153+0000", 2024-09-14T05:59:08.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1300000000000001e-06 2024-09-14T05:59:08.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.217061+0000", 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017908231 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.217201+0000", 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013981599999999999 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.217400+0000", 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199385 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218837+0000", 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001436615 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.219119+0000", 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028253499999999999 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.219191+0000", 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2142000000000001e-05 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.219244+0000", 2024-09-14T05:59:08.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2744000000000002e-05 2024-09-14T05:59:08.303 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.303 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.303 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.303 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.303 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.449419+0000", 2024-09-14T05:59:08.303 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.787967890000001, 2024-09-14T05:59:08.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012936479000000001, 2024-09-14T05:59:08.303 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.303 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.303 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.304 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.304 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.304 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.304 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 70 2024-09-14T05:59:08.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.304 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449419+0000", 2024-09-14T05:59:08.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449419+0000", 2024-09-14T05:59:08.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449420+0000", 2024-09-14T05:59:08.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.136e-06 2024-09-14T05:59:08.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449429+0000", 2024-09-14T05:59:08.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3170000000000002e-06 2024-09-14T05:59:08.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449439+0000", 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0759e-05 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449447+0000", 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0180000000000001e-06 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.453417+0000", 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0039694420000000001 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.453521+0000", 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010397500000000001 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.453681+0000", 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016051999999999999 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.456154+0000", 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024730049999999999 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462274+0000", 2024-09-14T05:59:08.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006119322 2024-09-14T05:59:08.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462322+0000", 2024-09-14T05:59:08.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8186999999999998e-05 2024-09-14T05:59:08.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462356+0000", 2024-09-14T05:59:08.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3797999999999997e-05 2024-09-14T05:59:08.308 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.309 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.309 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.309 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.449491+0000", 2024-09-14T05:59:08.309 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.787896347, 2024-09-14T05:59:08.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013062363, 2024-09-14T05:59:08.309 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.309 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.309 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.309 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.309 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.309 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.310 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 71 2024-09-14T05:59:08.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.310 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449491+0000", 2024-09-14T05:59:08.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449491+0000", 2024-09-14T05:59:08.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449492+0000", 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.085e-06 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449499+0000", 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2130000000000002e-06 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449516+0000", 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7289e-05 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449525+0000", 2024-09-14T05:59:08.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.901e-06 2024-09-14T05:59:08.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.454116+0000", 2024-09-14T05:59:08.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045903740000000004 2024-09-14T05:59:08.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.454185+0000", 2024-09-14T05:59:08.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8912999999999996e-05 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.454389+0000", 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020446799999999999 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.457305+0000", 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029157979999999998 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462412+0000", 2024-09-14T05:59:08.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051068579999999997 2024-09-14T05:59:08.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462498+0000", 2024-09-14T05:59:08.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6730000000000005e-05 2024-09-14T05:59:08.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462553+0000", 2024-09-14T05:59:08.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4734000000000001e-05 2024-09-14T05:59:08.314 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.314 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.314 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.315 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.315 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.449542+0000", 2024-09-14T05:59:08.315 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.787844715999999, 2024-09-14T05:59:08.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013186082, 2024-09-14T05:59:08.315 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.315 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.315 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.315 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.315 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.315 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.315 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 72 2024-09-14T05:59:08.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.315 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449542+0000", 2024-09-14T05:59:08.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449542+0000", 2024-09-14T05:59:08.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449543+0000", 2024-09-14T05:59:08.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1800000000000005e-07 2024-09-14T05:59:08.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449609+0000", 2024-09-14T05:59:08.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5724999999999998e-05 2024-09-14T05:59:08.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449620+0000", 2024-09-14T05:59:08.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0773e-05 2024-09-14T05:59:08.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449628+0000", 2024-09-14T05:59:08.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5969999999999992e-06 2024-09-14T05:59:08.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.454820+0000", 2024-09-14T05:59:08.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051917810000000003 2024-09-14T05:59:08.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.454919+0000", 2024-09-14T05:59:08.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8443999999999995e-05 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.455028+0000", 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108973 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.457581+0000", 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025533969999999998 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462623+0000", 2024-09-14T05:59:08.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050425399999999999 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462682+0000", 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8179e-05 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462729+0000", 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6854999999999998e-05 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.321 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.321 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.449647+0000", 2024-09-14T05:59:08.321 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.787740011, 2024-09-14T05:59:08.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013197947999999999, 2024-09-14T05:59:08.321 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.321 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.321 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.321 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.321 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.321 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.321 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 73 2024-09-14T05:59:08.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.321 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449647+0000", 2024-09-14T05:59:08.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449647+0000", 2024-09-14T05:59:08.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449648+0000", 2024-09-14T05:59:08.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0800000000000003e-07 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449655+0000", 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2529999999999998e-06 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449666+0000", 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.097e-05 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449674+0000", 2024-09-14T05:59:08.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6179999999999997e-06 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.456189+0000", 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065150800000000004 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.456257+0000", 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7578999999999998e-05 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.456364+0000", 2024-09-14T05:59:08.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000107565 2024-09-14T05:59:08.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.459238+0000", 2024-09-14T05:59:08.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028741299999999999 2024-09-14T05:59:08.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462778+0000", 2024-09-14T05:59:08.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035401439999999998 2024-09-14T05:59:08.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462817+0000", 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8498000000000003e-05 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462845+0000", 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8203000000000001e-05 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.449707+0000", 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.787680116000001, 2024-09-14T05:59:08.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013289877, 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 74 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449707+0000", 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449707+0000", 2024-09-14T05:59:08.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449708+0000", 2024-09-14T05:59:08.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8100000000000001e-07 2024-09-14T05:59:08.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449715+0000", 2024-09-14T05:59:08.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1590000000000004e-06 2024-09-14T05:59:08.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449726+0000", 2024-09-14T05:59:08.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0400999999999999e-05 2024-09-14T05:59:08.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449733+0000", 2024-09-14T05:59:08.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3540000000000002e-06 2024-09-14T05:59:08.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.456807+0000", 2024-09-14T05:59:08.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0070744390000000001 2024-09-14T05:59:08.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.456878+0000", 2024-09-14T05:59:08.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0827999999999993e-05 2024-09-14T05:59:08.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.456984+0000", 2024-09-14T05:59:08.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010630599999999999 2024-09-14T05:59:08.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.459245+0000", 2024-09-14T05:59:08.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022606739999999998 2024-09-14T05:59:08.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462910+0000", 2024-09-14T05:59:08.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036647199999999998 2024-09-14T05:59:08.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462951+0000", 2024-09-14T05:59:08.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1124000000000001e-05 2024-09-14T05:59:08.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462997+0000", 2024-09-14T05:59:08.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5890999999999998e-05 2024-09-14T05:59:08.332 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.332 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.332 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.332 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.332 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.449767+0000", 2024-09-14T05:59:08.332 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.787620390000001, 2024-09-14T05:59:08.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013370356, 2024-09-14T05:59:08.332 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.332 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.332 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.333 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.333 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.333 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.333 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 75 2024-09-14T05:59:08.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.333 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449767+0000", 2024-09-14T05:59:08.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449767+0000", 2024-09-14T05:59:08.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449768+0000", 2024-09-14T05:59:08.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.012e-06 2024-09-14T05:59:08.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449837+0000", 2024-09-14T05:59:08.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9581999999999999e-05 2024-09-14T05:59:08.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449884+0000", 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6554000000000002e-05 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449908+0000", 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3901e-05 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.457658+0000", 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007750659 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.457727+0000", 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8898000000000003e-05 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.457845+0000", 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011805499999999999 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.459475+0000", 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001629609 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.463060+0000", 2024-09-14T05:59:08.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035845220000000001 2024-09-14T05:59:08.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.463108+0000", 2024-09-14T05:59:08.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8597000000000002e-05 2024-09-14T05:59:08.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.463137+0000", 2024-09-14T05:59:08.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8966999999999999e-05 2024-09-14T05:59:08.337 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.449928+0000", 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.787459252000001, 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013395371999999999, 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.338 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 76 2024-09-14T05:59:08.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.339 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449928+0000", 2024-09-14T05:59:08.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449928+0000", 2024-09-14T05:59:08.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449929+0000", 2024-09-14T05:59:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7399999999999991e-07 2024-09-14T05:59:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449938+0000", 2024-09-14T05:59:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9209999999999998e-06 2024-09-14T05:59:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449951+0000", 2024-09-14T05:59:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3097e-05 2024-09-14T05:59:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449962+0000", 2024-09-14T05:59:08.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1379000000000001e-05 2024-09-14T05:59:08.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.458622+0000", 2024-09-14T05:59:08.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086600789999999993 2024-09-14T05:59:08.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.458693+0000", 2024-09-14T05:59:08.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0381000000000003e-05 2024-09-14T05:59:08.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.458837+0000", 2024-09-14T05:59:08.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000144466 2024-09-14T05:59:08.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.460237+0000", 2024-09-14T05:59:08.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014002350000000001 2024-09-14T05:59:08.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.463257+0000", 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030190920000000001 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.463295+0000", 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8275999999999997e-05 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.463323+0000", 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8472000000000001e-05 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.344 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:93 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.344 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.791537+0000", 2024-09-14T05:59:08.344 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.445849880000001, 2024-09-14T05:59:08.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012592311, 2024-09-14T05:59:08.344 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.344 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.344 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.344 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 93 2024-09-14T05:59:08.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.345 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791537+0000", 2024-09-14T05:59:08.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791537+0000", 2024-09-14T05:59:08.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791538+0000", 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0100000000000004e-07 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791614+0000", 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6470000000000005e-05 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791628+0000", 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3740000000000001e-05 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791637+0000", 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1530000000000003e-06 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.798617+0000", 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069797330000000001 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.798672+0000", 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5203e-05 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.798760+0000", 2024-09-14T05:59:08.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7631000000000002e-05 2024-09-14T05:59:08.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.801083+0000", 2024-09-14T05:59:08.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00232329 2024-09-14T05:59:08.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.803962+0000", 2024-09-14T05:59:08.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028785780000000001 2024-09-14T05:59:08.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.804060+0000", 2024-09-14T05:59:08.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8579000000000006e-05 2024-09-14T05:59:08.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.804130+0000", 2024-09-14T05:59:08.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9233000000000006e-05 2024-09-14T05:59:08.349 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.349 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.349 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.349 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:08.349 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.791654+0000", 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.445732765999999, 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015048914, 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 94 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791654+0000", 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791654+0000", 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791655+0000", 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7699999999999992e-07 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791662+0000", 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2990000000000002e-06 2024-09-14T05:59:08.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791671+0000", 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.747e-06 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791685+0000", 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.314e-05 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.800114+0000", 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084294509999999993 2024-09-14T05:59:08.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.800229+0000", 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011540999999999999 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.800454+0000", 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225011 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.801729+0000", 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0012740869999999999 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:08.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.806569+0000", 2024-09-14T05:59:08.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048402189999999998 2024-09-14T05:59:08.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:08.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.806646+0000", 2024-09-14T05:59:08.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7052999999999996e-05 2024-09-14T05:59:08.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:08.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:08.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:08.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.806703+0000", 2024-09-14T05:59:08.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7519999999999998e-05 2024-09-14T05:59:08.355 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.355 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.355 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.355 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:08.355 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:08.355 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2024-09-14T05:59:08.357 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:08.353+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:08.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:59:08.457 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:08.455+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:08.523 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:08.523 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:08.523 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:08.523 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:08.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:59:08.583 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:08.581+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:08.658 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:08.655+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:08.662 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:08.662 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:08.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:59:08.759 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:08.759+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:08.854 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:08.854 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:08.854 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:08.854 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:08.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.854 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:64 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'40)", 2024-09-14T05:59:08.854 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.446487+0000", 2024-09-14T05:59:08.854 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.404598802999999, 2024-09-14T05:59:08.854 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0050906279999999998, 2024-09-14T05:59:08.854 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.854 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.854 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.854 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.446487+0000", 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.446487+0000", 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.446489+0000", 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7829999999999999e-06 2024-09-14T05:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.446504+0000", 2024-09-14T05:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4547e-05 2024-09-14T05:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.446532+0000", 2024-09-14T05:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8238999999999998e-05 2024-09-14T05:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.446547+0000", 2024-09-14T05:59:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5143999999999999e-05 2024-09-14T05:59:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.446711+0000", 2024-09-14T05:59:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000164399 2024-09-14T05:59:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.446751+0000", 2024-09-14T05:59:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9422000000000003e-05 2024-09-14T05:59:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.858 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.858 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451491+0000", 2024-09-14T05:59:08.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004740391 2024-09-14T05:59:08.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.858 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.858 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451578+0000", 2024-09-14T05:59:08.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6703e-05 2024-09-14T05:59:08.858 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.858 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.858 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.858 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:65 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'40)", 2024-09-14T05:59:08.859 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.447230+0000", 2024-09-14T05:59:08.859 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.403856104999999, 2024-09-14T05:59:08.859 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044252689999999999, 2024-09-14T05:59:08.859 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.859 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.859 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.859 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.859 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.859 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.447230+0000", 2024-09-14T05:59:08.859 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.447230+0000", 2024-09-14T05:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.447232+0000", 2024-09-14T05:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.79e-06 2024-09-14T05:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.447243+0000", 2024-09-14T05:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1348999999999999e-05 2024-09-14T05:59:08.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.861 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.447272+0000", 2024-09-14T05:59:08.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8433e-05 2024-09-14T05:59:08.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.861 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.447285+0000", 2024-09-14T05:59:08.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2962999999999999e-05 2024-09-14T05:59:08.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.447659+0000", 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00037402099999999999 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.447696+0000", 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7255999999999997e-05 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451584+0000", 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038878179999999999 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451655+0000", 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1638999999999996e-05 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:66 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.447980+0000", 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.403106378, 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.005889905, 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.863 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.864 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.864 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.447980+0000", 2024-09-14T05:59:08.864 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.864 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.447980+0000", 2024-09-14T05:59:08.864 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.447982+0000", 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.88e-06 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.448043+0000", 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1036000000000003e-05 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.448067+0000", 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4267e-05 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.448082+0000", 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5203e-05 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.448465+0000", 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00038298999999999999 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.448501+0000", 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.57e-05 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.453791+0000", 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0052905299999999999 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.453870+0000", 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8299000000000004e-05 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:67 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'45, mlcod=17'40)", 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.448948+0000", 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.402138271999998, 2024-09-14T05:59:08.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0050080580000000001, 2024-09-14T05:59:08.868 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.868 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.868 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.868 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.868 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.868 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.448948+0000", 2024-09-14T05:59:08.868 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.868 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.868 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.448948+0000", 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.448950+0000", 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7e-06 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.448961+0000", 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1537e-05 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.869 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.448990+0000", 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8762999999999999e-05 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.449007+0000", 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7178999999999999e-05 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.449869+0000", 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00086203400000000002 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.449909+0000", 2024-09-14T05:59:08.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9860000000000001e-05 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.453876+0000", 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003966809 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.453956+0000", 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0175999999999999e-05 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'46, mlcod=17'40)", 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.449553+0000", 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.401532889999999, 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064715700000000003, 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.449553+0000", 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.449553+0000", 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.449554+0000", 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.449563+0000", 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9369999999999993e-06 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.873 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.449583+0000", 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9836000000000001e-05 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.449600+0000", 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6867e-05 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.450806+0000", 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001205694 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.874 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.450843+0000", 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7746000000000001e-05 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.455940+0000", 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0050964510000000001 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.456025+0000", 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4858999999999995e-05 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.875 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.876 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'47, mlcod=17'40)", 2024-09-14T05:59:08.876 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.450209+0000", 2024-09-14T05:59:08.876 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.400877428000001, 2024-09-14T05:59:08.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073864830000000001, 2024-09-14T05:59:08.876 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.876 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.876 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.876 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.450209+0000", 2024-09-14T05:59:08.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.450209+0000", 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.450210+0000", 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.796e-06 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.450266+0000", 2024-09-14T05:59:08.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5550000000000002e-05 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.450298+0000", 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1575999999999997e-05 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.450311+0000", 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.345e-05 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451750+0000", 2024-09-14T05:59:08.878 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001438913 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451809+0000", 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8585999999999998e-05 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.457513+0000", 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0057040820000000001 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.457595+0000", 2024-09-14T05:59:08.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2529999999999998e-05 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'48, mlcod=17'40)", 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.451303+0000", 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.399783413000002, 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0081942430000000004, 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.880 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451303+0000", 2024-09-14T05:59:08.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451303+0000", 2024-09-14T05:59:08.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451304+0000", 2024-09-14T05:59:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.773e-06 2024-09-14T05:59:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451316+0000", 2024-09-14T05:59:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1454000000000001e-05 2024-09-14T05:59:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451342+0000", 2024-09-14T05:59:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5826e-05 2024-09-14T05:59:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451362+0000", 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0703000000000002e-05 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.453251+0000", 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001888706 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.453294+0000", 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2735999999999999e-05 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.459397+0000", 2024-09-14T05:59:08.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0061034590000000003 2024-09-14T05:59:08.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.459497+0000", 2024-09-14T05:59:08.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9586000000000005e-05 2024-09-14T05:59:08.884 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.884 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.884 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:71 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'49, mlcod=17'40)", 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.451934+0000", 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.399152611000002, 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0076126010000000001, 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451934+0000", 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451934+0000", 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451935+0000", 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0729999999999999e-06 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451942+0000", 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5599999999999996e-06 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451966+0000", 2024-09-14T05:59:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3762999999999999e-05 2024-09-14T05:59:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.451976+0000", 2024-09-14T05:59:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0543999999999999e-05 2024-09-14T05:59:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.454048+0000", 2024-09-14T05:59:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020712669999999999 2024-09-14T05:59:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.454102+0000", 2024-09-14T05:59:08.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4762000000000002e-05 2024-09-14T05:59:08.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.459500+0000", 2024-09-14T05:59:08.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.005397738 2024-09-14T05:59:08.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.459546+0000", 2024-09-14T05:59:08.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5893999999999998e-05 2024-09-14T05:59:08.888 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.888 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.889 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.889 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:72 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'50, mlcod=17'40)", 2024-09-14T05:59:08.889 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.452654+0000", 2024-09-14T05:59:08.889 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.398431890000001, 2024-09-14T05:59:08.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070528120000000003, 2024-09-14T05:59:08.889 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.889 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.889 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.889 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.889 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.452654+0000", 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.452654+0000", 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.452656+0000", 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7099999999999999e-06 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.452713+0000", 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6582999999999997e-05 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.452745+0000", 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2076000000000003e-05 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.452759+0000", 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4780000000000001e-05 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.454780+0000", 2024-09-14T05:59:08.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020210940000000002 2024-09-14T05:59:08.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.454816+0000", 2024-09-14T05:59:08.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5463000000000002e-05 2024-09-14T05:59:08.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.459547+0000", 2024-09-14T05:59:08.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047314770000000004 2024-09-14T05:59:08.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.459707+0000", 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000159629 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:73 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'51, mlcod=17'42)", 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.453990+0000", 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.397096347000002, 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0057864680000000003, 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.893 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.453990+0000", 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.453990+0000", 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.453991+0000", 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2100000000000001e-06 2024-09-14T05:59:08.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.454001+0000", 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0416e-05 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.454026+0000", 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4774e-05 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.454048+0000", 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1849e-05 2024-09-14T05:59:08.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.456123+0000", 2024-09-14T05:59:08.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020752069999999999 2024-09-14T05:59:08.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.456160+0000", 2024-09-14T05:59:08.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.646e-05 2024-09-14T05:59:08.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.459711+0000", 2024-09-14T05:59:08.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035513659999999998 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.459776+0000", 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5185999999999996e-05 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:74 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'52, mlcod=17'42)", 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.454587+0000", 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.396499305999999, 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0052262469999999998, 2024-09-14T05:59:08.897 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.454587+0000", 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.454587+0000", 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.898 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.454589+0000", 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.717e-06 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.454600+0000", 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.135e-05 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.454625+0000", 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5066999999999999e-05 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.454647+0000", 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1916000000000002e-05 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.456845+0000", 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0021984629999999999 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.456882+0000", 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6643000000000001e-05 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.459778+0000", 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0028957610000000002 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.459813+0000", 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5330000000000002e-05 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:75 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'44)", 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.455530+0000", 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.395556332999998, 2024-09-14T05:59:08.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043630500000000003, 2024-09-14T05:59:08.902 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.902 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.902 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.902 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.902 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.902 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.455530+0000", 2024-09-14T05:59:08.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.902 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.902 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.455530+0000", 2024-09-14T05:59:08.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.455532+0000", 2024-09-14T05:59:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.877e-06 2024-09-14T05:59:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.455601+0000", 2024-09-14T05:59:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9302999999999997e-05 2024-09-14T05:59:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.455633+0000", 2024-09-14T05:59:08.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2326000000000002e-05 2024-09-14T05:59:08.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.455665+0000", 2024-09-14T05:59:08.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2002999999999998e-05 2024-09-14T05:59:08.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.457712+0000", 2024-09-14T05:59:08.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002046511 2024-09-14T05:59:08.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.457744+0000", 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2512999999999999e-05 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.459817+0000", 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020722340000000001 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.459893+0000", 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6283000000000001e-05 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:76 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'44)", 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.456388+0000", 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.394697826000002, 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041309040000000003, 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.456388+0000", 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.456388+0000", 2024-09-14T05:59:08.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.456389+0000", 2024-09-14T05:59:08.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.176e-06 2024-09-14T05:59:08.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.456401+0000", 2024-09-14T05:59:08.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1056999999999999e-05 2024-09-14T05:59:08.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.456432+0000", 2024-09-14T05:59:08.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1563000000000003e-05 2024-09-14T05:59:08.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.456455+0000", 2024-09-14T05:59:08.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2580000000000001e-05 2024-09-14T05:59:08.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.458861+0000", 2024-09-14T05:59:08.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0024064680000000001 2024-09-14T05:59:08.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.458895+0000", 2024-09-14T05:59:08.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3686999999999998e-05 2024-09-14T05:59:08.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.460455+0000", 2024-09-14T05:59:08.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001559794 2024-09-14T05:59:08.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.460519+0000", 2024-09-14T05:59:08.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4579000000000006e-05 2024-09-14T05:59:08.910 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.910 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.910 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.910 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:77 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'55, mlcod=17'53)", 2024-09-14T05:59:08.910 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.461597+0000", 2024-09-14T05:59:08.910 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.389489352999998, 2024-09-14T05:59:08.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037700210000000001, 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.461597+0000", 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.461597+0000", 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.461599+0000", 2024-09-14T05:59:08.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7430000000000001e-06 2024-09-14T05:59:08.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.461712+0000", 2024-09-14T05:59:08.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000113966 2024-09-14T05:59:08.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.461742+0000", 2024-09-14T05:59:08.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.919e-05 2024-09-14T05:59:08.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.461765+0000", 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3646e-05 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.461958+0000", 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019220899999999999 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.461996+0000", 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8583e-05 2024-09-14T05:59:08.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.465291+0000", 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0032953539999999999 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.465367+0000", 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5329999999999999e-05 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.914 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:78 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'56, mlcod=17'53)", 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.462099+0000", 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.388987019999998, 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0033152910000000002, 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.462099+0000", 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.462099+0000", 2024-09-14T05:59:08.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.462100+0000", 2024-09-14T05:59:08.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3400000000000001e-06 2024-09-14T05:59:08.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.462216+0000", 2024-09-14T05:59:08.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000115955 2024-09-14T05:59:08.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.462240+0000", 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3677e-05 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.462271+0000", 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0596000000000003e-05 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.462918+0000", 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00064726499999999995 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.462956+0000", 2024-09-14T05:59:08.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8166e-05 2024-09-14T05:59:08.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.465373+0000", 2024-09-14T05:59:08.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0024171259999999999 2024-09-14T05:59:08.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.465414+0000", 2024-09-14T05:59:08.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1165999999999999e-05 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:79 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'57, mlcod=17'53)", 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.462560+0000", 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.388526438, 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029172949999999999, 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.462560+0000", 2024-09-14T05:59:08.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.462560+0000", 2024-09-14T05:59:08.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.462561+0000", 2024-09-14T05:59:08.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5000000000000001e-07 2024-09-14T05:59:08.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.462687+0000", 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000126453 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.462706+0000", 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9233e-05 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.462718+0000", 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1463e-05 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.463720+0000", 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001002693 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.463758+0000", 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7942999999999999e-05 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.465417+0000", 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0016584810000000001 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.465477+0000", 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0179000000000001e-05 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:80 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'58, mlcod=17'53)", 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.463147+0000", 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.387939568, 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0050041319999999997, 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.923 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.463147+0000", 2024-09-14T05:59:08.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.463147+0000", 2024-09-14T05:59:08.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.463148+0000", 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7659999999999999e-06 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.463262+0000", 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000114083 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.463286+0000", 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.41e-05 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.463308+0000", 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1149e-05 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.464421+0000", 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0011133849999999999 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.464485+0000", 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3723e-05 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.468067+0000", 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035826489999999998 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.468151+0000", 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3276999999999996e-05 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:92 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'66, mlcod=17'63)", 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.795336+0000", 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.055750005, 2024-09-14T05:59:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0033709640000000002, 2024-09-14T05:59:08.928 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.928 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.928 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.928 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.795336+0000", 2024-09-14T05:59:08.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.795336+0000", 2024-09-14T05:59:08.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.795337+0000", 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2720000000000001e-06 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.795347+0000", 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.251e-06 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.795363+0000", 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6782999999999998e-05 2024-09-14T05:59:08.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.795374+0000", 2024-09-14T05:59:08.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0127e-05 2024-09-14T05:59:08.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.795493+0000", 2024-09-14T05:59:08.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000119296 2024-09-14T05:59:08.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.795513+0000", 2024-09-14T05:59:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0486e-05 2024-09-14T05:59:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.798670+0000", 2024-09-14T05:59:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031570190000000001 2024-09-14T05:59:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.798707+0000", 2024-09-14T05:59:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6730000000000002e-05 2024-09-14T05:59:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.931 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.932 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:93 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'67, mlcod=17'63)", 2024-09-14T05:59:08.932 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.796451+0000", 2024-09-14T05:59:08.932 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.054634875000001, 2024-09-14T05:59:08.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004626153, 2024-09-14T05:59:08.932 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.932 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.932 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.932 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.796451+0000", 2024-09-14T05:59:08.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.796451+0000", 2024-09-14T05:59:08.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.796452+0000", 2024-09-14T05:59:08.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6199999999999997e-07 2024-09-14T05:59:08.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.796492+0000", 2024-09-14T05:59:08.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0388e-05 2024-09-14T05:59:08.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.796506+0000", 2024-09-14T05:59:08.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3667e-05 2024-09-14T05:59:08.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.796518+0000", 2024-09-14T05:59:08.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1834000000000001e-05 2024-09-14T05:59:08.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.796588+0000", 2024-09-14T05:59:08.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9775000000000002e-05 2024-09-14T05:59:08.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.796607+0000", 2024-09-14T05:59:08.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9400000000000001e-05 2024-09-14T05:59:08.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.936 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.801021+0000", 2024-09-14T05:59:08.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044144539999999999 2024-09-14T05:59:08.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.936 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.801077+0000", 2024-09-14T05:59:08.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5973000000000001e-05 2024-09-14T05:59:08.936 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.936 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.936 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.936 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4207.0:94 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'68, mlcod=17'64)", 2024-09-14T05:59:08.936 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:49.798035+0000", 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.053050926000001, 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0056557659999999996, 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.798035+0000", 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.798035+0000", 2024-09-14T05:59:08.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.798036+0000", 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2300000000000001e-07 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.798041+0000", 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4639999999999997e-06 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.798050+0000", 2024-09-14T05:59:08.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7350000000000002e-06 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.798055+0000", 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3569999999999997e-06 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.798373+0000", 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00031715999999999998 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.798401+0000", 2024-09-14T05:59:08.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8347000000000002e-05 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.803603+0000", 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.005202005 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:49.803691+0000", 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8075e-05 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:08.940 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:08.941 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:08.942 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:59:08.942 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:08.943+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:09.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:59:09.043 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:09.041+0000 7feccafba640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26385) UID: 0 2024-09-14T05:59:09.061 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:09.061 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:09.062 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:09.062 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:09.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:59:09.163 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:09.161+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:09.176 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T05:59:09.176 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:59:09.193 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:09.193 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:09.210 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:09.210 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:09.228 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:09.228 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:09.234 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:09.234 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:09.244 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:09.243+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:09.247 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:59:09.249 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:09.249 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:09.270 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:09.270 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:09.291 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:09.291 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:09.311 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:09.345 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:09.343+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:09.366 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:09.366 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:09.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:59:09.446 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:09.443+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:09.535 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:09.535 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:09.547 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:09.545+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:09.548 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:59:09.607 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-14T05:59:09.607 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:59:09.608 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-14T05:59:09.608 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T05:59:09.608 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T05:59:09.647 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:09.645+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:09.718 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:09.718 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:09.731 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:59:09.747 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:09.747+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:09.849 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:09.847+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:09.895 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:09.895 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:09.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:59:09.948 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:09.945+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:10.040 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:10.040 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:10.049 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:10.047+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:10.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:59:10.150 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:10.147+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:10.217 INFO:teuthology.orchestra.run.smithi006.stdout:skipping zero size read 2024-09-14T05:59:10.217 INFO:teuthology.orchestra.run.smithi006.stdout:truncating to largest ever: 0x5553bd3 2024-09-14T05:59:10.219 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:10.219 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:10.223 INFO:teuthology.orchestra.run.smithi006.stdout:2 trunc from 0x0 to 0x5553bd3 2024-09-14T05:59:10.234 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:59:10.235 INFO:teuthology.orchestra.run.smithi006.stdout:4 read 0x1aab66d thru 0x1ab9735 (0xe0c9 bytes) 2024-09-14T05:59:10.235 INFO:teuthology.orchestra.run.smithi006.stdout:7 punch from 0x4644cc1 to 0x464f6a5, (0xa9e4 bytes) 2024-09-14T05:59:10.235 INFO:teuthology.orchestra.run.smithi006.stdout:9 read 0x781306 thru 0x7878d2 (0x65cd bytes) 2024-09-14T05:59:10.235 INFO:teuthology.orchestra.run.smithi006.stdout:10 read 0x3a0118d thru 0x3a0b2c6 (0xa13a bytes) 2024-09-14T05:59:10.251 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:10.249+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:10.254 INFO:teuthology.orchestra.run.smithi006.stdout:11 write 0xaf63bdf thru 0xaf66478 (0x289a bytes) 2024-09-14T05:59:10.353 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:10.349+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:10.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:59:10.398 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:10.398 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:10.412 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:59:10.455 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:10.455+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:10.539 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:10.539 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:10.553 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:59:10.555 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:10.553+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:10.655 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:10.655+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:10.722 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:10.722 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:10.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:59:10.756 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:10.753+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:10.857 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:10.853+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:10.904 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:10.904 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:10.918 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T05:59:10.963 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:10.963+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:11.041 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:11.041 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:11.055 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T05:59:11.059 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:11.057+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:11.159 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:11.159+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:11.222 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:11.222 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:11.236 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T05:59:11.279 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:11.279+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:11.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:59:11.361 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:11.359+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:11.402 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:11.402 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:11.418 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T05:59:11.461 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:11.459+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:11.472 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T05:59:11.490 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:11.491 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:11.507 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:11.507 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:11.525 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:11.525 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:11.535 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2024-09-14T05:59:11.550 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:11.550 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:11.562 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:11.559+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:11.569 INFO:teuthology.orchestra.run.smithi006.stdout:12 writesame 0xeb7f1df thru 0xeb8311c data_size 0x5(0x3f3e bytes) 2024-09-14T05:59:11.569 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:11.569 INFO:teuthology.orchestra.run.smithi006.stdout:14 read 0xbd81286 thru 0xbd8a4e0 (0x925b bytes) 2024-09-14T05:59:11.569 INFO:teuthology.orchestra.run.smithi006.stdout:15 read 0x6a5b1b1 thru 0x6a6a915 (0xf765 bytes) 2024-09-14T05:59:11.569 INFO:teuthology.orchestra.run.smithi006.stdout:17 read 0x4ae14a2 thru 0x4ae7453 (0x5fb2 bytes) 2024-09-14T05:59:11.570 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:11.570 INFO:teuthology.orchestra.run.smithi006.stdout:19 write 0x7f273aa thru 0x7f2cd39 (0x5990 bytes) 2024-09-14T05:59:11.573 INFO:teuthology.orchestra.run.smithi006.stdout:22 read 0x521209e thru 0x52151c5 (0x3128 bytes) 2024-09-14T05:59:11.573 INFO:teuthology.orchestra.run.smithi006.stdout:23 write 0x6825a56 thru 0x6830618 (0xabc3 bytes) 2024-09-14T05:59:11.577 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:11.578 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:11.580 INFO:teuthology.orchestra.run.smithi006.stdout:24 read 0xa3d5dae thru 0xa3e4220 (0xe473 bytes) 2024-09-14T05:59:11.580 INFO:teuthology.orchestra.run.smithi006.stdout:truncating to largest ever: 0x87a877e 2024-09-14T05:59:11.588 INFO:teuthology.orchestra.run.smithi006.stdout:25 trunc from 0xeb8311d to 0x87a877e 2024-09-14T05:59:11.592 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:11.592 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:11.599 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:11.599 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:11.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T05:59:11.620 INFO:teuthology.orchestra.run.smithi006.stdout:26 write 0xd1431d0 thru 0xd146492 (0x32c3 bytes) 2024-09-14T05:59:11.621 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:11.621 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:11.624 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T05:59:11.625 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T05:59:11.625 INFO:teuthology.orchestra.run.smithi006.stdout:27 read 0xac493bd thru 0xac55a64 (0xc6a8 bytes) 2024-09-14T05:59:11.625 INFO:teuthology.orchestra.run.smithi006.stdout:30 punch from 0x27113b8 to 0x271c270, (0xaeb8 bytes) 2024-09-14T05:59:11.625 INFO:teuthology.orchestra.run.smithi006.stdout:31 write 0xcfcffce thru 0xcfde506 (0xe539 bytes) 2024-09-14T05:59:11.630 INFO:teuthology.orchestra.run.smithi006.stdout:truncating to largest ever: 0xec6af3b 2024-09-14T05:59:11.632 INFO:teuthology.orchestra.run.smithi006.stdout:32 trunc from 0xd146493 to 0xec6af3b 2024-09-14T05:59:11.645 INFO:teuthology.orchestra.run.smithi006.stdout:33 trunc from 0xec6af3b to 0xaf3f13e 2024-09-14T05:59:11.665 INFO:teuthology.orchestra.run.smithi006.stdout:34 writesame 0x4c5dd71 thru 0x4c6afaf data_size 0x4d(0xd23f bytes) 2024-09-14T05:59:11.683 INFO:teuthology.orchestra.run.smithi006.stdout:35 trunc from 0xaf3f13e to 0x33a3ba 2024-09-14T05:59:11.770 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:11.699+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:11.772 INFO:teuthology.orchestra.run.smithi006.stdout:37 read 0x27899c thru 0x27d341 (0x49a6 bytes) 2024-09-14T05:59:11.772 INFO:teuthology.orchestra.run.smithi006.stdout:38 writesame 0xadc62e3 thru 0xadd2092 data_size 0x14(0xbdb0 bytes) 2024-09-14T05:59:11.772 INFO:teuthology.orchestra.run.smithi006.stdout:40 punch from 0xc79c00 to 0xc839d7, (0x9dd7 bytes) 2024-09-14T05:59:11.772 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:11.772 INFO:teuthology.orchestra.run.smithi006.stdout:42 writesame 0xd94d7b6 thru 0xd95bfa4 data_size 0x19(0xe7ef bytes) 2024-09-14T05:59:11.772 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:11.772 INFO:teuthology.orchestra.run.smithi006.stdout:46 write 0x42f0153 thru 0x42fc52c (0xc3da bytes) 2024-09-14T05:59:11.772 INFO:teuthology.orchestra.run.smithi006.stdout:47 read 0x2ce4738 thru 0x2ce7c4a (0x3513 bytes) 2024-09-14T05:59:11.772 INFO:teuthology.orchestra.run.smithi006.stdout:49 write 0x9cdd3c4 thru 0x9ce0b6b (0x37a8 bytes) 2024-09-14T05:59:11.772 INFO:teuthology.orchestra.run.smithi006.stdout:50 punch from 0x4f51ed7 to 0x4f5b083, (0x91ac bytes) 2024-09-14T05:59:11.772 INFO:teuthology.orchestra.run.smithi006.stdout:51 write 0x5670f7f thru 0x567ee67 (0xdee9 bytes) 2024-09-14T05:59:11.772 INFO:teuthology.orchestra.run.smithi006.stdout:52 read 0xa72ecfd thru 0xa737bc9 (0x8ecd bytes) 2024-09-14T05:59:11.772 INFO:teuthology.orchestra.run.smithi006.stdout:53 writesame 0x518e933 thru 0x5199f72 data_size 0xc0(0xb640 bytes) 2024-09-14T05:59:11.773 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:11.769+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:11.773 INFO:teuthology.orchestra.run.smithi006.stdout:56 read 0x2d7dae5 thru 0x2d834ac (0x59c8 bytes) 2024-09-14T05:59:11.773 INFO:teuthology.orchestra.run.smithi006.stdout:57 writesame 0x16e7d05 thru 0x16ecaf5 data_size 0x9(0x4df1 bytes) 2024-09-14T05:59:11.777 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:11.777 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:11.777 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:11.777 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:11.777 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:11.782 INFO:teuthology.orchestra.run.smithi006.stdout:59 write 0x88ec4c1 thru 0x88f5eee (0x9a2e bytes) 2024-09-14T05:59:11.787 INFO:teuthology.orchestra.run.smithi006.stdout:60 writesame 0x3e41241 thru 0x3e4d993 data_size 0x49(0xc753 bytes) 2024-09-14T05:59:11.793 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T05:59:11.795 INFO:teuthology.orchestra.run.smithi006.stdout:62 read 0x2e6f4d3 thru 0x2e7e2a6 (0xedd4 bytes) 2024-09-14T05:59:11.795 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:11.817 INFO:teuthology.orchestra.run.smithi006.stdout:66 trunc from 0xd95bfa5 to 0x46d2566 2024-09-14T05:59:11.861 INFO:teuthology.orchestra.run.smithi006.stdout:67 writesame 0x85b4fd3 thru 0x85b63ed data_size 0x1(0x141b bytes) 2024-09-14T05:59:11.861 INFO:teuthology.orchestra.run.smithi006.stdout:71 write 0x6525e65 thru 0x6528e5d (0x2ff9 bytes) 2024-09-14T05:59:11.868 INFO:teuthology.orchestra.run.smithi006.stdout:72 punch from 0x57abd4c to 0x57baf09, (0xf1bd bytes) 2024-09-14T05:59:11.881 INFO:teuthology.orchestra.run.smithi006.stdout:74 writesame 0x8f5a982 thru 0x8f644c0 data_size 0x1(0x9b3f bytes) 2024-09-14T05:59:11.881 INFO:teuthology.orchestra.run.smithi006.stdout:75 write 0x12a107a thru 0x12af4aa (0xe431 bytes) 2024-09-14T05:59:11.883 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:11.883+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:11.889 INFO:teuthology.orchestra.run.smithi006.stdout:76 read 0x62a03fd thru 0x62a04f5 (0xf9 bytes) 2024-09-14T05:59:11.889 INFO:teuthology.orchestra.run.smithi006.stdout:77 read 0x83f570f thru 0x83fa433 (0x4d25 bytes) 2024-09-14T05:59:11.889 INFO:teuthology.orchestra.run.smithi006.stdout:78 write 0x146c625 thru 0x1478f38 (0xc914 bytes) 2024-09-14T05:59:11.897 INFO:teuthology.orchestra.run.smithi006.stdout:79 trunc from 0x8f644c1 to 0x7192ad5 2024-09-14T05:59:11.910 INFO:teuthology.orchestra.run.smithi006.stdout:81 read 0x382dac7 thru 0x382fdb8 (0x22f2 bytes) 2024-09-14T05:59:11.910 INFO:teuthology.orchestra.run.smithi006.stdout:82 read 0x1ba3357 thru 0x1bb19d3 (0xe67d bytes) 2024-09-14T05:59:11.920 INFO:teuthology.orchestra.run.smithi006.stdout:84 trunc from 0x7192ad5 to 0xa936aff 2024-09-14T05:59:11.934 INFO:teuthology.orchestra.run.smithi006.stdout:87 read 0x7737b07 thru 0x773c5cf (0x4ac9 bytes) 2024-09-14T05:59:11.934 INFO:teuthology.orchestra.run.smithi006.stdout:88 read 0x127b2a3 thru 0x1285e6d (0xabcb bytes) 2024-09-14T05:59:11.935 INFO:teuthology.orchestra.run.smithi006.stdout:89 write 0x3604747 thru 0x3613178 (0xea32 bytes) 2024-09-14T05:59:11.942 INFO:teuthology.orchestra.run.smithi006.stdout:91 punch from 0x5e6c6a4 to 0x5e7c3f9, (0xfd55 bytes) 2024-09-14T05:59:11.942 INFO:teuthology.orchestra.run.smithi006.stdout:94 write 0xa263c77 thru 0xa272e7b (0xf205 bytes) 2024-09-14T05:59:11.950 INFO:teuthology.orchestra.run.smithi006.stdout:95 read 0x4438ebe thru 0x44449cb (0xbb0e bytes) 2024-09-14T05:59:11.950 INFO:teuthology.orchestra.run.smithi006.stdout:96 punch from 0x5235c17 to 0x5243ded, (0xe1d6 bytes) 2024-09-14T05:59:11.950 INFO:teuthology.orchestra.run.smithi006.stdout:97 read 0x977a64b thru 0x977bffe (0x19b4 bytes) 2024-09-14T05:59:11.971 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:11.971 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:11.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:11.971 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:11.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.971 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:11.971 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.197632+0000", 2024-09-14T05:59:11.971 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.772993044, 2024-09-14T05:59:11.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012882944, 2024-09-14T05:59:11.971 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:11.971 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:11.971 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 42 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.197632+0000", 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.197632+0000", 2024-09-14T05:59:11.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.197633+0000", 2024-09-14T05:59:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6199999999999999e-06 2024-09-14T05:59:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.197646+0000", 2024-09-14T05:59:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2874000000000001e-05 2024-09-14T05:59:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:11.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.197679+0000", 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3256000000000001e-05 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.197694+0000", 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5057e-05 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.202161+0000", 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044662850000000004 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.202438+0000", 2024-09-14T05:59:11.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027702500000000003 2024-09-14T05:59:11.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:11.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.202643+0000", 2024-09-14T05:59:11.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020561099999999999 2024-09-14T05:59:11.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:11.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.204411+0000", 2024-09-14T05:59:11.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0017682189999999999 2024-09-14T05:59:11.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:11.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210328+0000", 2024-09-14T05:59:11.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059166710000000001 2024-09-14T05:59:11.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:11.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210405+0000", 2024-09-14T05:59:11.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6379999999999997e-05 2024-09-14T05:59:11.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:11.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210514+0000", 2024-09-14T05:59:11.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010994599999999999 2024-09-14T05:59:11.976 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:11.976 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:11.976 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198145+0000", 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.772479623999999, 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012555759, 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 43 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:11.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:11.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198145+0000", 2024-09-14T05:59:11.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:11.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:11.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198145+0000", 2024-09-14T05:59:11.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:11.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:11.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198147+0000", 2024-09-14T05:59:11.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1129999999999999e-06 2024-09-14T05:59:11.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:11.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198161+0000", 2024-09-14T05:59:11.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.431e-05 2024-09-14T05:59:11.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:11.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198196+0000", 2024-09-14T05:59:11.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4943000000000001e-05 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198215+0000", 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9117e-05 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.203318+0000", 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051027169999999997 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.203446+0000", 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012750200000000001 2024-09-14T05:59:11.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.203639+0000", 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019343799999999999 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.207678+0000", 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040387959999999999 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210540+0000", 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028623440000000002 2024-09-14T05:59:11.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210606+0000", 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5573000000000004e-05 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210701+0000", 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4906000000000002e-05 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:11.982 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198301+0000", 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.772323374999999, 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017830464000000001, 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 44 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198301+0000", 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:11.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:11.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198301+0000", 2024-09-14T05:59:11.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:11.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:11.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198303+0000", 2024-09-14T05:59:11.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2029999999999999e-06 2024-09-14T05:59:11.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:11.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198425+0000", 2024-09-14T05:59:11.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012151599999999999 2024-09-14T05:59:11.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:11.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198448+0000", 2024-09-14T05:59:11.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3485999999999998e-05 2024-09-14T05:59:11.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:11.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198470+0000", 2024-09-14T05:59:11.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1433e-05 2024-09-14T05:59:11.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.204821+0000", 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0063514239999999996 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.205111+0000", 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000289711 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.205413+0000", 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030177099999999999 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:11.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.207849+0000", 2024-09-14T05:59:11.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024361510000000001 2024-09-14T05:59:11.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:11.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.215901+0000", 2024-09-14T05:59:11.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0080523179999999993 2024-09-14T05:59:11.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.215987+0000", 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6201999999999999e-05 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216132+0000", 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014424899999999999 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198525+0000", 2024-09-14T05:59:11.988 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.772099490999999, 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017790258999999999, 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198525+0000", 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:11.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198525+0000", 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198527+0000", 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.77e-06 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198539+0000", 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2634e-05 2024-09-14T05:59:11.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198560+0000", 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0656e-05 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198575+0000", 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4756999999999999e-05 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.206367+0000", 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0077922160000000002 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:11.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.206499+0000", 2024-09-14T05:59:11.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000132349 2024-09-14T05:59:11.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:11.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.206710+0000", 2024-09-14T05:59:11.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021102100000000001 2024-09-14T05:59:11.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:11.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210809+0000", 2024-09-14T05:59:11.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040987649999999999 2024-09-14T05:59:11.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:11.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216150+0000", 2024-09-14T05:59:11.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053402520000000002 2024-09-14T05:59:11.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:11.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216218+0000", 2024-09-14T05:59:11.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8539000000000002e-05 2024-09-14T05:59:11.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:11.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216315+0000", 2024-09-14T05:59:11.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7299999999999993e-05 2024-09-14T05:59:11.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:11.994 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:11.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:11.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.994 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:11.994 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198609+0000", 2024-09-14T05:59:11.994 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.772015965000001, 2024-09-14T05:59:11.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017922038000000001, 2024-09-14T05:59:11.994 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:11.994 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:11.995 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:11.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:11.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:11.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:11.995 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 46 2024-09-14T05:59:11.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.995 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:11.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:11.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198609+0000", 2024-09-14T05:59:11.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:11.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:11.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198609+0000", 2024-09-14T05:59:11.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:11.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:11.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198610+0000", 2024-09-14T05:59:11.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.474e-06 2024-09-14T05:59:11.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:11.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198621+0000", 2024-09-14T05:59:11.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0696000000000001e-05 2024-09-14T05:59:11.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:11.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198635+0000", 2024-09-14T05:59:11.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4042999999999999e-05 2024-09-14T05:59:11.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:11.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198643+0000", 2024-09-14T05:59:11.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0099999999999995e-06 2024-09-14T05:59:11.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.208126+0000", 2024-09-14T05:59:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094826830000000004 2024-09-14T05:59:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.208257+0000", 2024-09-14T05:59:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013192600000000001 2024-09-14T05:59:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.208469+0000", 2024-09-14T05:59:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000211342 2024-09-14T05:59:11.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.210935+0000", 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002466261 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216348+0000", 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054124840000000004 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216433+0000", 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5515999999999999e-05 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:11.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216531+0000", 2024-09-14T05:59:12.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7602999999999994e-05 2024-09-14T05:59:12.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.000 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.000 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.000 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198662+0000", 2024-09-14T05:59:12.000 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.771962788, 2024-09-14T05:59:12.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018079332, 2024-09-14T05:59:12.001 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.001 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.001 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.001 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 47 2024-09-14T05:59:12.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.001 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198662+0000", 2024-09-14T05:59:12.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198662+0000", 2024-09-14T05:59:12.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198663+0000", 2024-09-14T05:59:12.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8000000000000004e-07 2024-09-14T05:59:12.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198767+0000", 2024-09-14T05:59:12.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104262 2024-09-14T05:59:12.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198780+0000", 2024-09-14T05:59:12.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3253e-05 2024-09-14T05:59:12.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198789+0000", 2024-09-14T05:59:12.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8570000000000001e-06 2024-09-14T05:59:12.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.209052+0000", 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010262817 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.209186+0000", 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013397499999999999 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.209407+0000", 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022110899999999999 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.213132+0000", 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037247270000000002 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216548+0000", 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034159839999999999 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216641+0000", 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3548999999999995e-05 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216741+0000", 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9919000000000003e-05 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198807+0000", 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.771817812999998, 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018163529000000001, 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.006 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198807+0000", 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198807+0000", 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198808+0000", 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0640000000000001e-06 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198826+0000", 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8165999999999999e-05 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198837+0000", 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1073999999999999e-05 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198847+0000", 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4760000000000004e-06 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.211015+0000", 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012168442 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.211140+0000", 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000125346 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.211348+0000", 2024-09-14T05:59:12.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020795399999999999 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.213283+0000", 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0019344690000000001 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216755+0000", 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034720060000000001 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216864+0000", 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010964299999999999 2024-09-14T05:59:12.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.216970+0000", 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105889 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198860+0000", 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.771764637, 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019221714000000001, 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.011 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.012 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.012 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.012 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.012 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.012 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 49 2024-09-14T05:59:12.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.012 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198860+0000", 2024-09-14T05:59:12.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198860+0000", 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198877+0000", 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7254000000000001e-05 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198884+0000", 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8129999999999998e-06 2024-09-14T05:59:12.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198895+0000", 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0536e-05 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198902+0000", 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4739999999999999e-06 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.211923+0000", 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013020959 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.212065+0000", 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000141605 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.212258+0000", 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000193065 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.215745+0000", 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034873259999999998 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.217915+0000", 2024-09-14T05:59:12.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021705069999999999 2024-09-14T05:59:12.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.217983+0000", 2024-09-14T05:59:12.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7465999999999994e-05 2024-09-14T05:59:12.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218082+0000", 2024-09-14T05:59:12.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8709000000000006e-05 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.198940+0000", 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.771684260000001, 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019336696, 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.017 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 50 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198940+0000", 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198940+0000", 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.198941+0000", 2024-09-14T05:59:12.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.06e-06 2024-09-14T05:59:12.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199017+0000", 2024-09-14T05:59:12.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5825e-05 2024-09-14T05:59:12.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199034+0000", 2024-09-14T05:59:12.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6990000000000002e-05 2024-09-14T05:59:12.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199043+0000", 2024-09-14T05:59:12.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.02e-06 2024-09-14T05:59:12.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.213411+0000", 2024-09-14T05:59:12.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014367988 2024-09-14T05:59:12.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.213628+0000", 2024-09-14T05:59:12.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021679199999999999 2024-09-14T05:59:12.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.213836+0000", 2024-09-14T05:59:12.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020794499999999999 2024-09-14T05:59:12.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.215878+0000", 2024-09-14T05:59:12.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002041738 2024-09-14T05:59:12.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218095+0000", 2024-09-14T05:59:12.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022170890000000002 2024-09-14T05:59:12.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218183+0000", 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8115999999999995e-05 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218277+0000", 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4133000000000002e-05 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.199060+0000", 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.771564935000001, 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019363086000000002, 2024-09-14T05:59:12.023 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 51 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199060+0000", 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199060+0000", 2024-09-14T05:59:12.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199061+0000", 2024-09-14T05:59:12.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8700000000000004e-07 2024-09-14T05:59:12.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199067+0000", 2024-09-14T05:59:12.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3430000000000001e-06 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199082+0000", 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4749999999999999e-05 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199090+0000", 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7770000000000002e-06 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.214757+0000", 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015667441000000001 2024-09-14T05:59:12.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.214899+0000", 2024-09-14T05:59:12.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014178899999999999 2024-09-14T05:59:12.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.215109+0000", 2024-09-14T05:59:12.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021052199999999999 2024-09-14T05:59:12.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.217893+0000", 2024-09-14T05:59:12.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0027838350000000001 2024-09-14T05:59:12.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218287+0000", 2024-09-14T05:59:12.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039345299999999999 2024-09-14T05:59:12.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218359+0000", 2024-09-14T05:59:12.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2773000000000003e-05 2024-09-14T05:59:12.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218423+0000", 2024-09-14T05:59:12.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3416000000000004e-05 2024-09-14T05:59:12.029 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.029 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.029 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.029 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.029 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.199101+0000", 2024-09-14T05:59:12.030 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.771523171999998, 2024-09-14T05:59:12.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020142773999999999, 2024-09-14T05:59:12.030 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.030 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.030 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.030 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.030 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.030 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.030 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 52 2024-09-14T05:59:12.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.030 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199101+0000", 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199101+0000", 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199102+0000", 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2999999999999999e-07 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199109+0000", 2024-09-14T05:59:12.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2069999999999998e-06 2024-09-14T05:59:12.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199145+0000", 2024-09-14T05:59:12.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5138999999999997e-05 2024-09-14T05:59:12.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.199153+0000", 2024-09-14T05:59:12.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1300000000000001e-06 2024-09-14T05:59:12.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.217061+0000", 2024-09-14T05:59:12.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017908231 2024-09-14T05:59:12.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.217201+0000", 2024-09-14T05:59:12.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013981599999999999 2024-09-14T05:59:12.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.217400+0000", 2024-09-14T05:59:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199385 2024-09-14T05:59:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.218837+0000", 2024-09-14T05:59:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001436615 2024-09-14T05:59:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.219119+0000", 2024-09-14T05:59:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028253499999999999 2024-09-14T05:59:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.219191+0000", 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2142000000000001e-05 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.219244+0000", 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2744000000000002e-05 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.449419+0000", 2024-09-14T05:59:12.035 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.521205330000001, 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012936479000000001, 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 70 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449419+0000", 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449419+0000", 2024-09-14T05:59:12.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449420+0000", 2024-09-14T05:59:12.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.136e-06 2024-09-14T05:59:12.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449429+0000", 2024-09-14T05:59:12.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3170000000000002e-06 2024-09-14T05:59:12.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449439+0000", 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0759e-05 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449447+0000", 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0180000000000001e-06 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.453417+0000", 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0039694420000000001 2024-09-14T05:59:12.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.453521+0000", 2024-09-14T05:59:12.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010397500000000001 2024-09-14T05:59:12.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.453681+0000", 2024-09-14T05:59:12.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016051999999999999 2024-09-14T05:59:12.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.456154+0000", 2024-09-14T05:59:12.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024730049999999999 2024-09-14T05:59:12.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462274+0000", 2024-09-14T05:59:12.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006119322 2024-09-14T05:59:12.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462322+0000", 2024-09-14T05:59:12.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8186999999999998e-05 2024-09-14T05:59:12.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462356+0000", 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3797999999999997e-05 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.449491+0000", 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.521133787, 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013062363, 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.041 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 71 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449491+0000", 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449491+0000", 2024-09-14T05:59:12.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449492+0000", 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.085e-06 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449499+0000", 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2130000000000002e-06 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449516+0000", 2024-09-14T05:59:12.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7289e-05 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449525+0000", 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.901e-06 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.454116+0000", 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045903740000000004 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.454185+0000", 2024-09-14T05:59:12.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8912999999999996e-05 2024-09-14T05:59:12.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.454389+0000", 2024-09-14T05:59:12.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020446799999999999 2024-09-14T05:59:12.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.457305+0000", 2024-09-14T05:59:12.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029157979999999998 2024-09-14T05:59:12.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462412+0000", 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051068579999999997 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462498+0000", 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6730000000000005e-05 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462553+0000", 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4734000000000001e-05 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.047 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.047 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.449542+0000", 2024-09-14T05:59:12.047 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.521082155999999, 2024-09-14T05:59:12.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013186082, 2024-09-14T05:59:12.047 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.047 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.047 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.047 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 72 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449542+0000", 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449542+0000", 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449543+0000", 2024-09-14T05:59:12.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1800000000000005e-07 2024-09-14T05:59:12.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449609+0000", 2024-09-14T05:59:12.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5724999999999998e-05 2024-09-14T05:59:12.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449620+0000", 2024-09-14T05:59:12.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0773e-05 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449628+0000", 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5969999999999992e-06 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.454820+0000", 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051917810000000003 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.454919+0000", 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8443999999999995e-05 2024-09-14T05:59:12.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.455028+0000", 2024-09-14T05:59:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108973 2024-09-14T05:59:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.457581+0000", 2024-09-14T05:59:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025533969999999998 2024-09-14T05:59:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462623+0000", 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050425399999999999 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462682+0000", 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8179e-05 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462729+0000", 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6854999999999998e-05 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.449647+0000", 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.520977451, 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013197947999999999, 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 73 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449647+0000", 2024-09-14T05:59:12.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449647+0000", 2024-09-14T05:59:12.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449648+0000", 2024-09-14T05:59:12.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0800000000000003e-07 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449655+0000", 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2529999999999998e-06 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449666+0000", 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.097e-05 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449674+0000", 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6179999999999997e-06 2024-09-14T05:59:12.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.456189+0000", 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065150800000000004 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.456257+0000", 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7578999999999998e-05 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.456364+0000", 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000107565 2024-09-14T05:59:12.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.459238+0000", 2024-09-14T05:59:12.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028741299999999999 2024-09-14T05:59:12.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462778+0000", 2024-09-14T05:59:12.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035401439999999998 2024-09-14T05:59:12.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462817+0000", 2024-09-14T05:59:12.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8498000000000003e-05 2024-09-14T05:59:12.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462845+0000", 2024-09-14T05:59:12.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8203000000000001e-05 2024-09-14T05:59:12.058 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.058 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.058 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.058 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.059 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.449707+0000", 2024-09-14T05:59:12.059 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.520917556000001, 2024-09-14T05:59:12.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013289877, 2024-09-14T05:59:12.059 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.059 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.059 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.059 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.059 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.059 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.059 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 74 2024-09-14T05:59:12.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449707+0000", 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449707+0000", 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449708+0000", 2024-09-14T05:59:12.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8100000000000001e-07 2024-09-14T05:59:12.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449715+0000", 2024-09-14T05:59:12.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1590000000000004e-06 2024-09-14T05:59:12.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449726+0000", 2024-09-14T05:59:12.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0400999999999999e-05 2024-09-14T05:59:12.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449733+0000", 2024-09-14T05:59:12.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3540000000000002e-06 2024-09-14T05:59:12.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.456807+0000", 2024-09-14T05:59:12.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0070744390000000001 2024-09-14T05:59:12.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.456878+0000", 2024-09-14T05:59:12.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0827999999999993e-05 2024-09-14T05:59:12.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.456984+0000", 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010630599999999999 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.459245+0000", 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022606739999999998 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462910+0000", 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036647199999999998 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462951+0000", 2024-09-14T05:59:12.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1124000000000001e-05 2024-09-14T05:59:12.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.462997+0000", 2024-09-14T05:59:12.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5890999999999998e-05 2024-09-14T05:59:12.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.064 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.064 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.449767+0000", 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.520857830000001, 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013370356, 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 75 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449767+0000", 2024-09-14T05:59:12.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449767+0000", 2024-09-14T05:59:12.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449768+0000", 2024-09-14T05:59:12.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.012e-06 2024-09-14T05:59:12.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449837+0000", 2024-09-14T05:59:12.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9581999999999999e-05 2024-09-14T05:59:12.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449884+0000", 2024-09-14T05:59:12.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6554000000000002e-05 2024-09-14T05:59:12.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449908+0000", 2024-09-14T05:59:12.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3901e-05 2024-09-14T05:59:12.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.457658+0000", 2024-09-14T05:59:12.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007750659 2024-09-14T05:59:12.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.457727+0000", 2024-09-14T05:59:12.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8898000000000003e-05 2024-09-14T05:59:12.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.457845+0000", 2024-09-14T05:59:12.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011805499999999999 2024-09-14T05:59:12.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.459475+0000", 2024-09-14T05:59:12.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001629609 2024-09-14T05:59:12.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.463060+0000", 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035845220000000001 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.463108+0000", 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8597000000000002e-05 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.463137+0000", 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8966999999999999e-05 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.070 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.449928+0000", 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.520696692000001, 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013395371999999999, 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 76 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.071 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449928+0000", 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449928+0000", 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449929+0000", 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7399999999999991e-07 2024-09-14T05:59:12.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449938+0000", 2024-09-14T05:59:12.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9209999999999998e-06 2024-09-14T05:59:12.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449951+0000", 2024-09-14T05:59:12.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3097e-05 2024-09-14T05:59:12.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.449962+0000", 2024-09-14T05:59:12.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1379000000000001e-05 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.458622+0000", 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086600789999999993 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.458693+0000", 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0381000000000003e-05 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.458837+0000", 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000144466 2024-09-14T05:59:12.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.460237+0000", 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014002350000000001 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.463257+0000", 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030190920000000001 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.463295+0000", 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8275999999999997e-05 2024-09-14T05:59:12.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.463323+0000", 2024-09-14T05:59:12.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8472000000000001e-05 2024-09-14T05:59:12.076 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.076 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.076 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.076 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:93 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.076 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.791537+0000", 2024-09-14T05:59:12.076 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.179087320000001, 2024-09-14T05:59:12.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012592311, 2024-09-14T05:59:12.076 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 93 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791537+0000", 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791537+0000", 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791538+0000", 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0100000000000004e-07 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791614+0000", 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6470000000000005e-05 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791628+0000", 2024-09-14T05:59:12.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3740000000000001e-05 2024-09-14T05:59:12.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791637+0000", 2024-09-14T05:59:12.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1530000000000003e-06 2024-09-14T05:59:12.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.798617+0000", 2024-09-14T05:59:12.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069797330000000001 2024-09-14T05:59:12.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.798672+0000", 2024-09-14T05:59:12.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5203e-05 2024-09-14T05:59:12.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.798760+0000", 2024-09-14T05:59:12.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7631000000000002e-05 2024-09-14T05:59:12.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.801083+0000", 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00232329 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.803962+0000", 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028785780000000001 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.804060+0000", 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8579000000000006e-05 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.804130+0000", 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9233000000000006e-05 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4207.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:58:49.791654+0000", 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.178970205999999, 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015048914, 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.082 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:12.083 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4207", 2024-09-14T05:59:12.083 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.154:0/740275942", 2024-09-14T05:59:12.083 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 94 2024-09-14T05:59:12.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.083 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:12.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:12.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791654+0000", 2024-09-14T05:59:12.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:12.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791654+0000", 2024-09-14T05:59:12.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:12.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:12.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791655+0000", 2024-09-14T05:59:12.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7699999999999992e-07 2024-09-14T05:59:12.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:12.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791662+0000", 2024-09-14T05:59:12.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2990000000000002e-06 2024-09-14T05:59:12.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:12.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791671+0000", 2024-09-14T05:59:12.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.747e-06 2024-09-14T05:59:12.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.791685+0000", 2024-09-14T05:59:12.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.314e-05 2024-09-14T05:59:12.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:12.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.800114+0000", 2024-09-14T05:59:12.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084294509999999993 2024-09-14T05:59:12.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:12.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.800229+0000", 2024-09-14T05:59:12.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011540999999999999 2024-09-14T05:59:12.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T05:59:12.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.800454+0000", 2024-09-14T05:59:12.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225011 2024-09-14T05:59:12.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.801729+0000", 2024-09-14T05:59:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0012740869999999999 2024-09-14T05:59:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.806569+0000", 2024-09-14T05:59:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048402189999999998 2024-09-14T05:59:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.806646+0000", 2024-09-14T05:59:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7052999999999996e-05 2024-09-14T05:59:12.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:12.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:12.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:12.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:58:49.806703+0000", 2024-09-14T05:59:12.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7519999999999998e-05 2024-09-14T05:59:12.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.088 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:12.088 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:12.088 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:12.090 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:12.087+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:12.090 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:59:12.091 INFO:teuthology.orchestra.run.smithi006.stdout:99 trunc from 0xa936aff to 0xa22ab0 2024-09-14T05:59:12.091 INFO:teuthology.orchestra.run.smithi006.stdout:100 writesame 0x52695d2 thru 0x5277d37 data_size 0x1b(0xe766 bytes) 2024-09-14T05:59:12.091 INFO:teuthology.orchestra.run.smithi006.stdout:101 writesame 0xdc1584e thru 0xdc207c2 data_size 0x1(0xaf75 bytes) 2024-09-14T05:59:12.091 INFO:teuthology.orchestra.run.smithi006.stdout:103 write 0xd38eb2b thru 0xd39a7e8 (0xbcbe bytes) 2024-09-14T05:59:12.091 INFO:teuthology.orchestra.run.smithi006.stdout:104 punch from 0x4d55433 to 0x4d64ddb, (0xf9a8 bytes) 2024-09-14T05:59:12.091 INFO:teuthology.orchestra.run.smithi006.stdout:105 punch from 0xd3609de to 0xd3651cf, (0x47f1 bytes) 2024-09-14T05:59:12.091 INFO:teuthology.orchestra.run.smithi006.stdout:106 punch from 0x7cac5c to 0x7d82f3, (0xd697 bytes) 2024-09-14T05:59:12.091 INFO:teuthology.orchestra.run.smithi006.stdout:107 write 0x20d2a70 thru 0x20d865b (0x5bec bytes) 2024-09-14T05:59:12.115 INFO:teuthology.orchestra.run.smithi006.stdout:109 trunc from 0xdc207c3 to 0x19c6b1e 2024-09-14T05:59:12.138 INFO:teuthology.orchestra.run.smithi006.stdout:111 punch from 0x11940e0 to 0x1197e32, (0x3d52 bytes) 2024-09-14T05:59:12.138 INFO:teuthology.orchestra.run.smithi006.stdout:113 writesame 0xc07f2a thru 0xc12251 data_size 0x2(0xa328 bytes) 2024-09-14T05:59:12.190 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:12.185+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:12.198 INFO:teuthology.orchestra.run.smithi006.stdout:115 write 0x917d109 thru 0x917f39b (0x2293 bytes) 2024-09-14T05:59:12.206 INFO:teuthology.orchestra.run.smithi006.stdout:116 read 0x35e4fb3 thru 0x35f07c3 (0xb811 bytes) 2024-09-14T05:59:12.206 INFO:teuthology.orchestra.run.smithi006.stdout:118 punch from 0x1d33e05 to 0x1d384eb, (0x46e6 bytes) 2024-09-14T05:59:12.210 INFO:teuthology.orchestra.run.smithi006.stdout:119 trunc from 0x917f39c to 0xab731f6 2024-09-14T05:59:12.243 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:12.243 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:12.243 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:12.243 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:12.244 INFO:teuthology.orchestra.run.smithi006.stdout:122 writesame 0xcb14cc6 thru 0xcb15839 data_size 0x2(0xb74 bytes) 2024-09-14T05:59:12.244 INFO:teuthology.orchestra.run.smithi006.stdout:123 write 0x8b298e9 thru 0x8b38df1 (0xf509 bytes) 2024-09-14T05:59:12.251 INFO:teuthology.orchestra.run.smithi006.stdout:126 punch from 0xaece2a2 to 0xaedd87a, (0xf5d8 bytes) 2024-09-14T05:59:12.251 INFO:teuthology.orchestra.run.smithi006.stdout:129 punch from 0xafcd803 to 0xafceccf, (0x14cc bytes) 2024-09-14T05:59:12.251 INFO:teuthology.orchestra.run.smithi006.stdout:132 write 0x4912685 thru 0x491b6b0 (0x902c bytes) 2024-09-14T05:59:12.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:59:12.277 INFO:teuthology.orchestra.run.smithi006.stdout:133 write 0xe67a20d thru 0xe687a42 (0xd836 bytes) 2024-09-14T05:59:12.283 INFO:teuthology.orchestra.run.smithi006.stdout:134 writesame 0x533e793 thru 0x534257b data_size 0x9(0x3de9 bytes) 2024-09-14T05:59:12.291 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:12.287+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:12.298 INFO:teuthology.orchestra.run.smithi006.stdout:135 trunc from 0xe687a43 to 0xa23a091 2024-09-14T05:59:12.319 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:12.319 INFO:teuthology.orchestra.run.smithi006.stdout:137 punch from 0x190b90 to 0x19c800, (0xbc70 bytes) 2024-09-14T05:59:12.321 INFO:teuthology.orchestra.run.smithi006.stdout:139 trunc from 0xa23a091 to 0xb37504a 2024-09-14T05:59:12.336 INFO:teuthology.orchestra.run.smithi006.stdout:140 writesame 0x2bdd2d0 thru 0x2be4387 data_size 0x4(0x70b8 bytes) 2024-09-14T05:59:12.343 INFO:teuthology.orchestra.run.smithi006.stdout:141 writesame 0xf39150 thru 0xf3cd84 data_size 0x1(0x3c35 bytes) 2024-09-14T05:59:12.356 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:12.365 INFO:teuthology.orchestra.run.smithi006.stdout:143 trunc from 0xb37504a to 0x52c9fc0 2024-09-14T05:59:12.392 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:12.389+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:12.412 INFO:teuthology.orchestra.run.smithi006.stdout:144 write 0x72bd23b thru 0x72cc7c6 (0xf58c bytes) 2024-09-14T05:59:12.415 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:12.415 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:12.415 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:12.415 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:12.415 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:12.420 INFO:teuthology.orchestra.run.smithi006.stdout:146 read 0x23bf8da thru 0x23c0e78 (0x159f bytes) 2024-09-14T05:59:12.420 INFO:teuthology.orchestra.run.smithi006.stdout:147 punch from 0x2351a74 to 0x235507c, (0x3608 bytes) 2024-09-14T05:59:12.426 INFO:teuthology.orchestra.run.smithi006.stdout:148 trunc from 0x72cc7c7 to 0x498801f 2024-09-14T05:59:12.433 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:59:12.466 INFO:teuthology.orchestra.run.smithi006.stdout:149 write 0x57b0e2a thru 0x57b1329 (0x500 bytes) 2024-09-14T05:59:12.472 INFO:teuthology.orchestra.run.smithi006.stdout:151 punch from 0x47b98e1 to 0x47bbe94, (0x25b3 bytes) 2024-09-14T05:59:12.481 INFO:teuthology.orchestra.run.smithi006.stdout:152 trunc from 0x57b132a to 0x943859a 2024-09-14T05:59:12.493 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:12.491+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:12.504 INFO:teuthology.orchestra.run.smithi006.stdout:154 write 0x968e1fa thru 0x96913a3 (0x31aa bytes) 2024-09-14T05:59:12.511 INFO:teuthology.orchestra.run.smithi006.stdout:155 punch from 0x47e3560 to 0x47eddb3, (0xa853 bytes) 2024-09-14T05:59:12.511 INFO:teuthology.orchestra.run.smithi006.stdout:157 read 0x4830bd6 thru 0x48353ca (0x47f5 bytes) 2024-09-14T05:59:12.524 INFO:teuthology.orchestra.run.smithi006.stdout:158 writesame 0x9de68b0 thru 0x9de8123 data_size 0xa(0x1874 bytes) 2024-09-14T05:59:12.537 INFO:teuthology.orchestra.run.smithi006.stdout:160 write 0x9fd7fa0 thru 0x9fd977a (0x17db bytes) 2024-09-14T05:59:12.561 INFO:teuthology.orchestra.run.smithi006.stdout:161 trunc from 0x9fd977b to 0x22c523f 2024-09-14T05:59:12.591 INFO:teuthology.orchestra.run.smithi006.stdout:162 punch from 0x20bc88c to 0x20c7ca1, (0xb415 bytes) 2024-09-14T05:59:12.593 INFO:teuthology.orchestra.run.smithi006.stdout:164 trunc from 0x22c523f to 0x2f6c8b5 2024-09-14T05:59:12.594 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:12.591+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:12.601 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4208.0:5 2.2 e21/19 2:5cea7035:::rbd_info:head v 21'1, mlcod=0'0)", 2024-09-14T05:59:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:55.096003+0000", 2024-09-14T05:59:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.502664511999999, 2024-09-14T05:59:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0016871799999999999, 2024-09-14T05:59:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:55.096003+0000", 2024-09-14T05:59:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:55.096003+0000", 2024-09-14T05:59:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:55.096004+0000", 2024-09-14T05:59:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5999999999999999e-07 2024-09-14T05:59:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:55.096011+0000", 2024-09-14T05:59:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8359999999999992e-06 2024-09-14T05:59:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:55.096037+0000", 2024-09-14T05:59:12.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5996999999999999e-05 2024-09-14T05:59:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:55.096055+0000", 2024-09-14T05:59:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7376000000000001e-05 2024-09-14T05:59:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:55.096201+0000", 2024-09-14T05:59:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014576899999999999 2024-09-14T05:59:12.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:55.096251+0000", 2024-09-14T05:59:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.096e-05 2024-09-14T05:59:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:55.097606+0000", 2024-09-14T05:59:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001354606 2024-09-14T05:59:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:55.097690+0000", 2024-09-14T05:59:12.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4176000000000002e-05 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4208.0:7 2.2 e22/19 2:5cea7035:::rbd_info:head v 22'2, mlcod=0'0)", 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:56.100090+0000", 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 16.498577532999999, 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020477770000000002, 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:12.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:56.100090+0000", 2024-09-14T05:59:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:56.100090+0000", 2024-09-14T05:59:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:56.100091+0000", 2024-09-14T05:59:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9299999999999998e-07 2024-09-14T05:59:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:56.100111+0000", 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.048e-05 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:56.100140+0000", 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8975999999999998e-05 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:56.100159+0000", 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9426999999999999e-05 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:56.100312+0000", 2024-09-14T05:59:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015264200000000001 2024-09-14T05:59:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:56.100374+0000", 2024-09-14T05:59:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2193000000000006e-05 2024-09-14T05:59:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:56.102066+0000", 2024-09-14T05:59:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00169169 2024-09-14T05:59:12.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:56.102138+0000", 2024-09-14T05:59:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1876000000000001e-05 2024-09-14T05:59:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:7 3.1a e26/24 3:5cea7035:::rbd_info:head v 26'1, mlcod=0'0)", 2024-09-14T05:59:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:07.282350+0000", 2024-09-14T05:59:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3163178340000004, 2024-09-14T05:59:12.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020481539999999999, 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:07.282350+0000", 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:07.282350+0000", 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:07.282350+0000", 2024-09-14T05:59:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2699999999999999e-07 2024-09-14T05:59:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:07.282358+0000", 2024-09-14T05:59:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1729999999999995e-06 2024-09-14T05:59:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:07.282386+0000", 2024-09-14T05:59:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7217e-05 2024-09-14T05:59:12.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:07.282402+0000", 2024-09-14T05:59:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6177000000000001e-05 2024-09-14T05:59:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:07.282510+0000", 2024-09-14T05:59:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000107982 2024-09-14T05:59:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:07.282553+0000", 2024-09-14T05:59:12.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2660000000000002e-05 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:07.284284+0000", 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001731359 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:07.284398+0000", 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000114059 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.614 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:9 3.1a e27/24 3:5cea7035:::rbd_info:head v 27'2, mlcod=0'0)", 2024-09-14T05:59:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:08.285636+0000", 2024-09-14T05:59:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.3130317549999999, 2024-09-14T05:59:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00090513099999999999, 2024-09-14T05:59:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:08.285636+0000", 2024-09-14T05:59:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:08.285636+0000", 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:08.285636+0000", 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3799999999999999e-07 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:08.285643+0000", 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7560000000000002e-06 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:08.285662+0000", 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8915000000000001e-05 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:08.285677+0000", 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.571e-05 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:08.285746+0000", 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8652999999999995e-05 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:08.285767+0000", 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1101999999999999e-05 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:08.286483+0000", 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00071547199999999998 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:08.286541+0000", 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8285000000000002e-05 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.618 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:94 3.6 3:672cbd64:::rbd_data.11275e589b0d.000000000000002b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.592153+0000", 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.0065147080000001, 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000869132, 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 94 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.619 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.592153+0000", 2024-09-14T05:59:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.592153+0000", 2024-09-14T05:59:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.592155+0000", 2024-09-14T05:59:12.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.272e-06 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.592163+0000", 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8699999999999992e-06 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.592183+0000", 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.997e-05 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.592192+0000", 2024-09-14T05:59:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0690000000000008e-06 2024-09-14T05:59:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.592251+0000", 2024-09-14T05:59:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9148999999999999e-05 2024-09-14T05:59:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.592311+0000", 2024-09-14T05:59:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9344e-05 2024-09-14T05:59:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.592879+0000", 2024-09-14T05:59:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00056808100000000001 2024-09-14T05:59:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.592934+0000", 2024-09-14T05:59:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5475e-05 2024-09-14T05:59:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.593022+0000", 2024-09-14T05:59:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7902e-05 2024-09-14T05:59:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:224 3.4 3:234b7459:::rbd_data.11275e589b0d.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2756730~58417] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.885374+0000", 2024-09-14T05:59:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.71329401199999998, 2024-09-14T05:59:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038761899999999998, 2024-09-14T05:59:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.624 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 224 2024-09-14T05:59:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885374+0000", 2024-09-14T05:59:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885374+0000", 2024-09-14T05:59:12.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885378+0000", 2024-09-14T05:59:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9269999999999998e-06 2024-09-14T05:59:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885509+0000", 2024-09-14T05:59:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013164200000000001 2024-09-14T05:59:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885555+0000", 2024-09-14T05:59:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5493e-05 2024-09-14T05:59:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885582+0000", 2024-09-14T05:59:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6945999999999999e-05 2024-09-14T05:59:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885730+0000", 2024-09-14T05:59:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000148472 2024-09-14T05:59:12.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885962+0000", 2024-09-14T05:59:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023224199999999999 2024-09-14T05:59:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886186+0000", 2024-09-14T05:59:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00022364499999999999 2024-09-14T05:59:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.888378+0000", 2024-09-14T05:59:12.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0021923400000000001 2024-09-14T05:59:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.889088+0000", 2024-09-14T05:59:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000709338 2024-09-14T05:59:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.889174+0000", 2024-09-14T05:59:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5902999999999994e-05 2024-09-14T05:59:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.889250+0000", 2024-09-14T05:59:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6242000000000006e-05 2024-09-14T05:59:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop_reply(client.4391.0:224 3.4 e29/24 ondisk, result = 0)", 2024-09-14T05:59:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.888903+0000", 2024-09-14T05:59:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.70976436899999995, 2024-09-14T05:59:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00036189700000000002, 2024-09-14T05:59:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:12.630 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.888903+0000", 2024-09-14T05:59:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.888903+0000", 2024-09-14T05:59:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.888905+0000", 2024-09-14T05:59:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.663e-06 2024-09-14T05:59:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.888914+0000", 2024-09-14T05:59:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.054e-06 2024-09-14T05:59:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.888939+0000", 2024-09-14T05:59:12.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5126e-05 2024-09-14T05:59:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.888958+0000", 2024-09-14T05:59:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9196000000000001e-05 2024-09-14T05:59:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.889065+0000", 2024-09-14T05:59:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000106563 2024-09-14T05:59:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.633 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.889079+0000", 2024-09-14T05:59:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.394e-05 2024-09-14T05:59:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.889265+0000", 2024-09-14T05:59:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000186355 2024-09-14T05:59:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:244 3.4 3:234b7459:::rbd_data.11275e589b0d.0000000000000004:head [read 2601635~43979] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:12.634 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.935257+0000", 2024-09-14T05:59:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.66341046699999995, 2024-09-14T05:59:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00062317899999999996, 2024-09-14T05:59:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 244 2024-09-14T05:59:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.935257+0000", 2024-09-14T05:59:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.935257+0000", 2024-09-14T05:59:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.935261+0000", 2024-09-14T05:59:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4369999999999999e-06 2024-09-14T05:59:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.935276+0000", 2024-09-14T05:59:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5843000000000001e-05 2024-09-14T05:59:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.935315+0000", 2024-09-14T05:59:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8486999999999999e-05 2024-09-14T05:59:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.935333+0000", 2024-09-14T05:59:12.637 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7669e-05 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.935533+0000", 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020002900000000001 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.935678+0000", 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014561500000000001 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.935880+0000", 2024-09-14T05:59:12.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020209899999999999 2024-09-14T05:59:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:250 3.4 3:234b7459:::rbd_data.11275e589b0d.0000000000000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.982107+0000", 2024-09-14T05:59:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.61656040599999995, 2024-09-14T05:59:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041645420000000002, 2024-09-14T05:59:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:12.639 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 250 2024-09-14T05:59:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982107+0000", 2024-09-14T05:59:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.640 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982107+0000", 2024-09-14T05:59:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982110+0000", 2024-09-14T05:59:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1439999999999999e-06 2024-09-14T05:59:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982124+0000", 2024-09-14T05:59:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.33e-05 2024-09-14T05:59:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982160+0000", 2024-09-14T05:59:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6216e-05 2024-09-14T05:59:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982177+0000", 2024-09-14T05:59:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7456999999999999e-05 2024-09-14T05:59:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:12.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982335+0000", 2024-09-14T05:59:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000157532 2024-09-14T05:59:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982581+0000", 2024-09-14T05:59:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024623800000000002 2024-09-14T05:59:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982911+0000", 2024-09-14T05:59:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032986099999999998 2024-09-14T05:59:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.984610+0000", 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001699367 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.986108+0000", 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001498018 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.986197+0000", 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8973000000000003e-05 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.986272+0000", 2024-09-14T05:59:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4436000000000004e-05 2024-09-14T05:59:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop_reply(client.4391.0:250 3.4 e29/24 ondisk, result = 0)", 2024-09-14T05:59:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.985908+0000", 2024-09-14T05:59:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.61275965799999998, 2024-09-14T05:59:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000373247, 2024-09-14T05:59:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:12.645 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985908+0000", 2024-09-14T05:59:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985908+0000", 2024-09-14T05:59:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:12.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985910+0000", 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6330000000000001e-06 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985919+0000", 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0569999999999999e-06 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985945+0000", 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6815999999999999e-05 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.647 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985962+0000", 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6512999999999999e-05 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.986082+0000", 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011964300000000001 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.986099+0000", 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7736000000000001e-05 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:12.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.986281+0000", 2024-09-14T05:59:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018184900000000001 2024-09-14T05:59:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:347 3.4 3:207f511a:::rbd_data.11275e589b0d.0000000000000039:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2597389~55350] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.281493+0000", 2024-09-14T05:59:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.31717422299999998, 2024-09-14T05:59:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0026129640000000002, 2024-09-14T05:59:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:12.649 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 347 2024-09-14T05:59:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.281493+0000", 2024-09-14T05:59:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.650 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.281493+0000", 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.281495+0000", 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0490000000000002e-06 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.281556+0000", 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0874e-05 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.281576+0000", 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9981999999999999e-05 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.281585+0000", 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4079999999999998e-06 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.281694+0000", 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000109709 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.281925+0000", 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023057199999999999 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.282181+0000", 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025650500000000003 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.283455+0000", 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012735159999999999 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.283895+0000", 2024-09-14T05:59:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00043973999999999999 2024-09-14T05:59:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.283984+0000", 2024-09-14T05:59:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9276000000000004e-05 2024-09-14T05:59:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.284106+0000", 2024-09-14T05:59:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000122333 2024-09-14T05:59:12.654 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop_reply(client.4391.0:347 3.4 e29/24 ondisk, result = 0)", 2024-09-14T05:59:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.283755+0000", 2024-09-14T05:59:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.31491264099999999, 2024-09-14T05:59:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00036610499999999998, 2024-09-14T05:59:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:12.655 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.283755+0000", 2024-09-14T05:59:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.283755+0000", 2024-09-14T05:59:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.283756+0000", 2024-09-14T05:59:12.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7400000000000002e-07 2024-09-14T05:59:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.283760+0000", 2024-09-14T05:59:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8510000000000001e-06 2024-09-14T05:59:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.283771+0000", 2024-09-14T05:59:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1087000000000001e-05 2024-09-14T05:59:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.657 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.283776+0000", 2024-09-14T05:59:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2820000000000004e-06 2024-09-14T05:59:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.283875+0000", 2024-09-14T05:59:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8986000000000004e-05 2024-09-14T05:59:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.283887+0000", 2024-09-14T05:59:12.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1919999999999999e-05 2024-09-14T05:59:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.284121+0000", 2024-09-14T05:59:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000234205 2024-09-14T05:59:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:351 3.4 3:207f511a:::rbd_data.11275e589b0d.0000000000000039:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.302888+0000", 2024-09-14T05:59:12.659 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.29577973200000002, 2024-09-14T05:59:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001460472, 2024-09-14T05:59:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 351 2024-09-14T05:59:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.660 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.302888+0000", 2024-09-14T05:59:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.302888+0000", 2024-09-14T05:59:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.302890+0000", 2024-09-14T05:59:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0959999999999999e-06 2024-09-14T05:59:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.302899+0000", 2024-09-14T05:59:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6379999999999993e-06 2024-09-14T05:59:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.302918+0000", 2024-09-14T05:59:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9443999999999999e-05 2024-09-14T05:59:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.302927+0000", 2024-09-14T05:59:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5720000000000003e-06 2024-09-14T05:59:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.303006+0000", 2024-09-14T05:59:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9599999999999997e-05 2024-09-14T05:59:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.303096+0000", 2024-09-14T05:59:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9553000000000001e-05 2024-09-14T05:59:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.303199+0000", 2024-09-14T05:59:12.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102811 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304013+0000", 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00081414699999999998 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304284+0000", 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027154600000000001 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304317+0000", 2024-09-14T05:59:12.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3152999999999999e-05 2024-09-14T05:59:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304348+0000", 2024-09-14T05:59:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0911999999999998e-05 2024-09-14T05:59:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop_reply(client.4391.0:351 3.4 e29/24 ondisk, result = 0)", 2024-09-14T05:59:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.304191+0000", 2024-09-14T05:59:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.29447615199999999, 2024-09-14T05:59:12.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016396299999999999, 2024-09-14T05:59:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304191+0000", 2024-09-14T05:59:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304191+0000", 2024-09-14T05:59:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:12.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304193+0000", 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4750000000000001e-06 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304200+0000", 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.294e-06 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304218+0000", 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8011000000000001e-05 2024-09-14T05:59:12.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304228+0000", 2024-09-14T05:59:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0071999999999999e-05 2024-09-14T05:59:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304276+0000", 2024-09-14T05:59:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7466000000000003e-05 2024-09-14T05:59:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304281+0000", 2024-09-14T05:59:12.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2900000000000002e-06 2024-09-14T05:59:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304355+0000", 2024-09-14T05:59:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4355000000000002e-05 2024-09-14T05:59:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:12.669 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:12.669 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:12.670 INFO:teuthology.orchestra.run.smithi006.stdout:165 read 0x17fc180 thru 0x1805c11 (0x9a92 bytes) 2024-09-14T05:59:12.670 INFO:teuthology.orchestra.run.smithi006.stdout:168 punch from 0x52d903 to 0x53897c, (0xb079 bytes) 2024-09-14T05:59:12.670 INFO:teuthology.orchestra.run.smithi006.stdout:169 read 0x1a6a124 thru 0x1a79ca4 (0xfb81 bytes) 2024-09-14T05:59:12.670 INFO:teuthology.orchestra.run.smithi006.stdout:171 read 0xd080d0 thru 0xd0d0c7 (0x4ff8 bytes) 2024-09-14T05:59:12.671 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:59:12.672 INFO:teuthology.orchestra.run.smithi006.stdout:173 write 0x6562ac1 thru 0x6563d17 (0x1257 bytes) 2024-09-14T05:59:12.672 INFO:teuthology.orchestra.run.smithi006.stdout:174 read 0x32f690 thru 0x3353ff (0x5d70 bytes) 2024-09-14T05:59:12.672 INFO:teuthology.orchestra.run.smithi006.stdout:176 writesame 0xcf58768 thru 0xcf634ca data_size 0x11(0xad63 bytes) 2024-09-14T05:59:12.672 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:12.672 INFO:teuthology.orchestra.run.smithi006.stdout:179 write 0xc27269d thru 0xc2779be (0x5322 bytes) 2024-09-14T05:59:12.678 INFO:teuthology.orchestra.run.smithi006.stdout:181 punch from 0x5ff2cf5 to 0x5ffc548, (0x9853 bytes) 2024-09-14T05:59:12.678 INFO:teuthology.orchestra.run.smithi006.stdout:182 punch from 0xbebf68 to 0xbf325a, (0x72f2 bytes) 2024-09-14T05:59:12.678 INFO:teuthology.orchestra.run.smithi006.stdout:183 read 0xbf23f0 thru 0xc0077a (0xe38b bytes) 2024-09-14T05:59:12.680 INFO:teuthology.orchestra.run.smithi006.stdout:184 read 0x5863a1c thru 0x586aa6e (0x7053 bytes) 2024-09-14T05:59:12.680 INFO:teuthology.orchestra.run.smithi006.stdout:185 punch from 0xa484d1 to 0xa4ddee, (0x591d bytes) 2024-09-14T05:59:12.680 INFO:teuthology.orchestra.run.smithi006.stdout:186 read 0x2f4b286 thru 0x2f5a15e (0xeed9 bytes) 2024-09-14T05:59:12.680 INFO:teuthology.orchestra.run.smithi006.stdout:189 read 0x81918de thru 0x8194bb4 (0x32d7 bytes) 2024-09-14T05:59:12.680 INFO:teuthology.orchestra.run.smithi006.stdout:191 read 0xca6da77 thru 0xca6ee2f (0x13b9 bytes) 2024-09-14T05:59:12.680 INFO:teuthology.orchestra.run.smithi006.stdout:192 read 0x545d975 thru 0x5465da1 (0x842d bytes) 2024-09-14T05:59:12.681 INFO:teuthology.orchestra.run.smithi006.stdout:193 write 0x641589d thru 0x641cfac (0x7710 bytes) 2024-09-14T05:59:12.684 INFO:teuthology.orchestra.run.smithi006.stdout:195 punch from 0x2da459 to 0x2da984, (0x52b bytes) 2024-09-14T05:59:12.684 INFO:teuthology.orchestra.run.smithi006.stdout:196 read 0x91ec3d3 thru 0x91f013d (0x3d6b bytes) 2024-09-14T05:59:12.689 INFO:teuthology.orchestra.run.smithi006.stdout:197 trunc from 0xcf634cb to 0xb00cac2 2024-09-14T05:59:12.694 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:12.689+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:12.712 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:12.712 INFO:teuthology.orchestra.run.smithi006.stdout:199 read 0x888ce23 thru 0x8891d84 (0x4f62 bytes) 2024-09-14T05:59:12.717 INFO:teuthology.orchestra.run.smithi006.stdout:201 trunc from 0xb00cac2 to 0xd2736b2 2024-09-14T05:59:12.740 INFO:teuthology.orchestra.run.smithi006.stdout:202 trunc from 0xd2736b2 to 0x8be4cf3 2024-09-14T05:59:12.755 INFO:teuthology.orchestra.run.smithi006.stdout:203 trunc from 0x8be4cf3 to 0x8f0a8ac 2024-09-14T05:59:12.768 INFO:teuthology.orchestra.run.smithi006.stdout:204 writesame 0x4dd7f89 thru 0x4ddbc93 data_size 0x1(0x3d0b bytes) 2024-09-14T05:59:12.794 INFO:teuthology.orchestra.run.smithi006.stdout:205 write 0x63686f2 thru 0x636b4de (0x2ded bytes) 2024-09-14T05:59:12.795 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:12.793+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:12.801 INFO:teuthology.orchestra.run.smithi006.stdout:206 writesame 0x199898d thru 0x199b6b3 data_size 0x1(0x2d27 bytes) 2024-09-14T05:59:12.815 INFO:teuthology.orchestra.run.smithi006.stdout:208 read 0x243a76a thru 0x244102c (0x68c3 bytes) 2024-09-14T05:59:12.815 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:12.815 INFO:teuthology.orchestra.run.smithi006.stdout:211 writesame 0x1b9fd64 thru 0x1ba5baf data_size 0x55(0x5e4c bytes) 2024-09-14T05:59:12.820 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:12.820 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:12.820 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:12.820 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:12.835 INFO:teuthology.orchestra.run.smithi006.stdout:212 writesame 0xa383aa5 thru 0xa38445c data_size 0x4(0x9b8 bytes) 2024-09-14T05:59:12.835 INFO:teuthology.orchestra.run.smithi006.stdout:213 read 0x277b178 thru 0x277bd76 (0xbff bytes) 2024-09-14T05:59:12.835 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:12.835 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:12.835 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:12.835 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:12.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:59:12.846 INFO:teuthology.orchestra.run.smithi006.stdout:219 trunc from 0xa38445d to 0x55f4f9a 2024-09-14T05:59:12.889 INFO:teuthology.orchestra.run.smithi006.stdout:221 write 0x87fd508 thru 0x8804cc3 (0x77bc bytes) 2024-09-14T05:59:12.895 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:12.895+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:12.918 INFO:teuthology.orchestra.run.smithi006.stdout:222 write 0xc40e534 thru 0xc417843 (0x9310 bytes) 2024-09-14T05:59:12.925 INFO:teuthology.orchestra.run.smithi006.stdout:223 punch from 0xb9f58b5 to 0xb9fc570, (0x6cbb bytes) 2024-09-14T05:59:12.925 INFO:teuthology.orchestra.run.smithi006.stdout:224 read 0x3996cbc thru 0x39a24ea (0xb82f bytes) 2024-09-14T05:59:12.925 INFO:teuthology.orchestra.run.smithi006.stdout:225 writesame 0xa1168f5 thru 0xa11c742 data_size 0x1(0x5e4e bytes) 2024-09-14T05:59:12.956 INFO:teuthology.orchestra.run.smithi006.stdout:226 read 0xbf9a917 thru 0xbfa1768 (0x6e52 bytes) 2024-09-14T05:59:12.957 INFO:teuthology.orchestra.run.smithi006.stdout:229 write 0xb072dad thru 0xb077a0f (0x4c63 bytes) 2024-09-14T05:59:12.965 INFO:teuthology.orchestra.run.smithi006.stdout:230 read 0xbcddaa2 thru 0xbcea2d6 (0xc835 bytes) 2024-09-14T05:59:12.965 INFO:teuthology.orchestra.run.smithi006.stdout:231 writesame 0x2b8f84d thru 0x2b97077 data_size 0x1(0x782b bytes) 2024-09-14T05:59:12.969 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:12.969 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:12.970 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:12.970 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:12.970 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:12.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:59:12.997 INFO:teuthology.orchestra.run.smithi006.stdout:232 read 0x4d2f6fc thru 0x4d3338c (0x3c91 bytes) 2024-09-14T05:59:12.997 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:12.993+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:12.998 INFO:teuthology.orchestra.run.smithi006.stdout:233 write 0x1ddd13b thru 0x1de1c3c (0x4b02 bytes) 2024-09-14T05:59:13.009 INFO:teuthology.orchestra.run.smithi006.stdout:234 trunc from 0xc417844 to 0xaad704e 2024-09-14T05:59:13.030 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:13.030 INFO:teuthology.orchestra.run.smithi006.stdout:236 writesame 0xd4d6c7 thru 0xd53fda data_size 0x32(0x6914 bytes) 2024-09-14T05:59:13.033 INFO:teuthology.orchestra.run.smithi006.stdout:237 read 0xaa6ccc5 thru 0xaa6ddde (0x111a bytes) 2024-09-14T05:59:13.052 INFO:teuthology.orchestra.run.smithi006.stdout:239 write 0xecc64a6 thru 0xeccb66c (0x51c7 bytes) 2024-09-14T05:59:13.057 INFO:teuthology.orchestra.run.smithi006.stdout:241 read 0x28e7600 thru 0x28eb114 (0x3b15 bytes) 2024-09-14T05:59:13.080 INFO:teuthology.orchestra.run.smithi006.stdout:242 trunc from 0xeccb66d to 0x2aea82 2024-09-14T05:59:13.096 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:13.095+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:13.110 INFO:teuthology.orchestra.run.smithi006.stdout:244 punch from 0x9e9c2 to 0xac228, (0xd866 bytes) 2024-09-14T05:59:13.110 INFO:teuthology.orchestra.run.smithi006.stdout:246 read 0x61e60 thru 0x699ab (0x7b4c bytes) 2024-09-14T05:59:13.131 INFO:teuthology.orchestra.run.smithi006.stdout:247 writesame 0x4679c45 thru 0x467b9a1 data_size 0x1(0x1d5d bytes) 2024-09-14T05:59:13.139 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:13.139 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4208.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-14T05:59:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:58:54.100635+0000", 2024-09-14T05:59:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.034690368, 2024-09-14T05:59:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00090459500000000001, 2024-09-14T05:59:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:54.100635+0000", 2024-09-14T05:59:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:54.100635+0000", 2024-09-14T05:59:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:54.100635+0000", 2024-09-14T05:59:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4900000000000002e-07 2024-09-14T05:59:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:54.100642+0000", 2024-09-14T05:59:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5470000000000002e-06 2024-09-14T05:59:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:54.100658+0000", 2024-09-14T05:59:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6038000000000001e-05 2024-09-14T05:59:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:54.100669+0000", 2024-09-14T05:59:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1848000000000001e-05 2024-09-14T05:59:13.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:54.100744+0000", 2024-09-14T05:59:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4745000000000003e-05 2024-09-14T05:59:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:54.100785+0000", 2024-09-14T05:59:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0550000000000003e-05 2024-09-14T05:59:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.143 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:54.101485+0000", 2024-09-14T05:59:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00070013200000000001 2024-09-14T05:59:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:58:54.101539+0000", 2024-09-14T05:59:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4486e-05 2024-09-14T05:59:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:179 3.9 e29/24 3:92497260:::rbd_data.11275e589b0d.0000000000000015:head v 29'1, mlcod=0'0)", 2024-09-14T05:59:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.762511+0000", 2024-09-14T05:59:13.144 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.3728143850000001, 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0019249779999999999, 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762511+0000", 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762511+0000", 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762511+0000", 2024-09-14T05:59:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4999999999999998e-07 2024-09-14T05:59:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762726+0000", 2024-09-14T05:59:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021486500000000001 2024-09-14T05:59:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762752+0000", 2024-09-14T05:59:13.146 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.62e-05 2024-09-14T05:59:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762767+0000", 2024-09-14T05:59:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4389999999999999e-05 2024-09-14T05:59:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762897+0000", 2024-09-14T05:59:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000130555 2024-09-14T05:59:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.147 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762930+0000", 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2369999999999997e-05 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.764328+0000", 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0013980590000000001 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.764436+0000", 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108089 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:190 3.9 e29/24 3:92497260:::rbd_data.11275e589b0d.0000000000000015:head v 29'2, mlcod=0'0)", 2024-09-14T05:59:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.822806+0000", 2024-09-14T05:59:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.3125189669999999, 2024-09-14T05:59:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0018685100000000001, 2024-09-14T05:59:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.822806+0000", 2024-09-14T05:59:13.149 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.822806+0000", 2024-09-14T05:59:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.822808+0000", 2024-09-14T05:59:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:59:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.150 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.822824+0000", 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5753e-05 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.822862+0000", 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7783000000000001e-05 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.822882+0000", 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0276999999999999e-05 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.151 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.823030+0000", 2024-09-14T05:59:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014725799999999999 2024-09-14T05:59:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.823087+0000", 2024-09-14T05:59:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7726999999999998e-05 2024-09-14T05:59:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.824578+0000", 2024-09-14T05:59:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0014902680000000001 2024-09-14T05:59:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.824675+0000", 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.713e-05 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:213 3.9 e29/24 3:95751eaa:::rbd_data.11275e589b0d.0000000000000019:head v 29'3, mlcod=29'1)", 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.865898+0000", 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.26942665, 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0023456789999999998, 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.153 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865898+0000", 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865898+0000", 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865900+0000", 2024-09-14T05:59:13.154 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.99e-06 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865954+0000", 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3257000000000002e-05 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865985+0000", 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1239999999999999e-05 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.866009+0000", 2024-09-14T05:59:13.155 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3546000000000001e-05 2024-09-14T05:59:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.866164+0000", 2024-09-14T05:59:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015577200000000001 2024-09-14T05:59:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.866227+0000", 2024-09-14T05:59:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2817000000000005e-05 2024-09-14T05:59:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.156 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.868127+0000", 2024-09-14T05:59:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0019002909999999999 2024-09-14T05:59:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.868244+0000", 2024-09-14T05:59:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000116766 2024-09-14T05:59:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:224 3.4 e29/24 3:234b7459:::rbd_data.11275e589b0d.0000000000000004:head v 29'1, mlcod=0'0)", 2024-09-14T05:59:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.886470+0000", 2024-09-14T05:59:13.157 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.248855555, 2024-09-14T05:59:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0023458149999999998, 2024-09-14T05:59:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886470+0000", 2024-09-14T05:59:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886470+0000", 2024-09-14T05:59:13.158 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886470+0000", 2024-09-14T05:59:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9299999999999996e-07 2024-09-14T05:59:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886631+0000", 2024-09-14T05:59:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016085900000000001 2024-09-14T05:59:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.159 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886671+0000", 2024-09-14T05:59:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9573000000000002e-05 2024-09-14T05:59:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886706+0000", 2024-09-14T05:59:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4879999999999998e-05 2024-09-14T05:59:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886886+0000", 2024-09-14T05:59:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000180445 2024-09-14T05:59:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886946+0000", 2024-09-14T05:59:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9617000000000002e-05 2024-09-14T05:59:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.888726+0000", 2024-09-14T05:59:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0017802460000000001 2024-09-14T05:59:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.888815+0000", 2024-09-14T05:59:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9302000000000007e-05 2024-09-14T05:59:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:255 3.9 e29/24 3:95751eaa:::rbd_data.11275e589b0d.0000000000000019:head v 29'4, mlcod=29'2)", 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.982863+0000", 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.1524616590000001, 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002198373, 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.162 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982863+0000", 2024-09-14T05:59:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982863+0000", 2024-09-14T05:59:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982866+0000", 2024-09-14T05:59:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.723e-06 2024-09-14T05:59:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.163 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982884+0000", 2024-09-14T05:59:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8090000000000001e-05 2024-09-14T05:59:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982929+0000", 2024-09-14T05:59:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4697000000000003e-05 2024-09-14T05:59:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982951+0000", 2024-09-14T05:59:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1812999999999999e-05 2024-09-14T05:59:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983169+0000", 2024-09-14T05:59:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021797799999999999 2024-09-14T05:59:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983242+0000", 2024-09-14T05:59:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3473000000000006e-05 2024-09-14T05:59:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.984976+0000", 2024-09-14T05:59:13.165 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0017333559999999999 2024-09-14T05:59:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985062+0000", 2024-09-14T05:59:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6242999999999994e-05 2024-09-14T05:59:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:250 3.4 e29/24 3:234b7459:::rbd_data.11275e589b0d.0000000000000004:head v 29'2, mlcod=0'0)", 2024-09-14T05:59:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.983794+0000", 2024-09-14T05:59:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.1515308559999999, 2024-09-14T05:59:13.166 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020065980000000001, 2024-09-14T05:59:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983794+0000", 2024-09-14T05:59:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983794+0000", 2024-09-14T05:59:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983796+0000", 2024-09-14T05:59:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T05:59:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983813+0000", 2024-09-14T05:59:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6354e-05 2024-09-14T05:59:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.168 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983848+0000", 2024-09-14T05:59:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4696000000000001e-05 2024-09-14T05:59:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983868+0000", 2024-09-14T05:59:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.001e-05 2024-09-14T05:59:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.984029+0000", 2024-09-14T05:59:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016157199999999999 2024-09-14T05:59:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.169 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.984086+0000", 2024-09-14T05:59:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6802999999999998e-05 2024-09-14T05:59:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985676+0000", 2024-09-14T05:59:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0015901579999999999 2024-09-14T05:59:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985801+0000", 2024-09-14T05:59:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012483899999999999 2024-09-14T05:59:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.170 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:347 3.4 e29/24 3:207f511a:::rbd_data.11275e589b0d.0000000000000039:head v 29'3, mlcod=29'1)", 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.282340+0000", 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.85298520600000005, 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0013440259999999999, 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.282340+0000", 2024-09-14T05:59:13.171 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.282340+0000", 2024-09-14T05:59:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.282342+0000", 2024-09-14T05:59:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.685e-06 2024-09-14T05:59:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.172 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.282414+0000", 2024-09-14T05:59:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2495000000000003e-05 2024-09-14T05:59:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.282443+0000", 2024-09-14T05:59:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8775000000000001e-05 2024-09-14T05:59:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.282456+0000", 2024-09-14T05:59:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3237999999999999e-05 2024-09-14T05:59:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.282536+0000", 2024-09-14T05:59:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9710999999999996e-05 2024-09-14T05:59:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.282560+0000", 2024-09-14T05:59:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.457e-05 2024-09-14T05:59:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.174 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.283636+0000", 2024-09-14T05:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001075959 2024-09-14T05:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.283684+0000", 2024-09-14T05:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7593000000000003e-05 2024-09-14T05:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:351 3.4 e29/24 3:207f511a:::rbd_data.11275e589b0d.0000000000000039:head v 29'4, mlcod=29'2)", 2024-09-14T05:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.303318+0000", 2024-09-14T05:59:13.175 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.83200763499999997, 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00080290299999999999, 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.303318+0000", 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.303318+0000", 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.303319+0000", 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7740000000000001e-06 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.303331+0000", 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2072999999999999e-05 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.303357+0000", 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5723000000000001e-05 2024-09-14T05:59:13.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.303371+0000", 2024-09-14T05:59:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3654e-05 2024-09-14T05:59:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.303461+0000", 2024-09-14T05:59:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0507000000000006e-05 2024-09-14T05:59:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.303490+0000", 2024-09-14T05:59:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9135000000000001e-05 2024-09-14T05:59:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304086+0000", 2024-09-14T05:59:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00059541399999999995 2024-09-14T05:59:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.304120+0000", 2024-09-14T05:59:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4622999999999997e-05 2024-09-14T05:59:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:423 3.9 e29/24 3:92497260:::rbd_data.11275e589b0d.0000000000000015:head v 29'5, mlcod=29'3)", 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.471009+0000", 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.66431628899999995, 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001343323, 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.471009+0000", 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.471009+0000", 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.471011+0000", 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3259999999999998e-06 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.471026+0000", 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.467e-05 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.471057+0000", 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0722999999999997e-05 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.471072+0000", 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5136999999999999e-05 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.471148+0000", 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6017000000000001e-05 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.182 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.471164+0000", 2024-09-14T05:59:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5880999999999999e-05 2024-09-14T05:59:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.472220+0000", 2024-09-14T05:59:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0010566429999999999 2024-09-14T05:59:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.472352+0000", 2024-09-14T05:59:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013192600000000001 2024-09-14T05:59:13.183 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:468 3.9 e29/24 3:92497260:::rbd_data.11275e589b0d.0000000000000015:head v 29'6, mlcod=29'4)", 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.56708557299999995, 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002991737, 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568242+0000", 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3970000000000001e-06 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568261+0000", 2024-09-14T05:59:13.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9029999999999999e-05 2024-09-14T05:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568302+0000", 2024-09-14T05:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0756000000000001e-05 2024-09-14T05:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568324+0000", 2024-09-14T05:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2293000000000002e-05 2024-09-14T05:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568455+0000", 2024-09-14T05:59:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000130784 2024-09-14T05:59:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568479+0000", 2024-09-14T05:59:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4119000000000001e-05 2024-09-14T05:59:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.571135+0000", 2024-09-14T05:59:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0026556319999999998 2024-09-14T05:59:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.571231+0000", 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6725999999999995e-05 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:501 3.9 e29/24 3:95751eaa:::rbd_data.11275e589b0d.0000000000000019:head v 29'7, mlcod=29'5)", 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.639603+0000", 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.49572262700000003, 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0017221669999999999, 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.188 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639603+0000", 2024-09-14T05:59:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639603+0000", 2024-09-14T05:59:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639604+0000", 2024-09-14T05:59:13.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7600000000000001e-06 2024-09-14T05:59:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639629+0000", 2024-09-14T05:59:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.508e-05 2024-09-14T05:59:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639656+0000", 2024-09-14T05:59:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6143e-05 2024-09-14T05:59:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.190 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639669+0000", 2024-09-14T05:59:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3893000000000001e-05 2024-09-14T05:59:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639823+0000", 2024-09-14T05:59:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015394200000000001 2024-09-14T05:59:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639864+0000", 2024-09-14T05:59:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0779999999999999e-05 2024-09-14T05:59:13.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.641231+0000", 2024-09-14T05:59:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001366566 2024-09-14T05:59:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.641325+0000", 2024-09-14T05:59:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4003000000000001e-05 2024-09-14T05:59:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:514 3.9 e29/24 3:95751eaa:::rbd_data.11275e589b0d.0000000000000019:head v 29'8, mlcod=29'6)", 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.682080+0000", 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.45324514900000001, 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020706639999999998, 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682080+0000", 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.193 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682080+0000", 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682083+0000", 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6800000000000002e-06 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682237+0000", 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154086 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.194 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682270+0000", 2024-09-14T05:59:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2950000000000001e-05 2024-09-14T05:59:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682289+0000", 2024-09-14T05:59:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9355999999999999e-05 2024-09-14T05:59:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682447+0000", 2024-09-14T05:59:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015772900000000001 2024-09-14T05:59:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682489+0000", 2024-09-14T05:59:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2580000000000002e-05 2024-09-14T05:59:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.684066+0000", 2024-09-14T05:59:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0015761810000000001 2024-09-14T05:59:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.684151+0000", 2024-09-14T05:59:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5101999999999999e-05 2024-09-14T05:59:13.196 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:572 3.9 e29/24 3:95751eaa:::rbd_data.11275e589b0d.0000000000000019:head v 29'9, mlcod=29'7)", 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.851520+0000", 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.28380475300000002, 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001001048, 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.197 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.851520+0000", 2024-09-14T05:59:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.851520+0000", 2024-09-14T05:59:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.851523+0000", 2024-09-14T05:59:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.373e-06 2024-09-14T05:59:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.198 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.851537+0000", 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4283e-05 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.851570+0000", 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2614000000000003e-05 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.851586+0000", 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6453e-05 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.199 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.851667+0000", 2024-09-14T05:59:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1242000000000006e-05 2024-09-14T05:59:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.851684+0000", 2024-09-14T05:59:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6371999999999998e-05 2024-09-14T05:59:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.852483+0000", 2024-09-14T05:59:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00079916700000000004 2024-09-14T05:59:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.852521+0000", 2024-09-14T05:59:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8544000000000002e-05 2024-09-14T05:59:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:640 3.4 e29/24 3:24bd3545:::rbd_data.11275e589b0d.000000000000003b:head v 29'5, mlcod=29'3)", 2024-09-14T05:59:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.057119+0000", 2024-09-14T05:59:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078205916, 2024-09-14T05:59:13.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001014601, 2024-09-14T05:59:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.057119+0000", 2024-09-14T05:59:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.057119+0000", 2024-09-14T05:59:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.057121+0000", 2024-09-14T05:59:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4810000000000001e-06 2024-09-14T05:59:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.057166+0000", 2024-09-14T05:59:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5144e-05 2024-09-14T05:59:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.057186+0000", 2024-09-14T05:59:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0134000000000001e-05 2024-09-14T05:59:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.057198+0000", 2024-09-14T05:59:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2147000000000001e-05 2024-09-14T05:59:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.057272+0000", 2024-09-14T05:59:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3903e-05 2024-09-14T05:59:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.057289+0000", 2024-09-14T05:59:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.664e-05 2024-09-14T05:59:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.058097+0000", 2024-09-14T05:59:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00080853200000000004 2024-09-14T05:59:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.058134+0000", 2024-09-14T05:59:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6619999999999998e-05 2024-09-14T05:59:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:651 3.4 e29/24 3:24bd3545:::rbd_data.11275e589b0d.000000000000003b:head v 29'6, mlcod=29'4)", 2024-09-14T05:59:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.085426+0000", 2024-09-14T05:59:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.049899322000000003, 2024-09-14T05:59:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001270464, 2024-09-14T05:59:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.206 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085426+0000", 2024-09-14T05:59:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085426+0000", 2024-09-14T05:59:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085428+0000", 2024-09-14T05:59:13.207 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6469999999999998e-06 2024-09-14T05:59:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085445+0000", 2024-09-14T05:59:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6623e-05 2024-09-14T05:59:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085490+0000", 2024-09-14T05:59:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4762999999999998e-05 2024-09-14T05:59:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085518+0000", 2024-09-14T05:59:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8093e-05 2024-09-14T05:59:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085621+0000", 2024-09-14T05:59:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010335 2024-09-14T05:59:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085644+0000", 2024-09-14T05:59:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2532999999999999e-05 2024-09-14T05:59:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.209 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.086657+0000", 2024-09-14T05:59:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0010129990000000001 2024-09-14T05:59:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.086696+0000", 2024-09-14T05:59:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9456000000000003e-05 2024-09-14T05:59:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.210 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.210 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:13.212 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:59:13.213 INFO:teuthology.orchestra.run.smithi006.stdout:249 writesame 0xe2865ef thru 0xe288812 data_size 0x17(0x2224 bytes) 2024-09-14T05:59:13.213 INFO:teuthology.orchestra.run.smithi006.stdout:250 write 0xa790caf thru 0xa791ead (0x11ff bytes) 2024-09-14T05:59:13.213 INFO:teuthology.orchestra.run.smithi006.stdout:252 punch from 0x6a83f to 0x70d54, (0x6515 bytes) 2024-09-14T05:59:13.213 INFO:teuthology.orchestra.run.smithi006.stdout:254 write 0x88b02b0 thru 0x88ba5a5 (0xa2f6 bytes) 2024-09-14T05:59:13.213 INFO:teuthology.orchestra.run.smithi006.stdout:255 read 0x19fc611 thru 0x1a043f6 (0x7de6 bytes) 2024-09-14T05:59:13.213 INFO:teuthology.orchestra.run.smithi006.stdout:256 writesame 0x69cdf39 thru 0x69dd30a data_size 0x67(0xf3d2 bytes) 2024-09-14T05:59:13.214 INFO:teuthology.orchestra.run.smithi006.stdout:257 write 0x2a3e6c thru 0x2b176c (0xd901 bytes) 2024-09-14T05:59:13.214 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:13.214 INFO:teuthology.orchestra.run.smithi006.stdout:259 write 0xe3bf7c1 thru 0xe3cd0fa (0xd93a bytes) 2024-09-14T05:59:13.214 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:13.211+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:13.222 INFO:teuthology.orchestra.run.smithi006.stdout:260 read 0xbe940fa thru 0xbea0484 (0xc38b bytes) 2024-09-14T05:59:13.222 INFO:teuthology.orchestra.run.smithi006.stdout:261 write 0xd05c313 thru 0xd069cf5 (0xd9e3 bytes) 2024-09-14T05:59:13.230 INFO:teuthology.orchestra.run.smithi006.stdout:263 write 0xa317513 thru 0xa325d80 (0xe86e bytes) 2024-09-14T05:59:13.237 INFO:teuthology.orchestra.run.smithi006.stdout:264 punch from 0x3fad503 to 0x3fadf68, (0xa65 bytes) 2024-09-14T05:59:13.237 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:13.237 INFO:teuthology.orchestra.run.smithi006.stdout:267 read 0x2570a8e thru 0x2576d47 (0x62ba bytes) 2024-09-14T05:59:13.237 INFO:teuthology.orchestra.run.smithi006.stdout:268 punch from 0xb020818 to 0xb029817, (0x8fff bytes) 2024-09-14T05:59:13.250 INFO:teuthology.orchestra.run.smithi006.stdout:269 write 0xe87099c thru 0xe875fd2 (0x5637 bytes) 2024-09-14T05:59:13.260 INFO:teuthology.orchestra.run.smithi006.stdout:271 punch from 0x6f719dd to 0x6f7d5ce, (0xbbf1 bytes) 2024-09-14T05:59:13.261 INFO:teuthology.orchestra.run.smithi006.stdout:273 write 0x5dafaea thru 0x5db0c29 (0x1140 bytes) 2024-09-14T05:59:13.267 INFO:teuthology.orchestra.run.smithi006.stdout:274 write 0x8f26fc0 thru 0x8f31b34 (0xab75 bytes) 2024-09-14T05:59:13.298 INFO:teuthology.orchestra.run.smithi006.stdout:275 trunc from 0xe875fd3 to 0x141bf82 2024-09-14T05:59:13.312 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:13.309+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:13.358 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:13.359 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:13.359 INFO:teuthology.orchestra.run.smithi006.stdout:276 write 0xa5489ff thru 0xa550c22 (0x8224 bytes) 2024-09-14T05:59:13.365 INFO:teuthology.orchestra.run.smithi006.stdout:277 read 0x360976f thru 0x36135c0 (0x9e52 bytes) 2024-09-14T05:59:13.365 INFO:teuthology.orchestra.run.smithi006.stdout:278 write 0x9e3f2cb thru 0x9e457bd (0x64f3 bytes) 2024-09-14T05:59:13.374 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:59:13.390 INFO:teuthology.orchestra.run.smithi006.stdout:279 trunc from 0xa550c23 to 0x2b03514 2024-09-14T05:59:13.413 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:13.411+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:13.449 INFO:teuthology.orchestra.run.smithi006.stdout:280 writesame 0xd60c85d thru 0xd6114a2 data_size 0xd(0x4c46 bytes) 2024-09-14T05:59:13.458 INFO:teuthology.orchestra.run.smithi006.stdout:281 trunc from 0xd6114a3 to 0x9875ef7 2024-09-14T05:59:13.471 INFO:teuthology.orchestra.run.smithi006.stdout:282 punch from 0x19460bd to 0x195108f, (0xafd2 bytes) 2024-09-14T05:59:13.471 INFO:teuthology.orchestra.run.smithi006.stdout:286 writesame 0x1792144 thru 0x179399c data_size 0x1(0x1859 bytes) 2024-09-14T05:59:13.505 INFO:teuthology.orchestra.run.smithi006.stdout:287 write 0xd3679d0 thru 0xd369949 (0x1f7a bytes) 2024-09-14T05:59:13.514 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:13.509+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:13.514 INFO:teuthology.orchestra.run.smithi006.stdout:288 read 0x9c3f460 thru 0x9c48b1b (0x96bc bytes) 2024-09-14T05:59:13.514 INFO:teuthology.orchestra.run.smithi006.stdout:289 write 0x24811fb thru 0x2486ba8 (0x59ae bytes) 2024-09-14T05:59:13.519 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:13.519 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:13.519 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:13.519 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:13.519 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:13.538 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:59:13.540 INFO:teuthology.orchestra.run.smithi006.stdout:290 write 0xde7d42f thru 0xde853c7 (0x7f99 bytes) 2024-09-14T05:59:13.544 INFO:teuthology.orchestra.run.smithi006.stdout:295 read 0x2b03b7 thru 0x2bab55 (0xa79f bytes) 2024-09-14T05:59:13.545 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:13.563 INFO:teuthology.orchestra.run.smithi006.stdout:299 trunc from 0xde853c8 to 0x6386c21 2024-09-14T05:59:13.568 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:59:13.588 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:13.588 INFO:teuthology.orchestra.run.smithi006.stdout:304 punch from 0x4572a87 to 0x458129d, (0xe816 bytes) 2024-09-14T05:59:13.589 INFO:teuthology.orchestra.run.smithi006.stdout:305 trunc from 0x6386c21 to 0x5dd567a 2024-09-14T05:59:13.602 INFO:teuthology.orchestra.run.smithi006.stdout:306 read 0x3553f80 thru 0x35574a0 (0x3521 bytes) 2024-09-14T05:59:13.614 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:13.611+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:13.623 INFO:teuthology.orchestra.run.smithi006.stdout:308 writesame 0x94543e3 thru 0x94600ef data_size 0x1(0xbd0d bytes) 2024-09-14T05:59:13.623 INFO:teuthology.orchestra.run.smithi006.stdout:309 punch from 0x7ab0dc1 to 0x7abbeea, (0xb129 bytes) 2024-09-14T05:59:13.624 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:13.626 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:59:13.638 INFO:teuthology.orchestra.run.smithi006.stdout:312 write 0xa255f64 thru 0xa26148f (0xb52c bytes) 2024-09-14T05:59:13.644 INFO:teuthology.orchestra.run.smithi006.stdout:313 write 0x1374f87 thru 0x137a9ef (0x5a69 bytes) 2024-09-14T05:59:13.649 INFO:teuthology.orchestra.run.smithi006.stdout:316 write 0x8995e21 thru 0x899643d (0x61d bytes) 2024-09-14T05:59:13.669 INFO:teuthology.orchestra.run.smithi006.stdout:317 trunc from 0xa261490 to 0x2e9c5d 2024-09-14T05:59:13.676 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:79 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.551626+0000", 2024-09-14T05:59:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 2.1223740019999999, 2024-09-14T05:59:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064688590000000004, 2024-09-14T05:59:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.677 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 79 2024-09-14T05:59:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551626+0000", 2024-09-14T05:59:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551626+0000", 2024-09-14T05:59:13.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551628+0000", 2024-09-14T05:59:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3489999999999999e-06 2024-09-14T05:59:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551639+0000", 2024-09-14T05:59:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0634e-05 2024-09-14T05:59:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.679 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551662+0000", 2024-09-14T05:59:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3402000000000001e-05 2024-09-14T05:59:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551673+0000", 2024-09-14T05:59:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1044e-05 2024-09-14T05:59:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551747+0000", 2024-09-14T05:59:13.680 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3773e-05 2024-09-14T05:59:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551857+0000", 2024-09-14T05:59:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000109446 2024-09-14T05:59:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.552091+0000", 2024-09-14T05:59:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023430599999999999 2024-09-14T05:59:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.681 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.552804+0000", 2024-09-14T05:59:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00071353599999999997 2024-09-14T05:59:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.558019+0000", 2024-09-14T05:59:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0052144419999999997 2024-09-14T05:59:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.558058+0000", 2024-09-14T05:59:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9388999999999998e-05 2024-09-14T05:59:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.558095+0000", 2024-09-14T05:59:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6538000000000002e-05 2024-09-14T05:59:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:182 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.773357+0000", 2024-09-14T05:59:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.9006424399999999, 2024-09-14T05:59:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0062736679999999996, 2024-09-14T05:59:13.683 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 182 2024-09-14T05:59:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773357+0000", 2024-09-14T05:59:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773357+0000", 2024-09-14T05:59:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773360+0000", 2024-09-14T05:59:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1459999999999999e-06 2024-09-14T05:59:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773370+0000", 2024-09-14T05:59:13.685 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0837e-05 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773400+0000", 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9403e-05 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773414+0000", 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3946e-05 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773559+0000", 2024-09-14T05:59:13.686 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014528300000000001 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773820+0000", 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026123100000000001 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.774893+0000", 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0010726449999999999 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.776716+0000", 2024-09-14T05:59:13.687 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001823362 2024-09-14T05:59:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.779327+0000", 2024-09-14T05:59:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00261043 2024-09-14T05:59:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.779509+0000", 2024-09-14T05:59:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000181922 2024-09-14T05:59:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.688 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.779631+0000", 2024-09-14T05:59:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012246300000000001 2024-09-14T05:59:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:285 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.064746+0000", 2024-09-14T05:59:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.6092536129999999, 2024-09-14T05:59:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0060045380000000002, 2024-09-14T05:59:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.689 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 285 2024-09-14T05:59:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.064746+0000", 2024-09-14T05:59:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.690 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.064746+0000", 2024-09-14T05:59:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.064749+0000", 2024-09-14T05:59:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.424e-06 2024-09-14T05:59:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.064761+0000", 2024-09-14T05:59:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2063e-05 2024-09-14T05:59:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.064792+0000", 2024-09-14T05:59:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1508999999999999e-05 2024-09-14T05:59:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.064808+0000", 2024-09-14T05:59:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5597e-05 2024-09-14T05:59:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.064931+0000", 2024-09-14T05:59:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000123139 2024-09-14T05:59:13.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.065089+0000", 2024-09-14T05:59:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015805600000000001 2024-09-14T05:59:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.065648+0000", 2024-09-14T05:59:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000558915 2024-09-14T05:59:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.067238+0000", 2024-09-14T05:59:13.693 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001589504 2024-09-14T05:59:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.070583+0000", 2024-09-14T05:59:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0033456219999999999 2024-09-14T05:59:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.070679+0000", 2024-09-14T05:59:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5681999999999996e-05 2024-09-14T05:59:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.070751+0000", 2024-09-14T05:59:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2026999999999993e-05 2024-09-14T05:59:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:555 3.7 3:e2ffd4fe:::rbd_data.11275e589b0d.0000000000000013:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.773704+0000", 2024-09-14T05:59:13.695 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.90029599800000004, 2024-09-14T05:59:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.021020928000000001, 2024-09-14T05:59:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 555 2024-09-14T05:59:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.696 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773704+0000", 2024-09-14T05:59:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773704+0000", 2024-09-14T05:59:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.697 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773706+0000", 2024-09-14T05:59:13.698 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3300000000000001e-06 2024-09-14T05:59:13.698 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.698 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.698 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.698 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773718+0000", 2024-09-14T05:59:13.698 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1324e-05 2024-09-14T05:59:13.698 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.698 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.698 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.698 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773746+0000", 2024-09-14T05:59:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8813e-05 2024-09-14T05:59:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773761+0000", 2024-09-14T05:59:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4466e-05 2024-09-14T05:59:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773898+0000", 2024-09-14T05:59:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000137596 2024-09-14T05:59:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.699 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.774030+0000", 2024-09-14T05:59:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013141199999999999 2024-09-14T05:59:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T05:59:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.777366+0000", 2024-09-14T05:59:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003336468 2024-09-14T05:59:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794459+0000", 2024-09-14T05:59:13.700 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017092950999999999 2024-09-14T05:59:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794545+0000", 2024-09-14T05:59:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5609e-05 2024-09-14T05:59:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794644+0000", 2024-09-14T05:59:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8999000000000005e-05 2024-09-14T05:59:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794725+0000", 2024-09-14T05:59:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0959999999999997e-05 2024-09-14T05:59:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop_reply(client.4391.0:555 3.7 e29/24 ondisk, result = 0)", 2024-09-14T05:59:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.787144+0000", 2024-09-14T05:59:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.88685577199999999, 2024-09-14T05:59:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075976280000000004, 2024-09-14T05:59:13.702 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.787144+0000", 2024-09-14T05:59:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.787144+0000", 2024-09-14T05:59:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.787146+0000", 2024-09-14T05:59:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.73e-06 2024-09-14T05:59:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.787154+0000", 2024-09-14T05:59:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3769999999999996e-06 2024-09-14T05:59:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.704 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.787180+0000", 2024-09-14T05:59:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5488999999999999e-05 2024-09-14T05:59:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.787197+0000", 2024-09-14T05:59:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7503000000000002e-05 2024-09-14T05:59:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794520+0000", 2024-09-14T05:59:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073223510000000004 2024-09-14T05:59:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.705 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794533+0000", 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3093e-05 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794742+0000", 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020908499999999999 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:559 3.8 3:1552c62e:::rbd_data.11275e589b0d.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.806380+0000", 2024-09-14T05:59:13.706 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.86761959300000002, 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0090409600000000007, 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 559 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806380+0000", 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806380+0000", 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806383+0000", 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1530000000000001e-06 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806393+0000", 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.764e-06 2024-09-14T05:59:13.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806422+0000", 2024-09-14T05:59:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8739e-05 2024-09-14T05:59:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806436+0000", 2024-09-14T05:59:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4436999999999999e-05 2024-09-14T05:59:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806515+0000", 2024-09-14T05:59:13.709 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8813000000000006e-05 2024-09-14T05:59:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806655+0000", 2024-09-14T05:59:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000140109 2024-09-14T05:59:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 1", 2024-09-14T05:59:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.807787+0000", 2024-09-14T05:59:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001131909 2024-09-14T05:59:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.710 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.815280+0000", 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.007493151 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.815316+0000", 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5556000000000003e-05 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.815365+0000", 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8529000000000002e-05 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.711 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.815421+0000", 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6799999999999998e-05 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:608 3.7 3:e6b2e829:::rbd_data.11275e589b0d.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.930012+0000", 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.74398812000000003, 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.027079134000000001, 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.712 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 608 2024-09-14T05:59:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930012+0000", 2024-09-14T05:59:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930012+0000", 2024-09-14T05:59:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930013+0000", 2024-09-14T05:59:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2999999999999999e-07 2024-09-14T05:59:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930018+0000", 2024-09-14T05:59:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6239999999999999e-06 2024-09-14T05:59:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.714 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930032+0000", 2024-09-14T05:59:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3976e-05 2024-09-14T05:59:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930043+0000", 2024-09-14T05:59:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0764000000000001e-05 2024-09-14T05:59:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930152+0000", 2024-09-14T05:59:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108478 2024-09-14T05:59:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.715 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930287+0000", 2024-09-14T05:59:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000135029 2024-09-14T05:59:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T05:59:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.934701+0000", 2024-09-14T05:59:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044140050000000004 2024-09-14T05:59:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956894+0000", 2024-09-14T05:59:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022193039000000001 2024-09-14T05:59:13.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956924+0000", 2024-09-14T05:59:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0049999999999999e-05 2024-09-14T05:59:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.957018+0000", 2024-09-14T05:59:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4025999999999997e-05 2024-09-14T05:59:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.717 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.957091+0000", 2024-09-14T05:59:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3213000000000005e-05 2024-09-14T05:59:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop_reply(client.4391.0:608 3.7 e29/24 ondisk, result = 0)", 2024-09-14T05:59:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.942307+0000", 2024-09-14T05:59:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.73169260000000003, 2024-09-14T05:59:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014599915, 2024-09-14T05:59:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.718 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942307+0000", 2024-09-14T05:59:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942307+0000", 2024-09-14T05:59:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.719 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942309+0000", 2024-09-14T05:59:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.511e-06 2024-09-14T05:59:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942315+0000", 2024-09-14T05:59:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6629999999999998e-06 2024-09-14T05:59:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942333+0000", 2024-09-14T05:59:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8657000000000001e-05 2024-09-14T05:59:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.720 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942346+0000", 2024-09-14T05:59:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3254999999999999e-05 2024-09-14T05:59:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956866+0000", 2024-09-14T05:59:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014519353 2024-09-14T05:59:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.721 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956884+0000", 2024-09-14T05:59:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7825999999999998e-05 2024-09-14T05:59:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956907+0000", 2024-09-14T05:59:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3649999999999999e-05 2024-09-14T05:59:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:612 3.18 3:1a07fa9c:::rbd_data.11275e589b0d.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.970090+0000", 2024-09-14T05:59:13.722 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.70391008300000002, 2024-09-14T05:59:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.027517274000000001, 2024-09-14T05:59:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 612 2024-09-14T05:59:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970090+0000", 2024-09-14T05:59:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970090+0000", 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970092+0000", 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.663e-06 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970101+0000", 2024-09-14T05:59:13.724 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4560000000000006e-06 2024-09-14T05:59:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970127+0000", 2024-09-14T05:59:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5743999999999999e-05 2024-09-14T05:59:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970147+0000", 2024-09-14T05:59:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9973e-05 2024-09-14T05:59:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.725 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970270+0000", 2024-09-14T05:59:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000123182 2024-09-14T05:59:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970402+0000", 2024-09-14T05:59:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000131629 2024-09-14T05:59:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.997351+0000", 2024-09-14T05:59:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.026949039000000001 2024-09-14T05:59:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.726 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.997464+0000", 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011337599999999999 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.997607+0000", 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014321200000000001 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:648 3.7 3:e5c9d898:::rbd_data.11275e589b0d.0000000000000021:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.085190+0000", 2024-09-14T05:59:13.727 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.58880983799999997, 2024-09-14T05:59:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053110750000000002, 2024-09-14T05:59:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 648 2024-09-14T05:59:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.728 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085190+0000", 2024-09-14T05:59:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085190+0000", 2024-09-14T05:59:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085191+0000", 2024-09-14T05:59:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3599999999999999e-06 2024-09-14T05:59:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085198+0000", 2024-09-14T05:59:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5060000000000001e-06 2024-09-14T05:59:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085217+0000", 2024-09-14T05:59:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9347e-05 2024-09-14T05:59:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085234+0000", 2024-09-14T05:59:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6198999999999999e-05 2024-09-14T05:59:13.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.086168+0000", 2024-09-14T05:59:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00093455600000000002 2024-09-14T05:59:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.086232+0000", 2024-09-14T05:59:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4017999999999996e-05 2024-09-14T05:59:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.731 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T05:59:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.086329+0000", 2024-09-14T05:59:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6952000000000003e-05 2024-09-14T05:59:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.087866+0000", 2024-09-14T05:59:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001536955 2024-09-14T05:59:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.090349+0000", 2024-09-14T05:59:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0024831530000000001 2024-09-14T05:59:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.090432+0000", 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3339999999999998e-05 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.090501+0000", 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8689000000000006e-05 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:650 3.7 3:e6b2e829:::rbd_data.11275e589b0d.0000000000000028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.733 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.085260+0000", 2024-09-14T05:59:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.58874016900000004, 2024-09-14T05:59:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0081269900000000006, 2024-09-14T05:59:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 650 2024-09-14T05:59:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.734 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085260+0000", 2024-09-14T05:59:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085260+0000", 2024-09-14T05:59:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085261+0000", 2024-09-14T05:59:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2559999999999999e-06 2024-09-14T05:59:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085267+0000", 2024-09-14T05:59:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.84e-06 2024-09-14T05:59:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085287+0000", 2024-09-14T05:59:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0356999999999998e-05 2024-09-14T05:59:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085303+0000", 2024-09-14T05:59:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5356999999999999e-05 2024-09-14T05:59:13.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.086721+0000", 2024-09-14T05:59:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0014179539999999999 2024-09-14T05:59:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.086790+0000", 2024-09-14T05:59:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9399000000000004e-05 2024-09-14T05:59:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.737 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T05:59:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.086880+0000", 2024-09-14T05:59:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9884999999999997e-05 2024-09-14T05:59:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.087883+0000", 2024-09-14T05:59:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0010035630000000001 2024-09-14T05:59:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.093291+0000", 2024-09-14T05:59:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054079150000000001 2024-09-14T05:59:13.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.093332+0000", 2024-09-14T05:59:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0584000000000003e-05 2024-09-14T05:59:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.093387+0000", 2024-09-14T05:59:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4880000000000003e-05 2024-09-14T05:59:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:682 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.174691+0000", 2024-09-14T05:59:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.49930886699999999, 2024-09-14T05:59:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0065177710000000003, 2024-09-14T05:59:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 682 2024-09-14T05:59:13.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.174691+0000", 2024-09-14T05:59:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.174691+0000", 2024-09-14T05:59:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.174692+0000", 2024-09-14T05:59:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.057e-06 2024-09-14T05:59:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.174698+0000", 2024-09-14T05:59:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6690000000000003e-06 2024-09-14T05:59:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.174713+0000", 2024-09-14T05:59:13.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5194999999999999e-05 2024-09-14T05:59:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.174721+0000", 2024-09-14T05:59:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7549999999999994e-06 2024-09-14T05:59:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.174888+0000", 2024-09-14T05:59:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016734399999999999 2024-09-14T05:59:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.175032+0000", 2024-09-14T05:59:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014426900000000001 2024-09-14T05:59:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.175622+0000", 2024-09-14T05:59:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00058941799999999997 2024-09-14T05:59:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.177128+0000", 2024-09-14T05:59:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001505845 2024-09-14T05:59:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.181046+0000", 2024-09-14T05:59:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039182100000000001 2024-09-14T05:59:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.181141+0000", 2024-09-14T05:59:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5309000000000005e-05 2024-09-14T05:59:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.181209+0000", 2024-09-14T05:59:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7700000000000006e-05 2024-09-14T05:59:13.745 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:697 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.213420+0000", 2024-09-14T05:59:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.46058021599999999, 2024-09-14T05:59:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054108910000000001, 2024-09-14T05:59:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.746 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 697 2024-09-14T05:59:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213420+0000", 2024-09-14T05:59:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213420+0000", 2024-09-14T05:59:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213421+0000", 2024-09-14T05:59:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.342e-06 2024-09-14T05:59:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213427+0000", 2024-09-14T05:59:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2720000000000003e-06 2024-09-14T05:59:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213444+0000", 2024-09-14T05:59:13.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6688999999999999e-05 2024-09-14T05:59:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213452+0000", 2024-09-14T05:59:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0239999999999997e-06 2024-09-14T05:59:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213561+0000", 2024-09-14T05:59:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108473 2024-09-14T05:59:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.749 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213720+0000", 2024-09-14T05:59:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000159746 2024-09-14T05:59:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.214286+0000", 2024-09-14T05:59:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00056563200000000005 2024-09-14T05:59:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.215792+0000", 2024-09-14T05:59:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001506582 2024-09-14T05:59:13.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.218679+0000", 2024-09-14T05:59:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0028868940000000001 2024-09-14T05:59:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.218763+0000", 2024-09-14T05:59:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4118999999999999e-05 2024-09-14T05:59:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.218831+0000", 2024-09-14T05:59:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7118000000000004e-05 2024-09-14T05:59:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:712 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.251785+0000", 2024-09-14T05:59:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.422215061, 2024-09-14T05:59:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0055167250000000001, 2024-09-14T05:59:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.752 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 712 2024-09-14T05:59:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.251785+0000", 2024-09-14T05:59:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.753 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.251785+0000", 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.251786+0000", 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5990000000000001e-06 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.251794+0000", 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9410000000000007e-06 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.251814+0000", 2024-09-14T05:59:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9460999999999999e-05 2024-09-14T05:59:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.251822+0000", 2024-09-14T05:59:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4950000000000008e-06 2024-09-14T05:59:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.251925+0000", 2024-09-14T05:59:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102619 2024-09-14T05:59:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.252020+0000", 2024-09-14T05:59:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4914999999999995e-05 2024-09-14T05:59:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.252324+0000", 2024-09-14T05:59:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000304429 2024-09-14T05:59:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.253599+0000", 2024-09-14T05:59:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012745670000000001 2024-09-14T05:59:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.257210+0000", 2024-09-14T05:59:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00361145 2024-09-14T05:59:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.257259+0000", 2024-09-14T05:59:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8782000000000002e-05 2024-09-14T05:59:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.257302+0000", 2024-09-14T05:59:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2466999999999998e-05 2024-09-14T05:59:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:723 3.7 3:e6b2e829:::rbd_data.11275e589b0d.0000000000000028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.303359+0000", 2024-09-14T05:59:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.37064130200000001, 2024-09-14T05:59:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0066626519999999998, 2024-09-14T05:59:13.758 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 723 2024-09-14T05:59:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.303359+0000", 2024-09-14T05:59:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.303359+0000", 2024-09-14T05:59:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.303359+0000", 2024-09-14T05:59:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5600000000000004e-07 2024-09-14T05:59:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.303365+0000", 2024-09-14T05:59:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3329999999999996e-06 2024-09-14T05:59:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.303376+0000", 2024-09-14T05:59:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1195999999999999e-05 2024-09-14T05:59:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.303384+0000", 2024-09-14T05:59:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6699999999999994e-06 2024-09-14T05:59:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.304165+0000", 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000780855 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.304425+0000", 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026042200000000001 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.304766+0000", 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00034103999999999997 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.306148+0000", 2024-09-14T05:59:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001382147 2024-09-14T05:59:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.309919+0000", 2024-09-14T05:59:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003771319 2024-09-14T05:59:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.309976+0000", 2024-09-14T05:59:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6919999999999997e-05 2024-09-14T05:59:13.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.310021+0000", 2024-09-14T05:59:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4894000000000001e-05 2024-09-14T05:59:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:749 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.366629+0000", 2024-09-14T05:59:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.307371277, 2024-09-14T05:59:13.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0061304649999999999, 2024-09-14T05:59:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 749 2024-09-14T05:59:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366629+0000", 2024-09-14T05:59:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366629+0000", 2024-09-14T05:59:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366631+0000", 2024-09-14T05:59:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4169999999999999e-06 2024-09-14T05:59:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366644+0000", 2024-09-14T05:59:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2660000000000001e-05 2024-09-14T05:59:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366675+0000", 2024-09-14T05:59:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1689000000000001e-05 2024-09-14T05:59:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366690+0000", 2024-09-14T05:59:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4596999999999999e-05 2024-09-14T05:59:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366813+0000", 2024-09-14T05:59:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000122676 2024-09-14T05:59:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366943+0000", 2024-09-14T05:59:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000130321 2024-09-14T05:59:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.367407+0000", 2024-09-14T05:59:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00046437399999999998 2024-09-14T05:59:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.368711+0000", 2024-09-14T05:59:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001303972 2024-09-14T05:59:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.372617+0000", 2024-09-14T05:59:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039055600000000002 2024-09-14T05:59:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.372695+0000", 2024-09-14T05:59:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8201999999999994e-05 2024-09-14T05:59:13.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.372759+0000", 2024-09-14T05:59:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3997000000000004e-05 2024-09-14T05:59:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:764 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.435586+0000", 2024-09-14T05:59:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.23841418, 2024-09-14T05:59:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054708980000000001, 2024-09-14T05:59:13.770 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 764 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435586+0000", 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435586+0000", 2024-09-14T05:59:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435589+0000", 2024-09-14T05:59:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.422e-06 2024-09-14T05:59:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435611+0000", 2024-09-14T05:59:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1463000000000001e-05 2024-09-14T05:59:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435649+0000", 2024-09-14T05:59:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8577e-05 2024-09-14T05:59:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435667+0000", 2024-09-14T05:59:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7546000000000001e-05 2024-09-14T05:59:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435799+0000", 2024-09-14T05:59:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013210399999999999 2024-09-14T05:59:13.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435934+0000", 2024-09-14T05:59:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013530399999999999 2024-09-14T05:59:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.436268+0000", 2024-09-14T05:59:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000333784 2024-09-14T05:59:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.437304+0000", 2024-09-14T05:59:13.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001035787 2024-09-14T05:59:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.440930+0000", 2024-09-14T05:59:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0036263060000000001 2024-09-14T05:59:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.440999+0000", 2024-09-14T05:59:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9246999999999996e-05 2024-09-14T05:59:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.775 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.441057+0000", 2024-09-14T05:59:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7358000000000002e-05 2024-09-14T05:59:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:793 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.506764+0000", 2024-09-14T05:59:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.16723627899999999, 2024-09-14T05:59:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053809940000000001, 2024-09-14T05:59:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 793 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.506764+0000", 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.506764+0000", 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.506766+0000", 2024-09-14T05:59:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4329999999999998e-06 2024-09-14T05:59:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.506781+0000", 2024-09-14T05:59:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4584e-05 2024-09-14T05:59:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.506810+0000", 2024-09-14T05:59:13.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9496e-05 2024-09-14T05:59:13.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.779 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.779 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.506828+0000", 2024-09-14T05:59:13.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7827000000000001e-05 2024-09-14T05:59:13.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.779 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.779 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.506912+0000", 2024-09-14T05:59:13.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3752999999999996e-05 2024-09-14T05:59:13.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.780 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.780 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.507023+0000", 2024-09-14T05:59:13.780 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000110818 2024-09-14T05:59:13.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.780 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:13.780 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.507435+0000", 2024-09-14T05:59:13.780 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00041237100000000003 2024-09-14T05:59:13.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.780 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.780 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.508810+0000", 2024-09-14T05:59:13.780 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0013746019999999999 2024-09-14T05:59:13.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.781 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.781 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.512035+0000", 2024-09-14T05:59:13.781 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003225164 2024-09-14T05:59:13.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.781 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.781 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.512094+0000", 2024-09-14T05:59:13.781 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8959000000000003e-05 2024-09-14T05:59:13.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.781 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.781 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.512145+0000", 2024-09-14T05:59:13.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0986999999999998e-05 2024-09-14T05:59:13.782 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.782 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.782 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.782 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:795 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.782 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.515817+0000", 2024-09-14T05:59:13.782 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.15818338900000001, 2024-09-14T05:59:13.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0055946859999999998, 2024-09-14T05:59:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 795 2024-09-14T05:59:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.784 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.515817+0000", 2024-09-14T05:59:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.515817+0000", 2024-09-14T05:59:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.515819+0000", 2024-09-14T05:59:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.007e-06 2024-09-14T05:59:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.785 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.515829+0000", 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0336000000000001e-05 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.515856+0000", 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7177000000000001e-05 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.515870+0000", 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3570000000000001e-05 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.515947+0000", 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7583999999999994e-05 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.516044+0000", 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6562000000000001e-05 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.516438+0000", 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00039470800000000002 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.517670+0000", 2024-09-14T05:59:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012317319999999999 2024-09-14T05:59:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.521297+0000", 2024-09-14T05:59:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0036264689999999998 2024-09-14T05:59:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.521357+0000", 2024-09-14T05:59:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0807000000000002e-05 2024-09-14T05:59:13.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.521411+0000", 2024-09-14T05:59:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3733999999999997e-05 2024-09-14T05:59:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:809 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.564304+0000", 2024-09-14T05:59:13.789 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.10969641300000001, 2024-09-14T05:59:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054857380000000004, 2024-09-14T05:59:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 809 2024-09-14T05:59:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:13.790 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564304+0000", 2024-09-14T05:59:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564304+0000", 2024-09-14T05:59:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564307+0000", 2024-09-14T05:59:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0400000000000001e-06 2024-09-14T05:59:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564324+0000", 2024-09-14T05:59:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7793000000000001e-05 2024-09-14T05:59:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564362+0000", 2024-09-14T05:59:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7577000000000003e-05 2024-09-14T05:59:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564380+0000", 2024-09-14T05:59:13.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8185999999999998e-05 2024-09-14T05:59:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564465+0000", 2024-09-14T05:59:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5068999999999995e-05 2024-09-14T05:59:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564545+0000", 2024-09-14T05:59:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0185999999999994e-05 2024-09-14T05:59:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564799+0000", 2024-09-14T05:59:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025333799999999998 2024-09-14T05:59:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.565742+0000", 2024-09-14T05:59:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00094329699999999995 2024-09-14T05:59:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.569551+0000", 2024-09-14T05:59:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038091169999999999 2024-09-14T05:59:13.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.569658+0000", 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000107132 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.569789+0000", 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013100300000000001 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:13.795 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:13.797 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:59:13.798 INFO:teuthology.orchestra.run.smithi006.stdout:320 trunc from 0x2e9c5d to 0x7551228 2024-09-14T05:59:13.798 INFO:teuthology.orchestra.run.smithi006.stdout:321 trunc from 0x7551228 to 0xb8c1718 2024-09-14T05:59:13.798 INFO:teuthology.orchestra.run.smithi006.stdout:322 punch from 0x1775a0c to 0x177c72a, (0x6d1e bytes) 2024-09-14T05:59:13.798 INFO:teuthology.orchestra.run.smithi006.stdout:323 write 0xa2a6d21 thru 0xa2b22a2 (0xb582 bytes) 2024-09-14T05:59:13.798 INFO:teuthology.orchestra.run.smithi006.stdout:324 write 0x19d78ea thru 0x19e3d64 (0xc47b bytes) 2024-09-14T05:59:13.798 INFO:teuthology.orchestra.run.smithi006.stdout:325 clone 1 order 20 su 4096 sc 6 2024-09-14T05:59:13.798 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T05:59:13.799 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:13.799 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:13.799 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:13.795+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:13.803 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:13.820 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:13.820 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:13.839 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:13.839 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:13.857 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:13.857 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:13.875 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:13.876 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:13.897 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:13.897 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:13.898 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:13.895+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:13.900 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T05:59:13.901 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T05:59:13.931 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:13.931 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:13.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:59:14.031 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:14.031+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:14.100 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:14.099+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:14.111 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:14.112 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:14.123 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:59:14.211 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:14.211+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:14.277 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2024-09-14T05:59:14.299 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:14.299 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:14.301 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:14.297+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:14.316 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:59:14.403 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:14.403+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:14.485 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:14.485 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:14.500 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:59:14.543 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:14.543+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:14.560 INFO:teuthology.orchestra.run.smithi006.stdout:329 read 0x96f2884 thru 0x96fc9fa (0xa177 bytes) 2024-09-14T05:59:14.561 INFO:teuthology.orchestra.run.smithi006.stdout:331 write 0x7e8f484 thru 0x7e923bc (0x2f39 bytes) 2024-09-14T05:59:14.581 INFO:teuthology.orchestra.run.smithi006.stdout:333 write 0xa05ecf5 thru 0xa06290a (0x3c16 bytes) 2024-09-14T05:59:14.603 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:14.599+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:14.672 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:14.672 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:14.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:59:14.727 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:14.727+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:14.790 INFO:teuthology.orchestra.run.smithi006.stdout:334 write 0xd4d9426 thru 0xd4e2f17 (0x9af2 bytes) 2024-09-14T05:59:14.805 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:14.801+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:14.808 INFO:teuthology.orchestra.run.smithi006.stdout:335 writesame 0x57feea4 thru 0x5800ccf data_size 0x2(0x1e2c bytes) 2024-09-14T05:59:14.827 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:14.827 INFO:teuthology.orchestra.run.smithi006.stdout:337 read 0x4f93236 thru 0x4f96a3d (0x3808 bytes) 2024-09-14T05:59:14.827 INFO:teuthology.orchestra.run.smithi006.stdout:338 write 0x5fb6cc4 thru 0x5fc19e0 (0xad1d bytes) 2024-09-14T05:59:14.847 INFO:teuthology.orchestra.run.smithi006.stdout:339 writesame 0x86d67c thru 0x875f5e data_size 0x1(0x88e3 bytes) 2024-09-14T05:59:14.855 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:14.855 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:14.870 INFO:teuthology.orchestra.run.smithi006.stdout:341 read 0x5f41065 thru 0x5f4656c (0x5508 bytes) 2024-09-14T05:59:14.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T05:59:14.880 INFO:teuthology.orchestra.run.smithi006.stdout:343 trunc from 0xd4e2f18 to 0xa0ef762 2024-09-14T05:59:14.919 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:14.919+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:14.940 INFO:teuthology.orchestra.run.smithi006.stdout:344 write 0x348027 thru 0x3504c6 (0x84a0 bytes) 2024-09-14T05:59:14.997 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:14.997 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:15.006 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:15.003+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:15.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T05:59:15.107 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:15.105+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:15.179 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:15.179 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:15.193 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T05:59:15.239 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:15.239+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:15.274 INFO:teuthology.orchestra.run.smithi006.stdout:345 write 0x6df0ca5 thru 0x6df748d (0x67e9 bytes) 2024-09-14T05:59:15.290 INFO:teuthology.orchestra.run.smithi006.stdout:346 writesame 0x63c0b2b thru 0x63c9425 data_size 0x1(0x88fb bytes) 2024-09-14T05:59:15.308 INFO:teuthology.orchestra.run.smithi006.stdout:348 read 0x9c643ec thru 0x9c6a668 (0x627d bytes) 2024-09-14T05:59:15.309 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:15.307+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:15.309 INFO:teuthology.orchestra.run.smithi006.stdout:349 write 0x6eec67d thru 0x6efaad6 (0xe45a bytes) 2024-09-14T05:59:15.314 INFO:teuthology.orchestra.run.smithi006.stdout:350 read 0x568a6d4 thru 0x5698ac5 (0xe3f2 bytes) 2024-09-14T05:59:15.315 INFO:teuthology.orchestra.run.smithi006.stdout:352 punch from 0x58fcd8a to 0x59087f4, (0xba6a bytes) 2024-09-14T05:59:15.315 INFO:teuthology.orchestra.run.smithi006.stdout:353 read 0x148787d thru 0x148c398 (0x4b1c bytes) 2024-09-14T05:59:15.315 INFO:teuthology.orchestra.run.smithi006.stdout:355 punch from 0x876cbc1 to 0x876cf1a, (0x359 bytes) 2024-09-14T05:59:15.315 INFO:teuthology.orchestra.run.smithi006.stdout:356 writesame 0x721e96f thru 0x722e4a9 data_size 0x13(0xfb3b bytes) 2024-09-14T05:59:15.317 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:15.317 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:15.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T05:59:15.352 INFO:teuthology.orchestra.run.smithi006.stdout:358 trunc from 0xa0ef762 to 0x13a1b8c 2024-09-14T05:59:15.410 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:15.405+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:15.412 INFO:teuthology.orchestra.run.smithi006.stdout:359 read 0x911866 thru 0x91da1e (0xc1b9 bytes) 2024-09-14T05:59:15.413 INFO:teuthology.orchestra.run.smithi006.stdout:361 punch from 0xc5dd8e to 0xc69a53, (0xbcc5 bytes) 2024-09-14T05:59:15.413 INFO:teuthology.orchestra.run.smithi006.stdout:362 read 0xf2706 thru 0xfafe9 (0x88e4 bytes) 2024-09-14T05:59:15.429 INFO:teuthology.orchestra.run.smithi006.stdout:363 write 0x30fbd06 thru 0x310187b (0x5b76 bytes) 2024-09-14T05:59:15.446 INFO:teuthology.orchestra.run.smithi006.stdout:364 punch from 0x14725b3 to 0x1477bb1, (0x55fe bytes) 2024-09-14T05:59:15.472 INFO:teuthology.orchestra.run.smithi006.stdout:366 write 0x9592c1c thru 0x959ee6f (0xc254 bytes) 2024-09-14T05:59:15.491 INFO:teuthology.orchestra.run.smithi006.stdout:367 read 0x2bad8f4 thru 0x2bb9b88 (0xc295 bytes) 2024-09-14T05:59:15.491 INFO:teuthology.orchestra.run.smithi006.stdout:371 read 0x540cd26 thru 0x5412220 (0x54fb bytes) 2024-09-14T05:59:15.503 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:15.503 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:15.504 INFO:teuthology.orchestra.run.smithi006.stdout:372 write 0xa78032e thru 0xa780e35 (0xb08 bytes) 2024-09-14T05:59:15.510 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:15.507+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:15.511 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:15.512 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:15.512 INFO:teuthology.orchestra.run.smithi006.stdout:375 punch from 0x9ca98e4 to 0x9caedc3, (0x54df bytes) 2024-09-14T05:59:15.512 INFO:teuthology.orchestra.run.smithi006.stdout:376 write 0x3592399 thru 0x359dc4d (0xb8b5 bytes) 2024-09-14T05:59:15.516 INFO:teuthology.orchestra.run.smithi006.stdout:377 writesame 0x9f60131 thru 0x9f64b79 data_size 0x3(0x4a49 bytes) 2024-09-14T05:59:15.518 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T05:59:15.534 INFO:teuthology.orchestra.run.smithi006.stdout:378 punch from 0x3f6195c to 0x3f6bc0e, (0xa2b2 bytes) 2024-09-14T05:59:15.534 INFO:teuthology.orchestra.run.smithi006.stdout:379 punch from 0x82ef083 to 0x82fc1ce, (0xd14b bytes) 2024-09-14T05:59:15.559 INFO:teuthology.orchestra.run.smithi006.stdout:381 trunc from 0xa780e36 to 0xc571af 2024-09-14T05:59:15.611 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:15.609+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:15.660 INFO:teuthology.orchestra.run.smithi006.stdout:382 write 0xb49ec0b thru 0xb4a6d1d (0x8113 bytes) 2024-09-14T05:59:15.679 INFO:teuthology.orchestra.run.smithi006.stdout:384 read 0xab0d922 thru 0xab0fd70 (0x244f bytes) 2024-09-14T05:59:15.679 INFO:teuthology.orchestra.run.smithi006.stdout:385 read 0x19d95e1 thru 0x19da8f0 (0x1310 bytes) 2024-09-14T05:59:15.682 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:15.682 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:15.698 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T05:59:15.699 INFO:teuthology.orchestra.run.smithi006.stdout:390 writesame 0xd7d6ffb thru 0xd7db566 data_size 0x6(0x456c bytes) 2024-09-14T05:59:15.699 INFO:teuthology.orchestra.run.smithi006.stdout:391 write 0xc18a849 thru 0xc18bfe0 (0x1798 bytes) 2024-09-14T05:59:15.707 INFO:teuthology.orchestra.run.smithi006.stdout:393 read 0xc0749cc thru 0xc078208 (0x383d bytes) 2024-09-14T05:59:15.708 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T05:59:15.708 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.0 2024-09-14T05:59:15.709 INFO:tasks.thrashosds.thrasher:remote for osd 0 is ubuntu@smithi006.front.sepia.ceph.com 2024-09-14T05:59:15.709 DEBUG:teuthology.orchestra.run.smithi006:> type ceph-objectstore-tool 2024-09-14T05:59:15.714 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T05:59:15.715 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --op list-pgs 2024-09-14T05:59:15.725 INFO:teuthology.orchestra.run.smithi006.stdout:394 write 0xed6d0a9 thru 0xed7a893 (0xd7eb bytes) 2024-09-14T05:59:15.740 INFO:teuthology.orchestra.run.smithi006.stdout:395 writesame 0xa0e8b40 thru 0xa0edb1e data_size 0x17(0x4fdf bytes) 2024-09-14T05:59:15.743 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:15.743+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:15.752 INFO:teuthology.orchestra.run.smithi006.stdout:396 write 0x9bee5b7 thru 0x9bf7999 (0x93e3 bytes) 2024-09-14T05:59:15.783 INFO:teuthology.orchestra.run.smithi006.stdout:399 trunc from 0xed7a894 to 0x550baf4 2024-09-14T05:59:15.813 INFO:teuthology.orchestra.run.smithi006.stdout:401 write 0x1c15f09 thru 0x1c1bf61 (0x6059 bytes) 2024-09-14T05:59:15.813 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:15.811+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:15.828 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:15.828 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:15.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:59:15.855 INFO:teuthology.orchestra.run.smithi006.stdout:402 write 0xe092519 thru 0xe098ec1 (0x69a9 bytes) 2024-09-14T05:59:15.872 INFO:teuthology.orchestra.run.smithi006.stdout:403 writesame 0x4052d5f thru 0x405e0e6 data_size 0x3c(0xb388 bytes) 2024-09-14T05:59:15.886 INFO:teuthology.orchestra.run.smithi006.stdout:404 punch from 0xc8c2947 to 0xc8cac3e, (0x82f7 bytes) 2024-09-14T05:59:15.887 INFO:teuthology.orchestra.run.smithi006.stdout:405 write 0x217549 thru 0x21f856 (0x830e bytes) 2024-09-14T05:59:15.891 INFO:teuthology.orchestra.run.smithi006.stdout:406 write 0x4878bf4 thru 0x487bbe4 (0x2ff1 bytes) 2024-09-14T05:59:15.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:59:15.909 INFO:teuthology.orchestra.run.smithi006.stdout:407 write 0xe93a878 thru 0xe940050 (0x57d9 bytes) 2024-09-14T05:59:15.914 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:15.909+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:15.923 INFO:teuthology.orchestra.run.smithi006.stdout:409 writesame 0xc97920a thru 0xc9846b3 data_size 0x7d(0xb4aa bytes) 2024-09-14T05:59:15.939 INFO:teuthology.orchestra.run.smithi006.stdout:410 trunc from 0xe940051 to 0xd1584a5 2024-09-14T05:59:15.978 INFO:teuthology.orchestra.run.smithi006.stdout:412 writesame 0xe76e093 thru 0xe7725e4 data_size 0x13(0x4552 bytes) 2024-09-14T05:59:15.978 INFO:teuthology.orchestra.run.smithi006.stdout:416 write 0x5a3d630 thru 0x5a481fb (0xabcc bytes) 2024-09-14T05:59:15.983 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:15.984 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:15.990 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:15.990 INFO:teuthology.orchestra.run.smithi006.stdout:421 writesame 0x5e1b2f4 thru 0x5e1be50 data_size 0x1(0xb5d bytes) 2024-09-14T05:59:15.995 INFO:teuthology.orchestra.run.smithi006.stdout:422 read 0x82b7f61 thru 0x82c51ff (0xd29f bytes) 2024-09-14T05:59:15.995 INFO:teuthology.orchestra.run.smithi006.stdout:423 read 0x4267308 thru 0x426a56e (0x3267 bytes) 2024-09-14T05:59:16.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:59:16.018 INFO:teuthology.orchestra.run.smithi006.stdout:424 trunc from 0xe7725e5 to 0x15dfd45 2024-09-14T05:59:16.018 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:16.013+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:16.047 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T05:59:16.065 INFO:teuthology.orchestra.run.smithi006.stdout:427 trunc from 0x15dfd45 to 0xd2c5da4 2024-09-14T05:59:16.071 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:16.071 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:16.074 INFO:teuthology.orchestra.run.smithi006.stdout:429 writesame 0x52acff9 thru 0x52b76e0 data_size 0x6d(0xa6e8 bytes) 2024-09-14T05:59:16.085 INFO:teuthology.orchestra.run.smithi006.stdout:430 write 0x7f7a4c4 thru 0x7f825af (0x80ec bytes) 2024-09-14T05:59:16.095 INFO:teuthology.orchestra.run.smithi006.stdout:431 punch from 0x51ff602 to 0x520f0fc, (0xfafa bytes) 2024-09-14T05:59:16.097 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:16.097 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:16.097 INFO:teuthology.orchestra.run.smithi006.stdout:432 trunc from 0xd2c5da4 to 0xe2bf6bc 2024-09-14T05:59:16.107 INFO:teuthology.orchestra.run.smithi006.stdout:433 writesame 0xced4d0b thru 0xcee108d data_size 0x1(0xc383 bytes) 2024-09-14T05:59:16.116 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:16.115+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:16.119 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:16.120 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:16.150 INFO:teuthology.orchestra.run.smithi006.stdout:1.0 2024-09-14T05:59:16.150 INFO:teuthology.orchestra.run.smithi006.stdout:2.4 2024-09-14T05:59:16.150 INFO:teuthology.orchestra.run.smithi006.stdout:2.5 2024-09-14T05:59:16.150 INFO:teuthology.orchestra.run.smithi006.stdout:3.10 2024-09-14T05:59:16.150 INFO:teuthology.orchestra.run.smithi006.stdout:3.12 2024-09-14T05:59:16.150 INFO:teuthology.orchestra.run.smithi006.stdout:3.17 2024-09-14T05:59:16.151 INFO:teuthology.orchestra.run.smithi006.stdout:3.3 2024-09-14T05:59:16.151 INFO:teuthology.orchestra.run.smithi006.stdout:3.18 2024-09-14T05:59:16.151 INFO:teuthology.orchestra.run.smithi006.stdout:3.b 2024-09-14T05:59:16.151 INFO:teuthology.orchestra.run.smithi006.stdout:3.1 2024-09-14T05:59:16.151 INFO:teuthology.orchestra.run.smithi006.stdout:3.1b 2024-09-14T05:59:16.151 INFO:teuthology.orchestra.run.smithi006.stdout:3.1f 2024-09-14T05:59:16.151 INFO:teuthology.orchestra.run.smithi006.stdout:3.6 2024-09-14T05:59:16.151 INFO:teuthology.orchestra.run.smithi006.stdout:435 write 0x9a9de46 thru 0x9aa0bca (0x2d85 bytes) 2024-09-14T05:59:16.157 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:16.157 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:16.159 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:16.159 INFO:teuthology.orchestra.run.smithi006.stdout:439 clone 2 order 19 su 65536 sc 14 2024-09-14T05:59:16.167 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:16.167 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:16.167 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:16.178 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:16.178 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:16.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:59:16.200 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:16.200 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:16.217 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:16.215+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:16.221 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:16.222 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:16.225 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T05:59:16.225 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T05:59:16.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-14T05:59:16.304 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:59:16.318 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:16.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:224 3.4 3:234b7459:::rbd_data.11275e589b0d.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2756730~58417] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.885374+0000", 2024-09-14T05:59:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.4310007430000002, 2024-09-14T05:59:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038761899999999998, 2024-09-14T05:59:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.319 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 224 2024-09-14T05:59:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885374+0000", 2024-09-14T05:59:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885374+0000", 2024-09-14T05:59:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885378+0000", 2024-09-14T05:59:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9269999999999998e-06 2024-09-14T05:59:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885509+0000", 2024-09-14T05:59:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013164200000000001 2024-09-14T05:59:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885555+0000", 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5493e-05 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885582+0000", 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6945999999999999e-05 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885730+0000", 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000148472 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.885962+0000", 2024-09-14T05:59:16.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023224199999999999 2024-09-14T05:59:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886186+0000", 2024-09-14T05:59:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00022364499999999999 2024-09-14T05:59:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.888378+0000", 2024-09-14T05:59:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0021923400000000001 2024-09-14T05:59:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.889088+0000", 2024-09-14T05:59:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000709338 2024-09-14T05:59:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.889174+0000", 2024-09-14T05:59:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5902999999999994e-05 2024-09-14T05:59:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.889250+0000", 2024-09-14T05:59:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6242000000000006e-05 2024-09-14T05:59:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.324 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:250 3.4 3:234b7459:::rbd_data.11275e589b0d.0000000000000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.982107+0000", 2024-09-14T05:59:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.3342671370000003, 2024-09-14T05:59:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041645420000000002, 2024-09-14T05:59:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.325 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 250 2024-09-14T05:59:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982107+0000", 2024-09-14T05:59:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982107+0000", 2024-09-14T05:59:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982110+0000", 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1439999999999999e-06 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982124+0000", 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.33e-05 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982160+0000", 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6216e-05 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982177+0000", 2024-09-14T05:59:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7456999999999999e-05 2024-09-14T05:59:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982335+0000", 2024-09-14T05:59:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000157532 2024-09-14T05:59:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982581+0000", 2024-09-14T05:59:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024623800000000002 2024-09-14T05:59:16.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982911+0000", 2024-09-14T05:59:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032986099999999998 2024-09-14T05:59:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.984610+0000", 2024-09-14T05:59:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001699367 2024-09-14T05:59:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.986108+0000", 2024-09-14T05:59:16.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001498018 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.986197+0000", 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8973000000000003e-05 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.986272+0000", 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4436000000000004e-05 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:858 3.0 3:00d51ce4:::rbd_data.11275e589b0d.0000000000000009:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.674108+0000", 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 2.6422662360000002, 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041706859999999998, 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 858 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674108+0000", 2024-09-14T05:59:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674108+0000", 2024-09-14T05:59:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674109+0000", 2024-09-14T05:59:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6499999999999999e-07 2024-09-14T05:59:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674112+0000", 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3500000000000001e-06 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674121+0000", 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.115e-06 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674129+0000", 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8939999999999993e-06 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674202+0000", 2024-09-14T05:59:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2589000000000006e-05 2024-09-14T05:59:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674253+0000", 2024-09-14T05:59:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1637e-05 2024-09-14T05:59:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674325+0000", 2024-09-14T05:59:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1381e-05 2024-09-14T05:59:16.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.675261+0000", 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00093625200000000005 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.678155+0000", 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002893858 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.678221+0000", 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5883000000000006e-05 2024-09-14T05:59:16.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.678279+0000", 2024-09-14T05:59:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8062000000000001e-05 2024-09-14T05:59:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3200 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.075892+0000", 2024-09-14T05:59:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.24048230700000001, 2024-09-14T05:59:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0057534220000000002, 2024-09-14T05:59:16.336 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3200 2024-09-14T05:59:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075892+0000", 2024-09-14T05:59:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075892+0000", 2024-09-14T05:59:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075893+0000", 2024-09-14T05:59:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2799999999999995e-07 2024-09-14T05:59:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075898+0000", 2024-09-14T05:59:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9960000000000001e-06 2024-09-14T05:59:16.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075908+0000", 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0538e-05 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075915+0000", 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8240000000000002e-06 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076694+0000", 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00077917899999999996 2024-09-14T05:59:16.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076743+0000", 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9023000000000001e-05 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076932+0000", 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018885000000000001 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.079096+0000", 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0021635159999999999 2024-09-14T05:59:16.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081522+0000", 2024-09-14T05:59:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002425852 2024-09-14T05:59:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081585+0000", 2024-09-14T05:59:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3304000000000002e-05 2024-09-14T05:59:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081645+0000", 2024-09-14T05:59:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0612000000000002e-05 2024-09-14T05:59:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3201 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.075930+0000", 2024-09-14T05:59:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.24044427299999999, 2024-09-14T05:59:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0058222209999999998, 2024-09-14T05:59:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.342 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3201 2024-09-14T05:59:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075930+0000", 2024-09-14T05:59:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075930+0000", 2024-09-14T05:59:16.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075931+0000", 2024-09-14T05:59:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.82e-07 2024-09-14T05:59:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075934+0000", 2024-09-14T05:59:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.619e-06 2024-09-14T05:59:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075944+0000", 2024-09-14T05:59:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3070000000000008e-06 2024-09-14T05:59:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075950+0000", 2024-09-14T05:59:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2090000000000002e-06 2024-09-14T05:59:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.077324+0000", 2024-09-14T05:59:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0013742520000000001 2024-09-14T05:59:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.077389+0000", 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4733000000000005e-05 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.077638+0000", 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024908200000000003 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081422+0000", 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037840629999999998 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081656+0000", 2024-09-14T05:59:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000234372 2024-09-14T05:59:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081708+0000", 2024-09-14T05:59:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2088e-05 2024-09-14T05:59:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081752+0000", 2024-09-14T05:59:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3914e-05 2024-09-14T05:59:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.347 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3202 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.075959+0000", 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.24041515599999999, 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0058902759999999998, 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3202 2024-09-14T05:59:16.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075959+0000", 2024-09-14T05:59:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075959+0000", 2024-09-14T05:59:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.349 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075960+0000", 2024-09-14T05:59:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1999999999999999e-07 2024-09-14T05:59:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075963+0000", 2024-09-14T05:59:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2480000000000001e-06 2024-09-14T05:59:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075971+0000", 2024-09-14T05:59:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5349999999999999e-06 2024-09-14T05:59:16.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.075976+0000", 2024-09-14T05:59:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6790000000000002e-06 2024-09-14T05:59:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.078044+0000", 2024-09-14T05:59:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020672469999999999 2024-09-14T05:59:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.078096+0000", 2024-09-14T05:59:16.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2136999999999999e-05 2024-09-14T05:59:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.078426+0000", 2024-09-14T05:59:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00033000500000000002 2024-09-14T05:59:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081463+0000", 2024-09-14T05:59:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0030368690000000002 2024-09-14T05:59:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081760+0000", 2024-09-14T05:59:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029765400000000001 2024-09-14T05:59:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081809+0000", 2024-09-14T05:59:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8903999999999998e-05 2024-09-14T05:59:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081849+0000", 2024-09-14T05:59:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0377999999999999e-05 2024-09-14T05:59:16.353 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3203 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.076002+0000", 2024-09-14T05:59:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.240372484, 2024-09-14T05:59:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.005936289, 2024-09-14T05:59:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.354 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3203 2024-09-14T05:59:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076002+0000", 2024-09-14T05:59:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076002+0000", 2024-09-14T05:59:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076003+0000", 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9299999999999997e-07 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076007+0000", 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5549999999999996e-06 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076015+0000", 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2849999999999995e-06 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076022+0000", 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2060000000000004e-06 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.079135+0000", 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031133390000000001 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.079229+0000", 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4153000000000005e-05 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.079658+0000", 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042930300000000002 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081509+0000", 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0018511140000000001 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081857+0000", 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00034763099999999999 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081897+0000", 2024-09-14T05:59:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0061000000000002e-05 2024-09-14T05:59:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081938+0000", 2024-09-14T05:59:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0948999999999997e-05 2024-09-14T05:59:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3204 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.076032+0000", 2024-09-14T05:59:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.240342642, 2024-09-14T05:59:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0071965850000000001, 2024-09-14T05:59:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3204 2024-09-14T05:59:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076032+0000", 2024-09-14T05:59:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076032+0000", 2024-09-14T05:59:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076032+0000", 2024-09-14T05:59:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.32e-07 2024-09-14T05:59:16.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076035+0000", 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3569999999999998e-06 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076042+0000", 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7549999999999997e-06 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.076050+0000", 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.926e-06 2024-09-14T05:59:16.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.080619+0000", 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045691500000000001 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.080706+0000", 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6920000000000001e-05 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.080995+0000", 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028893700000000002 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.081947+0000", 2024-09-14T05:59:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00095196099999999997 2024-09-14T05:59:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.083094+0000", 2024-09-14T05:59:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0011467770000000001 2024-09-14T05:59:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.083186+0000", 2024-09-14T05:59:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2307999999999998e-05 2024-09-14T05:59:16.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.083228+0000", 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2061999999999998e-05 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3213 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.086135+0000", 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.23023911899999999, 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049666989999999998, 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.365 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3213 2024-09-14T05:59:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086135+0000", 2024-09-14T05:59:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086135+0000", 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086136+0000", 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3799999999999997e-07 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086140+0000", 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9729999999999999e-06 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086148+0000", 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4819999999999994e-06 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086153+0000", 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0409999999999997e-06 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.087659+0000", 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0015060329999999999 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.087756+0000", 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6731999999999995e-05 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.088047+0000", 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029126100000000002 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.089439+0000", 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00139116 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.091023+0000", 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0015846829999999999 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.091074+0000", 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0566999999999999e-05 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.091102+0000", 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8129000000000001e-05 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3214 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.086159+0000", 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.23021518299999999, 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0050492159999999996, 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3214 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086159+0000", 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086159+0000", 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086159+0000", 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6300000000000001e-07 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086162+0000", 2024-09-14T05:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.441e-06 2024-09-14T05:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086166+0000", 2024-09-14T05:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8060000000000001e-06 2024-09-14T05:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086168+0000", 2024-09-14T05:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.745e-06 2024-09-14T05:59:16.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.088451+0000", 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0022830609999999999 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.088538+0000", 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6117000000000002e-05 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.088904+0000", 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00036667600000000002 2024-09-14T05:59:16.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.091132+0000", 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0022281800000000002 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.091140+0000", 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4819999999999997e-06 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.091176+0000", 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5623000000000001e-05 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.091208+0000", 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2821999999999998e-05 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3215 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.086172+0000", 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.23020204599999999, 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0055881769999999997, 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.376 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3215 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086172+0000", 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086172+0000", 2024-09-14T05:59:16.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086173+0000", 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2700000000000001e-07 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086174+0000", 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.956e-06 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086178+0000", 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2100000000000002e-06 2024-09-14T05:59:16.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086180+0000", 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6400000000000001e-06 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.089597+0000", 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0034162300000000001 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.089664+0000", 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7343999999999998e-05 2024-09-14T05:59:16.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.089910+0000", 2024-09-14T05:59:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024562999999999999 2024-09-14T05:59:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.091217+0000", 2024-09-14T05:59:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001307557 2024-09-14T05:59:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.091694+0000", 2024-09-14T05:59:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00047687899999999999 2024-09-14T05:59:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.091725+0000", 2024-09-14T05:59:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0879e-05 2024-09-14T05:59:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.091760+0000", 2024-09-14T05:59:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5624999999999999e-05 2024-09-14T05:59:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.381 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3216 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.086184+0000", 2024-09-14T05:59:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.23019044399999999, 2024-09-14T05:59:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0060335720000000001, 2024-09-14T05:59:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.382 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3216 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086184+0000", 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086184+0000", 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086184+0000", 2024-09-14T05:59:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2000000000000001e-07 2024-09-14T05:59:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086186+0000", 2024-09-14T05:59:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8449999999999999e-06 2024-09-14T05:59:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086189+0000", 2024-09-14T05:59:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1410000000000001e-06 2024-09-14T05:59:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.086192+0000", 2024-09-14T05:59:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2739999999999999e-06 2024-09-14T05:59:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.090305+0000", 2024-09-14T05:59:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041124129999999997 2024-09-14T05:59:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.090381+0000", 2024-09-14T05:59:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6621999999999999e-05 2024-09-14T05:59:16.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.090687+0000", 2024-09-14T05:59:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030579899999999999 2024-09-14T05:59:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.091773+0000", 2024-09-14T05:59:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001085485 2024-09-14T05:59:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.092121+0000", 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00034828700000000002 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.092176+0000", 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4784000000000003e-05 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.092217+0000", 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1702000000000002e-05 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3233 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.108079+0000", 2024-09-14T05:59:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.208294901, 2024-09-14T05:59:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053735650000000003, 2024-09-14T05:59:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3233 2024-09-14T05:59:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.388 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108079+0000", 2024-09-14T05:59:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108079+0000", 2024-09-14T05:59:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108080+0000", 2024-09-14T05:59:16.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.61e-07 2024-09-14T05:59:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108085+0000", 2024-09-14T05:59:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.023e-06 2024-09-14T05:59:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108096+0000", 2024-09-14T05:59:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0445000000000001e-05 2024-09-14T05:59:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108104+0000", 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2959999999999999e-06 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108868+0000", 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00076439300000000004 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108970+0000", 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102042 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.109339+0000", 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00036895500000000002 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.110764+0000", 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00142435 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.113334+0000", 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0025705530000000002 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.113401+0000", 2024-09-14T05:59:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6602999999999999e-05 2024-09-14T05:59:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.113453+0000", 2024-09-14T05:59:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2144000000000001e-05 2024-09-14T05:59:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3234 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.393 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.108119+0000", 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.20825501199999999, 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054927589999999998, 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3234 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108119+0000", 2024-09-14T05:59:16.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108119+0000", 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108120+0000", 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8500000000000001e-07 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108124+0000", 2024-09-14T05:59:16.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.89e-06 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108132+0000", 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9540000000000004e-06 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108137+0000", 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2970000000000003e-06 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.109778+0000", 2024-09-14T05:59:16.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0016410719999999999 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.109857+0000", 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8307999999999996e-05 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.110197+0000", 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00034021499999999999 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.113469+0000", 2024-09-14T05:59:16.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0032721479999999999 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.113510+0000", 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1006e-05 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.113573+0000", 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3318999999999995e-05 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.113612+0000", 2024-09-14T05:59:16.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8865000000000001e-05 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3235 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.108148+0000", 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.208226626, 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0056099499999999998, 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.399 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3235 2024-09-14T05:59:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108148+0000", 2024-09-14T05:59:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108148+0000", 2024-09-14T05:59:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108148+0000", 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7000000000000005e-07 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108152+0000", 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.568e-06 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108174+0000", 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2062e-05 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108182+0000", 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.541e-06 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.110792+0000", 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0026095350000000001 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.110874+0000", 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1558999999999996e-05 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.111256+0000", 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00038258600000000003 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.113624+0000", 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0023679460000000001 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.113658+0000", 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3574000000000001e-05 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.113710+0000", 2024-09-14T05:59:16.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2648000000000001e-05 2024-09-14T05:59:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.113758+0000", 2024-09-14T05:59:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7361000000000003e-05 2024-09-14T05:59:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3236 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.404 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.108196+0000", 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.20817851700000001, 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0071731249999999998, 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3236 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108196+0000", 2024-09-14T05:59:16.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108196+0000", 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108196+0000", 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9400000000000005e-07 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108201+0000", 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1330000000000001e-06 2024-09-14T05:59:16.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108208+0000", 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.763e-06 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108214+0000", 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.524e-06 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.111675+0000", 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0034614189999999999 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.111762+0000", 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7232999999999996e-05 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.112255+0000", 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00049298199999999999 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.113800+0000", 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001544431 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.115264+0000", 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001464251 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.115323+0000", 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9336999999999998e-05 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.115369+0000", 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5457999999999997e-05 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3237 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.108223+0000", 2024-09-14T05:59:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.20815180699999999, 2024-09-14T05:59:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0076869080000000001, 2024-09-14T05:59:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3237 2024-09-14T05:59:16.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108223+0000", 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108223+0000", 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108223+0000", 2024-09-14T05:59:16.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7199999999999999e-07 2024-09-14T05:59:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108226+0000", 2024-09-14T05:59:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9050000000000001e-06 2024-09-14T05:59:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108232+0000", 2024-09-14T05:59:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3679999999999998e-06 2024-09-14T05:59:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108237+0000", 2024-09-14T05:59:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9069999999999998e-06 2024-09-14T05:59:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.113837+0000", 2024-09-14T05:59:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0055999300000000004 2024-09-14T05:59:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.113934+0000", 2024-09-14T05:59:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6649000000000002e-05 2024-09-14T05:59:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.114330+0000", 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00039657400000000002 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.115513+0000", 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0011823879999999999 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.115833+0000", 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000320515 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.115872+0000", 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9140000000000001e-05 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.115909+0000", 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7060000000000001e-05 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3245 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.151805+0000", 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.164569509, 2024-09-14T05:59:16.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035929780000000001, 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3245 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151805+0000", 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151805+0000", 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151805+0000", 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6400000000000003e-07 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151811+0000", 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6470000000000003e-06 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151817+0000", 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2349999999999996e-06 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151822+0000", 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5959999999999997e-06 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.153058+0000", 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012365060000000001 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.153150+0000", 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1835000000000004e-05 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.153535+0000", 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000384967 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.155160+0000", 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0016253120000000001 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.155302+0000", 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000142065 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.155354+0000", 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1842000000000003e-05 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.155398+0000", 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3509e-05 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3246 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.151829+0000", 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.16454497100000001, 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047227989999999997, 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3246 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151829+0000", 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151829+0000", 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151830+0000", 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4200000000000002e-07 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151832+0000", 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.978e-06 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151837+0000", 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4040000000000003e-06 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151848+0000", 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.117e-05 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.154060+0000", 2024-09-14T05:59:16.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0022115250000000002 2024-09-14T05:59:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.154156+0000", 2024-09-14T05:59:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6608999999999996e-05 2024-09-14T05:59:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.154583+0000", 2024-09-14T05:59:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042637399999999998 2024-09-14T05:59:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.155430+0000", 2024-09-14T05:59:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00084738100000000002 2024-09-14T05:59:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.156463+0000", 2024-09-14T05:59:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001033036 2024-09-14T05:59:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.156518+0000", 2024-09-14T05:59:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4719000000000002e-05 2024-09-14T05:59:16.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.156552+0000", 2024-09-14T05:59:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4261000000000003e-05 2024-09-14T05:59:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3247 3.0 3:05024aac:::rbd_object_map.1127c133286b:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-14T05:59:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.151854+0000", 2024-09-14T05:59:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.16451985299999999, 2024-09-14T05:59:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0051498439999999998, 2024-09-14T05:59:16.426 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3247 2024-09-14T05:59:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151854+0000", 2024-09-14T05:59:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151854+0000", 2024-09-14T05:59:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151855+0000", 2024-09-14T05:59:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2800000000000003e-07 2024-09-14T05:59:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151857+0000", 2024-09-14T05:59:16.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8989999999999999e-06 2024-09-14T05:59:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151868+0000", 2024-09-14T05:59:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1394e-05 2024-09-14T05:59:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.151872+0000", 2024-09-14T05:59:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1590000000000003e-06 2024-09-14T05:59:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.155499+0000", 2024-09-14T05:59:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0036269610000000002 2024-09-14T05:59:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.155597+0000", 2024-09-14T05:59:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7722999999999999e-05 2024-09-14T05:59:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.155991+0000", 2024-09-14T05:59:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00039420299999999998 2024-09-14T05:59:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.156783+0000", 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00079208100000000004 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.156908+0000", 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000124974 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.156964+0000", 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6273000000000001e-05 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:16.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.157004+0000", 2024-09-14T05:59:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9848999999999997e-05 2024-09-14T05:59:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:16.432 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:16.432 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:16.433 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:16.319+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:16.434 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:59:16.434 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:16.435+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:16.455 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --op export --pgid 3.18 --file /var/log/ceph/exp.3.18.0 2024-09-14T05:59:16.534 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:16.535+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:16.623 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:16.623 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:16.623 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:16.635 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:16.633+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:16.638 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:59:16.720 INFO:teuthology.orchestra.run.smithi006.stdout:leaving image image_client.0-clone1 intact 2024-09-14T05:59:16.736 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:16.733+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:16.822 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:16.823 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:16.823 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:16.837 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:16.835+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:16.840 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:59:16.929 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-14T05:59:16.937 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:16.933+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:16.972 INFO:teuthology.orchestra.run.smithi006.stderr:Exporting 3.18 info 3.18( empty local-lis/les=24/25 n=0 ec=24/24 lis/c=24/24 les/c/f=25/25/0 sis=24) 2024-09-14T05:59:16.972 INFO:teuthology.orchestra.run.smithi006.stderr:Export successful 2024-09-14T05:59:17.018 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:179 3.9 e29/24 3:92497260:::rbd_data.11275e589b0d.0000000000000015:head v 29'1, mlcod=0'0)", 2024-09-14T05:59:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.762511+0000", 2024-09-14T05:59:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.2533924370000005, 2024-09-14T05:59:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0019249779999999999, 2024-09-14T05:59:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762511+0000", 2024-09-14T05:59:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762511+0000", 2024-09-14T05:59:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762511+0000", 2024-09-14T05:59:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4999999999999998e-07 2024-09-14T05:59:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762726+0000", 2024-09-14T05:59:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021486500000000001 2024-09-14T05:59:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762752+0000", 2024-09-14T05:59:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.62e-05 2024-09-14T05:59:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762767+0000", 2024-09-14T05:59:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4389999999999999e-05 2024-09-14T05:59:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762897+0000", 2024-09-14T05:59:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000130555 2024-09-14T05:59:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.762930+0000", 2024-09-14T05:59:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2369999999999997e-05 2024-09-14T05:59:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.764328+0000", 2024-09-14T05:59:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0013980590000000001 2024-09-14T05:59:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.764436+0000", 2024-09-14T05:59:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108089 2024-09-14T05:59:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:190 3.9 e29/24 3:92497260:::rbd_data.11275e589b0d.0000000000000015:head v 29'2, mlcod=0'0)", 2024-09-14T05:59:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.822806+0000", 2024-09-14T05:59:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1930970189999996, 2024-09-14T05:59:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0018685100000000001, 2024-09-14T05:59:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.822806+0000", 2024-09-14T05:59:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.822806+0000", 2024-09-14T05:59:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.822808+0000", 2024-09-14T05:59:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:59:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.822824+0000", 2024-09-14T05:59:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5753e-05 2024-09-14T05:59:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.822862+0000", 2024-09-14T05:59:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7783000000000001e-05 2024-09-14T05:59:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.822882+0000", 2024-09-14T05:59:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0276999999999999e-05 2024-09-14T05:59:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.823030+0000", 2024-09-14T05:59:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014725799999999999 2024-09-14T05:59:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.823087+0000", 2024-09-14T05:59:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7726999999999998e-05 2024-09-14T05:59:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.824578+0000", 2024-09-14T05:59:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0014902680000000001 2024-09-14T05:59:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.824675+0000", 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.713e-05 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:213 3.9 e29/24 3:95751eaa:::rbd_data.11275e589b0d.0000000000000019:head v 29'3, mlcod=29'1)", 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.865898+0000", 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1500047020000004, 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0023456789999999998, 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865898+0000", 2024-09-14T05:59:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865898+0000", 2024-09-14T05:59:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865900+0000", 2024-09-14T05:59:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.99e-06 2024-09-14T05:59:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865954+0000", 2024-09-14T05:59:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3257000000000002e-05 2024-09-14T05:59:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865985+0000", 2024-09-14T05:59:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1239999999999999e-05 2024-09-14T05:59:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.866009+0000", 2024-09-14T05:59:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3546000000000001e-05 2024-09-14T05:59:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.866164+0000", 2024-09-14T05:59:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015577200000000001 2024-09-14T05:59:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.866227+0000", 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2817000000000005e-05 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.868127+0000", 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0019002909999999999 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.868244+0000", 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000116766 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:224 3.4 e29/24 3:234b7459:::rbd_data.11275e589b0d.0000000000000004:head v 29'1, mlcod=0'0)", 2024-09-14T05:59:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.886470+0000", 2024-09-14T05:59:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1294336070000002, 2024-09-14T05:59:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0023458149999999998, 2024-09-14T05:59:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886470+0000", 2024-09-14T05:59:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886470+0000", 2024-09-14T05:59:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886470+0000", 2024-09-14T05:59:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9299999999999996e-07 2024-09-14T05:59:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886631+0000", 2024-09-14T05:59:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016085900000000001 2024-09-14T05:59:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886671+0000", 2024-09-14T05:59:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9573000000000002e-05 2024-09-14T05:59:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886706+0000", 2024-09-14T05:59:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4879999999999998e-05 2024-09-14T05:59:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886886+0000", 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000180445 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886946+0000", 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9617000000000002e-05 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.888726+0000", 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0017802460000000001 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.888815+0000", 2024-09-14T05:59:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9302000000000007e-05 2024-09-14T05:59:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:255 3.9 e29/24 3:95751eaa:::rbd_data.11275e589b0d.0000000000000019:head v 29'4, mlcod=29'2)", 2024-09-14T05:59:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.982863+0000", 2024-09-14T05:59:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.0330397109999998, 2024-09-14T05:59:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002198373, 2024-09-14T05:59:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982863+0000", 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982863+0000", 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982866+0000", 2024-09-14T05:59:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.723e-06 2024-09-14T05:59:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982884+0000", 2024-09-14T05:59:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8090000000000001e-05 2024-09-14T05:59:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982929+0000", 2024-09-14T05:59:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4697000000000003e-05 2024-09-14T05:59:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982951+0000", 2024-09-14T05:59:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1812999999999999e-05 2024-09-14T05:59:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983169+0000", 2024-09-14T05:59:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021797799999999999 2024-09-14T05:59:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983242+0000", 2024-09-14T05:59:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3473000000000006e-05 2024-09-14T05:59:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.984976+0000", 2024-09-14T05:59:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0017333559999999999 2024-09-14T05:59:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985062+0000", 2024-09-14T05:59:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6242999999999994e-05 2024-09-14T05:59:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:250 3.4 e29/24 3:234b7459:::rbd_data.11275e589b0d.0000000000000004:head v 29'2, mlcod=0'0)", 2024-09-14T05:59:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.983794+0000", 2024-09-14T05:59:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.0321089079999997, 2024-09-14T05:59:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020065980000000001, 2024-09-14T05:59:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983794+0000", 2024-09-14T05:59:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983794+0000", 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983796+0000", 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983813+0000", 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6354e-05 2024-09-14T05:59:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983848+0000", 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4696000000000001e-05 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983868+0000", 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.001e-05 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.984029+0000", 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016157199999999999 2024-09-14T05:59:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.984086+0000", 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6802999999999998e-05 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985676+0000", 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0015901579999999999 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985801+0000", 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012483899999999999 2024-09-14T05:59:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:468 3.9 e29/24 3:92497260:::rbd_data.11275e589b0d.0000000000000015:head v 29'6, mlcod=29'4)", 2024-09-14T05:59:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.4476636249999997, 2024-09-14T05:59:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002991737, 2024-09-14T05:59:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568242+0000", 2024-09-14T05:59:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3970000000000001e-06 2024-09-14T05:59:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568261+0000", 2024-09-14T05:59:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9029999999999999e-05 2024-09-14T05:59:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568302+0000", 2024-09-14T05:59:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0756000000000001e-05 2024-09-14T05:59:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568324+0000", 2024-09-14T05:59:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2293000000000002e-05 2024-09-14T05:59:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568455+0000", 2024-09-14T05:59:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000130784 2024-09-14T05:59:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568479+0000", 2024-09-14T05:59:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4119000000000001e-05 2024-09-14T05:59:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.571135+0000", 2024-09-14T05:59:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0026556319999999998 2024-09-14T05:59:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.571231+0000", 2024-09-14T05:59:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6725999999999995e-05 2024-09-14T05:59:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:501 3.9 e29/24 3:95751eaa:::rbd_data.11275e589b0d.0000000000000019:head v 29'7, mlcod=29'5)", 2024-09-14T05:59:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.639603+0000", 2024-09-14T05:59:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.3763006789999999, 2024-09-14T05:59:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0017221669999999999, 2024-09-14T05:59:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639603+0000", 2024-09-14T05:59:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639603+0000", 2024-09-14T05:59:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639604+0000", 2024-09-14T05:59:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7600000000000001e-06 2024-09-14T05:59:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639629+0000", 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.508e-05 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639656+0000", 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6143e-05 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639669+0000", 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3893000000000001e-05 2024-09-14T05:59:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639823+0000", 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015394200000000001 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.639864+0000", 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0779999999999999e-05 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.641231+0000", 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001366566 2024-09-14T05:59:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.641325+0000", 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4003000000000001e-05 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:514 3.9 e29/24 3:95751eaa:::rbd_data.11275e589b0d.0000000000000019:head v 29'8, mlcod=29'6)", 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.682080+0000", 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.3338232010000004, 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020706639999999998, 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682080+0000", 2024-09-14T05:59:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682080+0000", 2024-09-14T05:59:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682083+0000", 2024-09-14T05:59:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6800000000000002e-06 2024-09-14T05:59:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682237+0000", 2024-09-14T05:59:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154086 2024-09-14T05:59:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682270+0000", 2024-09-14T05:59:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2950000000000001e-05 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682289+0000", 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9355999999999999e-05 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682447+0000", 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015772900000000001 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682489+0000", 2024-09-14T05:59:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2580000000000002e-05 2024-09-14T05:59:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.684066+0000", 2024-09-14T05:59:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0015761810000000001 2024-09-14T05:59:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.684151+0000", 2024-09-14T05:59:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5101999999999999e-05 2024-09-14T05:59:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:698 3.9 e29/24 3:9754e28e:::rbd_data.11275e589b0d.0000000000000038:head v 29'10, mlcod=29'8)", 2024-09-14T05:59:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.220798+0000", 2024-09-14T05:59:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.795105575, 2024-09-14T05:59:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001514325, 2024-09-14T05:59:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.220798+0000", 2024-09-14T05:59:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.220798+0000", 2024-09-14T05:59:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.220800+0000", 2024-09-14T05:59:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3999999999999999e-06 2024-09-14T05:59:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.220894+0000", 2024-09-14T05:59:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3479000000000004e-05 2024-09-14T05:59:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.220946+0000", 2024-09-14T05:59:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2120000000000002e-05 2024-09-14T05:59:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.220968+0000", 2024-09-14T05:59:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1880000000000001e-05 2024-09-14T05:59:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.221073+0000", 2024-09-14T05:59:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105262 2024-09-14T05:59:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.221093+0000", 2024-09-14T05:59:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0672000000000001e-05 2024-09-14T05:59:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.222231+0000", 2024-09-14T05:59:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001138018 2024-09-14T05:59:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.222312+0000", 2024-09-14T05:59:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0494000000000006e-05 2024-09-14T05:59:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:796 3.0 e29/24 3:00d51ce4:::rbd_data.11275e589b0d.0000000000000009:head v 29'1, mlcod=0'0)", 2024-09-14T05:59:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.522332+0000", 2024-09-14T05:59:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.4935708089999999, 2024-09-14T05:59:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001913632, 2024-09-14T05:59:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.522332+0000", 2024-09-14T05:59:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.522332+0000", 2024-09-14T05:59:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.522334+0000", 2024-09-14T05:59:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9630000000000001e-06 2024-09-14T05:59:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.522365+0000", 2024-09-14T05:59:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0814e-05 2024-09-14T05:59:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.522397+0000", 2024-09-14T05:59:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2013e-05 2024-09-14T05:59:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.522412+0000", 2024-09-14T05:59:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4929999999999999e-05 2024-09-14T05:59:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.522565+0000", 2024-09-14T05:59:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000153012 2024-09-14T05:59:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.522603+0000", 2024-09-14T05:59:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7499000000000001e-05 2024-09-14T05:59:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.524103+0000", 2024-09-14T05:59:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001500569 2024-09-14T05:59:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.524246+0000", 2024-09-14T05:59:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014283199999999999 2024-09-14T05:59:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:858 3.0 e29/24 3:00d51ce4:::rbd_data.11275e589b0d.0000000000000009:head v 29'2, mlcod=0'0)", 2024-09-14T05:59:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.3413449709999998, 2024-09-14T05:59:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003436171, 2024-09-14T05:59:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674560+0000", 2024-09-14T05:59:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.638e-06 2024-09-14T05:59:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674570+0000", 2024-09-14T05:59:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9890000000000004e-06 2024-09-14T05:59:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674594+0000", 2024-09-14T05:59:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4049e-05 2024-09-14T05:59:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674604+0000", 2024-09-14T05:59:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0165e-05 2024-09-14T05:59:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674720+0000", 2024-09-14T05:59:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000115993 2024-09-14T05:59:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674746+0000", 2024-09-14T05:59:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5984000000000001e-05 2024-09-14T05:59:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.677932+0000", 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031863669999999998 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.677994+0000", 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1985999999999999e-05 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:856 3.4 e29/24 3:234b7459:::rbd_data.11275e589b0d.0000000000000004:head v 29'10, mlcod=29'8)", 2024-09-14T05:59:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.674633+0000", 2024-09-14T05:59:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.34126995, 2024-09-14T05:59:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0016150030000000001, 2024-09-14T05:59:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674633+0000", 2024-09-14T05:59:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674633+0000", 2024-09-14T05:59:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674634+0000", 2024-09-14T05:59:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.96e-07 2024-09-14T05:59:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674638+0000", 2024-09-14T05:59:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.729e-06 2024-09-14T05:59:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674646+0000", 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7009999999999996e-06 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674652+0000", 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6409999999999999e-06 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674722+0000", 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0647000000000003e-05 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674746+0000", 2024-09-14T05:59:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3989999999999999e-05 2024-09-14T05:59:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.676190+0000", 2024-09-14T05:59:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001443202 2024-09-14T05:59:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.676248+0000", 2024-09-14T05:59:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8696999999999997e-05 2024-09-14T05:59:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3232 3.0 e30/24 3:05024aac:::rbd_object_map.1127c133286b:head v 30'202, mlcod=30'200)", 2024-09-14T05:59:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.108526+0000", 2024-09-14T05:59:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.90737760899999997, 2024-09-14T05:59:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001681838, 2024-09-14T05:59:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108526+0000", 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108526+0000", 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108527+0000", 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.421e-06 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108536+0000", 2024-09-14T05:59:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0769999999999997e-06 2024-09-14T05:59:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108556+0000", 2024-09-14T05:59:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9483999999999998e-05 2024-09-14T05:59:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108565+0000", 2024-09-14T05:59:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680000000000005e-06 2024-09-14T05:59:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108643+0000", 2024-09-14T05:59:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7867000000000005e-05 2024-09-14T05:59:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.108671+0000", 2024-09-14T05:59:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8002999999999999e-05 2024-09-14T05:59:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.080 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.110162+0000", 2024-09-14T05:59:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001491373 2024-09-14T05:59:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.110207+0000", 2024-09-14T05:59:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5045e-05 2024-09-14T05:59:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.081 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3233 3.0 e30/24 3:05024aac:::rbd_object_map.1127c133286b:head v 30'203, mlcod=30'200)", 2024-09-14T05:59:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.109432+0000", 2024-09-14T05:59:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.90647085599999999, 2024-09-14T05:59:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001764201, 2024-09-14T05:59:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.109432+0000", 2024-09-14T05:59:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.082 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.109432+0000", 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.109433+0000", 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3699999999999999e-07 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.109439+0000", 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0780000000000001e-06 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.083 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.109453+0000", 2024-09-14T05:59:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3862e-05 2024-09-14T05:59:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.109461+0000", 2024-09-14T05:59:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4399999999999999e-06 2024-09-14T05:59:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.109548+0000", 2024-09-14T05:59:17.084 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7942000000000006e-05 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.109570+0000", 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1946e-05 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.111147+0000", 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001576402 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.111197+0000", 2024-09-14T05:59:17.085 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9694000000000002e-05 2024-09-14T05:59:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3234 3.0 e30/24 3:05024aac:::rbd_object_map.1127c133286b:head v 30'204, mlcod=30'200)", 2024-09-14T05:59:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.110367+0000", 2024-09-14T05:59:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.90553623500000002, 2024-09-14T05:59:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001549239, 2024-09-14T05:59:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.086 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.110367+0000", 2024-09-14T05:59:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.110367+0000", 2024-09-14T05:59:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.087 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.110368+0000", 2024-09-14T05:59:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7499999999999999e-07 2024-09-14T05:59:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.110374+0000", 2024-09-14T05:59:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2179999999999996e-06 2024-09-14T05:59:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.110387+0000", 2024-09-14T05:59:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3446e-05 2024-09-14T05:59:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.088 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.110395+0000", 2024-09-14T05:59:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3459999999999996e-06 2024-09-14T05:59:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.110478+0000", 2024-09-14T05:59:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3219000000000004e-05 2024-09-14T05:59:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.110505+0000", 2024-09-14T05:59:17.089 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6808000000000002e-05 2024-09-14T05:59:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.111873+0000", 2024-09-14T05:59:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0013680369999999999 2024-09-14T05:59:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.111916+0000", 2024-09-14T05:59:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3390000000000003e-05 2024-09-14T05:59:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.090 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3238 3.9 e30/24 3:93562d7c:::rbd_data.1127c133286b.00000000000000cc:head v 30'21, mlcod=30'19)", 2024-09-14T05:59:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.114967+0000", 2024-09-14T05:59:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.900935975, 2024-09-14T05:59:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001586168, 2024-09-14T05:59:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.114967+0000", 2024-09-14T05:59:17.091 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.114967+0000", 2024-09-14T05:59:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.114968+0000", 2024-09-14T05:59:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9800000000000003e-07 2024-09-14T05:59:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.115795+0000", 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00082741499999999996 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.115812+0000", 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6339999999999999e-05 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.115820+0000", 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5089999999999993e-06 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.093 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.115913+0000", 2024-09-14T05:59:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3146999999999994e-05 2024-09-14T05:59:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.115935+0000", 2024-09-14T05:59:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1149999999999999e-05 2024-09-14T05:59:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.116507+0000", 2024-09-14T05:59:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00057262999999999997 2024-09-14T05:59:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.094 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.116553+0000", 2024-09-14T05:59:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6179e-05 2024-09-14T05:59:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3243 3.9 e30/24 3:90d76fdd:::rbd_data.1127c133286b.00000000000000d1:head v 30'23, mlcod=30'21)", 2024-09-14T05:59:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.143410+0000", 2024-09-14T05:59:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.87249295299999996, 2024-09-14T05:59:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0015636199999999999, 2024-09-14T05:59:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.095 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.143410+0000", 2024-09-14T05:59:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.143410+0000", 2024-09-14T05:59:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.096 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.143423+0000", 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2954e-05 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.144065+0000", 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00064185000000000002 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.144084+0000", 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9239e-05 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.144093+0000", 2024-09-14T05:59:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7499999999999992e-06 2024-09-14T05:59:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.144160+0000", 2024-09-14T05:59:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6705999999999995e-05 2024-09-14T05:59:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.144181+0000", 2024-09-14T05:59:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0933000000000001e-05 2024-09-14T05:59:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.098 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.144935+0000", 2024-09-14T05:59:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00075387100000000003 2024-09-14T05:59:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.144974+0000", 2024-09-14T05:59:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9317000000000003e-05 2024-09-14T05:59:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.099 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3257 3.0 e31/24 3:047331ac:::rbd_object_map.1127c133286b.0000000000000004:head v 31'212, mlcod=30'210)", 2024-09-14T05:59:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.598931+0000", 2024-09-14T05:59:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.41697207800000002, 2024-09-14T05:59:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0016353330000000001, 2024-09-14T05:59:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.598931+0000", 2024-09-14T05:59:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.100 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.598931+0000", 2024-09-14T05:59:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.598932+0000", 2024-09-14T05:59:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:59:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.598943+0000", 2024-09-14T05:59:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0852999999999999e-05 2024-09-14T05:59:17.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.598973+0000", 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9862999999999999e-05 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.598995+0000", 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2036e-05 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.599139+0000", 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000144463 2024-09-14T05:59:17.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.599202+0000", 2024-09-14T05:59:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2745999999999999e-05 2024-09-14T05:59:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.600487+0000", 2024-09-14T05:59:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001285364 2024-09-14T05:59:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.600566+0000", 2024-09-14T05:59:17.103 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9234999999999996e-05 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3303 3.0 e31/24 3:04479396:::rbd_id.image_client.0-clone2:head v 31'214, mlcod=31'212)", 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:16.671824+0000", 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.344078773, 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001534723, 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.104 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.671824+0000", 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.671824+0000", 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.671826+0000", 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3340000000000001e-06 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.671837+0000", 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1331e-05 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.671854+0000", 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7122e-05 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.671862+0000", 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1200000000000002e-06 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.106 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.671988+0000", 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012520000000000001 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.672034+0000", 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6640000000000001e-05 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.673256+0000", 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001221464 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:16.673359+0000", 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010351199999999999 2024-09-14T05:59:17.107 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.108 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.108 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:17.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:59:17.109 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:17.107+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:17.209 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:17.205+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:17.245 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:17.245 INFO:teuthology.orchestra.run.smithi006.stdout:442 write 0x7f3d766 thru 0x7f4c757 (0xeff2 bytes) 2024-09-14T05:59:17.263 INFO:teuthology.orchestra.run.smithi006.stdout:444 read 0x103b491 thru 0x1045798 (0xa308 bytes) 2024-09-14T05:59:17.265 INFO:teuthology.orchestra.run.smithi006.stdout:445 writesame 0x302bad8 thru 0x302bdd6 data_size 0x1(0x2ff bytes) 2024-09-14T05:59:17.270 INFO:teuthology.orchestra.run.smithi006.stdout:447 writesame 0x761099 thru 0x763a7b data_size 0x1(0x29e3 bytes) 2024-09-14T05:59:17.280 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:17.280 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:17.280 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:17.293 INFO:teuthology.orchestra.run.smithi006.stdout:449 punch from 0xc5941c to 0xc5c056, (0x2c3a bytes) 2024-09-14T05:59:17.293 INFO:teuthology.orchestra.run.smithi006.stdout:450 punch from 0xc897b52 to 0xc8a56ba, (0xdb68 bytes) 2024-09-14T05:59:17.293 INFO:teuthology.orchestra.run.smithi006.stdout:451 write 0x9382cc7 thru 0x938793a (0x4c74 bytes) 2024-09-14T05:59:17.294 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:59:17.301 INFO:teuthology.orchestra.run.smithi006.stdout:452 read 0xc2da61d thru 0xc2daf20 (0x904 bytes) 2024-09-14T05:59:17.301 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:17.301 INFO:teuthology.orchestra.run.smithi006.stdout:455 read 0x548f9ab thru 0x5495e16 (0x646c bytes) 2024-09-14T05:59:17.311 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:17.307+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:17.312 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal --force --op remove --pgid 3.18 2024-09-14T05:59:17.314 INFO:teuthology.orchestra.run.smithi006.stdout:457 trunc from 0xe2bf6bc to 0x5764458 2024-09-14T05:59:17.369 INFO:teuthology.orchestra.run.smithi006.stdout:458 writesame 0x7ed9ad5 thru 0x7ee3372 data_size 0x5(0x989e bytes) 2024-09-14T05:59:17.369 INFO:teuthology.orchestra.run.smithi006.stdout:459 trunc from 0x7ee3373 to 0x7febdc6 2024-09-14T05:59:17.380 INFO:teuthology.orchestra.run.smithi006.stdout:460 trunc from 0x7febdc6 to 0xb7892e1 2024-09-14T05:59:17.386 INFO:teuthology.orchestra.run.smithi006.stdout:463 write 0x84c1c3f thru 0x84cd2fe (0xb6c0 bytes) 2024-09-14T05:59:17.392 INFO:teuthology.orchestra.run.smithi006.stdout:464 write 0x2436bf5 thru 0x2444af1 (0xdefd bytes) 2024-09-14T05:59:17.401 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:17.401 INFO:teuthology.orchestra.run.smithi006.stdout:466 read 0x43fe7b0 thru 0x440c15f (0xd9b0 bytes) 2024-09-14T05:59:17.401 INFO:teuthology.orchestra.run.smithi006.stdout:467 read 0x815c28c thru 0x8169ad0 (0xd845 bytes) 2024-09-14T05:59:17.410 INFO:teuthology.orchestra.run.smithi006.stdout:468 write 0xc8e0411 thru 0xc8eba12 (0xb602 bytes) 2024-09-14T05:59:17.411 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:17.409+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:17.416 INFO:teuthology.orchestra.run.smithi006.stdout:469 read 0x78d3638 thru 0x78ddb9f (0xa568 bytes) 2024-09-14T05:59:17.417 INFO:teuthology.orchestra.run.smithi006.stdout:470 punch from 0x1497926 to 0x14a43e5, (0xcabf bytes) 2024-09-14T05:59:17.417 INFO:teuthology.orchestra.run.smithi006.stdout:471 write 0x51f5122 thru 0x51f5ca7 (0xb86 bytes) 2024-09-14T05:59:17.426 INFO:teuthology.orchestra.run.smithi006.stdout:472 write 0x280fe86 thru 0x281bd4f (0xbeca bytes) 2024-09-14T05:59:17.432 INFO:teuthology.orchestra.run.smithi006.stdout:473 read 0x5ef05df thru 0x5ef791d (0x733f bytes) 2024-09-14T05:59:17.432 INFO:teuthology.orchestra.run.smithi006.stdout:474 punch from 0x9f3fc2 to 0x9fc25a, (0x8298 bytes) 2024-09-14T05:59:17.432 INFO:teuthology.orchestra.run.smithi006.stdout:476 clone 3 order 25 su 131072 sc 6 2024-09-14T05:59:17.447 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:17.448 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:17.448 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:17.448 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:17.448 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:17.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:59:17.512 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:17.511+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:17.602 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2024-09-14T05:59:17.612 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:17.611+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:17.641 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:17.641 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:17.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:17.641 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:17.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.641 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:79 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.641 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.551626+0000", 2024-09-14T05:59:17.641 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 6.0879478850000002, 2024-09-14T05:59:17.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064688590000000004, 2024-09-14T05:59:17.641 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.641 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 79 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551626+0000", 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551626+0000", 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551628+0000", 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3489999999999999e-06 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551639+0000", 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0634e-05 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551662+0000", 2024-09-14T05:59:17.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3402000000000001e-05 2024-09-14T05:59:17.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551673+0000", 2024-09-14T05:59:17.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1044e-05 2024-09-14T05:59:17.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551747+0000", 2024-09-14T05:59:17.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3773e-05 2024-09-14T05:59:17.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.551857+0000", 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000109446 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.552091+0000", 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023430599999999999 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.552804+0000", 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00071353599999999997 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.558019+0000", 2024-09-14T05:59:17.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0052144419999999997 2024-09-14T05:59:17.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.558058+0000", 2024-09-14T05:59:17.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9388999999999998e-05 2024-09-14T05:59:17.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.558095+0000", 2024-09-14T05:59:17.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6538000000000002e-05 2024-09-14T05:59:17.646 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.647 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.647 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.647 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:182 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.647 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.773357+0000", 2024-09-14T05:59:17.647 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.8662163229999997, 2024-09-14T05:59:17.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0062736679999999996, 2024-09-14T05:59:17.647 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.647 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.647 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.647 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.647 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.647 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.648 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 182 2024-09-14T05:59:17.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.648 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773357+0000", 2024-09-14T05:59:17.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773357+0000", 2024-09-14T05:59:17.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773360+0000", 2024-09-14T05:59:17.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1459999999999999e-06 2024-09-14T05:59:17.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.650 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.650 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773370+0000", 2024-09-14T05:59:17.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0837e-05 2024-09-14T05:59:17.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.650 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.650 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773400+0000", 2024-09-14T05:59:17.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9403e-05 2024-09-14T05:59:17.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.650 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.650 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773414+0000", 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3946e-05 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773559+0000", 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014528300000000001 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.773820+0000", 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026123100000000001 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.774893+0000", 2024-09-14T05:59:17.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0010726449999999999 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.776716+0000", 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001823362 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.779327+0000", 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00261043 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.779509+0000", 2024-09-14T05:59:17.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000181922 2024-09-14T05:59:17.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.779631+0000", 2024-09-14T05:59:17.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012246300000000001 2024-09-14T05:59:17.653 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.653 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.653 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.653 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:285 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.653 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.064746+0000", 2024-09-14T05:59:17.653 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.5748274960000002, 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0060045380000000002, 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 285 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.064746+0000", 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.064746+0000", 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.064749+0000", 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.424e-06 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.064761+0000", 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2063e-05 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.064792+0000", 2024-09-14T05:59:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1508999999999999e-05 2024-09-14T05:59:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.064808+0000", 2024-09-14T05:59:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5597e-05 2024-09-14T05:59:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.064931+0000", 2024-09-14T05:59:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000123139 2024-09-14T05:59:17.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.065089+0000", 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015805600000000001 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.065648+0000", 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000558915 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.067238+0000", 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001589504 2024-09-14T05:59:17.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.070583+0000", 2024-09-14T05:59:17.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0033456219999999999 2024-09-14T05:59:17.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.070679+0000", 2024-09-14T05:59:17.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5681999999999996e-05 2024-09-14T05:59:17.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.070751+0000", 2024-09-14T05:59:17.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2026999999999993e-05 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:555 3.7 3:e2ffd4fe:::rbd_data.11275e589b0d.0000000000000013:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.773704+0000", 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.8658698810000001, 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.021020928000000001, 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.659 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 555 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773704+0000", 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773704+0000", 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.660 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773706+0000", 2024-09-14T05:59:17.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3300000000000001e-06 2024-09-14T05:59:17.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.661 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773718+0000", 2024-09-14T05:59:17.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1324e-05 2024-09-14T05:59:17.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.661 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773746+0000", 2024-09-14T05:59:17.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8813e-05 2024-09-14T05:59:17.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773761+0000", 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4466e-05 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773898+0000", 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000137596 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.774030+0000", 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013141199999999999 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.777366+0000", 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003336468 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794459+0000", 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017092950999999999 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794545+0000", 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5609e-05 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794644+0000", 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8999000000000005e-05 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794725+0000", 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0959999999999997e-05 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop_reply(client.4391.0:555 3.7 e29/24 ondisk, result = 0)", 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.787144+0000", 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.8524296549999999, 2024-09-14T05:59:17.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075976280000000004, 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.787144+0000", 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.787144+0000", 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.666 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.666 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.787146+0000", 2024-09-14T05:59:17.666 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.73e-06 2024-09-14T05:59:17.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.666 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.666 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.787154+0000", 2024-09-14T05:59:17.666 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3769999999999996e-06 2024-09-14T05:59:17.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.666 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.666 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.787180+0000", 2024-09-14T05:59:17.666 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5488999999999999e-05 2024-09-14T05:59:17.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.787197+0000", 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7503000000000002e-05 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794520+0000", 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073223510000000004 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794533+0000", 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3093e-05 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794742+0000", 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020908499999999999 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:559 3.8 3:1552c62e:::rbd_data.11275e589b0d.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.806380+0000", 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.8331934759999999, 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0090409600000000007, 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.668 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 559 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806380+0000", 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806380+0000", 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806383+0000", 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1530000000000001e-06 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806393+0000", 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.764e-06 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806422+0000", 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8739e-05 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806436+0000", 2024-09-14T05:59:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4436999999999999e-05 2024-09-14T05:59:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806515+0000", 2024-09-14T05:59:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8813000000000006e-05 2024-09-14T05:59:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.806655+0000", 2024-09-14T05:59:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000140109 2024-09-14T05:59:17.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 1", 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.807787+0000", 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001131909 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.815280+0000", 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.007493151 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.815316+0000", 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5556000000000003e-05 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.673 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.815365+0000", 2024-09-14T05:59:17.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8529000000000002e-05 2024-09-14T05:59:17.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.673 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.815421+0000", 2024-09-14T05:59:17.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6799999999999998e-05 2024-09-14T05:59:17.673 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.673 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.673 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.673 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:608 3.7 3:e6b2e829:::rbd_data.11275e589b0d.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.930012+0000", 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.7095620030000003, 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.027079134000000001, 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 608 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.674 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930012+0000", 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930012+0000", 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930013+0000", 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2999999999999999e-07 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930018+0000", 2024-09-14T05:59:17.675 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6239999999999999e-06 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930032+0000", 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3976e-05 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930043+0000", 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0764000000000001e-05 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930152+0000", 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108478 2024-09-14T05:59:17.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930287+0000", 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000135029 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.934701+0000", 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044140050000000004 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956894+0000", 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022193039000000001 2024-09-14T05:59:17.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956924+0000", 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0049999999999999e-05 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.957018+0000", 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4025999999999997e-05 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.957091+0000", 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3213000000000005e-05 2024-09-14T05:59:17.678 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop_reply(client.4391.0:608 3.7 e29/24 ondisk, result = 0)", 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.942307+0000", 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6972664829999999, 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014599915, 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942307+0000", 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.680 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.680 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942307+0000", 2024-09-14T05:59:17.680 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.680 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.680 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942309+0000", 2024-09-14T05:59:17.680 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.511e-06 2024-09-14T05:59:17.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.680 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.680 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942315+0000", 2024-09-14T05:59:17.680 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6629999999999998e-06 2024-09-14T05:59:17.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.681 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.681 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942333+0000", 2024-09-14T05:59:17.681 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8657000000000001e-05 2024-09-14T05:59:17.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.681 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.681 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942346+0000", 2024-09-14T05:59:17.681 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3254999999999999e-05 2024-09-14T05:59:17.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.681 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.681 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956866+0000", 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014519353 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956884+0000", 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7825999999999998e-05 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956907+0000", 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3649999999999999e-05 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:612 3.18 3:1a07fa9c:::rbd_data.11275e589b0d.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.970090+0000", 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6694839659999996, 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.027517274000000001, 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 612 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.683 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970090+0000", 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970090+0000", 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970092+0000", 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.663e-06 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.684 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970101+0000", 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4560000000000006e-06 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970127+0000", 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5743999999999999e-05 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970147+0000", 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9973e-05 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.685 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970270+0000", 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000123182 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970402+0000", 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000131629 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.997351+0000", 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.026949039000000001 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.686 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.997464+0000", 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011337599999999999 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.997607+0000", 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014321200000000001 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:650 3.7 3:e6b2e829:::rbd_data.11275e589b0d.0000000000000028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.085260+0000", 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.5543140519999996, 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0081269900000000006, 2024-09-14T05:59:17.687 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.688 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.688 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.688 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.688 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.688 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.688 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 650 2024-09-14T05:59:17.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.688 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.688 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.688 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085260+0000", 2024-09-14T05:59:17.688 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085260+0000", 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085261+0000", 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2559999999999999e-06 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085267+0000", 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.84e-06 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.689 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085287+0000", 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0356999999999998e-05 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.085303+0000", 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5356999999999999e-05 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.086721+0000", 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0014179539999999999 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.690 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.086790+0000", 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9399000000000004e-05 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.086880+0000", 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9884999999999997e-05 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.087883+0000", 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0010035630000000001 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.093291+0000", 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054079150000000001 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.093332+0000", 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0584000000000003e-05 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.093387+0000", 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4880000000000003e-05 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.693 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:682 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.693 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.174691+0000", 2024-09-14T05:59:17.693 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.4648827500000001, 2024-09-14T05:59:17.693 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0065177710000000003, 2024-09-14T05:59:17.693 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.693 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.693 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.693 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.693 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.693 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.693 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 682 2024-09-14T05:59:17.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.693 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.693 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.174691+0000", 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.174691+0000", 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.174692+0000", 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.057e-06 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.174698+0000", 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6690000000000003e-06 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.174713+0000", 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5194999999999999e-05 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.174721+0000", 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7549999999999994e-06 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.695 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.174888+0000", 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016734399999999999 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.175032+0000", 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014426900000000001 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.175622+0000", 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00058941799999999997 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.696 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.177128+0000", 2024-09-14T05:59:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001505845 2024-09-14T05:59:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.181046+0000", 2024-09-14T05:59:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039182100000000001 2024-09-14T05:59:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.181141+0000", 2024-09-14T05:59:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5309000000000005e-05 2024-09-14T05:59:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.698 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.698 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.181209+0000", 2024-09-14T05:59:17.698 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7700000000000006e-05 2024-09-14T05:59:17.698 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.698 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.698 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.698 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.698 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.698 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:697 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.698 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.213420+0000", 2024-09-14T05:59:17.698 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.4261540989999997, 2024-09-14T05:59:17.698 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054108910000000001, 2024-09-14T05:59:17.698 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.698 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 697 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213420+0000", 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.699 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213420+0000", 2024-09-14T05:59:17.700 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.700 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.700 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213421+0000", 2024-09-14T05:59:17.700 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.342e-06 2024-09-14T05:59:17.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.700 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.700 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213427+0000", 2024-09-14T05:59:17.700 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2720000000000003e-06 2024-09-14T05:59:17.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.700 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213444+0000", 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6688999999999999e-05 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213452+0000", 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0239999999999997e-06 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213561+0000", 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108473 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.701 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.213720+0000", 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000159746 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.214286+0000", 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00056563200000000005 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.215792+0000", 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001506582 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.218679+0000", 2024-09-14T05:59:17.702 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0028868940000000001 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.218763+0000", 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4118999999999999e-05 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.218831+0000", 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7118000000000004e-05 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:712 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.703 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.251785+0000", 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.3877889440000004, 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0055167250000000001, 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 712 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.251785+0000", 2024-09-14T05:59:17.704 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.251785+0000", 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.251786+0000", 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5990000000000001e-06 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.251794+0000", 2024-09-14T05:59:17.705 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9410000000000007e-06 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.251814+0000", 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9460999999999999e-05 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.251822+0000", 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4950000000000008e-06 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.251925+0000", 2024-09-14T05:59:17.706 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102619 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.252020+0000", 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4914999999999995e-05 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.252324+0000", 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000304429 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.253599+0000", 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012745670000000001 2024-09-14T05:59:17.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.257210+0000", 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00361145 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.257259+0000", 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8782000000000002e-05 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.257302+0000", 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2466999999999998e-05 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.708 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:723 3.7 3:e6b2e829:::rbd_data.11275e589b0d.0000000000000028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.303359+0000", 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.3362151850000004, 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0066626519999999998, 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 723 2024-09-14T05:59:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.303359+0000", 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.303359+0000", 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.303359+0000", 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5600000000000004e-07 2024-09-14T05:59:17.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.303365+0000", 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3329999999999996e-06 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.303376+0000", 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1195999999999999e-05 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.303384+0000", 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6699999999999994e-06 2024-09-14T05:59:17.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.304165+0000", 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000780855 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.304425+0000", 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026042200000000001 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.304766+0000", 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00034103999999999997 2024-09-14T05:59:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.306148+0000", 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001382147 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.309919+0000", 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003771319 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.309976+0000", 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6919999999999997e-05 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.310021+0000", 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4894000000000001e-05 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:749 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.366629+0000", 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.2729451599999999, 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0061304649999999999, 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.714 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.715 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.715 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.715 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.715 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 749 2024-09-14T05:59:17.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.715 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.715 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.715 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.715 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366629+0000", 2024-09-14T05:59:17.715 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.715 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.715 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.715 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366629+0000", 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366631+0000", 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4169999999999999e-06 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366644+0000", 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2660000000000001e-05 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.716 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366675+0000", 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1689000000000001e-05 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366690+0000", 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4596999999999999e-05 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366813+0000", 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000122676 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.717 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.366943+0000", 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000130321 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.367407+0000", 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00046437399999999998 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.368711+0000", 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001303972 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.372617+0000", 2024-09-14T05:59:17.718 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039055600000000002 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.372695+0000", 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8201999999999994e-05 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.372759+0000", 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3997000000000004e-05 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:764 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.435586+0000", 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.2039880629999997, 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054708980000000001, 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 764 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.720 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435586+0000", 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435586+0000", 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435589+0000", 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.422e-06 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.721 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435611+0000", 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1463000000000001e-05 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435649+0000", 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8577e-05 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435667+0000", 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7546000000000001e-05 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435799+0000", 2024-09-14T05:59:17.722 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013210399999999999 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.435934+0000", 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013530399999999999 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.436268+0000", 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000333784 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.437304+0000", 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001035787 2024-09-14T05:59:17.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.724 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.724 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.440930+0000", 2024-09-14T05:59:17.724 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0036263060000000001 2024-09-14T05:59:17.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.724 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.724 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.440999+0000", 2024-09-14T05:59:17.724 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9246999999999996e-05 2024-09-14T05:59:17.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.724 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.724 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.441057+0000", 2024-09-14T05:59:17.724 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7358000000000002e-05 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:793 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.506764+0000", 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.1328101620000002, 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053809940000000001, 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.725 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 793 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.506764+0000", 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.506764+0000", 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.506766+0000", 2024-09-14T05:59:17.726 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4329999999999998e-06 2024-09-14T05:59:17.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.727 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.727 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.506781+0000", 2024-09-14T05:59:17.727 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4584e-05 2024-09-14T05:59:17.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.727 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.727 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.506810+0000", 2024-09-14T05:59:17.727 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9496e-05 2024-09-14T05:59:17.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.727 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.727 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.506828+0000", 2024-09-14T05:59:17.728 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7827000000000001e-05 2024-09-14T05:59:17.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.728 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.728 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.728 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.506912+0000", 2024-09-14T05:59:17.728 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3752999999999996e-05 2024-09-14T05:59:17.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.728 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.728 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.728 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.507023+0000", 2024-09-14T05:59:17.728 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000110818 2024-09-14T05:59:17.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.728 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.728 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.507435+0000", 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00041237100000000003 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.508810+0000", 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0013746019999999999 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.512035+0000", 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003225164 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.730 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.512094+0000", 2024-09-14T05:59:17.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8959000000000003e-05 2024-09-14T05:59:17.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.730 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.730 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.512145+0000", 2024-09-14T05:59:17.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0986999999999998e-05 2024-09-14T05:59:17.730 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.730 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.730 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.730 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:795 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.730 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.515817+0000", 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.1237572719999998, 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0055946859999999998, 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 795 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.515817+0000", 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.515817+0000", 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.515819+0000", 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.007e-06 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.515829+0000", 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0336000000000001e-05 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.733 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.733 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.515856+0000", 2024-09-14T05:59:17.733 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7177000000000001e-05 2024-09-14T05:59:17.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.733 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.733 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.515870+0000", 2024-09-14T05:59:17.733 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3570000000000001e-05 2024-09-14T05:59:17.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.733 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.733 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.515947+0000", 2024-09-14T05:59:17.733 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7583999999999994e-05 2024-09-14T05:59:17.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.516044+0000", 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6562000000000001e-05 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.516438+0000", 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00039470800000000002 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.517670+0000", 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012317319999999999 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.521297+0000", 2024-09-14T05:59:17.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0036264689999999998 2024-09-14T05:59:17.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.521357+0000", 2024-09-14T05:59:17.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0807000000000002e-05 2024-09-14T05:59:17.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.521411+0000", 2024-09-14T05:59:17.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3733999999999997e-05 2024-09-14T05:59:17.735 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:809 3.1e 3:7d289195:::rbd_object_map.11275e589b0d:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.564304+0000", 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.0752702960000002, 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054857380000000004, 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 809 2024-09-14T05:59:17.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564304+0000", 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564304+0000", 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564307+0000", 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0400000000000001e-06 2024-09-14T05:59:17.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564324+0000", 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7793000000000001e-05 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564362+0000", 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7577000000000003e-05 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564380+0000", 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8185999999999998e-05 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564465+0000", 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5068999999999995e-05 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564545+0000", 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0185999999999994e-05 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.564799+0000", 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025333799999999998 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.740 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.565742+0000", 2024-09-14T05:59:17.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00094329699999999995 2024-09-14T05:59:17.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.740 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.740 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.569551+0000", 2024-09-14T05:59:17.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038091169999999999 2024-09-14T05:59:17.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.740 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.740 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.569658+0000", 2024-09-14T05:59:17.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000107132 2024-09-14T05:59:17.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.569789+0000", 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013100300000000001 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:3651 3.1e 3:7fe78e70:::rbd_data.1127a326aacb.00000000000000b5:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,truncate 196608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.340739+0000", 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.29883478600000002, 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0090216110000000006, 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:17.741 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 3651 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.340739+0000", 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.340739+0000", 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.340742+0000", 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4940000000000002e-06 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.340748+0000", 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.015e-06 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.340760+0000", 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1970999999999999e-05 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.340766+0000", 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1229999999999997e-06 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.340826+0000", 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0318000000000001e-05 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.341025+0000", 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019875700000000001 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 6", 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.341344+0000", 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00031893699999999999 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.344098+0000", 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0027548109999999998 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.349612+0000", 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0055139029999999997 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:17.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.349700+0000", 2024-09-14T05:59:17.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8059999999999994e-05 2024-09-14T05:59:17.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:17.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:17.746 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:17.746 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.349761+0000", 2024-09-14T05:59:17.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0222e-05 2024-09-14T05:59:17.746 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.746 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.746 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.746 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:17.746 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:17.746 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:17.748 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:59:17.748 INFO:teuthology.orchestra.run.smithi006.stdout:flattening image image_client.0-clone2 2024-09-14T05:59:17.750 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:17.747+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:17.849 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:17.845+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:17.923 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:17.924 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:17.924 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:17.924 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:17.937 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:59:17.983 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:17.983+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:18.051 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:18.047+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:18.057 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:18.057 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:18.057 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:18.057 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:18.057 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:18.071 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:59:18.093 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-14T05:59:18.151 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:18.149+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:18.226 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:59:18.244 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:303 3.3 3:c0f18601:::rbd_data.11275e589b0d.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:12.146341+0000", 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.098153677, 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022824968000000001, 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 303 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146341+0000", 2024-09-14T05:59:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146341+0000", 2024-09-14T05:59:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146344+0000", 2024-09-14T05:59:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1100000000000001e-06 2024-09-14T05:59:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146358+0000", 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3957e-05 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146387+0000", 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9332999999999999e-05 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146402+0000", 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4789e-05 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146524+0000", 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012266600000000001 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146767+0000", 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024287500000000001 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.168912+0000", 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022144635999999999 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.169022+0000", 2024-09-14T05:59:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-14T05:59:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.169166+0000", 2024-09-14T05:59:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014476300000000001 2024-09-14T05:59:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:373 3.3 3:c0f18601:::rbd_data.11275e589b0d.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:12.347489+0000", 2024-09-14T05:59:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.8970064749999995, 2024-09-14T05:59:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012096216, 2024-09-14T05:59:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 373 2024-09-14T05:59:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.347489+0000", 2024-09-14T05:59:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.347489+0000", 2024-09-14T05:59:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.347491+0000", 2024-09-14T05:59:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1629999999999999e-06 2024-09-14T05:59:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.347503+0000", 2024-09-14T05:59:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2099999999999999e-05 2024-09-14T05:59:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.347533+0000", 2024-09-14T05:59:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9892000000000001e-05 2024-09-14T05:59:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.347548+0000", 2024-09-14T05:59:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5126999999999999e-05 2024-09-14T05:59:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.347667+0000", 2024-09-14T05:59:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119326 2024-09-14T05:59:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.347814+0000", 2024-09-14T05:59:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014661200000000001 2024-09-14T05:59:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.359345+0000", 2024-09-14T05:59:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011530640999999999 2024-09-14T05:59:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.359436+0000", 2024-09-14T05:59:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1955999999999998e-05 2024-09-14T05:59:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.359585+0000", 2024-09-14T05:59:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014839900000000001 2024-09-14T05:59:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5904 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 983040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867124+0000", 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.377370761, 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012069441, 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5904 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867124+0000", 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867124+0000", 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867125+0000", 2024-09-14T05:59:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0200000000000002e-07 2024-09-14T05:59:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867127+0000", 2024-09-14T05:59:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.024e-06 2024-09-14T05:59:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867143+0000", 2024-09-14T05:59:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6444999999999999e-05 2024-09-14T05:59:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867154+0000", 2024-09-14T05:59:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0203e-05 2024-09-14T05:59:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879014+0000", 2024-09-14T05:59:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011860525 2024-09-14T05:59:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879099+0000", 2024-09-14T05:59:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4565000000000001e-05 2024-09-14T05:59:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879194+0000", 2024-09-14T05:59:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5177e-05 2024-09-14T05:59:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5941 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 241664~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867454+0000", 2024-09-14T05:59:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.377041354, 2024-09-14T05:59:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012245608, 2024-09-14T05:59:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5941 2024-09-14T05:59:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867454+0000", 2024-09-14T05:59:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867454+0000", 2024-09-14T05:59:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867454+0000", 2024-09-14T05:59:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.32e-07 2024-09-14T05:59:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867456+0000", 2024-09-14T05:59:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0810000000000001e-06 2024-09-14T05:59:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867464+0000", 2024-09-14T05:59:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3669999999999999e-06 2024-09-14T05:59:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867476+0000", 2024-09-14T05:59:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2298e-05 2024-09-14T05:59:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879488+0000", 2024-09-14T05:59:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01201201 2024-09-14T05:59:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879570+0000", 2024-09-14T05:59:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2227999999999999e-05 2024-09-14T05:59:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879699+0000", 2024-09-14T05:59:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012919200000000001 2024-09-14T05:59:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5942 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 393216~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867486+0000", 2024-09-14T05:59:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37700936800000001, 2024-09-14T05:59:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012466517999999999, 2024-09-14T05:59:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5942 2024-09-14T05:59:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867486+0000", 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867486+0000", 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867486+0000", 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4200000000000001e-07 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867493+0000", 2024-09-14T05:59:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2080000000000003e-06 2024-09-14T05:59:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867500+0000", 2024-09-14T05:59:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7830000000000001e-06 2024-09-14T05:59:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867505+0000", 2024-09-14T05:59:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1410000000000004e-06 2024-09-14T05:59:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879743+0000", 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01223773 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879823+0000", 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0284999999999994e-05 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879952+0000", 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012892900000000001 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5943 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 544768~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867513+0000", 2024-09-14T05:59:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37698202600000003, 2024-09-14T05:59:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012654174000000001, 2024-09-14T05:59:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5943 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867513+0000", 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867513+0000", 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867514+0000", 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4299999999999998e-07 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867521+0000", 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8269999999999998e-06 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867528+0000", 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3470000000000004e-06 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867533+0000", 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879990+0000", 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012457161 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880066+0000", 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5711999999999996e-05 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880167+0000", 2024-09-14T05:59:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101486 2024-09-14T05:59:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5944 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 700416~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867541+0000", 2024-09-14T05:59:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37695443099999998, 2024-09-14T05:59:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012957006, 2024-09-14T05:59:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5944 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867541+0000", 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867541+0000", 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867541+0000", 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4400000000000001e-07 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867543+0000", 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9910000000000001e-06 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867549+0000", 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2330000000000003e-06 2024-09-14T05:59:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867556+0000", 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.302e-06 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880227+0000", 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012671392 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880331+0000", 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010417 2024-09-14T05:59:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880498+0000", 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016647400000000001 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5945 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867563+0000", 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37693251300000002, 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013088752, 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5945 2024-09-14T05:59:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867563+0000", 2024-09-14T05:59:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867563+0000", 2024-09-14T05:59:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867563+0000", 2024-09-14T05:59:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0999999999999998e-07 2024-09-14T05:59:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867565+0000", 2024-09-14T05:59:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9570000000000001e-06 2024-09-14T05:59:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867572+0000", 2024-09-14T05:59:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2589999999999997e-06 2024-09-14T05:59:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867577+0000", 2024-09-14T05:59:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9509999999999997e-06 2024-09-14T05:59:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880539+0000", 2024-09-14T05:59:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012962840999999999 2024-09-14T05:59:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880584+0000", 2024-09-14T05:59:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4354000000000003e-05 2024-09-14T05:59:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880651+0000", 2024-09-14T05:59:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7680000000000003e-05 2024-09-14T05:59:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5946 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867586+0000", 2024-09-14T05:59:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37690890100000002, 2024-09-14T05:59:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013207419999999999, 2024-09-14T05:59:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5946 2024-09-14T05:59:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867586+0000", 2024-09-14T05:59:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867586+0000", 2024-09-14T05:59:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867587+0000", 2024-09-14T05:59:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6000000000000004e-07 2024-09-14T05:59:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867589+0000", 2024-09-14T05:59:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0470000000000001e-06 2024-09-14T05:59:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867595+0000", 2024-09-14T05:59:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1510000000000001e-06 2024-09-14T05:59:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867600+0000", 2024-09-14T05:59:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.741e-06 2024-09-14T05:59:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880678+0000", 2024-09-14T05:59:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013078233 2024-09-14T05:59:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880725+0000", 2024-09-14T05:59:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6802999999999999e-05 2024-09-14T05:59:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880794+0000", 2024-09-14T05:59:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8885000000000002e-05 2024-09-14T05:59:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5985 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 557056~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.869949+0000", 2024-09-14T05:59:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37454619900000002, 2024-09-14T05:59:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012040392, 2024-09-14T05:59:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5985 2024-09-14T05:59:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869949+0000", 2024-09-14T05:59:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869949+0000", 2024-09-14T05:59:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869949+0000", 2024-09-14T05:59:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5600000000000001e-07 2024-09-14T05:59:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869952+0000", 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0880000000000002e-06 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869958+0000", 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7120000000000003e-06 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869963+0000", 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T05:59:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881765+0000", 2024-09-14T05:59:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011801387999999999 2024-09-14T05:59:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881851+0000", 2024-09-14T05:59:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6524e-05 2024-09-14T05:59:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881989+0000", 2024-09-14T05:59:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013810999999999999 2024-09-14T05:59:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5986 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 708608~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.869970+0000", 2024-09-14T05:59:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37452485600000002, 2024-09-14T05:59:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012341964, 2024-09-14T05:59:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5986 2024-09-14T05:59:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869970+0000", 2024-09-14T05:59:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869970+0000", 2024-09-14T05:59:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869971+0000", 2024-09-14T05:59:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6399999999999998e-07 2024-09-14T05:59:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869973+0000", 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8509999999999999e-06 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869982+0000", 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869987+0000", 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3369999999999999e-06 2024-09-14T05:59:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882036+0000", 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012049150999999999 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882154+0000", 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011795599999999999 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882312+0000", 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000157944 2024-09-14T05:59:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5987 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 864256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.869995+0000", 2024-09-14T05:59:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37450006000000002, 2024-09-14T05:59:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012559504000000001, 2024-09-14T05:59:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5987 2024-09-14T05:59:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869995+0000", 2024-09-14T05:59:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869995+0000", 2024-09-14T05:59:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869995+0000", 2024-09-14T05:59:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T05:59:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869997+0000", 2024-09-14T05:59:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0040000000000002e-06 2024-09-14T05:59:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870004+0000", 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6959999999999999e-06 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870015+0000", 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1021e-05 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882354+0000", 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012338948000000001 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882441+0000", 2024-09-14T05:59:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6877000000000002e-05 2024-09-14T05:59:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882555+0000", 2024-09-14T05:59:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011357 2024-09-14T05:59:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5988 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 1015808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870023+0000", 2024-09-14T05:59:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.374472166, 2024-09-14T05:59:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012808669, 2024-09-14T05:59:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5988 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870023+0000", 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870023+0000", 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870023+0000", 2024-09-14T05:59:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2e-07 2024-09-14T05:59:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870026+0000", 2024-09-14T05:59:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6139999999999999e-06 2024-09-14T05:59:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870034+0000", 2024-09-14T05:59:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9710000000000004e-06 2024-09-14T05:59:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870039+0000", 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4700000000000001e-06 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882603+0000", 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012563138999999999 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882697+0000", 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4158000000000002e-05 2024-09-14T05:59:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882832+0000", 2024-09-14T05:59:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013489700000000001 2024-09-14T05:59:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6024 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 110592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870236+0000", 2024-09-14T05:59:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37425872700000001, 2024-09-14T05:59:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01286999, 2024-09-14T05:59:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6024 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870236+0000", 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870236+0000", 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870237+0000", 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.65e-07 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870239+0000", 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870245+0000", 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3010000000000003e-06 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870256+0000", 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1267000000000001e-05 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882882+0000", 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012625994999999999 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882966+0000", 2024-09-14T05:59:18.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4007999999999999e-05 2024-09-14T05:59:18.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883106+0000", 2024-09-14T05:59:18.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014023400000000001 2024-09-14T05:59:18.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.309 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6025 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 262144~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870265+0000", 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37423046599999998, 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013131543000000001, 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6025 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870265+0000", 2024-09-14T05:59:18.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870265+0000", 2024-09-14T05:59:18.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870265+0000", 2024-09-14T05:59:18.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7999999999999995e-07 2024-09-14T05:59:18.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870268+0000", 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.587e-06 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870274+0000", 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5100000000000004e-06 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870286+0000", 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1184e-05 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883151+0000", 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012865829000000001 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883253+0000", 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101326 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883396+0000", 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014342700000000001 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.313 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.314 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.314 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6026 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 413696~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.314 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870294+0000", 2024-09-14T05:59:18.314 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37420077099999999, 2024-09-14T05:59:18.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013341486, 2024-09-14T05:59:18.314 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.314 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.314 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.314 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.314 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.314 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.314 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6026 2024-09-14T05:59:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870294+0000", 2024-09-14T05:59:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870294+0000", 2024-09-14T05:59:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870295+0000", 2024-09-14T05:59:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5300000000000004e-07 2024-09-14T05:59:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870297+0000", 2024-09-14T05:59:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4710000000000001e-06 2024-09-14T05:59:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870304+0000", 2024-09-14T05:59:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7750000000000004e-06 2024-09-14T05:59:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870309+0000", 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1109999999999999e-06 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883451+0000", 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013142167 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883541+0000", 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9672000000000005e-05 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883636+0000", 2024-09-14T05:59:18.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4736999999999998e-05 2024-09-14T05:59:18.318 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.318 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.318 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.318 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6027 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 569344~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.318 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870317+0000", 2024-09-14T05:59:18.318 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37417798499999999, 2024-09-14T05:59:18.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013635599, 2024-09-14T05:59:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6027 2024-09-14T05:59:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870317+0000", 2024-09-14T05:59:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870317+0000", 2024-09-14T05:59:18.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870318+0000", 2024-09-14T05:59:18.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4700000000000002e-07 2024-09-14T05:59:18.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870320+0000", 2024-09-14T05:59:18.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2790000000000001e-06 2024-09-14T05:59:18.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870327+0000", 2024-09-14T05:59:18.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4460000000000004e-06 2024-09-14T05:59:18.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870332+0000", 2024-09-14T05:59:18.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0289999999999996e-06 2024-09-14T05:59:18.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883677+0000", 2024-09-14T05:59:18.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013344765 2024-09-14T05:59:18.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883794+0000", 2024-09-14T05:59:18.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116668 2024-09-14T05:59:18.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883953+0000", 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015896500000000001 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6028 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 720896~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870340+0000", 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37415536599999999, 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013748082999999999, 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.323 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6028 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870340+0000", 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870340+0000", 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870340+0000", 2024-09-14T05:59:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4499999999999997e-07 2024-09-14T05:59:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870342+0000", 2024-09-14T05:59:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.244e-06 2024-09-14T05:59:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870349+0000", 2024-09-14T05:59:18.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5640000000000002e-06 2024-09-14T05:59:18.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870354+0000", 2024-09-14T05:59:18.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3029999999999999e-06 2024-09-14T05:59:18.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883970+0000", 2024-09-14T05:59:18.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013615304 2024-09-14T05:59:18.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884014+0000", 2024-09-14T05:59:18.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3912000000000002e-05 2024-09-14T05:59:18.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884088+0000", 2024-09-14T05:59:18.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4311000000000001e-05 2024-09-14T05:59:18.327 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.327 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.327 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.328 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6029 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 872448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.328 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870386+0000", 2024-09-14T05:59:18.328 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37410881699999998, 2024-09-14T05:59:18.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013989418999999999, 2024-09-14T05:59:18.328 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.328 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.328 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.329 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.329 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.329 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.329 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6029 2024-09-14T05:59:18.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.329 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870386+0000", 2024-09-14T05:59:18.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870386+0000", 2024-09-14T05:59:18.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870387+0000", 2024-09-14T05:59:18.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4400000000000001e-07 2024-09-14T05:59:18.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870389+0000", 2024-09-14T05:59:18.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3649999999999998e-06 2024-09-14T05:59:18.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870403+0000", 2024-09-14T05:59:18.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3603e-05 2024-09-14T05:59:18.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870409+0000", 2024-09-14T05:59:18.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.767e-06 2024-09-14T05:59:18.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884135+0000", 2024-09-14T05:59:18.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01372603 2024-09-14T05:59:18.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884239+0000", 2024-09-14T05:59:18.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104141 2024-09-14T05:59:18.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884376+0000", 2024-09-14T05:59:18.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000137069 2024-09-14T05:59:18.333 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.333 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.334 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6030 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 1028096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:18.334 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870419+0000", 2024-09-14T05:59:18.334 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37407654499999998, 2024-09-14T05:59:18.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014083284, 2024-09-14T05:59:18.334 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:18.334 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:18.334 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:18.334 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:18.334 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:18.334 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:18.335 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6030 2024-09-14T05:59:18.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.335 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:18.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:18.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870419+0000", 2024-09-14T05:59:18.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:18.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870419+0000", 2024-09-14T05:59:18.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:18.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:18.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870419+0000", 2024-09-14T05:59:18.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3000000000000001e-07 2024-09-14T05:59:18.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:18.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870422+0000", 2024-09-14T05:59:18.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4219999999999999e-06 2024-09-14T05:59:18.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:18.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870435+0000", 2024-09-14T05:59:18.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3729e-05 2024-09-14T05:59:18.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:18.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870441+0000", 2024-09-14T05:59:18.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3900000000000001e-06 2024-09-14T05:59:18.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:18.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884391+0000", 2024-09-14T05:59:18.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013950786999999999 2024-09-14T05:59:18.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:18.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884433+0000", 2024-09-14T05:59:18.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1559e-05 2024-09-14T05:59:18.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:18.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:18.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:18.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884502+0000", 2024-09-14T05:59:18.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8867000000000003e-05 2024-09-14T05:59:18.338 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.338 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:18.339 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:18.339 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:18.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:59:18.341 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:18.339+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T05:59:18.372 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:18.372 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:18.389 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:18.406 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:18.428 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:18.428 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:18.441 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:18.437+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:18.448 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:18.449 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:18.469 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:18.470 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:18.490 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:18.491 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:18.495 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T05:59:18.495 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T05:59:18.511 INFO:teuthology.orchestra.run.smithi006.stdout:477 read 0x1fee88 thru 0x209d9f (0xaf18 bytes) 2024-09-14T05:59:18.512 INFO:teuthology.orchestra.run.smithi006.stdout:478 read 0xfd38ac thru 0xfd5e77 (0x25cc bytes) 2024-09-14T05:59:18.512 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:18.512 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:18.515 INFO:teuthology.orchestra.run.smithi006.stdout:479 trunc from 0xc8eba13 to 0xae3baf9 2024-09-14T05:59:18.533 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:59:18.542 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:18.537+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:18.569 INFO:teuthology.orchestra.run.smithi006.stdout:480 write 0x757870e thru 0x757cf87 (0x487a bytes) 2024-09-14T05:59:18.570 INFO:teuthology.orchestra.run.smithi006.stdout:481 read 0x160ed thru 0x17d9e (0x1cb2 bytes) 2024-09-14T05:59:18.571 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:18.571 INFO:teuthology.orchestra.run.smithi006.stdout:484 read 0xbc33a5 thru 0xbcf427 (0xc083 bytes) 2024-09-14T05:59:18.572 INFO:teuthology.orchestra.run.smithi006.stdout:485 punch from 0x630175 to 0x63d75b, (0xd5e6 bytes) 2024-09-14T05:59:18.572 INFO:teuthology.orchestra.run.smithi006.stdout:487 write 0x9001599 thru 0x90074ff (0x5f67 bytes) 2024-09-14T05:59:18.577 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:18.587 INFO:teuthology.orchestra.run.smithi006.stdout:490 write 0xd697ba5 thru 0xd69dbdf (0x603b bytes) 2024-09-14T05:59:18.592 INFO:teuthology.orchestra.run.smithi006.stdout:492 write 0x611052 thru 0x6204ab (0xf45a bytes) 2024-09-14T05:59:18.604 INFO:teuthology.orchestra.run.smithi006.stdout:494 trunc from 0xd69dbe0 to 0x6d329c2 2024-09-14T05:59:18.625 INFO:teuthology.orchestra.run.smithi006.stdout:496 read 0x5008e08 thru 0x5014bdb (0xbdd4 bytes) 2024-09-14T05:59:18.626 INFO:teuthology.orchestra.run.smithi006.stdout:498 punch from 0x5da6155 to 0x5db2145, (0xbff0 bytes) 2024-09-14T05:59:18.643 INFO:teuthology.orchestra.run.smithi006.stdout:499 write 0x9f4d26c thru 0x9f51ba6 (0x493b bytes) 2024-09-14T05:59:18.643 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:18.641+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:18.644 INFO:teuthology.orchestra.run.smithi006.stdout:500 write 0x21453ba thru 0x21502de (0xaf25 bytes) 2024-09-14T05:59:18.647 INFO:teuthology.orchestra.run.smithi006.stdout:501 write 0x45ffb44 thru 0x46063ac (0x6869 bytes) 2024-09-14T05:59:18.649 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:18.649 INFO:teuthology.orchestra.run.smithi006.stdout:503 read 0x21209d7 thru 0x2125482 (0x4aac bytes) 2024-09-14T05:59:18.650 INFO:teuthology.orchestra.run.smithi006.stdout:504 write 0x6d50773 thru 0x6d5a612 (0x9ea0 bytes) 2024-09-14T05:59:18.654 INFO:teuthology.orchestra.run.smithi006.stdout:507 read 0x89cf098 thru 0x89d7e93 (0x8dfc bytes) 2024-09-14T05:59:18.654 INFO:teuthology.orchestra.run.smithi006.stdout:508 writesame 0x202db30 thru 0x2030f83 data_size 0x11(0x3454 bytes) 2024-09-14T05:59:18.657 INFO:teuthology.orchestra.run.smithi006.stdout:510 read 0x60bdf95 thru 0x60c5072 (0x70de bytes) 2024-09-14T05:59:18.663 INFO:teuthology.orchestra.run.smithi006.stdout:511 trunc from 0x9f51ba7 to 0x4b85a6a 2024-09-14T05:59:18.672 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:18.672 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:18.680 INFO:teuthology.orchestra.run.smithi006.stdout:512 punch from 0x3cf4042 to 0x3cfa4e2, (0x64a0 bytes) 2024-09-14T05:59:18.680 INFO:teuthology.orchestra.run.smithi006.stdout:513 read 0x32475ae thru 0x3254b2e (0xd581 bytes) 2024-09-14T05:59:18.681 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:18.681 INFO:teuthology.orchestra.run.smithi006.stdout:516 write 0x216ca7e thru 0x217719c (0xa71f bytes) 2024-09-14T05:59:18.684 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:18.684 INFO:teuthology.orchestra.run.smithi006.stdout:518 read 0x2958fd0 thru 0x29639bc (0xa9ed bytes) 2024-09-14T05:59:18.685 INFO:teuthology.orchestra.run.smithi006.stdout:520 read 0x9e13ce thru 0x9e6a10 (0x5643 bytes) 2024-09-14T05:59:18.686 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:18.687 INFO:teuthology.orchestra.run.smithi006.stdout:523 read 0x1304b09 thru 0x130a4fc (0x59f4 bytes) 2024-09-14T05:59:18.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:59:18.704 INFO:teuthology.orchestra.run.smithi006.stdout:525 writesame 0xa1ac5ac thru 0xa1b4c93 data_size 0xc(0x86e8 bytes) 2024-09-14T05:59:18.720 INFO:teuthology.orchestra.run.smithi006.stdout:526 writesame 0xeaefa5c thru 0xeaf1767 data_size 0x1a(0x1d0c bytes) 2024-09-14T05:59:18.720 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:18.720 INFO:teuthology.orchestra.run.smithi006.stdout:528 read 0xb068b05 thru 0xb076c8a (0xe186 bytes) 2024-09-14T05:59:18.721 INFO:teuthology.orchestra.run.smithi006.stdout:531 write 0x8a5dd65 thru 0x8a6937e (0xb61a bytes) 2024-09-14T05:59:18.725 INFO:teuthology.orchestra.run.smithi006.stdout:532 write 0xa88699 thru 0xa91215 (0x8b7d bytes) 2024-09-14T05:59:18.744 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:18.741+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:18.748 INFO:teuthology.orchestra.run.smithi006.stdout:533 trunc from 0xeaf1768 to 0x3f76a07 2024-09-14T05:59:18.764 INFO:teuthology.orchestra.run.smithi006.stdout:535 punch from 0x3cfad45 to 0x3cfe264, (0x351f bytes) 2024-09-14T05:59:18.764 INFO:teuthology.orchestra.run.smithi006.stdout:536 read 0x3718a4e thru 0x3723534 (0xaae7 bytes) 2024-09-14T05:59:18.765 INFO:teuthology.orchestra.run.smithi006.stdout:537 punch from 0x3693466 to 0x3696bc1, (0x375b bytes) 2024-09-14T05:59:18.786 INFO:teuthology.orchestra.run.smithi006.stdout:538 write 0x9e2891c thru 0x9e2c456 (0x3b3b bytes) 2024-09-14T05:59:18.789 INFO:teuthology.orchestra.run.smithi006.stdout:539 read 0x919596 thru 0x91eb31 (0x559c bytes) 2024-09-14T05:59:18.790 INFO:teuthology.orchestra.run.smithi006.stdout:540 punch from 0x9915711 to 0x9920fdf, (0xb8ce bytes) 2024-09-14T05:59:18.808 INFO:teuthology.orchestra.run.smithi006.stdout:541 trunc from 0x9e2c457 to 0x156eab2 2024-09-14T05:59:18.813 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:18.814 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:18.829 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T05:59:18.860 INFO:teuthology.orchestra.run.smithi006.stdout:543 writesame 0xb9f7a76 thru 0xb9faeb9 data_size 0x1e(0x3444 bytes) 2024-09-14T05:59:18.875 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:18.875+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:18.876 INFO:teuthology.orchestra.run.smithi006.stdout:544 writesame 0xdc4816c thru 0xdc4cf5c data_size 0x9(0x4df1 bytes) 2024-09-14T05:59:18.888 INFO:teuthology.orchestra.run.smithi006.stdout:546 trunc from 0xdc4cf5d to 0x8ef5b0f 2024-09-14T05:59:18.902 INFO:teuthology.orchestra.run.smithi006.stdout:547 read 0x1b82150 thru 0x1b89bbc (0x7a6d bytes) 2024-09-14T05:59:18.903 INFO:teuthology.orchestra.run.smithi006.stdout:552 read 0x45f3ec1 thru 0x45fa566 (0x66a6 bytes) 2024-09-14T05:59:18.904 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:18.904 INFO:teuthology.orchestra.run.smithi006.stdout:554 read 0xf1845e thru 0xf23804 (0xb3a7 bytes) 2024-09-14T05:59:18.905 INFO:teuthology.orchestra.run.smithi006.stdout:557 punch from 0x5aa6288 to 0x5ab409b, (0xde13 bytes) 2024-09-14T05:59:18.912 INFO:teuthology.orchestra.run.smithi006.stdout:564 trunc from 0x8ef5b0f to 0x5f70e2c 2024-09-14T05:59:18.923 INFO:teuthology.orchestra.run.smithi006.stdout:566 read 0x4d780e0 thru 0x4d82b3f (0xaa60 bytes) 2024-09-14T05:59:18.924 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:18.924 INFO:teuthology.orchestra.run.smithi006.stdout:569 punch from 0x2555139 to 0x25582f6, (0x31bd bytes) 2024-09-14T05:59:18.924 INFO:teuthology.orchestra.run.smithi006.stdout:570 punch from 0x340310c to 0x340835f, (0x5253 bytes) 2024-09-14T05:59:18.924 INFO:teuthology.orchestra.run.smithi006.stdout:571 read 0x5cc0ef2 thru 0x5cc4de3 (0x3ef2 bytes) 2024-09-14T05:59:18.925 INFO:teuthology.orchestra.run.smithi006.stdout:572 writesame 0x48d7f0d thru 0x48db87a data_size 0x1(0x396e bytes) 2024-09-14T05:59:18.945 INFO:teuthology.orchestra.run.smithi006.stdout:574 writesame 0x649b3d4 thru 0x64a56ed data_size 0x3(0xa31a bytes) 2024-09-14T05:59:18.945 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:18.943+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:18.948 INFO:teuthology.orchestra.run.smithi006.stdout:575 punch from 0x3ff03ad to 0x3ff6219, (0x5e6c bytes) 2024-09-14T05:59:18.948 INFO:teuthology.orchestra.run.smithi006.stdout:577 writesame 0x10bef98 thru 0x10cb49d data_size 0x1(0xc506 bytes) 2024-09-14T05:59:18.958 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:18.958 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:18.963 INFO:teuthology.orchestra.run.smithi006.stdout: marking collection for removal 2024-09-14T05:59:18.963 INFO:teuthology.orchestra.run.smithi006.stdout:setting '_remove' omap key 2024-09-14T05:59:18.964 INFO:teuthology.orchestra.run.smithi006.stdout:finish_remove_pgs 3.18_head removing 3.18 2024-09-14T05:59:18.965 INFO:teuthology.orchestra.run.smithi006.stdout:Remove successful 2024-09-14T05:59:18.973 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T05:59:18.982 INFO:teuthology.orchestra.run.smithi006.stdout:579 read 0xa912d8 thru 0xa9994d (0x8676 bytes) 2024-09-14T05:59:18.983 INFO:teuthology.orchestra.run.smithi006.stdout:580 writesame 0x281c22 thru 0x287251 data_size 0x7(0x5630 bytes) 2024-09-14T05:59:18.985 INFO:teuthology.orchestra.run.smithi006.stdout:581 write 0x357e1fd thru 0x358c2ab (0xe0af bytes) 2024-09-14T05:59:19.007 INFO:teuthology.orchestra.run.smithi006.stdout:582 writesame 0xb92ef09 thru 0xb93217e data_size 0x3(0x3276 bytes) 2024-09-14T05:59:19.010 INFO:teuthology.orchestra.run.smithi006.stdout:583 clone 4 order 21 su 1048576 sc 15 2024-09-14T05:59:19.059 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:19.059+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:19.140 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:19.140 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:19.148 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:19.145+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:19.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T05:59:19.249 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:19.245+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:19.319 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:19.319 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:19.334 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T05:59:19.379 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:19.379+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:19.450 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:19.445+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:19.456 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:19.456 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:19.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T05:59:19.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-0 --journal-path /var/lib/ceph/osd/ceph-0/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.18.0 2024-09-14T05:59:19.563 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:19.563+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:19.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:59:19.651 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:19.651+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:19.651 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:19.651 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:19.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T05:59:19.715 INFO:teuthology.orchestra.run.smithi006.stdout:flattening image image_client.0-clone3 2024-09-14T05:59:19.752 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:19.749+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:19.836 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:19.836 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:19.850 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:59:19.852 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:19.849+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:19.909 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-14T05:59:19.953 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:19.949+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:19.974 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:19.975 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:19.993 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:59:20.079 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:20.077+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:20.154 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:20.151+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:20.165 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:20.165 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:20.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:59:20.275 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:20.273+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:20.293 INFO:teuthology.orchestra.run.smithi006.stdout:584 writesame 0xcb28f7b thru 0xcb3454d data_size 0x1(0xb5d3 bytes) 2024-09-14T05:59:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:585 write 0x492a7dd thru 0x492b6a5 (0xec9 bytes) 2024-09-14T05:59:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:586 read 0xb0c238f thru 0xb0cd4d8 (0xb14a bytes) 2024-09-14T05:59:20.299 INFO:teuthology.orchestra.run.smithi006.stdout:587 read 0x62f6835 thru 0x62f85ac (0x1d78 bytes) 2024-09-14T05:59:20.300 INFO:teuthology.orchestra.run.smithi006.stdout:588 writesame 0xa64f51 thru 0xa735c1 data_size 0x1f(0xe671 bytes) 2024-09-14T05:59:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:20.306 INFO:teuthology.orchestra.run.smithi006.stdout:591 writesame 0x77dcbaa thru 0x77e732c data_size 0x25(0xa783 bytes) 2024-09-14T05:59:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:592 trunc from 0xcb3454e to 0x92bb1e4 2024-09-14T05:59:20.338 INFO:teuthology.orchestra.run.smithi006.stdout:593 write 0x24bffd thru 0x24c0a8 (0xac bytes) 2024-09-14T05:59:20.348 INFO:teuthology.orchestra.run.smithi006.stdout:594 write 0x69bfec7 thru 0x69c8579 (0x86b3 bytes) 2024-09-14T05:59:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:596 read 0x3516df2 thru 0x3522561 (0xb770 bytes) 2024-09-14T05:59:20.355 INFO:teuthology.orchestra.run.smithi006.stdout:598 read 0x5856330 thru 0x585ae21 (0x4af2 bytes) 2024-09-14T05:59:20.356 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:20.355+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:20.356 INFO:teuthology.orchestra.run.smithi006.stdout:599 writesame 0x84122d4 thru 0x841a5bc data_size 0x1(0x82e9 bytes) 2024-09-14T05:59:20.374 INFO:teuthology.orchestra.run.smithi006.stdout:600 read 0x7f7d3be thru 0x7f86120 (0x8d63 bytes) 2024-09-14T05:59:20.375 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:20.386 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:20.386 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:20.395 INFO:teuthology.orchestra.run.smithi006.stdout:603 write 0xebe46d0 thru 0xebe8056 (0x3987 bytes) 2024-09-14T05:59:20.401 INFO:teuthology.orchestra.run.smithi006.stdout:605 writesame 0xa91c929 thru 0xa925b15 data_size 0x1(0x91ed bytes) 2024-09-14T05:59:20.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:59:20.426 INFO:teuthology.orchestra.run.smithi006.stdout:606 writesame 0x31361f thru 0x31d871 data_size 0x1(0xa253 bytes) 2024-09-14T05:59:20.457 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:20.455+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:20.474 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:20.475 INFO:teuthology.orchestra.run.smithi006.stdout:608 write 0xe5485e6 thru 0xe5492b7 (0xcd2 bytes) 2024-09-14T05:59:20.480 INFO:teuthology.orchestra.run.smithi006.stdout:613 punch from 0x668d877 to 0x6695d92, (0x851b bytes) 2024-09-14T05:59:20.480 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:20.480 INFO:teuthology.orchestra.run.smithi006.stdout:615 writesame 0x4747dc2 thru 0x475578c data_size 0xb1(0xd9cb bytes) 2024-09-14T05:59:20.488 INFO:teuthology.orchestra.run.smithi006.stdout:616 read 0x83da33 thru 0x846d08 (0x92d6 bytes) 2024-09-14T05:59:20.489 INFO:teuthology.orchestra.run.smithi006.stdout:617 write 0xe3dc78c thru 0xe3e366e (0x6ee3 bytes) 2024-09-14T05:59:20.495 INFO:teuthology.orchestra.run.smithi006.stdout:618 write 0x19fba93 thru 0x1a09085 (0xd5f3 bytes) 2024-09-14T05:59:20.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:59:20.509 INFO:teuthology.orchestra.run.smithi006.stdout:619 trunc from 0xebe8057 to 0x9d04efb 2024-09-14T05:59:20.528 INFO:teuthology.orchestra.run.smithi006.stdout:620 writesame 0x98b1700 thru 0x98b7faf data_size 0xa(0x68b0 bytes) 2024-09-14T05:59:20.533 INFO:teuthology.orchestra.run.smithi006.stdout:621 write 0x7532703 thru 0x753b190 (0x8a8e bytes) 2024-09-14T05:59:20.553 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:20.553 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:20.554 INFO:teuthology.orchestra.run.smithi006.stdout:622 write 0xaf22c15 thru 0xaf23991 (0xd7d bytes) 2024-09-14T05:59:20.558 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:20.553+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:20.559 INFO:teuthology.orchestra.run.smithi006.stdout:624 read 0x628ad78 thru 0x6298a11 (0xdc9a bytes) 2024-09-14T05:59:20.560 INFO:teuthology.orchestra.run.smithi006.stdout:627 punch from 0x869847d to 0x86a46fd, (0xc280 bytes) 2024-09-14T05:59:20.573 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:59:20.577 INFO:teuthology.orchestra.run.smithi006.stdout:628 trunc from 0xaf23992 to 0x3638b61 2024-09-14T05:59:20.611 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2024-09-14T05:59:20.638 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T05:59:20.646 INFO:teuthology.orchestra.run.smithi006.stdout:629 write 0x8aa7b4c thru 0x8aa8b36 (0xfeb bytes) 2024-09-14T05:59:20.649 INFO:teuthology.orchestra.run.smithi006.stdout:630 writesame 0x32c8503 thru 0x32d1b78 data_size 0x1(0x9676 bytes) 2024-09-14T05:59:20.658 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:20.658 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:20.658 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:20.655+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:20.683 INFO:teuthology.orchestra.run.smithi006.stdout:631 read 0xda411f thru 0xdb3b97 (0xfa79 bytes) 2024-09-14T05:59:20.684 INFO:teuthology.orchestra.run.smithi006.stdout:632 read 0x5d84e22 thru 0x5d8c3a1 (0x7580 bytes) 2024-09-14T05:59:20.684 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:20.686 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:20.696 INFO:teuthology.orchestra.run.smithi006.stdout:634 trunc from 0x8aa8b37 to 0x1ed86ad 2024-09-14T05:59:20.707 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:20.707 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:20.728 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:20.728 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:20.728 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:20.729 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:20.729 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:20.732 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:20.732 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:20.747 INFO:teuthology.orchestra.run.smithi006.stdout:635 write 0x8a7bda5 thru 0x8a89e5c (0xe0b8 bytes) 2024-09-14T05:59:20.751 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:59:20.754 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:20.754 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:20.759 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:20.759+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:20.762 INFO:teuthology.orchestra.run.smithi006.stdout:636 trunc from 0x8a89e5d to 0x1f440bd 2024-09-14T05:59:20.777 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:20.777 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:20.781 INFO:teuthology.orchestra.run.smithi006.stdout:637 read 0x104f0b7 thru 0x10591e9 (0xa133 bytes) 2024-09-14T05:59:20.782 INFO:teuthology.orchestra.run.smithi006.stdout:638 read 0x17b4042 thru 0x17bf78a (0xb749 bytes) 2024-09-14T05:59:20.783 INFO:teuthology.orchestra.run.smithi006.stdout:639 write 0x74629 thru 0x7c7aa (0x8182 bytes) 2024-09-14T05:59:20.790 INFO:teuthology.orchestra.run.smithi006.stdout:640 write 0xed544b thru 0xee450d (0xf0c3 bytes) 2024-09-14T05:59:20.800 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:20.801 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:20.801 INFO:teuthology.orchestra.run.smithi006.stdout:641 trunc from 0x1f440bd to 0x43f3920 2024-09-14T05:59:20.805 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T05:59:20.805 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T05:59:20.831 INFO:teuthology.orchestra.run.smithi006.stdout:642 write 0xa6da24b thru 0xa6e1b20 (0x78d6 bytes) 2024-09-14T05:59:20.837 INFO:teuthology.orchestra.run.smithi006.stdout:643 write 0x7481dd1 thru 0x748bdce (0x9ffe bytes) 2024-09-14T05:59:20.841 INFO:teuthology.orchestra.run.smithi006.stdout:644 read 0x71b22a3 thru 0x71bff89 (0xdce7 bytes) 2024-09-14T05:59:20.841 INFO:teuthology.orchestra.run.smithi006.stdout:645 punch from 0x83e4fc6 to 0x83eb286, (0x62c0 bytes) 2024-09-14T05:59:20.844 INFO:teuthology.orchestra.run.smithi006.stdout:647 trunc from 0xa6e1b21 to 0x8346a46 2024-09-14T05:59:20.860 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:20.857+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:20.862 INFO:teuthology.orchestra.run.smithi006.stdout:648 write 0x29b0c24 thru 0x29be629 (0xda06 bytes) 2024-09-14T05:59:20.868 INFO:teuthology.orchestra.run.smithi006.stdout:651 read 0x3c05410 thru 0x3c0b0e5 (0x5cd6 bytes) 2024-09-14T05:59:20.868 INFO:teuthology.orchestra.run.smithi006.stdout:652 read 0x19299ff thru 0x19339c9 (0x9fcb bytes) 2024-09-14T05:59:20.868 INFO:teuthology.orchestra.run.smithi006.stdout:654 writesame 0x3e78a70 thru 0x3e8398b data_size 0xe(0xaf1c bytes) 2024-09-14T05:59:20.876 INFO:teuthology.orchestra.run.smithi006.stdout:655 read 0x2cdb65c thru 0x2ce1d1a (0x66bf bytes) 2024-09-14T05:59:20.880 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:20.880 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:20.880 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:20.881 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:20.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.881 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:213 3.9 e29/24 3:95751eaa:::rbd_data.11275e589b0d.0000000000000019:head v 29'3, mlcod=29'1)", 2024-09-14T05:59:20.881 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.865898+0000", 2024-09-14T05:59:20.881 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.0130152199999998, 2024-09-14T05:59:20.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0023456789999999998, 2024-09-14T05:59:20.881 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.881 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.881 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.881 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865898+0000", 2024-09-14T05:59:20.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865898+0000", 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865900+0000", 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.99e-06 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865954+0000", 2024-09-14T05:59:20.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3257000000000002e-05 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.865985+0000", 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1239999999999999e-05 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.866009+0000", 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3546000000000001e-05 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.866164+0000", 2024-09-14T05:59:20.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015577200000000001 2024-09-14T05:59:20.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.866227+0000", 2024-09-14T05:59:20.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2817000000000005e-05 2024-09-14T05:59:20.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.868127+0000", 2024-09-14T05:59:20.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0019002909999999999 2024-09-14T05:59:20.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.868244+0000", 2024-09-14T05:59:20.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000116766 2024-09-14T05:59:20.885 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.885 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.885 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.885 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:224 3.4 e29/24 3:234b7459:::rbd_data.11275e589b0d.0000000000000004:head v 29'1, mlcod=0'0)", 2024-09-14T05:59:20.885 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.886470+0000", 2024-09-14T05:59:20.885 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9924441250000005, 2024-09-14T05:59:20.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0023458149999999998, 2024-09-14T05:59:20.885 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.885 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.885 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.885 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886470+0000", 2024-09-14T05:59:20.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886470+0000", 2024-09-14T05:59:20.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886470+0000", 2024-09-14T05:59:20.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9299999999999996e-07 2024-09-14T05:59:20.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886631+0000", 2024-09-14T05:59:20.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016085900000000001 2024-09-14T05:59:20.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886671+0000", 2024-09-14T05:59:20.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9573000000000002e-05 2024-09-14T05:59:20.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886706+0000", 2024-09-14T05:59:20.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4879999999999998e-05 2024-09-14T05:59:20.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886886+0000", 2024-09-14T05:59:20.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000180445 2024-09-14T05:59:20.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.886946+0000", 2024-09-14T05:59:20.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9617000000000002e-05 2024-09-14T05:59:20.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.889 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.889 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.888726+0000", 2024-09-14T05:59:20.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0017802460000000001 2024-09-14T05:59:20.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.889 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.889 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.888815+0000", 2024-09-14T05:59:20.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9302000000000007e-05 2024-09-14T05:59:20.889 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.889 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.889 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:255 3.9 e29/24 3:95751eaa:::rbd_data.11275e589b0d.0000000000000019:head v 29'4, mlcod=29'2)", 2024-09-14T05:59:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.982863+0000", 2024-09-14T05:59:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.8960502290000001, 2024-09-14T05:59:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002198373, 2024-09-14T05:59:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982863+0000", 2024-09-14T05:59:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982863+0000", 2024-09-14T05:59:20.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982866+0000", 2024-09-14T05:59:20.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.723e-06 2024-09-14T05:59:20.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982884+0000", 2024-09-14T05:59:20.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8090000000000001e-05 2024-09-14T05:59:20.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982929+0000", 2024-09-14T05:59:20.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4697000000000003e-05 2024-09-14T05:59:20.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.982951+0000", 2024-09-14T05:59:20.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1812999999999999e-05 2024-09-14T05:59:20.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.893 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983169+0000", 2024-09-14T05:59:20.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021797799999999999 2024-09-14T05:59:20.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.893 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.893 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983242+0000", 2024-09-14T05:59:20.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3473000000000006e-05 2024-09-14T05:59:20.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.984976+0000", 2024-09-14T05:59:20.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0017333559999999999 2024-09-14T05:59:20.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985062+0000", 2024-09-14T05:59:20.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6242999999999994e-05 2024-09-14T05:59:20.895 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.895 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.895 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.895 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:250 3.4 e29/24 3:234b7459:::rbd_data.11275e589b0d.0000000000000004:head v 29'2, mlcod=0'0)", 2024-09-14T05:59:20.895 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:11.983794+0000", 2024-09-14T05:59:20.895 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.8951194260000008, 2024-09-14T05:59:20.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020065980000000001, 2024-09-14T05:59:20.895 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.895 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.896 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.896 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983794+0000", 2024-09-14T05:59:20.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983794+0000", 2024-09-14T05:59:20.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983796+0000", 2024-09-14T05:59:20.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T05:59:20.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983813+0000", 2024-09-14T05:59:20.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6354e-05 2024-09-14T05:59:20.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.898 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.898 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983848+0000", 2024-09-14T05:59:20.898 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4696000000000001e-05 2024-09-14T05:59:20.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.983868+0000", 2024-09-14T05:59:20.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.001e-05 2024-09-14T05:59:20.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.984029+0000", 2024-09-14T05:59:20.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016157199999999999 2024-09-14T05:59:20.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.984086+0000", 2024-09-14T05:59:20.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6802999999999998e-05 2024-09-14T05:59:20.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985676+0000", 2024-09-14T05:59:20.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0015901579999999999 2024-09-14T05:59:20.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.902 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.902 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:11.985801+0000", 2024-09-14T05:59:20.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012483899999999999 2024-09-14T05:59:20.903 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.903 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.903 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.904 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:468 3.9 e29/24 3:92497260:::rbd_data.11275e589b0d.0000000000000015:head v 29'6, mlcod=29'4)", 2024-09-14T05:59:20.904 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:20.904 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.310674143, 2024-09-14T05:59:20.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002991737, 2024-09-14T05:59:20.904 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.904 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.905 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.905 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:20.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.906 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.906 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:20.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568242+0000", 2024-09-14T05:59:20.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3970000000000001e-06 2024-09-14T05:59:20.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568261+0000", 2024-09-14T05:59:20.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9029999999999999e-05 2024-09-14T05:59:20.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568302+0000", 2024-09-14T05:59:20.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0756000000000001e-05 2024-09-14T05:59:20.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568324+0000", 2024-09-14T05:59:20.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2293000000000002e-05 2024-09-14T05:59:20.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568455+0000", 2024-09-14T05:59:20.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000130784 2024-09-14T05:59:20.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568479+0000", 2024-09-14T05:59:20.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4119000000000001e-05 2024-09-14T05:59:20.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.571135+0000", 2024-09-14T05:59:20.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0026556319999999998 2024-09-14T05:59:20.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.571231+0000", 2024-09-14T05:59:20.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6725999999999995e-05 2024-09-14T05:59:20.911 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.911 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.911 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.911 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:514 3.9 e29/24 3:95751eaa:::rbd_data.11275e589b0d.0000000000000019:head v 29'8, mlcod=29'6)", 2024-09-14T05:59:20.911 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.682080+0000", 2024-09-14T05:59:20.912 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.1968337190000007, 2024-09-14T05:59:20.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020706639999999998, 2024-09-14T05:59:20.912 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.912 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.912 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.912 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682080+0000", 2024-09-14T05:59:20.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682080+0000", 2024-09-14T05:59:20.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682083+0000", 2024-09-14T05:59:20.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6800000000000002e-06 2024-09-14T05:59:20.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682237+0000", 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154086 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682270+0000", 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2950000000000001e-05 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682289+0000", 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9355999999999999e-05 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682447+0000", 2024-09-14T05:59:20.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015772900000000001 2024-09-14T05:59:20.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.682489+0000", 2024-09-14T05:59:20.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2580000000000002e-05 2024-09-14T05:59:20.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.684066+0000", 2024-09-14T05:59:20.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0015761810000000001 2024-09-14T05:59:20.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.684151+0000", 2024-09-14T05:59:20.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5101999999999999e-05 2024-09-14T05:59:20.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.916 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.916 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:858 3.0 e29/24 3:00d51ce4:::rbd_data.11275e589b0d.0000000000000009:head v 29'2, mlcod=0'0)", 2024-09-14T05:59:20.916 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:20.916 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.2043554890000001, 2024-09-14T05:59:20.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003436171, 2024-09-14T05:59:20.916 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.916 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674560+0000", 2024-09-14T05:59:20.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.638e-06 2024-09-14T05:59:20.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674570+0000", 2024-09-14T05:59:20.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9890000000000004e-06 2024-09-14T05:59:20.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674594+0000", 2024-09-14T05:59:20.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4049e-05 2024-09-14T05:59:20.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674604+0000", 2024-09-14T05:59:20.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0165e-05 2024-09-14T05:59:20.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674720+0000", 2024-09-14T05:59:20.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000115993 2024-09-14T05:59:20.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674746+0000", 2024-09-14T05:59:20.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5984000000000001e-05 2024-09-14T05:59:20.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.677932+0000", 2024-09-14T05:59:20.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031863669999999998 2024-09-14T05:59:20.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.677994+0000", 2024-09-14T05:59:20.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1985999999999999e-05 2024-09-14T05:59:20.920 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.920 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.920 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.921 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3625 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'27, mlcod=31'25)", 2024-09-14T05:59:20.921 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.325533+0000", 2024-09-14T05:59:20.921 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.5533808819999999, 2024-09-14T05:59:20.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035513340000000002, 2024-09-14T05:59:20.921 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.921 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.921 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.921 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325533+0000", 2024-09-14T05:59:20.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325533+0000", 2024-09-14T05:59:20.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325534+0000", 2024-09-14T05:59:20.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.02e-06 2024-09-14T05:59:20.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325542+0000", 2024-09-14T05:59:20.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0339999999999997e-06 2024-09-14T05:59:20.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325560+0000", 2024-09-14T05:59:20.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8403e-05 2024-09-14T05:59:20.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325570+0000", 2024-09-14T05:59:20.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9010000000000006e-06 2024-09-14T05:59:20.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325639+0000", 2024-09-14T05:59:20.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8610999999999998e-05 2024-09-14T05:59:20.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325661+0000", 2024-09-14T05:59:20.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1848000000000002e-05 2024-09-14T05:59:20.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329045+0000", 2024-09-14T05:59:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0033840400000000001 2024-09-14T05:59:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329084+0000", 2024-09-14T05:59:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9477000000000002e-05 2024-09-14T05:59:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.925 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3626 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'28, mlcod=31'25)", 2024-09-14T05:59:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.326628+0000", 2024-09-14T05:59:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.5522855890000002, 2024-09-14T05:59:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003397672, 2024-09-14T05:59:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326628+0000", 2024-09-14T05:59:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326628+0000", 2024-09-14T05:59:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326630+0000", 2024-09-14T05:59:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:59:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326637+0000", 2024-09-14T05:59:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6420000000000007e-06 2024-09-14T05:59:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326660+0000", 2024-09-14T05:59:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2816999999999999e-05 2024-09-14T05:59:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326671+0000", 2024-09-14T05:59:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0862999999999999e-05 2024-09-14T05:59:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326744+0000", 2024-09-14T05:59:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3411999999999994e-05 2024-09-14T05:59:20.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326763+0000", 2024-09-14T05:59:20.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9049e-05 2024-09-14T05:59:20.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329958+0000", 2024-09-14T05:59:20.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031946909999999999 2024-09-14T05:59:20.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330026+0000", 2024-09-14T05:59:20.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7634999999999999e-05 2024-09-14T05:59:20.930 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.930 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.930 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.930 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3627 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'29, mlcod=31'25)", 2024-09-14T05:59:20.930 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.327358+0000", 2024-09-14T05:59:20.930 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.5515557520000001, 2024-09-14T05:59:20.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0027111560000000002, 2024-09-14T05:59:20.930 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.327358+0000", 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.327358+0000", 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.327359+0000", 2024-09-14T05:59:20.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5000000000000001e-07 2024-09-14T05:59:20.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.327368+0000", 2024-09-14T05:59:20.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8089999999999999e-06 2024-09-14T05:59:20.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.327389+0000", 2024-09-14T05:59:20.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0818999999999998e-05 2024-09-14T05:59:20.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.327399+0000", 2024-09-14T05:59:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0949e-05 2024-09-14T05:59:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.327464+0000", 2024-09-14T05:59:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4679999999999997e-05 2024-09-14T05:59:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.327486+0000", 2024-09-14T05:59:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2291999999999999e-05 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330029+0000", 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00254287 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330069+0000", 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9786999999999997e-05 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.935 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3628 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'30, mlcod=31'25)", 2024-09-14T05:59:20.935 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.328532+0000", 2024-09-14T05:59:20.935 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.5503818869999999, 2024-09-14T05:59:20.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037713170000000002, 2024-09-14T05:59:20.935 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.935 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.935 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.935 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328532+0000", 2024-09-14T05:59:20.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.936 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328532+0000", 2024-09-14T05:59:20.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.936 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328533+0000", 2024-09-14T05:59:20.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8999999999999995e-07 2024-09-14T05:59:20.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.936 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328539+0000", 2024-09-14T05:59:20.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.913e-06 2024-09-14T05:59:20.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328551+0000", 2024-09-14T05:59:20.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2782999999999999e-05 2024-09-14T05:59:20.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328560+0000", 2024-09-14T05:59:20.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9400000000000008e-06 2024-09-14T05:59:20.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328620+0000", 2024-09-14T05:59:20.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9360000000000001e-05 2024-09-14T05:59:20.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328642+0000", 2024-09-14T05:59:20.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1891000000000001e-05 2024-09-14T05:59:20.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332262+0000", 2024-09-14T05:59:20.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0036202909999999999 2024-09-14T05:59:20.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332303+0000", 2024-09-14T05:59:20.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1349e-05 2024-09-14T05:59:20.939 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.939 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.939 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.939 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3629 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'31, mlcod=31'25)", 2024-09-14T05:59:20.939 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:20.940 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.5494318260000002, 2024-09-14T05:59:20.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048071900000000002, 2024-09-14T05:59:20.940 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.940 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.940 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.940 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:20.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:20.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329483+0000", 2024-09-14T05:59:20.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-07 2024-09-14T05:59:20.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329488+0000", 2024-09-14T05:59:20.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000004e-06 2024-09-14T05:59:20.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329496+0000", 2024-09-14T05:59:20.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2209999999999997e-06 2024-09-14T05:59:20.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329501+0000", 2024-09-14T05:59:20.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8729999999999998e-06 2024-09-14T05:59:20.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329545+0000", 2024-09-14T05:59:20.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4382999999999998e-05 2024-09-14T05:59:20.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329564+0000", 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8947999999999999e-05 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334225+0000", 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004660923 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334289+0000", 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4041999999999994e-05 2024-09-14T05:59:20.943 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3630 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'32, mlcod=31'25)", 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.548683821, 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0040991680000000003, 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:20.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:20.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330231+0000", 2024-09-14T05:59:20.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4099999999999998e-07 2024-09-14T05:59:20.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330235+0000", 2024-09-14T05:59:20.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.391e-06 2024-09-14T05:59:20.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330245+0000", 2024-09-14T05:59:20.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:59:20.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330249+0000", 2024-09-14T05:59:20.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T05:59:20.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330301+0000", 2024-09-14T05:59:20.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1515999999999999e-05 2024-09-14T05:59:20.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330312+0000", 2024-09-14T05:59:20.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1603000000000001e-05 2024-09-14T05:59:20.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334293+0000", 2024-09-14T05:59:20.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039809449999999996 2024-09-14T05:59:20.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334329+0000", 2024-09-14T05:59:20.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5763000000000003e-05 2024-09-14T05:59:20.950 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.950 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.950 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.950 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3631 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'33, mlcod=31'27)", 2024-09-14T05:59:20.950 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:20.950 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.5475280260000002, 2024-09-14T05:59:20.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035882079999999998, 2024-09-14T05:59:20.951 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.951 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.951 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.951 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:20.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:20.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:20.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3300000000000001e-07 2024-09-14T05:59:20.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331392+0000", 2024-09-14T05:59:20.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7880000000000003e-06 2024-09-14T05:59:20.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331403+0000", 2024-09-14T05:59:20.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0703000000000001e-05 2024-09-14T05:59:20.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331420+0000", 2024-09-14T05:59:20.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6959000000000001e-05 2024-09-14T05:59:20.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331466+0000", 2024-09-14T05:59:20.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5867e-05 2024-09-14T05:59:20.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331486+0000", 2024-09-14T05:59:20.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0511000000000001e-05 2024-09-14T05:59:20.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334926+0000", 2024-09-14T05:59:20.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0034397490000000002 2024-09-14T05:59:20.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334974+0000", 2024-09-14T05:59:20.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7898000000000001e-05 2024-09-14T05:59:20.955 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.955 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.955 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.955 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3632 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'34, mlcod=31'27)", 2024-09-14T05:59:20.955 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:20.955 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.5463096379999999, 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047983469999999997, 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332605+0000", 2024-09-14T05:59:20.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5099999999999999e-07 2024-09-14T05:59:20.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332611+0000", 2024-09-14T05:59:20.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6999999999999996e-06 2024-09-14T05:59:20.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332623+0000", 2024-09-14T05:59:20.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2401e-05 2024-09-14T05:59:20.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332629+0000", 2024-09-14T05:59:20.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3720000000000001e-06 2024-09-14T05:59:20.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332691+0000", 2024-09-14T05:59:20.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1451000000000005e-05 2024-09-14T05:59:20.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332711+0000", 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0285e-05 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337341+0000", 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046295900000000003 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337402+0000", 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1797000000000005e-05 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.960 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3633 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'35, mlcod=31'27)", 2024-09-14T05:59:20.960 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:20.960 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.5454481929999999, 2024-09-14T05:59:20.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039783919999999999, 2024-09-14T05:59:20.960 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.960 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.960 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.960 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:20.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:20.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:20.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1500000000000004e-07 2024-09-14T05:59:20.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333479+0000", 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2918999999999999e-05 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333489+0000", 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0068000000000001e-05 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333494+0000", 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9309999999999999e-06 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333543+0000", 2024-09-14T05:59:20.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9293999999999999e-05 2024-09-14T05:59:20.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333555+0000", 2024-09-14T05:59:20.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1467e-05 2024-09-14T05:59:20.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337408+0000", 2024-09-14T05:59:20.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038532549999999999 2024-09-14T05:59:20.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337444+0000", 2024-09-14T05:59:20.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5843000000000002e-05 2024-09-14T05:59:20.964 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.964 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.964 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.964 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3634 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'36, mlcod=31'27)", 2024-09-14T05:59:20.964 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.334299+0000", 2024-09-14T05:59:20.964 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.5446151619999999, 2024-09-14T05:59:20.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031846980000000001, 2024-09-14T05:59:20.965 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.965 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.965 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.965 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334299+0000", 2024-09-14T05:59:20.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334299+0000", 2024-09-14T05:59:20.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334299+0000", 2024-09-14T05:59:20.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0699999999999996e-07 2024-09-14T05:59:20.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334306+0000", 2024-09-14T05:59:20.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3849999999999999e-06 2024-09-14T05:59:20.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334316+0000", 2024-09-14T05:59:20.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9969999999999993e-06 2024-09-14T05:59:20.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334322+0000", 2024-09-14T05:59:20.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2060000000000004e-06 2024-09-14T05:59:20.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334414+0000", 2024-09-14T05:59:20.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2650000000000002e-05 2024-09-14T05:59:20.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334444+0000", 2024-09-14T05:59:20.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9213e-05 2024-09-14T05:59:20.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337447+0000", 2024-09-14T05:59:20.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0030035729999999998 2024-09-14T05:59:20.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337483+0000", 2024-09-14T05:59:20.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5967000000000003e-05 2024-09-14T05:59:20.968 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.969 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.969 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.969 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3637 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'39, mlcod=31'32)", 2024-09-14T05:59:20.969 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.337827+0000", 2024-09-14T05:59:20.969 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.5410868139999998, 2024-09-14T05:59:20.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002550835, 2024-09-14T05:59:20.969 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.969 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.969 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.969 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337827+0000", 2024-09-14T05:59:20.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337827+0000", 2024-09-14T05:59:20.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337828+0000", 2024-09-14T05:59:20.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7999999999999993e-07 2024-09-14T05:59:20.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337878+0000", 2024-09-14T05:59:20.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9731999999999998e-05 2024-09-14T05:59:20.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337892+0000", 2024-09-14T05:59:20.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4803999999999999e-05 2024-09-14T05:59:20.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337902+0000", 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4460000000000007e-06 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337953+0000", 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0739000000000003e-05 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337972+0000", 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8927999999999999e-05 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.340336+0000", 2024-09-14T05:59:20.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002364859 2024-09-14T05:59:20.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.340378+0000", 2024-09-14T05:59:20.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1347000000000002e-05 2024-09-14T05:59:20.973 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.973 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.973 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.974 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3638 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'40, mlcod=31'32)", 2024-09-14T05:59:20.974 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:20.974 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.5401677230000002, 2024-09-14T05:59:20.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004283345, 2024-09-14T05:59:20.974 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.974 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.974 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.974 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:20.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:20.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338747+0000", 2024-09-14T05:59:20.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0279999999999999e-06 2024-09-14T05:59:20.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338756+0000", 2024-09-14T05:59:20.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5909999999999996e-06 2024-09-14T05:59:20.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338774+0000", 2024-09-14T05:59:20.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8073000000000001e-05 2024-09-14T05:59:20.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338785+0000", 2024-09-14T05:59:20.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1017e-05 2024-09-14T05:59:20.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338844+0000", 2024-09-14T05:59:20.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9292000000000001e-05 2024-09-14T05:59:20.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338864+0000", 2024-09-14T05:59:20.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9528999999999999e-05 2024-09-14T05:59:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.342984+0000", 2024-09-14T05:59:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041207809999999996 2024-09-14T05:59:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.343029+0000", 2024-09-14T05:59:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5034000000000003e-05 2024-09-14T05:59:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3692 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'47, mlcod=31'44)", 2024-09-14T05:59:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.394505+0000", 2024-09-14T05:59:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.4844083449999999, 2024-09-14T05:59:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031415789999999998, 2024-09-14T05:59:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394505+0000", 2024-09-14T05:59:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.980 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.980 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:20.980 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394505+0000", 2024-09-14T05:59:20.980 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:20.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.980 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.980 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:20.980 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394506+0000", 2024-09-14T05:59:20.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0100000000000004e-07 2024-09-14T05:59:20.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:20.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394511+0000", 2024-09-14T05:59:20.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7709999999999997e-06 2024-09-14T05:59:20.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:20.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394522+0000", 2024-09-14T05:59:20.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1270999999999999e-05 2024-09-14T05:59:20.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:20.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394531+0000", 2024-09-14T05:59:20.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6309999999999992e-06 2024-09-14T05:59:20.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:20.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394598+0000", 2024-09-14T05:59:20.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7516999999999997e-05 2024-09-14T05:59:20.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.984 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:20.984 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394629+0000", 2024-09-14T05:59:20.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0380000000000001e-05 2024-09-14T05:59:20.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.984 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.984 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:20.984 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.397611+0000", 2024-09-14T05:59:20.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002982434 2024-09-14T05:59:20.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:20.984 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:20.984 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:20.984 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.397647+0000", 2024-09-14T05:59:20.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5874000000000002e-05 2024-09-14T05:59:20.985 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.985 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.985 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.985 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:20.985 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:20.985 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:20.986 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:59:20.988 INFO:teuthology.orchestra.run.smithi006.stdout:656 write 0xd30490c thru 0xd30ee3c (0xa531 bytes) 2024-09-14T05:59:20.989 INFO:teuthology.orchestra.run.smithi006.stdout:659 write 0x434c9 thru 0x4b0a5 (0x7bdd bytes) 2024-09-14T05:59:20.989 INFO:teuthology.orchestra.run.smithi006.stdout:660 writesame 0x316dcf5 thru 0x3173e9b data_size 0xd(0x61a7 bytes) 2024-09-14T05:59:20.989 INFO:teuthology.orchestra.run.smithi006.stdout:661 read 0x4c91d8f thru 0x4c9c0d0 (0xa342 bytes) 2024-09-14T05:59:20.989 INFO:teuthology.orchestra.run.smithi006.stdout:662 read 0x7f21917 thru 0x7f2a100 (0x87ea bytes) 2024-09-14T05:59:20.989 INFO:teuthology.orchestra.run.smithi006.stdout:663 read 0x87dc309 thru 0x87e7eec (0xbbe4 bytes) 2024-09-14T05:59:20.989 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:20.989 INFO:teuthology.orchestra.run.smithi006.stdout:666 read 0x1ff952e thru 0x1ffd11b (0x3bee bytes) 2024-09-14T05:59:20.989 INFO:teuthology.orchestra.run.smithi006.stdout:667 write 0x7a305d7 thru 0x7a4008f (0xfab9 bytes) 2024-09-14T05:59:20.989 INFO:teuthology.orchestra.run.smithi006.stdout:668 read 0x22b8119 thru 0x22bc8c3 (0x47ab bytes) 2024-09-14T05:59:20.989 INFO:teuthology.orchestra.run.smithi006.stdout:669 write 0xb8b057b thru 0xb8b0b52 (0x5d8 bytes) 2024-09-14T05:59:20.989 INFO:teuthology.orchestra.run.smithi006.stdout:670 read 0x7c1d2e2 thru 0x7c2705e (0x9d7d bytes) 2024-09-14T05:59:20.989 INFO:teuthology.orchestra.run.smithi006.stdout:671 write 0x7f68e2d thru 0x7f6b8c3 (0x2a97 bytes) 2024-09-14T05:59:20.989 INFO:teuthology.orchestra.run.smithi006.stdout:672 write 0xd2c558c thru 0xd2c59c2 (0x437 bytes) 2024-09-14T05:59:20.990 INFO:teuthology.orchestra.run.smithi006.stdout:674 write 0x85f29b3 thru 0x8600691 (0xdcdf bytes) 2024-09-14T05:59:20.990 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:20.990 INFO:teuthology.orchestra.run.smithi006.stdout:676 read 0x4bc87ea thru 0x4bcb60c (0x2e23 bytes) 2024-09-14T05:59:20.990 INFO:teuthology.orchestra.run.smithi006.stdout:679 trunc from 0xd30ee3d to 0xe74daa 2024-09-14T05:59:20.990 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:20.981+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:21.006 INFO:teuthology.orchestra.run.smithi006.stdout:683 read 0x1693d0 thru 0x16cd7e (0x39af bytes) 2024-09-14T05:59:21.007 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:21.007 INFO:teuthology.orchestra.run.smithi006.stdout:688 read 0x734496 thru 0x73c6ea (0x8255 bytes) 2024-09-14T05:59:21.034 INFO:teuthology.orchestra.run.smithi006.stdout:689 write 0xacb4a01 thru 0xacba072 (0x5672 bytes) 2024-09-14T05:59:21.039 INFO:teuthology.orchestra.run.smithi006.stdout:690 read 0x2179a07 thru 0x217d164 (0x375e bytes) 2024-09-14T05:59:21.039 INFO:teuthology.orchestra.run.smithi006.stdout:692 read 0x12c5d1a thru 0x12ca924 (0x4c0b bytes) 2024-09-14T05:59:21.040 INFO:teuthology.orchestra.run.smithi006.stdout:693 writesame 0x9e95eef thru 0x9ea2442 data_size 0x4(0xc554 bytes) 2024-09-14T05:59:21.053 INFO:teuthology.orchestra.run.smithi006.stdout:694 read 0x82adbdd thru 0x82bcbd7 (0xeffb bytes) 2024-09-14T05:59:21.054 INFO:teuthology.orchestra.run.smithi006.stdout:696 read 0x89275c4 thru 0x8933280 (0xbcbd bytes) 2024-09-14T05:59:21.061 INFO:teuthology.orchestra.run.smithi006.stdout:699 trunc from 0xacba073 to 0xec4a0fc 2024-09-14T05:59:21.072 INFO:teuthology.orchestra.run.smithi006.stdout:700 writesame 0x90a89eb thru 0x90ab3c4 data_size 0xb(0x29da bytes) 2024-09-14T05:59:21.077 INFO:teuthology.orchestra.run.smithi006.stdout:701 write 0xe8e0532 thru 0xe8e2346 (0x1e15 bytes) 2024-09-14T05:59:21.083 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:21.083 INFO:teuthology.orchestra.run.smithi006.stdout:703 read 0x6c9cc98 thru 0x6ca068b (0x39f4 bytes) 2024-09-14T05:59:21.083 INFO:teuthology.orchestra.run.smithi006.stdout:704 writesame 0xaddf17f thru 0xade8811 data_size 0x3(0x9693 bytes) 2024-09-14T05:59:21.087 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:21.087+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:21.101 INFO:teuthology.orchestra.run.smithi006.stdout:705 trunc from 0xec4a0fc to 0x9b70dd5 2024-09-14T05:59:21.124 INFO:teuthology.orchestra.run.smithi006.stdout:706 read 0x518aa94 thru 0x5193549 (0x8ab6 bytes) 2024-09-14T05:59:21.133 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:21.133 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:21.133 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:21.133 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:21.146 INFO:teuthology.orchestra.run.smithi006.stdout:707 writesame 0xdce43cf thru 0xdcef887 data_size 0x13(0xb4b9 bytes) 2024-09-14T05:59:21.146 INFO:teuthology.orchestra.run.smithi006.stdout:708 writesame 0xcca5994 thru 0xcca9539 data_size 0xf(0x3ba6 bytes) 2024-09-14T05:59:21.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:59:21.153 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:21.153 INFO:teuthology.orchestra.run.smithi006.stdout:710 read 0x6381975 thru 0x6389e2d (0x84b9 bytes) 2024-09-14T05:59:21.153 INFO:teuthology.orchestra.run.smithi006.stdout:711 write 0x25c2654 thru 0x25cf02c (0xc9d9 bytes) 2024-09-14T05:59:21.159 INFO:teuthology.orchestra.run.smithi006.stdout:713 punch from 0xaad5597 to 0xaae4ac6, (0xf52f bytes) 2024-09-14T05:59:21.159 INFO:teuthology.orchestra.run.smithi006.stdout:714 write 0x63dac2c thru 0x63e346f (0x8844 bytes) 2024-09-14T05:59:21.164 INFO:teuthology.orchestra.run.smithi006.stdout:715 writesame 0xd7ec7aa thru 0xd7edcb7 data_size 0xe(0x150e bytes) 2024-09-14T05:59:21.169 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:21.169 INFO:teuthology.orchestra.run.smithi006.stdout:717 read 0xcac741e thru 0xcad6e25 (0xfa08 bytes) 2024-09-14T05:59:21.169 INFO:teuthology.orchestra.run.smithi006.stdout:718 punch from 0xa6cfe08 to 0xa6d212d, (0x2325 bytes) 2024-09-14T05:59:21.169 INFO:teuthology.orchestra.run.smithi006.stdout:719 writesame 0x42ecdf8 thru 0x42f5ccf data_size 0x1c(0x8ed8 bytes) 2024-09-14T05:59:21.173 INFO:teuthology.orchestra.run.smithi006.stdout:720 write 0xab9149d thru 0xab99751 (0x82b5 bytes) 2024-09-14T05:59:21.178 INFO:teuthology.orchestra.run.smithi006.stdout:722 write 0xf3638 thru 0xf74ac (0x3e75 bytes) 2024-09-14T05:59:21.180 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:21.188 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:21.187+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:21.197 INFO:teuthology.orchestra.run.smithi006.stdout:725 trunc from 0xdcef888 to 0x4328646 2024-09-14T05:59:21.222 INFO:teuthology.orchestra.run.smithi006.stdout:726 punch from 0xe7f798 to 0xe8eb63, (0xf3cb bytes) 2024-09-14T05:59:21.235 INFO:teuthology.orchestra.run.smithi006.stdout:727 write 0x620fa0f thru 0x6218ae9 (0x90db bytes) 2024-09-14T05:59:21.240 INFO:teuthology.orchestra.run.smithi006.stdout:729 punch from 0x9fd42a to 0xa026c8, (0x529e bytes) 2024-09-14T05:59:21.255 INFO:teuthology.orchestra.run.smithi006.stdout:get_pg_num_history pg_num_history pg_num_history(e27 pg_nums {1={16=1},2={19=8},3={24=32}} deleted_pools ) 2024-09-14T05:59:21.255 INFO:teuthology.orchestra.run.smithi006.stdout:Importing pgid 3.18 2024-09-14T05:59:21.255 INFO:teuthology.orchestra.run.smithi006.stdout:write_pg epoch 27 info 3.18( empty local-lis/les=24/25 n=0 ec=24/24 lis/c=24/24 les/c/f=25/25/0 sis=24) 2024-09-14T05:59:21.255 INFO:teuthology.orchestra.run.smithi006.stdout:Import successful 2024-09-14T05:59:21.261 INFO:teuthology.orchestra.run.smithi006.stdout:730 writesame 0xaf9f345 thru 0xafa0cd2 data_size 0x1(0x198e bytes) 2024-09-14T05:59:21.261 INFO:teuthology.orchestra.run.smithi006.stdout:731 read 0x6abc0c8 thru 0x6ac2891 (0x67ca bytes) 2024-09-14T05:59:21.261 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:21.274 INFO:teuthology.orchestra.run.smithi006.stdout:735 trunc from 0xafa0cd3 to 0x2051464 2024-09-14T05:59:21.288 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:21.287+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:21.297 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:21.297 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:21.297 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:21.297 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:21.297 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:21.306 INFO:teuthology.orchestra.run.smithi006.stdout:737 trunc from 0x2051464 to 0x9c393fa 2024-09-14T05:59:21.318 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:59:21.324 INFO:teuthology.orchestra.run.smithi006.stdout:743 trunc from 0x9c393fa to 0x59cd0ad 2024-09-14T05:59:21.352 INFO:teuthology.orchestra.run.smithi006.stdout:745 writesame 0x7fbc1f4 thru 0x7fc1db3 data_size 0x20(0x5bc0 bytes) 2024-09-14T05:59:21.372 INFO:teuthology.orchestra.run.smithi006.stdout:746 write 0xcd310e3 thru 0xcd3b6dd (0xa5fb bytes) 2024-09-14T05:59:21.377 INFO:teuthology.orchestra.run.smithi006.stdout:747 read 0x40575b thru 0x4110b7 (0xb95d bytes) 2024-09-14T05:59:21.379 INFO:teuthology.orchestra.run.smithi006.stdout:749 read 0x6d776a6 thru 0x6d81eb2 (0xa80d bytes) 2024-09-14T05:59:21.379 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:21.379 INFO:teuthology.orchestra.run.smithi006.stdout:752 read 0x9721454 thru 0x9730dd8 (0xf985 bytes) 2024-09-14T05:59:21.389 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:21.387+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:21.390 INFO:teuthology.orchestra.run.smithi006.stdout:753 write 0xd3079bb thru 0xd311791 (0x9dd7 bytes) 2024-09-14T05:59:21.393 INFO:teuthology.orchestra.run.smithi006.stdout:754 punch from 0x2e60490 to 0x2e64fed, (0x4b5d bytes) 2024-09-14T05:59:21.393 INFO:teuthology.orchestra.run.smithi006.stdout:755 writesame 0xc31b0a thru 0xc3f79d data_size 0x26(0xdc94 bytes) 2024-09-14T05:59:21.397 INFO:teuthology.orchestra.run.smithi006.stdout:756 write 0x738b981 thru 0x73950bc (0x973c bytes) 2024-09-14T05:59:21.402 INFO:teuthology.orchestra.run.smithi006.stdout:759 read 0xc9d1c54 thru 0xc9dbaf7 (0x9ea4 bytes) 2024-09-14T05:59:21.402 INFO:teuthology.orchestra.run.smithi006.stdout:760 punch from 0x6b82b2c to 0x6b90dbe, (0xe292 bytes) 2024-09-14T05:59:21.402 INFO:teuthology.orchestra.run.smithi006.stdout:761 punch from 0x22cf2ea to 0x22d4641, (0x5357 bytes) 2024-09-14T05:59:21.403 INFO:teuthology.orchestra.run.smithi006.stdout:762 read 0x9a1adb3 thru 0x9a25207 (0xa455 bytes) 2024-09-14T05:59:21.403 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:21.403 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:21.403 INFO:teuthology.orchestra.run.smithi006.stdout:765 read 0xb90a834 thru 0xb90aff0 (0x7bd bytes) 2024-09-14T05:59:21.403 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:21.403 INFO:teuthology.orchestra.run.smithi006.stdout:772 write 0xbedaf9d thru 0xbedc3dc (0x1440 bytes) 2024-09-14T05:59:21.407 INFO:teuthology.orchestra.run.smithi006.stdout:773 trunc from 0xd311792 to 0xe8691c6 2024-09-14T05:59:21.418 INFO:teuthology.orchestra.run.smithi006.stdout:775 read 0x7002a0e thru 0x700afeb (0x85de bytes) 2024-09-14T05:59:21.418 INFO:teuthology.orchestra.run.smithi006.stdout:776 write 0x6c87a06 thru 0x6c92c44 (0xb23f bytes) 2024-09-14T05:59:21.421 INFO:teuthology.orchestra.run.smithi006.stdout:777 write 0xbde533c thru 0xbdec338 (0x6ffd bytes) 2024-09-14T05:59:21.426 INFO:teuthology.orchestra.run.smithi006.stdout:778 writesame 0x8f260fe thru 0x8f28d33 data_size 0x1(0x2c36 bytes) 2024-09-14T05:59:21.443 INFO:teuthology.orchestra.run.smithi006.stdout:779 read 0x1ea5907 thru 0x1eaa568 (0x4c62 bytes) 2024-09-14T05:59:21.465 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:21.465 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:21.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:21.465 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:21.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.465 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:555 3.7 3:e2ffd4fe:::rbd_data.11275e589b0d.0000000000000013:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:21.465 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.773704+0000", 2024-09-14T05:59:21.465 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.6883944540000009, 2024-09-14T05:59:21.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.021020928000000001, 2024-09-14T05:59:21.465 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.466 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.466 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:21.466 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.466 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.466 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.466 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 555 2024-09-14T05:59:21.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.466 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.466 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.466 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773704+0000", 2024-09-14T05:59:21.466 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773704+0000", 2024-09-14T05:59:21.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773706+0000", 2024-09-14T05:59:21.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3300000000000001e-06 2024-09-14T05:59:21.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773718+0000", 2024-09-14T05:59:21.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1324e-05 2024-09-14T05:59:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773746+0000", 2024-09-14T05:59:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8813e-05 2024-09-14T05:59:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773761+0000", 2024-09-14T05:59:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4466e-05 2024-09-14T05:59:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773898+0000", 2024-09-14T05:59:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000137596 2024-09-14T05:59:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.774030+0000", 2024-09-14T05:59:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013141199999999999 2024-09-14T05:59:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T05:59:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.777366+0000", 2024-09-14T05:59:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003336468 2024-09-14T05:59:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:21.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794459+0000", 2024-09-14T05:59:21.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017092950999999999 2024-09-14T05:59:21.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:21.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794545+0000", 2024-09-14T05:59:21.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5609e-05 2024-09-14T05:59:21.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:21.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794644+0000", 2024-09-14T05:59:21.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8999000000000005e-05 2024-09-14T05:59:21.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794725+0000", 2024-09-14T05:59:21.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0959999999999997e-05 2024-09-14T05:59:21.471 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.471 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.471 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.471 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:608 3.7 3:e6b2e829:::rbd_data.11275e589b0d.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:21.471 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.930012+0000", 2024-09-14T05:59:21.471 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.5320865759999993, 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.027079134000000001, 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 608 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.472 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930012+0000", 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930012+0000", 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930013+0000", 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2999999999999999e-07 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930018+0000", 2024-09-14T05:59:21.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6239999999999999e-06 2024-09-14T05:59:21.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930032+0000", 2024-09-14T05:59:21.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3976e-05 2024-09-14T05:59:21.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930043+0000", 2024-09-14T05:59:21.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0764000000000001e-05 2024-09-14T05:59:21.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930152+0000", 2024-09-14T05:59:21.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108478 2024-09-14T05:59:21.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930287+0000", 2024-09-14T05:59:21.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000135029 2024-09-14T05:59:21.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T05:59:21.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.934701+0000", 2024-09-14T05:59:21.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044140050000000004 2024-09-14T05:59:21.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.476 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.476 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:21.476 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956894+0000", 2024-09-14T05:59:21.476 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022193039000000001 2024-09-14T05:59:21.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.476 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.476 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:21.476 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956924+0000", 2024-09-14T05:59:21.476 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0049999999999999e-05 2024-09-14T05:59:21.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.476 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.476 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:21.476 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.957018+0000", 2024-09-14T05:59:21.477 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4025999999999997e-05 2024-09-14T05:59:21.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.477 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.477 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.477 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.957091+0000", 2024-09-14T05:59:21.477 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3213000000000005e-05 2024-09-14T05:59:21.477 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.477 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.477 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.477 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.477 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop_reply(client.4391.0:608 3.7 e29/24 ondisk, result = 0)", 2024-09-14T05:59:21.477 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.942307+0000", 2024-09-14T05:59:21.477 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.5197910560000008, 2024-09-14T05:59:21.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014599915, 2024-09-14T05:59:21.478 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.478 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.478 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.478 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.478 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942307+0000", 2024-09-14T05:59:21.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.478 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942307+0000", 2024-09-14T05:59:21.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.479 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.479 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942309+0000", 2024-09-14T05:59:21.479 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.511e-06 2024-09-14T05:59:21.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.479 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.479 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942315+0000", 2024-09-14T05:59:21.479 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6629999999999998e-06 2024-09-14T05:59:21.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.479 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.480 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942333+0000", 2024-09-14T05:59:21.480 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8657000000000001e-05 2024-09-14T05:59:21.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.480 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.480 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.480 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942346+0000", 2024-09-14T05:59:21.480 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3254999999999999e-05 2024-09-14T05:59:21.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.480 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.480 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.480 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956866+0000", 2024-09-14T05:59:21.480 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014519353 2024-09-14T05:59:21.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.480 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.481 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.481 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956884+0000", 2024-09-14T05:59:21.481 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7825999999999998e-05 2024-09-14T05:59:21.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.481 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.481 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.481 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956907+0000", 2024-09-14T05:59:21.481 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3649999999999999e-05 2024-09-14T05:59:21.481 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.481 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.481 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.481 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.482 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:612 3.18 3:1a07fa9c:::rbd_data.11275e589b0d.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:21.482 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.970090+0000", 2024-09-14T05:59:21.482 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.4920085390000004, 2024-09-14T05:59:21.482 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.027517274000000001, 2024-09-14T05:59:21.482 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.482 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.482 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:21.482 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.482 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.482 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.482 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 612 2024-09-14T05:59:21.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.482 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.482 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.483 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.483 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970090+0000", 2024-09-14T05:59:21.483 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.483 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.483 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.483 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970090+0000", 2024-09-14T05:59:21.483 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.483 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.483 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.483 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970092+0000", 2024-09-14T05:59:21.483 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.663e-06 2024-09-14T05:59:21.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.484 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.484 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.484 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970101+0000", 2024-09-14T05:59:21.484 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4560000000000006e-06 2024-09-14T05:59:21.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.484 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.484 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.484 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970127+0000", 2024-09-14T05:59:21.484 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5743999999999999e-05 2024-09-14T05:59:21.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.484 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.484 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.484 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970147+0000", 2024-09-14T05:59:21.485 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9973e-05 2024-09-14T05:59:21.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.485 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.485 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.485 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970270+0000", 2024-09-14T05:59:21.485 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000123182 2024-09-14T05:59:21.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.485 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.485 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.485 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970402+0000", 2024-09-14T05:59:21.485 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000131629 2024-09-14T05:59:21.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.486 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.486 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:21.486 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.997351+0000", 2024-09-14T05:59:21.486 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.026949039000000001 2024-09-14T05:59:21.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.486 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.486 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:21.486 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.997464+0000", 2024-09-14T05:59:21.486 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011337599999999999 2024-09-14T05:59:21.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.486 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.486 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.486 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.997607+0000", 2024-09-14T05:59:21.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014321200000000001 2024-09-14T05:59:21.487 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.487 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.487 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.487 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.487 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4193 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 843776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.487 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.749843+0000", 2024-09-14T05:59:21.487 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.7122556090000001, 2024-09-14T05:59:21.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.013019149000000001, 2024-09-14T05:59:21.487 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.487 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.487 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.487 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.488 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.488 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.488 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4193 2024-09-14T05:59:21.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.488 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749843+0000", 2024-09-14T05:59:21.488 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749843+0000", 2024-09-14T05:59:21.489 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.489 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.489 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749843+0000", 2024-09-14T05:59:21.489 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9499999999999998e-07 2024-09-14T05:59:21.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.489 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.489 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749845+0000", 2024-09-14T05:59:21.489 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1830000000000001e-06 2024-09-14T05:59:21.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.489 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.490 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749852+0000", 2024-09-14T05:59:21.490 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2160000000000003e-06 2024-09-14T05:59:21.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.490 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.490 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749857+0000", 2024-09-14T05:59:21.490 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9760000000000003e-06 2024-09-14T05:59:21.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.490 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.490 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.762691+0000", 2024-09-14T05:59:21.490 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.012834059 2024-09-14T05:59:21.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.491 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.762777+0000", 2024-09-14T05:59:21.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6788999999999999e-05 2024-09-14T05:59:21.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.491 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.762862+0000", 2024-09-14T05:59:21.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4530999999999994e-05 2024-09-14T05:59:21.491 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.491 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.491 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.491 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4194 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 995328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.492 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.749866+0000", 2024-09-14T05:59:21.492 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.712232846, 2024-09-14T05:59:21.492 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.013212824, 2024-09-14T05:59:21.492 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.492 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.492 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.492 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.493 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.493 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.493 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4194 2024-09-14T05:59:21.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.493 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.493 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.493 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749866+0000", 2024-09-14T05:59:21.493 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.493 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.494 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749866+0000", 2024-09-14T05:59:21.494 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.494 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.494 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749866+0000", 2024-09-14T05:59:21.494 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2800000000000002e-07 2024-09-14T05:59:21.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.494 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.494 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749868+0000", 2024-09-14T05:59:21.494 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4059999999999999e-06 2024-09-14T05:59:21.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.495 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.495 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749875+0000", 2024-09-14T05:59:21.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7850000000000003e-06 2024-09-14T05:59:21.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.495 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.495 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749878+0000", 2024-09-14T05:59:21.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2219999999999998e-06 2024-09-14T05:59:21.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.495 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.495 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.762901+0000", 2024-09-14T05:59:21.496 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.013022325 2024-09-14T05:59:21.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.496 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.496 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.496 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.762990+0000", 2024-09-14T05:59:21.496 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9336e-05 2024-09-14T05:59:21.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.496 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.496 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.496 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.763078+0000", 2024-09-14T05:59:21.496 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8321999999999999e-05 2024-09-14T05:59:21.496 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.496 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.497 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.497 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4236 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 90112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.497 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.749930+0000", 2024-09-14T05:59:21.497 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.7121682410000001, 2024-09-14T05:59:21.497 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.013584933, 2024-09-14T05:59:21.497 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.497 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.497 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.497 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.497 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.497 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.497 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4236 2024-09-14T05:59:21.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.498 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.498 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.498 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749930+0000", 2024-09-14T05:59:21.498 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.498 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.498 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749930+0000", 2024-09-14T05:59:21.498 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.498 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.499 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749931+0000", 2024-09-14T05:59:21.499 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5299999999999999e-07 2024-09-14T05:59:21.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.499 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.499 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749933+0000", 2024-09-14T05:59:21.499 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0820000000000001e-06 2024-09-14T05:59:21.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.499 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.499 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749939+0000", 2024-09-14T05:59:21.499 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2190000000000001e-06 2024-09-14T05:59:21.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.500 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.500 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749943+0000", 2024-09-14T05:59:21.500 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5549999999999996e-06 2024-09-14T05:59:21.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.500 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.500 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.763117+0000", 2024-09-14T05:59:21.500 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.013173750999999999 2024-09-14T05:59:21.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.500 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.500 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.763202+0000", 2024-09-14T05:59:21.500 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4297999999999998e-05 2024-09-14T05:59:21.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.501 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.501 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.763515+0000", 2024-09-14T05:59:21.501 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00031357500000000002 2024-09-14T05:59:21.501 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.501 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.501 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.501 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4237 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 241664~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.501 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.749952+0000", 2024-09-14T05:59:21.501 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.7121468800000001, 2024-09-14T05:59:21.502 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014061176999999999, 2024-09-14T05:59:21.502 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.502 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.502 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.502 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.502 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.502 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.502 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4237 2024-09-14T05:59:21.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.502 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.502 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.502 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749952+0000", 2024-09-14T05:59:21.502 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.503 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.503 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749952+0000", 2024-09-14T05:59:21.503 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.503 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.503 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749952+0000", 2024-09-14T05:59:21.503 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:59:21.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.503 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.503 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749955+0000", 2024-09-14T05:59:21.504 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:59:21.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.504 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.504 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749961+0000", 2024-09-14T05:59:21.504 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4080000000000003e-06 2024-09-14T05:59:21.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.504 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.504 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749966+0000", 2024-09-14T05:59:21.504 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3980000000000001e-06 2024-09-14T05:59:21.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.504 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.763575+0000", 2024-09-14T05:59:21.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.013609654000000001 2024-09-14T05:59:21.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.505 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.763679+0000", 2024-09-14T05:59:21.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000103352 2024-09-14T05:59:21.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.505 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.764013+0000", 2024-09-14T05:59:21.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00033413200000000001 2024-09-14T05:59:21.505 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.505 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4238 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 393216~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.749975+0000", 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.7121230920000001, 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014464156000000001, 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4238 2024-09-14T05:59:21.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.507 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.507 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.507 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749975+0000", 2024-09-14T05:59:21.507 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.507 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.507 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749975+0000", 2024-09-14T05:59:21.507 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.507 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.507 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749976+0000", 2024-09-14T05:59:21.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3799999999999998e-07 2024-09-14T05:59:21.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.508 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749982+0000", 2024-09-14T05:59:21.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8599999999999998e-06 2024-09-14T05:59:21.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.508 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749988+0000", 2024-09-14T05:59:21.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8530000000000003e-06 2024-09-14T05:59:21.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.509 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749994+0000", 2024-09-14T05:59:21.509 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7919999999999998e-06 2024-09-14T05:59:21.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.509 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.509 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.764063+0000", 2024-09-14T05:59:21.509 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014069016 2024-09-14T05:59:21.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.509 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.509 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.764144+0000", 2024-09-14T05:59:21.509 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0958999999999995e-05 2024-09-14T05:59:21.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.510 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.764439+0000", 2024-09-14T05:59:21.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029523800000000002 2024-09-14T05:59:21.510 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.510 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.510 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.510 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4239 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 548864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.510 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750003+0000", 2024-09-14T05:59:21.510 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.7120951820000001, 2024-09-14T05:59:21.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014983017, 2024-09-14T05:59:21.510 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.511 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.511 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.511 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.511 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.511 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.511 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4239 2024-09-14T05:59:21.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.511 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.511 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.511 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750003+0000", 2024-09-14T05:59:21.511 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.512 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750003+0000", 2024-09-14T05:59:21.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.512 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750004+0000", 2024-09-14T05:59:21.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8599999999999998e-07 2024-09-14T05:59:21.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.512 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750006+0000", 2024-09-14T05:59:21.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5210000000000001e-06 2024-09-14T05:59:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750013+0000", 2024-09-14T05:59:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4980000000000003e-06 2024-09-14T05:59:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750018+0000", 2024-09-14T05:59:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0710000000000002e-06 2024-09-14T05:59:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.764685+0000", 2024-09-14T05:59:21.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014667659 2024-09-14T05:59:21.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.764830+0000", 2024-09-14T05:59:21.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014494 2024-09-14T05:59:21.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.764986+0000", 2024-09-14T05:59:21.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000155842 2024-09-14T05:59:21.514 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.514 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.514 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4240 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 700416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750026+0000", 2024-09-14T05:59:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.7120726360000003, 2024-09-14T05:59:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015151886, 2024-09-14T05:59:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4240 2024-09-14T05:59:21.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750026+0000", 2024-09-14T05:59:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750026+0000", 2024-09-14T05:59:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.516 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750026+0000", 2024-09-14T05:59:21.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.46e-07 2024-09-14T05:59:21.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.517 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750029+0000", 2024-09-14T05:59:21.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5220000000000002e-06 2024-09-14T05:59:21.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.517 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750036+0000", 2024-09-14T05:59:21.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2010000000000002e-06 2024-09-14T05:59:21.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750041+0000", 2024-09-14T05:59:21.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0479999999999998e-06 2024-09-14T05:59:21.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765044+0000", 2024-09-14T05:59:21.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015003357 2024-09-14T05:59:21.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765118+0000", 2024-09-14T05:59:21.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3833999999999998e-05 2024-09-14T05:59:21.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765178+0000", 2024-09-14T05:59:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9478000000000002e-05 2024-09-14T05:59:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4241 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750049+0000", 2024-09-14T05:59:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.712049688, 2024-09-14T05:59:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015338802, 2024-09-14T05:59:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4241 2024-09-14T05:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750049+0000", 2024-09-14T05:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750049+0000", 2024-09-14T05:59:21.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750049+0000", 2024-09-14T05:59:21.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T05:59:21.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750052+0000", 2024-09-14T05:59:21.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4959999999999999e-06 2024-09-14T05:59:21.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750060+0000", 2024-09-14T05:59:21.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6640000000000004e-06 2024-09-14T05:59:21.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750066+0000", 2024-09-14T05:59:21.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2490000000000001e-06 2024-09-14T05:59:21.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765224+0000", 2024-09-14T05:59:21.523 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015158229 2024-09-14T05:59:21.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.523 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.523 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765300+0000", 2024-09-14T05:59:21.523 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6338e-05 2024-09-14T05:59:21.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.523 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.523 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765388+0000", 2024-09-14T05:59:21.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7367000000000006e-05 2024-09-14T05:59:21.524 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.524 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.524 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.524 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4242 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 1007616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.524 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750074+0000", 2024-09-14T05:59:21.524 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.7120240710000001, 2024-09-14T05:59:21.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015636724000000001, 2024-09-14T05:59:21.524 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.524 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.524 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.525 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.525 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.525 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.525 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4242 2024-09-14T05:59:21.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.525 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.525 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.525 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750074+0000", 2024-09-14T05:59:21.525 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.525 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750074+0000", 2024-09-14T05:59:21.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.526 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750075+0000", 2024-09-14T05:59:21.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6700000000000003e-07 2024-09-14T05:59:21.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.526 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750077+0000", 2024-09-14T05:59:21.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3870000000000002e-06 2024-09-14T05:59:21.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750084+0000", 2024-09-14T05:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6490000000000002e-06 2024-09-14T05:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750089+0000", 2024-09-14T05:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.724e-06 2024-09-14T05:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765443+0000", 2024-09-14T05:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015353983999999999 2024-09-14T05:59:21.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765557+0000", 2024-09-14T05:59:21.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000114294 2024-09-14T05:59:21.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765711+0000", 2024-09-14T05:59:21.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015411900000000001 2024-09-14T05:59:21.528 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.528 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.528 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.529 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4284 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 98304~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.529 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750123+0000", 2024-09-14T05:59:21.529 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.7119748970000002, 2024-09-14T05:59:21.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016056608, 2024-09-14T05:59:21.529 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.529 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.529 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.529 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.529 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.529 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.529 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4284 2024-09-14T05:59:21.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.530 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.530 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.530 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750123+0000", 2024-09-14T05:59:21.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.530 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.530 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750123+0000", 2024-09-14T05:59:21.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750124+0000", 2024-09-14T05:59:21.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T05:59:21.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750127+0000", 2024-09-14T05:59:21.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.553e-06 2024-09-14T05:59:21.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750133+0000", 2024-09-14T05:59:21.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3330000000000002e-06 2024-09-14T05:59:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750138+0000", 2024-09-14T05:59:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0629999999999996e-06 2024-09-14T05:59:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765754+0000", 2024-09-14T05:59:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015616591000000001 2024-09-14T05:59:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765853+0000", 2024-09-14T05:59:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8054999999999995e-05 2024-09-14T05:59:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.766180+0000", 2024-09-14T05:59:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032755399999999997 2024-09-14T05:59:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4285 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 253952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750146+0000", 2024-09-14T05:59:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.711952165, 2024-09-14T05:59:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016491355999999999, 2024-09-14T05:59:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4285 2024-09-14T05:59:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750146+0000", 2024-09-14T05:59:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750146+0000", 2024-09-14T05:59:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750147+0000", 2024-09-14T05:59:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9899999999999999e-07 2024-09-14T05:59:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750150+0000", 2024-09-14T05:59:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:59:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750156+0000", 2024-09-14T05:59:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.883e-06 2024-09-14T05:59:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750161+0000", 2024-09-14T05:59:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9230000000000001e-06 2024-09-14T05:59:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.766286+0000", 2024-09-14T05:59:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016124230999999999 2024-09-14T05:59:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.766336+0000", 2024-09-14T05:59:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0593000000000002e-05 2024-09-14T05:59:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.766638+0000", 2024-09-14T05:59:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030136600000000001 2024-09-14T05:59:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4286 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 405504~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750170+0000", 2024-09-14T05:59:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.711928538, 2024-09-14T05:59:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016886575000000001, 2024-09-14T05:59:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4286 2024-09-14T05:59:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750170+0000", 2024-09-14T05:59:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750170+0000", 2024-09-14T05:59:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750170+0000", 2024-09-14T05:59:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7800000000000002e-07 2024-09-14T05:59:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750173+0000", 2024-09-14T05:59:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8590000000000001e-06 2024-09-14T05:59:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750180+0000", 2024-09-14T05:59:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6470000000000001e-06 2024-09-14T05:59:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750189+0000", 2024-09-14T05:59:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9670000000000007e-06 2024-09-14T05:59:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.766692+0000", 2024-09-14T05:59:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016503054999999999 2024-09-14T05:59:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.766778+0000", 2024-09-14T05:59:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6408000000000003e-05 2024-09-14T05:59:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767056+0000", 2024-09-14T05:59:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027816100000000002 2024-09-14T05:59:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4287 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 557056~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750196+0000", 2024-09-14T05:59:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.711902604, 2024-09-14T05:59:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017054339000000002, 2024-09-14T05:59:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4287 2024-09-14T05:59:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750196+0000", 2024-09-14T05:59:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750196+0000", 2024-09-14T05:59:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750196+0000", 2024-09-14T05:59:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T05:59:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750199+0000", 2024-09-14T05:59:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3910000000000001e-06 2024-09-14T05:59:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750205+0000", 2024-09-14T05:59:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3790000000000003e-06 2024-09-14T05:59:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750209+0000", 2024-09-14T05:59:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7639999999999999e-06 2024-09-14T05:59:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767098+0000", 2024-09-14T05:59:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016889062999999999 2024-09-14T05:59:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767156+0000", 2024-09-14T05:59:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7979000000000002e-05 2024-09-14T05:59:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767250+0000", 2024-09-14T05:59:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4258000000000005e-05 2024-09-14T05:59:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4288 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 712704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750216+0000", 2024-09-14T05:59:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.7118823230000002, 2024-09-14T05:59:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017253942000000001, 2024-09-14T05:59:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4288 2024-09-14T05:59:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750216+0000", 2024-09-14T05:59:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750216+0000", 2024-09-14T05:59:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750217+0000", 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5499999999999998e-07 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750219+0000", 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2500000000000001e-06 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750225+0000", 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1460000000000001e-06 2024-09-14T05:59:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750230+0000", 2024-09-14T05:59:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:59:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767293+0000", 2024-09-14T05:59:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017062269000000001 2024-09-14T05:59:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767379+0000", 2024-09-14T05:59:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6030000000000001e-05 2024-09-14T05:59:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767470+0000", 2024-09-14T05:59:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1434000000000006e-05 2024-09-14T05:59:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4289 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 864256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750237+0000", 2024-09-14T05:59:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.7118611189999999, 2024-09-14T05:59:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017366869, 2024-09-14T05:59:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4289 2024-09-14T05:59:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750237+0000", 2024-09-14T05:59:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750237+0000", 2024-09-14T05:59:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750238+0000", 2024-09-14T05:59:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9299999999999999e-07 2024-09-14T05:59:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750240+0000", 2024-09-14T05:59:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0040000000000002e-06 2024-09-14T05:59:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750246+0000", 2024-09-14T05:59:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1140000000000002e-06 2024-09-14T05:59:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750251+0000", 2024-09-14T05:59:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1660000000000002e-06 2024-09-14T05:59:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767509+0000", 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017258295 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767557+0000", 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7355999999999999e-05 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767604+0000", 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7540999999999998e-05 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4290 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 1015808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750258+0000", 2024-09-14T05:59:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.711839967, 2024-09-14T05:59:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017551872999999999, 2024-09-14T05:59:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4290 2024-09-14T05:59:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750258+0000", 2024-09-14T05:59:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750258+0000", 2024-09-14T05:59:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750259+0000", 2024-09-14T05:59:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8000000000000001e-07 2024-09-14T05:59:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750266+0000", 2024-09-14T05:59:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-06 2024-09-14T05:59:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750274+0000", 2024-09-14T05:59:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2400000000000007e-06 2024-09-14T05:59:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750285+0000", 2024-09-14T05:59:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0818e-05 2024-09-14T05:59:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767642+0000", 2024-09-14T05:59:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017357351 2024-09-14T05:59:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767729+0000", 2024-09-14T05:59:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6915000000000004e-05 2024-09-14T05:59:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767810+0000", 2024-09-14T05:59:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1069000000000006e-05 2024-09-14T05:59:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:21.560 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:21.561 INFO:teuthology.orchestra.run.smithi006.stdout:780 trunc from 0xe8691c6 to 0x2336e33 2024-09-14T05:59:21.562 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:59:21.563 INFO:teuthology.orchestra.run.smithi006.stdout:782 read 0xb8e795 thru 0xb944e1 (0x5d4d bytes) 2024-09-14T05:59:21.563 INFO:teuthology.orchestra.run.smithi006.stdout:783 read 0x7ffdda thru 0x80863e (0x8865 bytes) 2024-09-14T05:59:21.563 INFO:teuthology.orchestra.run.smithi006.stdout:784 writesame 0x69d7965 thru 0x69e3620 data_size 0x4(0xbcbc bytes) 2024-09-14T05:59:21.563 INFO:teuthology.orchestra.run.smithi006.stdout:785 clone 5 order 25 su 16777216 sc 13 2024-09-14T05:59:21.563 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:21.557+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:21.663 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:21.663+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:21.704 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:21.704 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:21.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.704 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:8451 3.14 3:2bb4acb3:::rbd_id.image_client.0-clone5:head [create,call rbd.set_id in=25b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-14T05:59:21.704 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:21.704358+0000", 2024-09-14T05:59:21.704 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0029284850000000002, 2024-09-14T05:59:21.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029765939999999999, 2024-09-14T05:59:21.705 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:21.705 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:21.705 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-09-14T05:59:21.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:21.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:21.705 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:21.705 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 8451 2024-09-14T05:59:21.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.705 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:21.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:21.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.704358+0000", 2024-09-14T05:59:21.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:21.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:21.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.704358+0000", 2024-09-14T05:59:21.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:21.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:21.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.704359+0000", 2024-09-14T05:59:21.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.026e-06 2024-09-14T05:59:21.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:21.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.704364+0000", 2024-09-14T05:59:21.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2619999999999998e-06 2024-09-14T05:59:21.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:21.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.704380+0000", 2024-09-14T05:59:21.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5421e-05 2024-09-14T05:59:21.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.704389+0000", 2024-09-14T05:59:21.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2099999999999999e-06 2024-09-14T05:59:21.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:21.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.704520+0000", 2024-09-14T05:59:21.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013074000000000001 2024-09-14T05:59:21.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:21.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.704884+0000", 2024-09-14T05:59:21.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036392400000000001 2024-09-14T05:59:21.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 7", 2024-09-14T05:59:21.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.705413+0000", 2024-09-14T05:59:21.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00052987599999999998 2024-09-14T05:59:21.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:21.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.706802+0000", 2024-09-14T05:59:21.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00138878 2024-09-14T05:59:21.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:21.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.707355+0000", 2024-09-14T05:59:21.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055291200000000002 2024-09-14T05:59:21.709 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:21.709 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:21.709 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:21.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.710 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4391.0:8451 3.14 e35/24 ondisk, result = 0)", 2024-09-14T05:59:21.710 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:21.707240+0000", 2024-09-14T05:59:21.710 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6848000000000003e-05, 2024-09-14T05:59:21.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000239779, 2024-09-14T05:59:21.710 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:21.710 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:21.710 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:21.710 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:21.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:21.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.707240+0000", 2024-09-14T05:59:21.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:21.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:21.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.707240+0000", 2024-09-14T05:59:21.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:21.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:21.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.707240+0000", 2024-09-14T05:59:21.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1800000000000005e-07 2024-09-14T05:59:21.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:21.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.707244+0000", 2024-09-14T05:59:21.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.41e-06 2024-09-14T05:59:21.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:21.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.707254+0000", 2024-09-14T05:59:21.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0373999999999999e-05 2024-09-14T05:59:21.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:21.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.707259+0000", 2024-09-14T05:59:21.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.181e-06 2024-09-14T05:59:21.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:21.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.707335+0000", 2024-09-14T05:59:21.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5401000000000005e-05 2024-09-14T05:59:21.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:21.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:21.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:21.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:21.707347+0000", 2024-09-14T05:59:21.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.224e-05 2024-09-14T05:59:21.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:21.713 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:21.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:21.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:21.713 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-09-14T05:59:21.713 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 2 2024-09-14T05:59:21.713 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:21.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:59:21.748 INFO:teuthology.orchestra.run.smithi006.stdout:flattening image image_client.0-clone4 2024-09-14T05:59:21.764 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:21.761+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:21.865 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:21.861+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:21.892 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:21.892 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:21.892 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:21.892 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:21.892 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:21.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f /var/log/ceph/exp.3.18.0 2024-09-14T05:59:21.907 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:59:21.930 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-14T05:59:21.987 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:21.985+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:22.035 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:22.035 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:22.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:22.035 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:22.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.035 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:303 3.3 3:c0f18601:::rbd_data.11275e589b0d.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:22.035 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:12.146341+0000", 2024-09-14T05:59:22.035 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.8890235220000005, 2024-09-14T05:59:22.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022824968000000001, 2024-09-14T05:59:22.035 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.035 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.035 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:22.036 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.036 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.036 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.036 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 303 2024-09-14T05:59:22.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.036 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146341+0000", 2024-09-14T05:59:22.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146341+0000", 2024-09-14T05:59:22.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146344+0000", 2024-09-14T05:59:22.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1100000000000001e-06 2024-09-14T05:59:22.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146358+0000", 2024-09-14T05:59:22.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3957e-05 2024-09-14T05:59:22.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146387+0000", 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9332999999999999e-05 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146402+0000", 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4789e-05 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146524+0000", 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012266600000000001 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146767+0000", 2024-09-14T05:59:22.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024287500000000001 2024-09-14T05:59:22.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:22.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.168912+0000", 2024-09-14T05:59:22.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022144635999999999 2024-09-14T05:59:22.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:22.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.169022+0000", 2024-09-14T05:59:22.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-14T05:59:22.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.169166+0000", 2024-09-14T05:59:22.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014476300000000001 2024-09-14T05:59:22.040 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.040 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.040 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.040 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5941 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 241664~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.040 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867454+0000", 2024-09-14T05:59:22.040 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1679111989999997, 2024-09-14T05:59:22.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012245608, 2024-09-14T05:59:22.041 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.041 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.041 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.041 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.041 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.041 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.041 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5941 2024-09-14T05:59:22.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.041 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867454+0000", 2024-09-14T05:59:22.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867454+0000", 2024-09-14T05:59:22.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867454+0000", 2024-09-14T05:59:22.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.32e-07 2024-09-14T05:59:22.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867456+0000", 2024-09-14T05:59:22.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0810000000000001e-06 2024-09-14T05:59:22.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867464+0000", 2024-09-14T05:59:22.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3669999999999999e-06 2024-09-14T05:59:22.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867476+0000", 2024-09-14T05:59:22.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2298e-05 2024-09-14T05:59:22.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879488+0000", 2024-09-14T05:59:22.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01201201 2024-09-14T05:59:22.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879570+0000", 2024-09-14T05:59:22.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2227999999999999e-05 2024-09-14T05:59:22.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879699+0000", 2024-09-14T05:59:22.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012919200000000001 2024-09-14T05:59:22.045 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.045 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.045 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.045 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5942 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 393216~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.045 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867486+0000", 2024-09-14T05:59:22.045 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.167879213, 2024-09-14T05:59:22.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012466517999999999, 2024-09-14T05:59:22.045 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.046 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.046 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.046 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.046 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.046 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.046 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5942 2024-09-14T05:59:22.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.046 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867486+0000", 2024-09-14T05:59:22.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867486+0000", 2024-09-14T05:59:22.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867486+0000", 2024-09-14T05:59:22.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4200000000000001e-07 2024-09-14T05:59:22.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867493+0000", 2024-09-14T05:59:22.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2080000000000003e-06 2024-09-14T05:59:22.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867500+0000", 2024-09-14T05:59:22.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7830000000000001e-06 2024-09-14T05:59:22.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867505+0000", 2024-09-14T05:59:22.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1410000000000004e-06 2024-09-14T05:59:22.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879743+0000", 2024-09-14T05:59:22.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01223773 2024-09-14T05:59:22.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879823+0000", 2024-09-14T05:59:22.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0284999999999994e-05 2024-09-14T05:59:22.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879952+0000", 2024-09-14T05:59:22.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012892900000000001 2024-09-14T05:59:22.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.050 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.050 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5943 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 544768~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.050 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867513+0000", 2024-09-14T05:59:22.050 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1678518709999999, 2024-09-14T05:59:22.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012654174000000001, 2024-09-14T05:59:22.050 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.050 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.050 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.050 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.051 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.051 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.051 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5943 2024-09-14T05:59:22.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.051 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867513+0000", 2024-09-14T05:59:22.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867513+0000", 2024-09-14T05:59:22.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867514+0000", 2024-09-14T05:59:22.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4299999999999998e-07 2024-09-14T05:59:22.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867521+0000", 2024-09-14T05:59:22.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8269999999999998e-06 2024-09-14T05:59:22.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867528+0000", 2024-09-14T05:59:22.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3470000000000004e-06 2024-09-14T05:59:22.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867533+0000", 2024-09-14T05:59:22.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-09-14T05:59:22.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879990+0000", 2024-09-14T05:59:22.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012457161 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880066+0000", 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5711999999999996e-05 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880167+0000", 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101486 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.054 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5944 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 700416~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.055 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867541+0000", 2024-09-14T05:59:22.055 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1678242760000002, 2024-09-14T05:59:22.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012957006, 2024-09-14T05:59:22.055 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.055 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.055 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.055 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.055 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.055 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.055 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5944 2024-09-14T05:59:22.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.055 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867541+0000", 2024-09-14T05:59:22.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867541+0000", 2024-09-14T05:59:22.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867541+0000", 2024-09-14T05:59:22.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4400000000000001e-07 2024-09-14T05:59:22.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867543+0000", 2024-09-14T05:59:22.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9910000000000001e-06 2024-09-14T05:59:22.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867549+0000", 2024-09-14T05:59:22.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2330000000000003e-06 2024-09-14T05:59:22.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867556+0000", 2024-09-14T05:59:22.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.302e-06 2024-09-14T05:59:22.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880227+0000", 2024-09-14T05:59:22.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012671392 2024-09-14T05:59:22.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880331+0000", 2024-09-14T05:59:22.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010417 2024-09-14T05:59:22.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880498+0000", 2024-09-14T05:59:22.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016647400000000001 2024-09-14T05:59:22.059 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.059 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.059 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.059 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5945 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.060 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867563+0000", 2024-09-14T05:59:22.060 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1678023580000003, 2024-09-14T05:59:22.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013088752, 2024-09-14T05:59:22.060 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.060 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.060 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.060 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.060 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.060 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.060 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5945 2024-09-14T05:59:22.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.060 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867563+0000", 2024-09-14T05:59:22.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867563+0000", 2024-09-14T05:59:22.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867563+0000", 2024-09-14T05:59:22.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0999999999999998e-07 2024-09-14T05:59:22.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867565+0000", 2024-09-14T05:59:22.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9570000000000001e-06 2024-09-14T05:59:22.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867572+0000", 2024-09-14T05:59:22.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2589999999999997e-06 2024-09-14T05:59:22.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867577+0000", 2024-09-14T05:59:22.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9509999999999997e-06 2024-09-14T05:59:22.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880539+0000", 2024-09-14T05:59:22.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012962840999999999 2024-09-14T05:59:22.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880584+0000", 2024-09-14T05:59:22.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4354000000000003e-05 2024-09-14T05:59:22.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880651+0000", 2024-09-14T05:59:22.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7680000000000003e-05 2024-09-14T05:59:22.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.064 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.064 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5946 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.064 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867586+0000", 2024-09-14T05:59:22.064 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1677787459999998, 2024-09-14T05:59:22.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013207419999999999, 2024-09-14T05:59:22.064 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.065 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.065 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.065 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5946 2024-09-14T05:59:22.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.065 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867586+0000", 2024-09-14T05:59:22.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867586+0000", 2024-09-14T05:59:22.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867587+0000", 2024-09-14T05:59:22.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6000000000000004e-07 2024-09-14T05:59:22.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867589+0000", 2024-09-14T05:59:22.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0470000000000001e-06 2024-09-14T05:59:22.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867595+0000", 2024-09-14T05:59:22.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1510000000000001e-06 2024-09-14T05:59:22.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867600+0000", 2024-09-14T05:59:22.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.741e-06 2024-09-14T05:59:22.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880678+0000", 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013078233 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880725+0000", 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6802999999999999e-05 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880794+0000", 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8885000000000002e-05 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.069 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5986 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 708608~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.069 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.869970+0000", 2024-09-14T05:59:22.069 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1653947010000003, 2024-09-14T05:59:22.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012341964, 2024-09-14T05:59:22.069 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.069 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.069 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.069 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.069 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.069 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.069 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5986 2024-09-14T05:59:22.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.070 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869970+0000", 2024-09-14T05:59:22.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869970+0000", 2024-09-14T05:59:22.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869971+0000", 2024-09-14T05:59:22.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6399999999999998e-07 2024-09-14T05:59:22.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869973+0000", 2024-09-14T05:59:22.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8509999999999999e-06 2024-09-14T05:59:22.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869982+0000", 2024-09-14T05:59:22.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-09-14T05:59:22.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869987+0000", 2024-09-14T05:59:22.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3369999999999999e-06 2024-09-14T05:59:22.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882036+0000", 2024-09-14T05:59:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012049150999999999 2024-09-14T05:59:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882154+0000", 2024-09-14T05:59:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011795599999999999 2024-09-14T05:59:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882312+0000", 2024-09-14T05:59:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000157944 2024-09-14T05:59:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5987 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 864256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.869995+0000", 2024-09-14T05:59:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1653699050000004, 2024-09-14T05:59:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012559504000000001, 2024-09-14T05:59:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5987 2024-09-14T05:59:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869995+0000", 2024-09-14T05:59:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869995+0000", 2024-09-14T05:59:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869995+0000", 2024-09-14T05:59:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T05:59:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869997+0000", 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0040000000000002e-06 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870004+0000", 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6959999999999999e-06 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870015+0000", 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1021e-05 2024-09-14T05:59:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882354+0000", 2024-09-14T05:59:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012338948000000001 2024-09-14T05:59:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882441+0000", 2024-09-14T05:59:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6877000000000002e-05 2024-09-14T05:59:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882555+0000", 2024-09-14T05:59:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011357 2024-09-14T05:59:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5988 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 1015808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870023+0000", 2024-09-14T05:59:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1653420109999999, 2024-09-14T05:59:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012808669, 2024-09-14T05:59:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5988 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870023+0000", 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870023+0000", 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870023+0000", 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2e-07 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870026+0000", 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6139999999999999e-06 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870034+0000", 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9710000000000004e-06 2024-09-14T05:59:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870039+0000", 2024-09-14T05:59:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4700000000000001e-06 2024-09-14T05:59:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882603+0000", 2024-09-14T05:59:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012563138999999999 2024-09-14T05:59:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882697+0000", 2024-09-14T05:59:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4158000000000002e-05 2024-09-14T05:59:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882832+0000", 2024-09-14T05:59:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013489700000000001 2024-09-14T05:59:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6024 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 110592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870236+0000", 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1651285720000004, 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01286999, 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6024 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870236+0000", 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870236+0000", 2024-09-14T05:59:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870237+0000", 2024-09-14T05:59:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.65e-07 2024-09-14T05:59:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870239+0000", 2024-09-14T05:59:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T05:59:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870245+0000", 2024-09-14T05:59:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3010000000000003e-06 2024-09-14T05:59:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870256+0000", 2024-09-14T05:59:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1267000000000001e-05 2024-09-14T05:59:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882882+0000", 2024-09-14T05:59:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012625994999999999 2024-09-14T05:59:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882966+0000", 2024-09-14T05:59:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4007999999999999e-05 2024-09-14T05:59:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883106+0000", 2024-09-14T05:59:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014023400000000001 2024-09-14T05:59:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6025 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 262144~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870265+0000", 2024-09-14T05:59:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1651003109999998, 2024-09-14T05:59:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013131543000000001, 2024-09-14T05:59:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6025 2024-09-14T05:59:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870265+0000", 2024-09-14T05:59:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870265+0000", 2024-09-14T05:59:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870265+0000", 2024-09-14T05:59:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7999999999999995e-07 2024-09-14T05:59:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870268+0000", 2024-09-14T05:59:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.587e-06 2024-09-14T05:59:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870274+0000", 2024-09-14T05:59:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5100000000000004e-06 2024-09-14T05:59:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870286+0000", 2024-09-14T05:59:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1184e-05 2024-09-14T05:59:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883151+0000", 2024-09-14T05:59:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012865829000000001 2024-09-14T05:59:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883253+0000", 2024-09-14T05:59:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101326 2024-09-14T05:59:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883396+0000", 2024-09-14T05:59:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014342700000000001 2024-09-14T05:59:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6026 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 413696~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870294+0000", 2024-09-14T05:59:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1650706160000004, 2024-09-14T05:59:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013341486, 2024-09-14T05:59:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6026 2024-09-14T05:59:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870294+0000", 2024-09-14T05:59:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870294+0000", 2024-09-14T05:59:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870295+0000", 2024-09-14T05:59:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5300000000000004e-07 2024-09-14T05:59:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870297+0000", 2024-09-14T05:59:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4710000000000001e-06 2024-09-14T05:59:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870304+0000", 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7750000000000004e-06 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870309+0000", 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1109999999999999e-06 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883451+0000", 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013142167 2024-09-14T05:59:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883541+0000", 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9672000000000005e-05 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883636+0000", 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4736999999999998e-05 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6027 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 569344~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870317+0000", 2024-09-14T05:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1650478299999998, 2024-09-14T05:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013635599, 2024-09-14T05:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6027 2024-09-14T05:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870317+0000", 2024-09-14T05:59:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870317+0000", 2024-09-14T05:59:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870318+0000", 2024-09-14T05:59:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4700000000000002e-07 2024-09-14T05:59:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870320+0000", 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2790000000000001e-06 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870327+0000", 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4460000000000004e-06 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870332+0000", 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0289999999999996e-06 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883677+0000", 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013344765 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883794+0000", 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116668 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883953+0000", 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015896500000000001 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6028 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 720896~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870340+0000", 2024-09-14T05:59:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1650252109999997, 2024-09-14T05:59:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013748082999999999, 2024-09-14T05:59:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6028 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870340+0000", 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870340+0000", 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870340+0000", 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4499999999999997e-07 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870342+0000", 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.244e-06 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870349+0000", 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5640000000000002e-06 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870354+0000", 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3029999999999999e-06 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883970+0000", 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013615304 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884014+0000", 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3912000000000002e-05 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884088+0000", 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4311000000000001e-05 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6029 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 872448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870386+0000", 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1649786620000002, 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013989418999999999, 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6029 2024-09-14T05:59:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870386+0000", 2024-09-14T05:59:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870386+0000", 2024-09-14T05:59:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870387+0000", 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4400000000000001e-07 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870389+0000", 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3649999999999998e-06 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870403+0000", 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3603e-05 2024-09-14T05:59:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870409+0000", 2024-09-14T05:59:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.767e-06 2024-09-14T05:59:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884135+0000", 2024-09-14T05:59:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01372603 2024-09-14T05:59:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884239+0000", 2024-09-14T05:59:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104141 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884376+0000", 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000137069 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6030 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 1028096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870419+0000", 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1649463899999999, 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014083284, 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6030 2024-09-14T05:59:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870419+0000", 2024-09-14T05:59:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870419+0000", 2024-09-14T05:59:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870419+0000", 2024-09-14T05:59:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3000000000000001e-07 2024-09-14T05:59:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870422+0000", 2024-09-14T05:59:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4219999999999999e-06 2024-09-14T05:59:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870435+0000", 2024-09-14T05:59:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3729e-05 2024-09-14T05:59:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870441+0000", 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3900000000000001e-06 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884391+0000", 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013950786999999999 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884433+0000", 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1559e-05 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884502+0000", 2024-09-14T05:59:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8867000000000003e-05 2024-09-14T05:59:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:8133 3.3 3:c6f36cf7:::rbd_data.112766adc194.0000000000000003:6 [sparse-read 4718592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T05:59:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:20.977211+0000", 2024-09-14T05:59:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0581540899999999, 2024-09-14T05:59:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012271931999999999, 2024-09-14T05:59:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 8133 2024-09-14T05:59:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977211+0000", 2024-09-14T05:59:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977211+0000", 2024-09-14T05:59:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977212+0000", 2024-09-14T05:59:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.327e-06 2024-09-14T05:59:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977246+0000", 2024-09-14T05:59:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4173e-05 2024-09-14T05:59:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977266+0000", 2024-09-14T05:59:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0023000000000001e-05 2024-09-14T05:59:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977281+0000", 2024-09-14T05:59:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4589999999999999e-05 2024-09-14T05:59:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.988770+0000", 2024-09-14T05:59:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011489291 2024-09-14T05:59:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.989045+0000", 2024-09-14T05:59:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000274672 2024-09-14T05:59:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.989483+0000", 2024-09-14T05:59:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00043785599999999998 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:8144 3.3 3:c6f36cf7:::rbd_data.112766adc194.0000000000000003:6 [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:20.977303+0000", 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.058062184, 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012937881, 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 8144 2024-09-14T05:59:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977303+0000", 2024-09-14T05:59:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977303+0000", 2024-09-14T05:59:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977304+0000", 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.42e-06 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977310+0000", 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0399999999999998e-06 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977328+0000", 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7895999999999999e-05 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977342+0000", 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3859999999999999e-05 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.989580+0000", 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01223773 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.989835+0000", 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025570399999999999 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.990241+0000", 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00040523099999999998 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:8145 3.3 3:c6f36cf7:::rbd_data.112766adc194.0000000000000003:6 [sparse-read 4849664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:20.977445+0000", 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0579196719999999, 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013340134999999999, 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 8145 2024-09-14T05:59:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977445+0000", 2024-09-14T05:59:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977445+0000", 2024-09-14T05:59:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977447+0000", 2024-09-14T05:59:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0030000000000001e-06 2024-09-14T05:59:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977452+0000", 2024-09-14T05:59:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9570000000000001e-06 2024-09-14T05:59:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977471+0000", 2024-09-14T05:59:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9017000000000001e-05 2024-09-14T05:59:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977487+0000", 2024-09-14T05:59:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5376e-05 2024-09-14T05:59:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.990331+0000", 2024-09-14T05:59:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012844288000000001 2024-09-14T05:59:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.990477+0000", 2024-09-14T05:59:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014558600000000001 2024-09-14T05:59:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.990785+0000", 2024-09-14T05:59:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030890799999999999 2024-09-14T05:59:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.134 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:22.135 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:59:22.136 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:22.133+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:22.235 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:22.235+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:22.265 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:22.265 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:22.265 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:22.266 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:22.279 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:59:22.314 INFO:teuthology.orchestra.run.smithi006.stdout:786 punch from 0x1022d33 to 0x1023a3f, (0xd0c bytes) 2024-09-14T05:59:22.328 INFO:teuthology.orchestra.run.smithi006.stdout:787 write 0x6fa6921 thru 0x6fa8d89 (0x2469 bytes) 2024-09-14T05:59:22.333 INFO:teuthology.orchestra.run.smithi006.stdout:789 read 0x23d27ef thru 0x23e0226 (0xda38 bytes) 2024-09-14T05:59:22.349 INFO:teuthology.orchestra.run.smithi006.stdout:793 write 0xa17ae22 thru 0xa186b3a (0xbd19 bytes) 2024-09-14T05:59:22.354 INFO:teuthology.orchestra.run.smithi006.stdout:794 write 0x197dae8 thru 0x19830b2 (0x55cb bytes) 2024-09-14T05:59:22.361 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:22.371 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:22.371+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:22.375 INFO:teuthology.orchestra.run.smithi006.stdout:798 write 0xc522e8f thru 0xc52f144 (0xc2b6 bytes) 2024-09-14T05:59:22.394 INFO:teuthology.orchestra.run.smithi006.stdout:799 write 0xdc673c9 thru 0xdc6fc98 (0x88d0 bytes) 2024-09-14T05:59:22.413 INFO:teuthology.orchestra.run.smithi006.stdout:800 read 0x95cb7ee thru 0x95cb9ce (0x1e1 bytes) 2024-09-14T05:59:22.413 INFO:teuthology.orchestra.run.smithi006.stdout:801 punch from 0xa86c297 to 0xa8733c7, (0x7130 bytes) 2024-09-14T05:59:22.413 INFO:teuthology.orchestra.run.smithi006.stdout:802 read 0x677cb01 thru 0x6781fbe (0x54be bytes) 2024-09-14T05:59:22.414 INFO:teuthology.orchestra.run.smithi006.stdout:804 write 0x2318edf thru 0x2323fd8 (0xb0fa bytes) 2024-09-14T05:59:22.421 INFO:teuthology.orchestra.run.smithi006.stdout:805 write 0x709448f thru 0x709b65b (0x71cd bytes) 2024-09-14T05:59:22.429 INFO:teuthology.orchestra.run.smithi006.stdout:806 write 0x64d0ebe thru 0x64d4e96 (0x3fd9 bytes) 2024-09-14T05:59:22.432 INFO:teuthology.orchestra.run.smithi006.stdout:808 write 0x574e4f4 thru 0x575d3b7 (0xeec4 bytes) 2024-09-14T05:59:22.438 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:22.435+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:22.440 INFO:teuthology.orchestra.run.smithi006.stdout:809 read 0x7fdd7fe thru 0x7fe3dd8 (0x65db bytes) 2024-09-14T05:59:22.441 INFO:teuthology.orchestra.run.smithi006.stdout:810 read 0x490b54 thru 0x49fcbc (0xf169 bytes) 2024-09-14T05:59:22.442 INFO:teuthology.orchestra.run.smithi006.stdout:812 punch from 0x1b3b8e9 to 0x1b3c2b4, (0x9cb bytes) 2024-09-14T05:59:22.442 INFO:teuthology.orchestra.run.smithi006.stdout:813 punch from 0xc1b6e1b to 0xc1b927f, (0x2464 bytes) 2024-09-14T05:59:22.455 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:22.455 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:22.455 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:22.456 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:22.456 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:22.457 INFO:teuthology.orchestra.run.smithi006.stdout:814 writesame 0xe3db92e thru 0xe3df619 data_size 0xe(0x3cec bytes) 2024-09-14T05:59:22.460 INFO:teuthology.orchestra.run.smithi006.stdout:815 write 0x4e4f178 thru 0x4e5ee08 (0xfc91 bytes) 2024-09-14T05:59:22.467 INFO:teuthology.orchestra.run.smithi006.stdout:816 write 0x8901085 thru 0x890fe30 (0xedac bytes) 2024-09-14T05:59:22.471 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:59:22.475 INFO:teuthology.orchestra.run.smithi006.stdout:817 read 0x3821973 thru 0x382b2a0 (0x992e bytes) 2024-09-14T05:59:22.475 INFO:teuthology.orchestra.run.smithi006.stdout:818 read 0x767358 thru 0x76fd66 (0x8a0f bytes) 2024-09-14T05:59:22.491 INFO:teuthology.orchestra.run.smithi006.stdout:819 write 0xea8b82a thru 0xea8ffee (0x47c5 bytes) 2024-09-14T05:59:22.494 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:22.494 INFO:teuthology.orchestra.run.smithi006.stdout:822 write 0xd93094b thru 0xd93927a (0x8930 bytes) 2024-09-14T05:59:22.497 INFO:teuthology.orchestra.run.smithi006.stdout:823 write 0xb98c1f3 thru 0xb98cebb (0xcc9 bytes) 2024-09-14T05:59:22.502 INFO:teuthology.orchestra.run.smithi006.stdout:824 punch from 0x4fd277e to 0x4fd2cbf, (0x541 bytes) 2024-09-14T05:59:22.502 INFO:teuthology.orchestra.run.smithi006.stdout:826 read 0x6b48d6e thru 0x6b52099 (0x932c bytes) 2024-09-14T05:59:22.504 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:22.504 INFO:teuthology.orchestra.run.smithi006.stdout:832 write 0xdaf58cb thru 0xdb050b5 (0xf7eb bytes) 2024-09-14T05:59:22.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-14T05:59:22.545 INFO:teuthology.orchestra.run.smithi006.stdout:833 trunc from 0xea8ffef to 0x78157e 2024-09-14T05:59:22.563 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:22.563+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:22.626 INFO:teuthology.orchestra.run.smithi006.stdout:834 write 0xc3765d3 thru 0xc3852c2 (0xecf0 bytes) 2024-09-14T05:59:22.632 INFO:teuthology.orchestra.run.smithi006.stdout:835 write 0x118ccde thru 0x118f4fb (0x281e bytes) 2024-09-14T05:59:22.638 INFO:teuthology.orchestra.run.smithi006.stdout:837 trunc from 0xc3852c3 to 0xc580df7 2024-09-14T05:59:22.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:59:22.639 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:22.637+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:22.651 INFO:teuthology.orchestra.run.smithi006.stdout:840 writesame 0x10a3661 thru 0x10a9648 data_size 0x16(0x5fe8 bytes) 2024-09-14T05:59:22.658 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4224 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 229376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.759977+0000", 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.899070772, 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.026699262000000001, 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4224 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.759977+0000", 2024-09-14T05:59:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.759977+0000", 2024-09-14T05:59:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.759978+0000", 2024-09-14T05:59:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.133e-06 2024-09-14T05:59:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.759983+0000", 2024-09-14T05:59:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9359999999999998e-06 2024-09-14T05:59:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760000+0000", 2024-09-14T05:59:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7124000000000001e-05 2024-09-14T05:59:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760013+0000", 2024-09-14T05:59:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.361e-05 2024-09-14T05:59:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786376+0000", 2024-09-14T05:59:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.026363055999999999 2024-09-14T05:59:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786458+0000", 2024-09-14T05:59:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1427999999999994e-05 2024-09-14T05:59:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786676+0000", 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000217975 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4225 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 380928~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760032+0000", 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8990156760000003, 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027212358999999998, 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4225 2024-09-14T05:59:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760032+0000", 2024-09-14T05:59:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760032+0000", 2024-09-14T05:59:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760033+0000", 2024-09-14T05:59:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.217e-06 2024-09-14T05:59:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760038+0000", 2024-09-14T05:59:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1100000000000002e-06 2024-09-14T05:59:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760056+0000", 2024-09-14T05:59:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7595999999999999e-05 2024-09-14T05:59:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760069+0000", 2024-09-14T05:59:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.293e-05 2024-09-14T05:59:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786745+0000", 2024-09-14T05:59:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.026676294999999999 2024-09-14T05:59:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786878+0000", 2024-09-14T05:59:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013333299999999999 2024-09-14T05:59:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787244+0000", 2024-09-14T05:59:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036587799999999998 2024-09-14T05:59:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4226 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 532480~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760098+0000", 2024-09-14T05:59:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8989494000000002, 2024-09-14T05:59:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027297739000000001, 2024-09-14T05:59:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4226 2024-09-14T05:59:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760098+0000", 2024-09-14T05:59:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760098+0000", 2024-09-14T05:59:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760099+0000", 2024-09-14T05:59:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T05:59:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760105+0000", 2024-09-14T05:59:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3900000000000001e-06 2024-09-14T05:59:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760123+0000", 2024-09-14T05:59:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7853e-05 2024-09-14T05:59:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760136+0000", 2024-09-14T05:59:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3293e-05 2024-09-14T05:59:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787278+0000", 2024-09-14T05:59:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027142287000000001 2024-09-14T05:59:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787325+0000", 2024-09-14T05:59:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6663999999999999e-05 2024-09-14T05:59:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787396+0000", 2024-09-14T05:59:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0945000000000006e-05 2024-09-14T05:59:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4227 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 688128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760155+0000", 2024-09-14T05:59:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8988928139999999, 2024-09-14T05:59:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027419176, 2024-09-14T05:59:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4227 2024-09-14T05:59:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760155+0000", 2024-09-14T05:59:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760155+0000", 2024-09-14T05:59:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760156+0000", 2024-09-14T05:59:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0640000000000001e-06 2024-09-14T05:59:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760161+0000", 2024-09-14T05:59:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259999999999998e-06 2024-09-14T05:59:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760178+0000", 2024-09-14T05:59:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7577000000000001e-05 2024-09-14T05:59:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760191+0000", 2024-09-14T05:59:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2666999999999999e-05 2024-09-14T05:59:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787444+0000", 2024-09-14T05:59:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027253042000000002 2024-09-14T05:59:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787493+0000", 2024-09-14T05:59:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8942e-05 2024-09-14T05:59:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787574+0000", 2024-09-14T05:59:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0858000000000004e-05 2024-09-14T05:59:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4228 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 839680~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760209+0000", 2024-09-14T05:59:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8988388199999999, 2024-09-14T05:59:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027666842000000001, 2024-09-14T05:59:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4228 2024-09-14T05:59:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760209+0000", 2024-09-14T05:59:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760209+0000", 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760210+0000", 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1090000000000001e-06 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760215+0000", 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8840000000000002e-06 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760232+0000", 2024-09-14T05:59:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7088999999999999e-05 2024-09-14T05:59:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760278+0000", 2024-09-14T05:59:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6853e-05 2024-09-14T05:59:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787640+0000", 2024-09-14T05:59:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027361143000000001 2024-09-14T05:59:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787757+0000", 2024-09-14T05:59:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117501 2024-09-14T05:59:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787875+0000", 2024-09-14T05:59:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118263 2024-09-14T05:59:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4229 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 991232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760299+0000", 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.898748565, 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027803151000000002, 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4229 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760299+0000", 2024-09-14T05:59:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760299+0000", 2024-09-14T05:59:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760300+0000", 2024-09-14T05:59:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4899999999999999e-06 2024-09-14T05:59:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760305+0000", 2024-09-14T05:59:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1769999999999997e-06 2024-09-14T05:59:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760325+0000", 2024-09-14T05:59:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9616999999999999e-05 2024-09-14T05:59:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760338+0000", 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2903e-05 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787925+0000", 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027586658 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.788008+0000", 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3796999999999997e-05 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.788102+0000", 2024-09-14T05:59:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3509000000000002e-05 2024-09-14T05:59:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4271 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 86016~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760417+0000", 2024-09-14T05:59:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8986304020000002, 2024-09-14T05:59:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030270609, 2024-09-14T05:59:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4271 2024-09-14T05:59:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760417+0000", 2024-09-14T05:59:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760417+0000", 2024-09-14T05:59:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760418+0000", 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1230000000000001e-06 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760436+0000", 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.825e-05 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760454+0000", 2024-09-14T05:59:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7759999999999999e-05 2024-09-14T05:59:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760468+0000", 2024-09-14T05:59:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3783e-05 2024-09-14T05:59:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.788193+0000", 2024-09-14T05:59:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027725428999999999 2024-09-14T05:59:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.788792+0000", 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059851200000000005 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.790688+0000", 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0018957519999999999 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4272 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 237568~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760488+0000", 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8985590730000004, 2024-09-14T05:59:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030663546999999999, 2024-09-14T05:59:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4272 2024-09-14T05:59:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760488+0000", 2024-09-14T05:59:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760488+0000", 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760489+0000", 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1400000000000001e-06 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760495+0000", 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.13e-06 2024-09-14T05:59:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760512+0000", 2024-09-14T05:59:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7056000000000001e-05 2024-09-14T05:59:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760524+0000", 2024-09-14T05:59:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2683999999999999e-05 2024-09-14T05:59:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.790738+0000", 2024-09-14T05:59:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030213509 2024-09-14T05:59:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.790836+0000", 2024-09-14T05:59:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8252999999999996e-05 2024-09-14T05:59:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791152+0000", 2024-09-14T05:59:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031577500000000002 2024-09-14T05:59:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4273 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 393216~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760542+0000", 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8985053470000004, 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031086694000000002, 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4273 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760542+0000", 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760542+0000", 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760543+0000", 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2300000000000001e-06 2024-09-14T05:59:22.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760548+0000", 2024-09-14T05:59:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0039999999999999e-06 2024-09-14T05:59:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760565+0000", 2024-09-14T05:59:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7045999999999999e-05 2024-09-14T05:59:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760578+0000", 2024-09-14T05:59:22.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.276e-05 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791207+0000", 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030628566999999999 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791302+0000", 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5870000000000002e-05 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791629+0000", 2024-09-14T05:59:22.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032621700000000001 2024-09-14T05:59:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4274 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 544768~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760596+0000", 2024-09-14T05:59:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8984515829999999, 2024-09-14T05:59:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031394564999999999, 2024-09-14T05:59:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4274 2024-09-14T05:59:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760596+0000", 2024-09-14T05:59:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760596+0000", 2024-09-14T05:59:22.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760597+0000", 2024-09-14T05:59:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:59:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760602+0000", 2024-09-14T05:59:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9760000000000003e-06 2024-09-14T05:59:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760619+0000", 2024-09-14T05:59:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7430000000000001e-05 2024-09-14T05:59:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760632+0000", 2024-09-14T05:59:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2856e-05 2024-09-14T05:59:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791696+0000", 2024-09-14T05:59:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031063666 2024-09-14T05:59:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791810+0000", 2024-09-14T05:59:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011434699999999999 2024-09-14T05:59:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791990+0000", 2024-09-14T05:59:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018011000000000001 2024-09-14T05:59:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4275 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 696320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760650+0000", 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8983975940000004, 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031562075000000002, 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4275 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760650+0000", 2024-09-14T05:59:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760650+0000", 2024-09-14T05:59:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760651+0000", 2024-09-14T05:59:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7000000000000003e-07 2024-09-14T05:59:22.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760656+0000", 2024-09-14T05:59:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9629999999999997e-06 2024-09-14T05:59:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760672+0000", 2024-09-14T05:59:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6787e-05 2024-09-14T05:59:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760685+0000", 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2706e-05 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792041+0000", 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031355782999999998 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792123+0000", 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2142000000000001e-05 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792212+0000", 2024-09-14T05:59:22.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8724e-05 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4276 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 851968~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760703+0000", 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8983447509999998, 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031786208000000003, 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4276 2024-09-14T05:59:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760703+0000", 2024-09-14T05:59:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760703+0000", 2024-09-14T05:59:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760704+0000", 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.17e-06 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760723+0000", 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8940000000000002e-05 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760741+0000", 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7932999999999999e-05 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760758+0000", 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7560000000000001e-05 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792269+0000", 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031510479000000001 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792375+0000", 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010609500000000001 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792489+0000", 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011403100000000001 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4277 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 1003520~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760829+0000", 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8982186590000003, 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031877567000000002, 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.712 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4277 2024-09-14T05:59:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760829+0000", 2024-09-14T05:59:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760829+0000", 2024-09-14T05:59:22.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760830+0000", 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6840000000000001e-06 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760849+0000", 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8542999999999998e-05 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760869+0000", 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.967e-05 2024-09-14T05:59:22.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760900+0000", 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1572999999999997e-05 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792541+0000", 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031640692999999998 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792605+0000", 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4339999999999997e-05 2024-09-14T05:59:22.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792706+0000", 2024-09-14T05:59:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010106399999999999 2024-09-14T05:59:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4319 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 98304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760993+0000", 2024-09-14T05:59:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8980542329999999, 2024-09-14T05:59:22.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032127042000000001, 2024-09-14T05:59:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4319 2024-09-14T05:59:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760993+0000", 2024-09-14T05:59:22.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760993+0000", 2024-09-14T05:59:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760994+0000", 2024-09-14T05:59:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.133e-06 2024-09-14T05:59:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761001+0000", 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4269999999999996e-06 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761018+0000", 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7640000000000001e-05 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761032+0000", 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3399e-05 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792742+0000", 2024-09-14T05:59:22.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031710473000000003 2024-09-14T05:59:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792835+0000", 2024-09-14T05:59:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3105999999999999e-05 2024-09-14T05:59:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793120+0000", 2024-09-14T05:59:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028486400000000002 2024-09-14T05:59:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.720 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4320 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 249856~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761051+0000", 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8979963069999997, 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032569796999999998, 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4320 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.721 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761051+0000", 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761051+0000", 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761052+0000", 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.133e-06 2024-09-14T05:59:22.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761057+0000", 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.797e-06 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761073+0000", 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6160000000000001e-05 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761086+0000", 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-09-14T05:59:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793160+0000", 2024-09-14T05:59:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032073664000000002 2024-09-14T05:59:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793249+0000", 2024-09-14T05:59:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9473000000000002e-05 2024-09-14T05:59:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793621+0000", 2024-09-14T05:59:22.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037151399999999998 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4321 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 401408~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761106+0000", 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8979414410000004, 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032930359999999999, 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.725 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4321 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761106+0000", 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761106+0000", 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761107+0000", 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.037e-06 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761112+0000", 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9130000000000002e-06 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761129+0000", 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7144000000000001e-05 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761142+0000", 2024-09-14T05:59:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2926e-05 2024-09-14T05:59:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793654+0000", 2024-09-14T05:59:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032512438999999997 2024-09-14T05:59:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793765+0000", 2024-09-14T05:59:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111042 2024-09-14T05:59:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794036+0000", 2024-09-14T05:59:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027085899999999998 2024-09-14T05:59:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4322 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 557056~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761160+0000", 2024-09-14T05:59:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8978874550000002, 2024-09-14T05:59:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033073877000000002, 2024-09-14T05:59:22.729 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4322 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761160+0000", 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761160+0000", 2024-09-14T05:59:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761161+0000", 2024-09-14T05:59:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0499999999999999e-06 2024-09-14T05:59:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761181+0000", 2024-09-14T05:59:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0353e-05 2024-09-14T05:59:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761200+0000", 2024-09-14T05:59:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-09-14T05:59:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761213+0000", 2024-09-14T05:59:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2979999999999999e-05 2024-09-14T05:59:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794092+0000", 2024-09-14T05:59:22.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032878978000000003 2024-09-14T05:59:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794158+0000", 2024-09-14T05:59:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6026999999999997e-05 2024-09-14T05:59:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794234+0000", 2024-09-14T05:59:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5389000000000006e-05 2024-09-14T05:59:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.733 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.734 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4323 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 708608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.734 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761233+0000", 2024-09-14T05:59:22.734 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8978147849999996, 2024-09-14T05:59:22.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033143201999999997, 2024-09-14T05:59:22.734 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.734 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.734 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.734 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.734 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.734 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.734 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4323 2024-09-14T05:59:22.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761233+0000", 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761233+0000", 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761234+0000", 2024-09-14T05:59:22.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.13e-06 2024-09-14T05:59:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761239+0000", 2024-09-14T05:59:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9869999999999999e-06 2024-09-14T05:59:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761255+0000", 2024-09-14T05:59:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6492999999999999e-05 2024-09-14T05:59:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761268+0000", 2024-09-14T05:59:22.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2796000000000001e-05 2024-09-14T05:59:22.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794276+0000", 2024-09-14T05:59:22.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033008505 2024-09-14T05:59:22.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794322+0000", 2024-09-14T05:59:22.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5852000000000001e-05 2024-09-14T05:59:22.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794376+0000", 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3439000000000001e-05 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4324 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 860160~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761286+0000", 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.897761042, 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033242971000000003, 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.738 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4324 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761286+0000", 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761286+0000", 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761287+0000", 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.133e-06 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761292+0000", 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7369999999999997e-06 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761309+0000", 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7218999999999999e-05 2024-09-14T05:59:22.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761322+0000", 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.278e-05 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794409+0000", 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033087111000000002 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794454+0000", 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4814000000000002e-05 2024-09-14T05:59:22.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794529+0000", 2024-09-14T05:59:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5177000000000002e-05 2024-09-14T05:59:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4325 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 1015808~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761339+0000", 2024-09-14T05:59:22.742 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8977080229999999, 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033372190000000003, 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4325 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761339+0000", 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:22.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761339+0000", 2024-09-14T05:59:22.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:22.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:22.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761340+0000", 2024-09-14T05:59:22.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9000000000000005e-07 2024-09-14T05:59:22.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:22.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761345+0000", 2024-09-14T05:59:22.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2370000000000003e-06 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761362+0000", 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7842999999999998e-05 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761375+0000", 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2864000000000001e-05 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794569+0000", 2024-09-14T05:59:22.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033193328000000001 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794641+0000", 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2071999999999997e-05 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794712+0000", 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0856000000000001e-05 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:22.748 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T05:59:22.749 INFO:teuthology.orchestra.run.smithi006.stdout:841 trunc from 0xc580df7 to 0x36f83c0 2024-09-14T05:59:22.749 INFO:teuthology.orchestra.run.smithi006.stdout:842 write 0x15bb98 thru 0x166fb4 (0xb41d bytes) 2024-09-14T05:59:22.749 INFO:teuthology.orchestra.run.smithi006.stdout:844 writesame 0x9a8f189 thru 0x9a9c243 data_size 0x1(0xd0bb bytes) 2024-09-14T05:59:22.749 INFO:teuthology.orchestra.run.smithi006.stdout:845 write 0x440b752 thru 0x4417f04 (0xc7b3 bytes) 2024-09-14T05:59:22.750 INFO:teuthology.orchestra.run.smithi006.stdout:846 write 0x20ff3c9 thru 0x2109640 (0xa278 bytes) 2024-09-14T05:59:22.750 INFO:teuthology.orchestra.run.smithi006.stdout:847 punch from 0x288ce76 to 0x2890d71, (0x3efb bytes) 2024-09-14T05:59:22.750 INFO:teuthology.orchestra.run.smithi006.stdout:849 read 0x3249524 thru 0x32588fe (0xf3db bytes) 2024-09-14T05:59:22.750 INFO:teuthology.orchestra.run.smithi006.stdout:850 writesame 0x25eae30 thru 0x25f3a73 data_size 0x5e(0x8c44 bytes) 2024-09-14T05:59:22.750 INFO:teuthology.orchestra.run.smithi006.stdout:854 trunc from 0x9a9c244 to 0xd11151a 2024-09-14T05:59:22.750 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:22.750 INFO:teuthology.orchestra.run.smithi006.stdout:857 write 0x238a25f thru 0x23945f0 (0xa392 bytes) 2024-09-14T05:59:22.750 INFO:teuthology.orchestra.run.smithi006.stdout:858 punch from 0x793d1c2 to 0x793d915, (0x753 bytes) 2024-09-14T05:59:22.750 INFO:teuthology.orchestra.run.smithi006.stdout:859 write 0x6980564 thru 0x6984178 (0x3c15 bytes) 2024-09-14T05:59:22.750 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:22.745+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:22.753 INFO:teuthology.orchestra.run.smithi006.stdout:864 write 0xc856f66 thru 0xc863a35 (0xcad0 bytes) 2024-09-14T05:59:22.761 INFO:teuthology.orchestra.run.smithi006.stdout:865 write 0x3e1b45e thru 0x3e1fe40 (0x49e3 bytes) 2024-09-14T05:59:22.768 INFO:teuthology.orchestra.run.smithi006.stdout:866 write 0x61027 thru 0x663eb (0x53c5 bytes) 2024-09-14T05:59:22.772 INFO:teuthology.orchestra.run.smithi006.stdout:867 write 0xb4ac3a thru 0xb551e4 (0xa5ab bytes) 2024-09-14T05:59:22.775 INFO:teuthology.orchestra.run.smithi006.stdout:868 writesame 0xd87c18 thru 0xd89e2e data_size 0x1(0x2217 bytes) 2024-09-14T05:59:22.788 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:22.788 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:22.788 INFO:teuthology.orchestra.run.smithi006.stdout:875 punch from 0x956e0b9 to 0x957be66, (0xddad bytes) 2024-09-14T05:59:22.788 INFO:teuthology.orchestra.run.smithi006.stdout:877 write 0x4ed577d thru 0x4ee3515 (0xdd99 bytes) 2024-09-14T05:59:22.790 INFO:teuthology.orchestra.run.smithi006.stdout:878 trunc from 0xd11151a to 0xd81ae50 2024-09-14T05:59:22.801 INFO:teuthology.orchestra.run.smithi006.stdout:879 write 0x2042e79 thru 0x2052695 (0xf81d bytes) 2024-09-14T05:59:22.806 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:59:22.809 INFO:teuthology.orchestra.run.smithi006.stdout:880 write 0xd90402b thru 0xd9052b2 (0x1288 bytes) 2024-09-14T05:59:22.811 INFO:teuthology.orchestra.run.smithi006.stdout:882 punch from 0x432e560 to 0x4339cb2, (0xb752 bytes) 2024-09-14T05:59:22.815 INFO:teuthology.orchestra.run.smithi006.stdout:883 trunc from 0xd9052b3 to 0xb022830 2024-09-14T05:59:22.827 INFO:teuthology.orchestra.run.smithi006.stdout:885 write 0xa03cdca thru 0xa04c7c4 (0xf9fb bytes) 2024-09-14T05:59:22.831 INFO:teuthology.orchestra.run.smithi006.stdout:886 write 0x4eb2ece thru 0x4eb6adb (0x3c0e bytes) 2024-09-14T05:59:22.832 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:22.832 INFO:teuthology.orchestra.run.smithi006.stdout:888 punch from 0x7233852 to 0x7243720, (0xfece bytes) 2024-09-14T05:59:22.832 INFO:teuthology.orchestra.run.smithi006.stdout:889 write 0x5ebf591 thru 0x5ecb015 (0xba85 bytes) 2024-09-14T05:59:22.836 INFO:teuthology.orchestra.run.smithi006.stdout:890 punch from 0x282e620 to 0x2831b9b, (0x357b bytes) 2024-09-14T05:59:22.836 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:22.836 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:22.845 INFO:teuthology.orchestra.run.smithi006.stdout:893 write 0xcf552ce thru 0xcf60298 (0xafcb bytes) 2024-09-14T05:59:22.848 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:22.845+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:22.850 INFO:teuthology.orchestra.run.smithi006.stdout:894 punch from 0x68ae1a1 to 0x68bbd2d, (0xdb8c bytes) 2024-09-14T05:59:22.850 INFO:teuthology.orchestra.run.smithi006.stdout:896 punch from 0x335bb4a to 0x335c00a, (0x4c0 bytes) 2024-09-14T05:59:22.850 INFO:teuthology.orchestra.run.smithi006.stdout:899 write 0x9689806 thru 0x96909b1 (0x71ac bytes) 2024-09-14T05:59:22.853 INFO:teuthology.orchestra.run.smithi006.stdout:900 writesame 0x9dc67cb thru 0x9dcba56 data_size 0x24(0x528c bytes) 2024-09-14T05:59:22.855 INFO:teuthology.orchestra.run.smithi006.stdout:901 writesame 0x4afbef7 thru 0x4afebec data_size 0x5(0x2cf6 bytes) 2024-09-14T05:59:22.864 INFO:teuthology.orchestra.run.smithi006.stdout:902 writesame 0xd2d08ee thru 0xd2dc8e9 data_size 0x4(0xbffc bytes) 2024-09-14T05:59:22.865 INFO:teuthology.orchestra.run.smithi006.stdout:904 read 0x4bf4eff thru 0x4bf5111 (0x213 bytes) 2024-09-14T05:59:22.866 INFO:teuthology.orchestra.run.smithi006.stdout:905 read 0xb15bb78 thru 0xb166905 (0xad8e bytes) 2024-09-14T05:59:22.866 INFO:teuthology.orchestra.run.smithi006.stdout:906 punch from 0xd69928 to 0xd705e6, (0x6cbe bytes) 2024-09-14T05:59:22.866 INFO:teuthology.orchestra.run.smithi006.stdout:908 write 0x5324d65 thru 0x532face (0xad6a bytes) 2024-09-14T05:59:22.868 INFO:teuthology.orchestra.run.smithi006.stdout:909 write 0x6a58d07 thru 0x6a60224 (0x751e bytes) 2024-09-14T05:59:22.869 INFO:teuthology.orchestra.run.smithi006.stdout:910 write 0x2ee8756 thru 0x2eef9e4 (0x728f bytes) 2024-09-14T05:59:22.870 INFO:teuthology.orchestra.run.smithi006.stdout:911 punch from 0x6f00126 to 0x6f0a6aa, (0xa584 bytes) 2024-09-14T05:59:22.885 INFO:teuthology.orchestra.run.smithi006.stdout:914 trunc from 0xd2dc8ea to 0x4426c75 2024-09-14T05:59:22.930 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:22.930 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:22.930 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:22.930 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:22.937 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T05:59:22.938 INFO:teuthology.orchestra.run.smithi006.stdout:915 write 0x7e0c7a7 thru 0x7e1786d (0xb0c7 bytes) 2024-09-14T05:59:22.943 INFO:teuthology.orchestra.run.smithi006.stdout:916 write 0x7d96945 thru 0x7d9c7a8 (0x5e64 bytes) 2024-09-14T05:59:22.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T05:59:22.946 INFO:teuthology.orchestra.run.smithi006.stdout:917 punch from 0x2449280 to 0x2454d3d, (0xbabd bytes) 2024-09-14T05:59:22.946 INFO:teuthology.orchestra.run.smithi006.stdout:920 write 0x55e47a5 thru 0x55f0263 (0xbabf bytes) 2024-09-14T05:59:22.949 INFO:teuthology.orchestra.run.smithi006.stdout:922 write 0x30cf5a1 thru 0x30d8937 (0x9397 bytes) 2024-09-14T05:59:22.951 INFO:teuthology.orchestra.run.smithi006.stdout:924 read 0x5a10a6a thru 0x5a13d5b (0x32f2 bytes) 2024-09-14T05:59:22.952 INFO:teuthology.orchestra.run.smithi006.stdout:925 read 0x362c3ab thru 0x3633909 (0x755f bytes) 2024-09-14T05:59:22.955 INFO:teuthology.orchestra.run.smithi006.stdout:926 trunc from 0x7e1786e to 0x963e893 2024-09-14T05:59:22.964 INFO:teuthology.orchestra.run.smithi006.stdout:927 read 0x21d3bdc thru 0x21e05de (0xca03 bytes) 2024-09-14T05:59:22.964 INFO:teuthology.orchestra.run.smithi006.stdout:929 punch from 0x4c41669 to 0x4c4bd97, (0xa72e bytes) 2024-09-14T05:59:22.964 INFO:teuthology.orchestra.run.smithi006.stdout:930 punch from 0x88df712 to 0x88e9acf, (0xa3bd bytes) 2024-09-14T05:59:22.964 INFO:teuthology.orchestra.run.smithi006.stdout:932 write 0x7211bb6 thru 0x72140d0 (0x251b bytes) 2024-09-14T05:59:22.972 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:22.972 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:22.975 INFO:teuthology.orchestra.run.smithi006.stdout:933 writesame 0xb417912 thru 0xb41b7d1 data_size 0x20(0x3ec0 bytes) 2024-09-14T05:59:22.976 INFO:teuthology.orchestra.run.smithi006.stdout:934 punch from 0x789262d to 0x789801e, (0x59f1 bytes) 2024-09-14T05:59:22.976 INFO:teuthology.orchestra.run.smithi006.stdout:935 clone 6 order 22 su 524288 sc 13 2024-09-14T05:59:22.989 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:22.989 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:22.996 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:22.995+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:23.006 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:23.025 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:23.044 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:23.044 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:23.049 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:23.045+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:23.065 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:23.065 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:23.070 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:23.070 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:23.085 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T05:59:23.085 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:23.088 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T05:59:23.089 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T05:59:23.171 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:23.171+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:23.246 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:23.246 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:23.251 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:23.247+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:23.261 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T05:59:23.351 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:23.351+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:23.425 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:23.425 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:23.441 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T05:59:23.483 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:23.483+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:23.553 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:23.549+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:23.609 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:23.609 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:23.623 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T05:59:23.640 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2024-09-14T05:59:23.667 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:23.667+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:23.732 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone5 from 0xb41b7d2 (overlap 0x78157e) to 0x0 2024-09-14T05:59:23.753 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:23.753 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:23.754 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:23.751+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:23.769 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:59:23.830 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-14T05:59:23.854 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:23.849+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:23.913 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:23.913 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:23.928 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:59:23.956 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:23.955+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:24.056 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:24.059+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:24.106 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:24.106 INFO:teuthology.orchestra.run.smithi006.stdout:938 write 0x3615045 thru 0x361ed4a (0x9d06 bytes) 2024-09-14T05:59:24.109 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:24.109 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:24.122 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:24.122 INFO:teuthology.orchestra.run.smithi006.stdout:941 read 0x7b69a77 thru 0x7b77139 (0xd6c3 bytes) 2024-09-14T05:59:24.124 INFO:teuthology.orchestra.run.smithi006.stdout:942 punch from 0x94b3a98 to 0x94c12c8, (0xd830 bytes) 2024-09-14T05:59:24.124 INFO:teuthology.orchestra.run.smithi006.stdout:943 write 0x285d265 thru 0x2862fa7 (0x5d43 bytes) 2024-09-14T05:59:24.125 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:59:24.134 INFO:teuthology.orchestra.run.smithi006.stdout:944 read 0x583cc7f thru 0x5845923 (0x8ca5 bytes) 2024-09-14T05:59:24.134 INFO:teuthology.orchestra.run.smithi006.stdout:947 write 0x51984e7 thru 0x51a4f0a (0xca24 bytes) 2024-09-14T05:59:24.143 INFO:teuthology.orchestra.run.smithi006.stdout:948 read 0x5579d74 thru 0x55834b6 (0x9743 bytes) 2024-09-14T05:59:24.144 INFO:teuthology.orchestra.run.smithi006.stdout:949 punch from 0x423519a to 0x423d741, (0x85a7 bytes) 2024-09-14T05:59:24.145 INFO:teuthology.orchestra.run.smithi006.stdout:950 writesame 0x8c09c6c thru 0x8c15400 data_size 0x1(0xb795 bytes) 2024-09-14T05:59:24.157 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:24.153+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:24.212 INFO:teuthology.orchestra.run.smithi006.stdout:951 read 0x5e1ddcc thru 0x5e28fae (0xb1e3 bytes) 2024-09-14T05:59:24.214 INFO:teuthology.orchestra.run.smithi006.stdout:953 punch from 0x6d11243 to 0x6d1a081, (0x8e3e bytes) 2024-09-14T05:59:24.214 INFO:teuthology.orchestra.run.smithi006.stdout:955 read 0x652302f thru 0x652b886 (0x8858 bytes) 2024-09-14T05:59:24.215 INFO:teuthology.orchestra.run.smithi006.stdout:957 writesame 0x3638155 thru 0x3645393 data_size 0x15(0xd23f bytes) 2024-09-14T05:59:24.220 INFO:teuthology.orchestra.run.smithi006.stdout:958 read 0x7f27ba7 thru 0x7f2cdbb (0x5215 bytes) 2024-09-14T05:59:24.221 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:24.222 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:24.222 INFO:teuthology.orchestra.run.smithi006.stdout:962 writesame 0x4f343cc thru 0x4f3cd9b data_size 0x5a(0x89d0 bytes) 2024-09-14T05:59:24.255 INFO:teuthology.orchestra.run.smithi006.stdout:963 trunc from 0xb41b7d2 to 0xae95d0 2024-09-14T05:59:24.258 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:24.253+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:24.258 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:24.258 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:24.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:59:24.321 INFO:teuthology.orchestra.run.smithi006.stdout:964 write 0x376ea2 thru 0x377679 (0x7d8 bytes) 2024-09-14T05:59:24.324 INFO:teuthology.orchestra.run.smithi006.stdout:965 read 0x6dadec thru 0x6df836 (0x4a4b bytes) 2024-09-14T05:59:24.324 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:24.325 INFO:teuthology.orchestra.run.smithi006.stdout:967 flatten 2024-09-14T05:59:24.359 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:24.359+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:24.368 INFO:teuthology.orchestra.run.smithi006.stdout:968 write 0x8cc46c6 thru 0x8cc718d (0x2ac8 bytes) 2024-09-14T05:59:24.373 INFO:teuthology.orchestra.run.smithi006.stdout:969 punch from 0x5aa0c27 to 0x5aa1ec6, (0x129f bytes) 2024-09-14T05:59:24.373 INFO:teuthology.orchestra.run.smithi006.stdout:970 write 0x28da1b5 thru 0x28e06c6 (0x6512 bytes) 2024-09-14T05:59:24.376 INFO:teuthology.orchestra.run.smithi006.stdout:971 read 0x7f794f0 thru 0x7f81a1e (0x852f bytes) 2024-09-14T05:59:24.377 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:24.386 INFO:teuthology.orchestra.run.smithi006.stdout:973 trunc from 0x8cc718e to 0xdab33d4 2024-09-14T05:59:24.398 INFO:teuthology.orchestra.run.smithi006.stdout:974 write 0x7409bc8 thru 0x7419ad3 (0xff0c bytes) 2024-09-14T05:59:24.407 INFO:teuthology.orchestra.run.smithi006.stdout:975 write 0x639a419 thru 0x63a68af (0xc497 bytes) 2024-09-14T05:59:24.414 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:24.414 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:24.414 INFO:teuthology.orchestra.run.smithi006.stdout:979 read 0x63e3921 thru 0x63ef3df (0xbabf bytes) 2024-09-14T05:59:24.439 INFO:teuthology.orchestra.run.smithi006.stdout:980 trunc from 0xdab33d4 to 0x1de1d25 2024-09-14T05:59:24.460 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:24.459+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:24.461 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:24.461 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:24.473 INFO:teuthology.orchestra.run.smithi006.stdout:981 read 0x94f8e7 thru 0x95cd36 (0xd450 bytes) 2024-09-14T05:59:24.475 INFO:teuthology.orchestra.run.smithi006.stdout:982 clone 7 order 23 su 65536 sc 8 2024-09-14T05:59:24.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:59:24.563 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:24.561+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:24.650 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:24.650 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:24.661 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:24.659+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:24.666 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:59:24.762 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:24.757+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:24.829 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:24.829 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:24.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:59:24.861 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-14T05:59:24.863 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:24.861+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:24.864 INFO:teuthology.orchestra.run.smithi006.stdout:983 punch from 0x1b30173 to 0x1b31cf1, (0x1b7e bytes) 2024-09-14T05:59:24.871 INFO:teuthology.orchestra.run.smithi006.stdout:985 writesame 0x92fb36 thru 0x938b59 data_size 0x3c(0x9024 bytes) 2024-09-14T05:59:24.917 INFO:teuthology.orchestra.run.smithi006.stdout:990 trunc from 0x1de1d25 to 0xe87c25f 2024-09-14T05:59:24.951 INFO:teuthology.orchestra.run.smithi006.stdout:991 trunc from 0xe87c25f to 0x2b8e36c 2024-09-14T05:59:24.964 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:24.963+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:25.027 INFO:teuthology.orchestra.run.smithi006.stdout:993 write 0x4bcfafc thru 0x4bd3608 (0x3b0d bytes) 2024-09-14T05:59:25.028 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:25.028 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:25.035 INFO:teuthology.orchestra.run.smithi006.stdout:994 write 0x2288ef2 thru 0x228a543 (0x1652 bytes) 2024-09-14T05:59:25.045 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:59:25.055 INFO:teuthology.orchestra.run.smithi006.stdout:995 write 0x6d07fa2 thru 0x6d17068 (0xf0c7 bytes) 2024-09-14T05:59:25.064 INFO:teuthology.orchestra.run.smithi006.stdout:998 write 0x234f920 thru 0x2350754 (0xe35 bytes) 2024-09-14T05:59:25.065 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:25.063+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:25.067 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:25.067 INFO:teuthology.orchestra.run.smithi006.stdout:1001 writesame 0x6671548 thru 0x667706d data_size 0x3(0x5b26 bytes) 2024-09-14T05:59:25.076 INFO:teuthology.orchestra.run.smithi006.stdout:1002 write 0x3374210 thru 0x337c31e (0x810f bytes) 2024-09-14T05:59:25.087 INFO:teuthology.orchestra.run.smithi006.stdout:1003 trunc from 0x6d17069 to 0xad26c64 2024-09-14T05:59:25.090 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:59:25.099 INFO:teuthology.orchestra.run.smithi006.stdout:1004 read 0x39d27b6 thru 0x39d39a7 (0x11f2 bytes) 2024-09-14T05:59:25.100 INFO:teuthology.orchestra.run.smithi006.stdout:1005 read 0x5b273c7 thru 0x5b31aab (0xa6e5 bytes) 2024-09-14T05:59:25.100 INFO:teuthology.orchestra.run.smithi006.stdout:1006 write 0x5bed58e thru 0x5bf5956 (0x83c9 bytes) 2024-09-14T05:59:25.107 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:25.107 INFO:teuthology.orchestra.run.smithi006.stdout:1008 read 0x976af9d thru 0x976cab4 (0x1b18 bytes) 2024-09-14T05:59:25.107 INFO:teuthology.orchestra.run.smithi006.stdout:1010 read 0x11db3b0 thru 0x11dc929 (0x157a bytes) 2024-09-14T05:59:25.107 INFO:teuthology.orchestra.run.smithi006.stdout:1011 write 0x8951af4 thru 0x895b83b (0x9d48 bytes) 2024-09-14T05:59:25.114 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:25.114 INFO:teuthology.orchestra.run.smithi006.stdout:1014 write 0x44fd205 thru 0x4508b3b (0xb937 bytes) 2024-09-14T05:59:25.117 INFO:teuthology.orchestra.run.smithi006.stdout:1015 read 0x8e2955b thru 0x8e2fe81 (0x6927 bytes) 2024-09-14T05:59:25.131 INFO:teuthology.orchestra.run.smithi006.stdout:1017 write 0xc873f09 thru 0xc877cbd (0x3db5 bytes) 2024-09-14T05:59:25.138 INFO:teuthology.orchestra.run.smithi006.stdout:1018 punch from 0xac2bde4 to 0xac38503, (0xc71f bytes) 2024-09-14T05:59:25.138 INFO:teuthology.orchestra.run.smithi006.stdout:1019 clone 8 order 20 su 16384 sc 4 2024-09-14T05:59:25.165 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:25.163+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:25.189 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:25.190 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:25.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:59:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T05:59:25.241 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:25.258 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:25.258 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:25.266 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:25.261+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:25.275 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:25.275 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:25.296 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:25.296 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:25.317 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:25.317 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:25.339 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:25.339 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:25.342 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:25.342 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:25.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:25.342 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:25.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.342 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:555 3.7 3:e2ffd4fe:::rbd_data.11275e589b0d.0000000000000013:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:25.342 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.773704+0000", 2024-09-14T05:59:25.342 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 12.565996477000001, 2024-09-14T05:59:25.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.021020928000000001, 2024-09-14T05:59:25.343 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.343 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:25.343 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.343 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.343 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.343 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 555 2024-09-14T05:59:25.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.343 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773704+0000", 2024-09-14T05:59:25.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773704+0000", 2024-09-14T05:59:25.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773706+0000", 2024-09-14T05:59:25.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3300000000000001e-06 2024-09-14T05:59:25.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773718+0000", 2024-09-14T05:59:25.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1324e-05 2024-09-14T05:59:25.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773746+0000", 2024-09-14T05:59:25.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8813e-05 2024-09-14T05:59:25.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773761+0000", 2024-09-14T05:59:25.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4466e-05 2024-09-14T05:59:25.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.773898+0000", 2024-09-14T05:59:25.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000137596 2024-09-14T05:59:25.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.774030+0000", 2024-09-14T05:59:25.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013141199999999999 2024-09-14T05:59:25.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T05:59:25.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.777366+0000", 2024-09-14T05:59:25.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003336468 2024-09-14T05:59:25.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:25.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794459+0000", 2024-09-14T05:59:25.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017092950999999999 2024-09-14T05:59:25.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:25.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794545+0000", 2024-09-14T05:59:25.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5609e-05 2024-09-14T05:59:25.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.348 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:25.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794644+0000", 2024-09-14T05:59:25.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8999000000000005e-05 2024-09-14T05:59:25.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.348 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.794725+0000", 2024-09-14T05:59:25.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0959999999999997e-05 2024-09-14T05:59:25.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.348 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.349 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:608 3.7 3:e6b2e829:::rbd_data.11275e589b0d.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:25.349 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.930012+0000", 2024-09-14T05:59:25.349 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 12.409688599000001, 2024-09-14T05:59:25.349 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.027079134000000001, 2024-09-14T05:59:25.349 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.349 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:25.349 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.349 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.349 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.349 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 608 2024-09-14T05:59:25.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.350 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930012+0000", 2024-09-14T05:59:25.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930012+0000", 2024-09-14T05:59:25.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930013+0000", 2024-09-14T05:59:25.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2999999999999999e-07 2024-09-14T05:59:25.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930018+0000", 2024-09-14T05:59:25.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6239999999999999e-06 2024-09-14T05:59:25.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930032+0000", 2024-09-14T05:59:25.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3976e-05 2024-09-14T05:59:25.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930043+0000", 2024-09-14T05:59:25.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0764000000000001e-05 2024-09-14T05:59:25.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930152+0000", 2024-09-14T05:59:25.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108478 2024-09-14T05:59:25.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.930287+0000", 2024-09-14T05:59:25.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000135029 2024-09-14T05:59:25.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T05:59:25.353 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.934701+0000", 2024-09-14T05:59:25.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044140050000000004 2024-09-14T05:59:25.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:25.353 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956894+0000", 2024-09-14T05:59:25.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022193039000000001 2024-09-14T05:59:25.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:25.353 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956924+0000", 2024-09-14T05:59:25.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0049999999999999e-05 2024-09-14T05:59:25.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.957018+0000", 2024-09-14T05:59:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4025999999999997e-05 2024-09-14T05:59:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.957091+0000", 2024-09-14T05:59:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3213000000000005e-05 2024-09-14T05:59:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.355 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop_reply(client.4391.0:608 3.7 e29/24 ondisk, result = 0)", 2024-09-14T05:59:25.355 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.942307+0000", 2024-09-14T05:59:25.355 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 12.397393079, 2024-09-14T05:59:25.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014599915, 2024-09-14T05:59:25.355 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.355 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.355 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.355 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942307+0000", 2024-09-14T05:59:25.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942307+0000", 2024-09-14T05:59:25.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942309+0000", 2024-09-14T05:59:25.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.511e-06 2024-09-14T05:59:25.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942315+0000", 2024-09-14T05:59:25.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6629999999999998e-06 2024-09-14T05:59:25.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942333+0000", 2024-09-14T05:59:25.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8657000000000001e-05 2024-09-14T05:59:25.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.942346+0000", 2024-09-14T05:59:25.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3254999999999999e-05 2024-09-14T05:59:25.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956866+0000", 2024-09-14T05:59:25.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014519353 2024-09-14T05:59:25.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956884+0000", 2024-09-14T05:59:25.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7825999999999998e-05 2024-09-14T05:59:25.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.956907+0000", 2024-09-14T05:59:25.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3649999999999999e-05 2024-09-14T05:59:25.359 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.359 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.359 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.359 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:612 3.18 3:1a07fa9c:::rbd_data.11275e589b0d.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:25.359 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.970090+0000", 2024-09-14T05:59:25.359 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 12.369610562, 2024-09-14T05:59:25.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.027517274000000001, 2024-09-14T05:59:25.360 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.360 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.360 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:25.360 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.360 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.360 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.361 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 612 2024-09-14T05:59:25.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.361 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970090+0000", 2024-09-14T05:59:25.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970090+0000", 2024-09-14T05:59:25.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970092+0000", 2024-09-14T05:59:25.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.663e-06 2024-09-14T05:59:25.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970101+0000", 2024-09-14T05:59:25.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4560000000000006e-06 2024-09-14T05:59:25.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970127+0000", 2024-09-14T05:59:25.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5743999999999999e-05 2024-09-14T05:59:25.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970147+0000", 2024-09-14T05:59:25.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9973e-05 2024-09-14T05:59:25.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970270+0000", 2024-09-14T05:59:25.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000123182 2024-09-14T05:59:25.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.970402+0000", 2024-09-14T05:59:25.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000131629 2024-09-14T05:59:25.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:25.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.997351+0000", 2024-09-14T05:59:25.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.026949039000000001 2024-09-14T05:59:25.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:25.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.997464+0000", 2024-09-14T05:59:25.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011337599999999999 2024-09-14T05:59:25.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.997607+0000", 2024-09-14T05:59:25.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014321200000000001 2024-09-14T05:59:25.365 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.365 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.365 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.365 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4193 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 843776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.365 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.749843+0000", 2024-09-14T05:59:25.365 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5898576320000002, 2024-09-14T05:59:25.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.013019149000000001, 2024-09-14T05:59:25.366 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.366 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.366 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.366 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.366 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.366 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4193 2024-09-14T05:59:25.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.366 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749843+0000", 2024-09-14T05:59:25.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749843+0000", 2024-09-14T05:59:25.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749843+0000", 2024-09-14T05:59:25.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9499999999999998e-07 2024-09-14T05:59:25.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749845+0000", 2024-09-14T05:59:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1830000000000001e-06 2024-09-14T05:59:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749852+0000", 2024-09-14T05:59:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2160000000000003e-06 2024-09-14T05:59:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749857+0000", 2024-09-14T05:59:25.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9760000000000003e-06 2024-09-14T05:59:25.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.762691+0000", 2024-09-14T05:59:25.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.012834059 2024-09-14T05:59:25.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.762777+0000", 2024-09-14T05:59:25.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6788999999999999e-05 2024-09-14T05:59:25.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.762862+0000", 2024-09-14T05:59:25.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4530999999999994e-05 2024-09-14T05:59:25.370 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.370 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.370 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.370 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4194 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 995328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.370 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.749866+0000", 2024-09-14T05:59:25.371 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5898348689999997, 2024-09-14T05:59:25.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.013212824, 2024-09-14T05:59:25.371 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.371 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.371 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.371 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4194 2024-09-14T05:59:25.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.371 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749866+0000", 2024-09-14T05:59:25.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749866+0000", 2024-09-14T05:59:25.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749866+0000", 2024-09-14T05:59:25.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2800000000000002e-07 2024-09-14T05:59:25.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749868+0000", 2024-09-14T05:59:25.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4059999999999999e-06 2024-09-14T05:59:25.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749875+0000", 2024-09-14T05:59:25.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7850000000000003e-06 2024-09-14T05:59:25.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749878+0000", 2024-09-14T05:59:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2219999999999998e-06 2024-09-14T05:59:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.762901+0000", 2024-09-14T05:59:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.013022325 2024-09-14T05:59:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.762990+0000", 2024-09-14T05:59:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9336e-05 2024-09-14T05:59:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.763078+0000", 2024-09-14T05:59:25.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8321999999999999e-05 2024-09-14T05:59:25.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.375 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.375 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4236 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 90112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.375 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.749930+0000", 2024-09-14T05:59:25.375 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5897702640000002, 2024-09-14T05:59:25.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.013584933, 2024-09-14T05:59:25.375 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.376 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.376 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.376 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.376 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.376 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.376 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4236 2024-09-14T05:59:25.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.376 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749930+0000", 2024-09-14T05:59:25.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749930+0000", 2024-09-14T05:59:25.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749931+0000", 2024-09-14T05:59:25.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5299999999999999e-07 2024-09-14T05:59:25.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749933+0000", 2024-09-14T05:59:25.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0820000000000001e-06 2024-09-14T05:59:25.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749939+0000", 2024-09-14T05:59:25.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2190000000000001e-06 2024-09-14T05:59:25.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749943+0000", 2024-09-14T05:59:25.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5549999999999996e-06 2024-09-14T05:59:25.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.763117+0000", 2024-09-14T05:59:25.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.013173750999999999 2024-09-14T05:59:25.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.763202+0000", 2024-09-14T05:59:25.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4297999999999998e-05 2024-09-14T05:59:25.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.763515+0000", 2024-09-14T05:59:25.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00031357500000000002 2024-09-14T05:59:25.380 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.380 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.380 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.380 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4237 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 241664~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.380 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.749952+0000", 2024-09-14T05:59:25.380 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5897489030000003, 2024-09-14T05:59:25.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014061176999999999, 2024-09-14T05:59:25.381 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.381 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.381 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.381 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.381 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.381 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.381 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4237 2024-09-14T05:59:25.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.381 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749952+0000", 2024-09-14T05:59:25.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749952+0000", 2024-09-14T05:59:25.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749952+0000", 2024-09-14T05:59:25.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:59:25.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749955+0000", 2024-09-14T05:59:25.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:59:25.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749961+0000", 2024-09-14T05:59:25.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4080000000000003e-06 2024-09-14T05:59:25.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749966+0000", 2024-09-14T05:59:25.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3980000000000001e-06 2024-09-14T05:59:25.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.763575+0000", 2024-09-14T05:59:25.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.013609654000000001 2024-09-14T05:59:25.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.763679+0000", 2024-09-14T05:59:25.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000103352 2024-09-14T05:59:25.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.764013+0000", 2024-09-14T05:59:25.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00033413200000000001 2024-09-14T05:59:25.385 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.385 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.385 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.385 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4238 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 393216~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.385 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.749975+0000", 2024-09-14T05:59:25.385 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5897251150000002, 2024-09-14T05:59:25.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014464156000000001, 2024-09-14T05:59:25.385 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.385 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.385 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.386 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4238 2024-09-14T05:59:25.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.386 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749975+0000", 2024-09-14T05:59:25.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749975+0000", 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749976+0000", 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3799999999999998e-07 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749982+0000", 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8599999999999998e-06 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749988+0000", 2024-09-14T05:59:25.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8530000000000003e-06 2024-09-14T05:59:25.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.749994+0000", 2024-09-14T05:59:25.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7919999999999998e-06 2024-09-14T05:59:25.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.764063+0000", 2024-09-14T05:59:25.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014069016 2024-09-14T05:59:25.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.764144+0000", 2024-09-14T05:59:25.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0958999999999995e-05 2024-09-14T05:59:25.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.764439+0000", 2024-09-14T05:59:25.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029523800000000002 2024-09-14T05:59:25.389 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.389 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.389 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4239 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 548864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750003+0000", 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5896972050000002, 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014983017, 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4239 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750003+0000", 2024-09-14T05:59:25.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750003+0000", 2024-09-14T05:59:25.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750004+0000", 2024-09-14T05:59:25.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8599999999999998e-07 2024-09-14T05:59:25.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750006+0000", 2024-09-14T05:59:25.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5210000000000001e-06 2024-09-14T05:59:25.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750013+0000", 2024-09-14T05:59:25.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4980000000000003e-06 2024-09-14T05:59:25.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750018+0000", 2024-09-14T05:59:25.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0710000000000002e-06 2024-09-14T05:59:25.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.764685+0000", 2024-09-14T05:59:25.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.014667659 2024-09-14T05:59:25.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.764830+0000", 2024-09-14T05:59:25.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014494 2024-09-14T05:59:25.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.764986+0000", 2024-09-14T05:59:25.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000155842 2024-09-14T05:59:25.394 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.394 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.395 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4240 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 700416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.395 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750026+0000", 2024-09-14T05:59:25.395 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5896746589999999, 2024-09-14T05:59:25.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015151886, 2024-09-14T05:59:25.395 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.395 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.395 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.395 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.395 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.395 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.395 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4240 2024-09-14T05:59:25.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.396 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750026+0000", 2024-09-14T05:59:25.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750026+0000", 2024-09-14T05:59:25.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750026+0000", 2024-09-14T05:59:25.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.46e-07 2024-09-14T05:59:25.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750029+0000", 2024-09-14T05:59:25.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5220000000000002e-06 2024-09-14T05:59:25.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750036+0000", 2024-09-14T05:59:25.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2010000000000002e-06 2024-09-14T05:59:25.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750041+0000", 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0479999999999998e-06 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765044+0000", 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015003357 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765118+0000", 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3833999999999998e-05 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765178+0000", 2024-09-14T05:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9478000000000002e-05 2024-09-14T05:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4241 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750049+0000", 2024-09-14T05:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5896517110000001, 2024-09-14T05:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015338802, 2024-09-14T05:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4241 2024-09-14T05:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750049+0000", 2024-09-14T05:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750049+0000", 2024-09-14T05:59:25.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750049+0000", 2024-09-14T05:59:25.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T05:59:25.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750052+0000", 2024-09-14T05:59:25.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4959999999999999e-06 2024-09-14T05:59:25.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750060+0000", 2024-09-14T05:59:25.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6640000000000004e-06 2024-09-14T05:59:25.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750066+0000", 2024-09-14T05:59:25.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2490000000000001e-06 2024-09-14T05:59:25.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765224+0000", 2024-09-14T05:59:25.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015158229 2024-09-14T05:59:25.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765300+0000", 2024-09-14T05:59:25.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6338e-05 2024-09-14T05:59:25.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765388+0000", 2024-09-14T05:59:25.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7367000000000006e-05 2024-09-14T05:59:25.404 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.404 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.404 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.404 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4242 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 1007616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.404 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750074+0000", 2024-09-14T05:59:25.404 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5896260939999998, 2024-09-14T05:59:25.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015636724000000001, 2024-09-14T05:59:25.404 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.405 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.405 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.405 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4242 2024-09-14T05:59:25.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.405 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750074+0000", 2024-09-14T05:59:25.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750074+0000", 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750075+0000", 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6700000000000003e-07 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750077+0000", 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3870000000000002e-06 2024-09-14T05:59:25.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750084+0000", 2024-09-14T05:59:25.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6490000000000002e-06 2024-09-14T05:59:25.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750089+0000", 2024-09-14T05:59:25.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.724e-06 2024-09-14T05:59:25.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765443+0000", 2024-09-14T05:59:25.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015353983999999999 2024-09-14T05:59:25.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765557+0000", 2024-09-14T05:59:25.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000114294 2024-09-14T05:59:25.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765711+0000", 2024-09-14T05:59:25.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015411900000000001 2024-09-14T05:59:25.408 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.408 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.408 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4284 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 98304~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750123+0000", 2024-09-14T05:59:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5895769199999998, 2024-09-14T05:59:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016056608, 2024-09-14T05:59:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4284 2024-09-14T05:59:25.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750123+0000", 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750123+0000", 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750124+0000", 2024-09-14T05:59:25.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750127+0000", 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.553e-06 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750133+0000", 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3330000000000002e-06 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750138+0000", 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0629999999999996e-06 2024-09-14T05:59:25.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765754+0000", 2024-09-14T05:59:25.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015616591000000001 2024-09-14T05:59:25.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.765853+0000", 2024-09-14T05:59:25.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8054999999999995e-05 2024-09-14T05:59:25.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.766180+0000", 2024-09-14T05:59:25.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032755399999999997 2024-09-14T05:59:25.413 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.413 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.413 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.413 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4285 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 253952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.413 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750146+0000", 2024-09-14T05:59:25.413 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5895541880000001, 2024-09-14T05:59:25.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016491355999999999, 2024-09-14T05:59:25.413 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.413 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.413 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.413 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.413 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4285 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750146+0000", 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750146+0000", 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750147+0000", 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9899999999999999e-07 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750150+0000", 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750156+0000", 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.883e-06 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750161+0000", 2024-09-14T05:59:25.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9230000000000001e-06 2024-09-14T05:59:25.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.766286+0000", 2024-09-14T05:59:25.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016124230999999999 2024-09-14T05:59:25.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.766336+0000", 2024-09-14T05:59:25.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0593000000000002e-05 2024-09-14T05:59:25.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.766638+0000", 2024-09-14T05:59:25.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030136600000000001 2024-09-14T05:59:25.417 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.417 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.417 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.417 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4286 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 405504~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.417 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750170+0000", 2024-09-14T05:59:25.417 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5895305610000001, 2024-09-14T05:59:25.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016886575000000001, 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4286 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750170+0000", 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750170+0000", 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750170+0000", 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7800000000000002e-07 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750173+0000", 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8590000000000001e-06 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750180+0000", 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6470000000000001e-06 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750189+0000", 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9670000000000007e-06 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.766692+0000", 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016503054999999999 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.766778+0000", 2024-09-14T05:59:25.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6408000000000003e-05 2024-09-14T05:59:25.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767056+0000", 2024-09-14T05:59:25.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027816100000000002 2024-09-14T05:59:25.421 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.421 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.421 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.421 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4287 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 557056~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750196+0000", 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5895046270000002, 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017054339000000002, 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4287 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750196+0000", 2024-09-14T05:59:25.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750196+0000", 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750196+0000", 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750199+0000", 2024-09-14T05:59:25.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3910000000000001e-06 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750205+0000", 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3790000000000003e-06 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750209+0000", 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7639999999999999e-06 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767098+0000", 2024-09-14T05:59:25.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016889062999999999 2024-09-14T05:59:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767156+0000", 2024-09-14T05:59:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7979000000000002e-05 2024-09-14T05:59:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767250+0000", 2024-09-14T05:59:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4258000000000005e-05 2024-09-14T05:59:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.426 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4288 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 712704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.426 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750216+0000", 2024-09-14T05:59:25.426 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5894843459999999, 2024-09-14T05:59:25.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017253942000000001, 2024-09-14T05:59:25.426 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.426 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.426 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.426 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.426 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.426 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.426 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4288 2024-09-14T05:59:25.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.426 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750216+0000", 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750216+0000", 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750217+0000", 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5499999999999998e-07 2024-09-14T05:59:25.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750219+0000", 2024-09-14T05:59:25.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2500000000000001e-06 2024-09-14T05:59:25.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750225+0000", 2024-09-14T05:59:25.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1460000000000001e-06 2024-09-14T05:59:25.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750230+0000", 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767293+0000", 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017062269000000001 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767379+0000", 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6030000000000001e-05 2024-09-14T05:59:25.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767470+0000", 2024-09-14T05:59:25.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1434000000000006e-05 2024-09-14T05:59:25.430 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.430 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.430 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.430 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4289 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 864256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.430 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750237+0000", 2024-09-14T05:59:25.430 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5894631419999996, 2024-09-14T05:59:25.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017366869, 2024-09-14T05:59:25.430 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.431 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.431 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.431 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.431 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.431 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.431 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4289 2024-09-14T05:59:25.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.431 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750237+0000", 2024-09-14T05:59:25.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750237+0000", 2024-09-14T05:59:25.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750238+0000", 2024-09-14T05:59:25.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9299999999999999e-07 2024-09-14T05:59:25.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750240+0000", 2024-09-14T05:59:25.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0040000000000002e-06 2024-09-14T05:59:25.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750246+0000", 2024-09-14T05:59:25.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1140000000000002e-06 2024-09-14T05:59:25.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750251+0000", 2024-09-14T05:59:25.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1660000000000002e-06 2024-09-14T05:59:25.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767509+0000", 2024-09-14T05:59:25.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017258295 2024-09-14T05:59:25.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767557+0000", 2024-09-14T05:59:25.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7355999999999999e-05 2024-09-14T05:59:25.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767604+0000", 2024-09-14T05:59:25.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7540999999999998e-05 2024-09-14T05:59:25.434 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.435 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.435 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.435 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:4290 3.2 3:4127f602:::rbd_data.1127c133286b.0000000000000000:4 [read 1015808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.435 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.750258+0000", 2024-09-14T05:59:25.435 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.5894419900000001, 2024-09-14T05:59:25.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017551872999999999, 2024-09-14T05:59:25.435 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:25.435 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:25.435 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:25.435 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:25.435 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:25.435 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.436 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 4290 2024-09-14T05:59:25.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.436 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:25.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:25.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750258+0000", 2024-09-14T05:59:25.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:25.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750258+0000", 2024-09-14T05:59:25.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:25.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750259+0000", 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8000000000000001e-07 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750266+0000", 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-06 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750274+0000", 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2400000000000007e-06 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.750285+0000", 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0818e-05 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767642+0000", 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017357351 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767729+0000", 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6915000000000004e-05 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:25.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:25.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.767810+0000", 2024-09-14T05:59:25.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1069000000000006e-05 2024-09-14T05:59:25.439 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.439 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.439 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.439 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:25.439 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:25.439 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:25.441 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:59:25.441 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:25.441 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T05:59:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:25.442 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T05:59:25.442 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:25.439+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:25.542 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:25.539+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:25.573 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:25.573 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:25.573 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:25.573 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:25.587 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:59:25.643 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:25.641+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:25.669 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:59:25.744 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:25.741+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:25.782 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone7 from 0xc877cbe (overlap 0x1de1d25) to 0x1ae4d6e 2024-09-14T05:59:25.783 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:25.783 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:25.783 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:25.783 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:25.783 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:25.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:59:25.844 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:25.841+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:25.902 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-14T05:59:25.936 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:25.936 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:25.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:25.936 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:25.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.936 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:303 3.3 3:c0f18601:::rbd_data.11275e589b0d.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-14T05:59:25.936 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:12.146341+0000", 2024-09-14T05:59:25.936 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.790007885, 2024-09-14T05:59:25.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022824968000000001, 2024-09-14T05:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 303 2024-09-14T05:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146341+0000", 2024-09-14T05:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146341+0000", 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146344+0000", 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1100000000000001e-06 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146358+0000", 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3957e-05 2024-09-14T05:59:25.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146387+0000", 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9332999999999999e-05 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146402+0000", 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4789e-05 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146524+0000", 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012266600000000001 2024-09-14T05:59:25.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:25.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.146767+0000", 2024-09-14T05:59:25.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024287500000000001 2024-09-14T05:59:25.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:25.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.168912+0000", 2024-09-14T05:59:25.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022144635999999999 2024-09-14T05:59:25.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:25.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.169022+0000", 2024-09-14T05:59:25.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109839 2024-09-14T05:59:25.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:25.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:12.169166+0000", 2024-09-14T05:59:25.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014476300000000001 2024-09-14T05:59:25.941 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.941 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:25.941 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.941 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5941 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 241664~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.941 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867454+0000", 2024-09-14T05:59:25.941 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0688955619999998, 2024-09-14T05:59:25.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012245608, 2024-09-14T05:59:25.942 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:25.942 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:25.942 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:25.942 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:25.942 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:25.942 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.942 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5941 2024-09-14T05:59:25.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.942 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:25.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:25.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867454+0000", 2024-09-14T05:59:25.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:25.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867454+0000", 2024-09-14T05:59:25.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:25.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867454+0000", 2024-09-14T05:59:25.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.32e-07 2024-09-14T05:59:25.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:25.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867456+0000", 2024-09-14T05:59:25.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0810000000000001e-06 2024-09-14T05:59:25.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:25.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867464+0000", 2024-09-14T05:59:25.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3669999999999999e-06 2024-09-14T05:59:25.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867476+0000", 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2298e-05 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879488+0000", 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01201201 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879570+0000", 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2227999999999999e-05 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:25.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879699+0000", 2024-09-14T05:59:25.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012919200000000001 2024-09-14T05:59:25.946 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.946 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:25.946 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.946 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5942 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 393216~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.946 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867486+0000", 2024-09-14T05:59:25.946 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.068863576, 2024-09-14T05:59:25.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012466517999999999, 2024-09-14T05:59:25.946 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:25.946 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:25.946 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:25.946 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5942 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867486+0000", 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867486+0000", 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867486+0000", 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4200000000000001e-07 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867493+0000", 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2080000000000003e-06 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867500+0000", 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7830000000000001e-06 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867505+0000", 2024-09-14T05:59:25.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1410000000000004e-06 2024-09-14T05:59:25.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:25.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879743+0000", 2024-09-14T05:59:25.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01223773 2024-09-14T05:59:25.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:25.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879823+0000", 2024-09-14T05:59:25.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0284999999999994e-05 2024-09-14T05:59:25.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:25.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879952+0000", 2024-09-14T05:59:25.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012892900000000001 2024-09-14T05:59:25.950 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.950 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:25.950 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.950 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5943 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 544768~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.950 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867513+0000", 2024-09-14T05:59:25.950 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0688362340000008, 2024-09-14T05:59:25.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012654174000000001, 2024-09-14T05:59:25.951 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:25.951 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:25.951 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:25.951 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:25.951 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:25.951 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.951 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5943 2024-09-14T05:59:25.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.951 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:25.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:25.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867513+0000", 2024-09-14T05:59:25.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:25.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867513+0000", 2024-09-14T05:59:25.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:25.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867514+0000", 2024-09-14T05:59:25.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4299999999999998e-07 2024-09-14T05:59:25.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:25.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867521+0000", 2024-09-14T05:59:25.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8269999999999998e-06 2024-09-14T05:59:25.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:25.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867528+0000", 2024-09-14T05:59:25.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3470000000000004e-06 2024-09-14T05:59:25.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867533+0000", 2024-09-14T05:59:25.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.198e-06 2024-09-14T05:59:25.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:25.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879990+0000", 2024-09-14T05:59:25.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012457161 2024-09-14T05:59:25.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:25.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880066+0000", 2024-09-14T05:59:25.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5711999999999996e-05 2024-09-14T05:59:25.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:25.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880167+0000", 2024-09-14T05:59:25.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101486 2024-09-14T05:59:25.955 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.955 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:25.955 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.955 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5944 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 700416~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.955 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867541+0000", 2024-09-14T05:59:25.955 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0688086390000002, 2024-09-14T05:59:25.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012957006, 2024-09-14T05:59:25.955 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:25.955 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:25.955 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:25.955 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:25.956 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:25.956 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.956 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5944 2024-09-14T05:59:25.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.956 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:25.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:25.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867541+0000", 2024-09-14T05:59:25.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:25.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867541+0000", 2024-09-14T05:59:25.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:25.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867541+0000", 2024-09-14T05:59:25.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4400000000000001e-07 2024-09-14T05:59:25.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:25.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867543+0000", 2024-09-14T05:59:25.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9910000000000001e-06 2024-09-14T05:59:25.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:25.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867549+0000", 2024-09-14T05:59:25.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2330000000000003e-06 2024-09-14T05:59:25.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867556+0000", 2024-09-14T05:59:25.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.302e-06 2024-09-14T05:59:25.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:25.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880227+0000", 2024-09-14T05:59:25.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012671392 2024-09-14T05:59:25.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:25.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880331+0000", 2024-09-14T05:59:25.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010417 2024-09-14T05:59:25.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:25.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880498+0000", 2024-09-14T05:59:25.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016647400000000001 2024-09-14T05:59:25.959 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.959 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:25.959 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5945 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867563+0000", 2024-09-14T05:59:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0687867210000004, 2024-09-14T05:59:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013088752, 2024-09-14T05:59:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5945 2024-09-14T05:59:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:25.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:25.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867563+0000", 2024-09-14T05:59:25.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:25.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867563+0000", 2024-09-14T05:59:25.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:25.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867563+0000", 2024-09-14T05:59:25.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0999999999999998e-07 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867565+0000", 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9570000000000001e-06 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867572+0000", 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2589999999999997e-06 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867577+0000", 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9509999999999997e-06 2024-09-14T05:59:25.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880539+0000", 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012962840999999999 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880584+0000", 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4354000000000003e-05 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880651+0000", 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7680000000000003e-05 2024-09-14T05:59:25.963 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5946 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.867586+0000", 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0687631090000007, 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013207419999999999, 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.964 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5946 2024-09-14T05:59:25.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.965 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:25.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:25.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867586+0000", 2024-09-14T05:59:25.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:25.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867586+0000", 2024-09-14T05:59:25.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867587+0000", 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6000000000000004e-07 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867589+0000", 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0470000000000001e-06 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867595+0000", 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1510000000000001e-06 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.867600+0000", 2024-09-14T05:59:25.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.741e-06 2024-09-14T05:59:25.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:25.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880678+0000", 2024-09-14T05:59:25.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013078233 2024-09-14T05:59:25.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:25.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880725+0000", 2024-09-14T05:59:25.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6802999999999999e-05 2024-09-14T05:59:25.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:25.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880794+0000", 2024-09-14T05:59:25.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8885000000000002e-05 2024-09-14T05:59:25.968 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.968 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:25.968 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.968 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5986 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 708608~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.968 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.869970+0000", 2024-09-14T05:59:25.968 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0663790639999995, 2024-09-14T05:59:25.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012341964, 2024-09-14T05:59:25.969 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:25.969 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:25.969 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:25.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:25.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:25.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.969 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5986 2024-09-14T05:59:25.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.969 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:25.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:25.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869970+0000", 2024-09-14T05:59:25.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:25.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869970+0000", 2024-09-14T05:59:25.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:25.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869971+0000", 2024-09-14T05:59:25.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6399999999999998e-07 2024-09-14T05:59:25.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869973+0000", 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8509999999999999e-06 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869982+0000", 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3610000000000007e-06 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869987+0000", 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3369999999999999e-06 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:25.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882036+0000", 2024-09-14T05:59:25.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012049150999999999 2024-09-14T05:59:25.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:25.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882154+0000", 2024-09-14T05:59:25.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011795599999999999 2024-09-14T05:59:25.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:25.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882312+0000", 2024-09-14T05:59:25.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000157944 2024-09-14T05:59:25.973 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.973 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:25.973 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.973 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5987 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 864256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.973 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.869995+0000", 2024-09-14T05:59:25.973 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0663542679999995, 2024-09-14T05:59:25.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012559504000000001, 2024-09-14T05:59:25.973 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:25.973 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:25.973 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:25.973 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:25.973 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5987 2024-09-14T05:59:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869995+0000", 2024-09-14T05:59:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869995+0000", 2024-09-14T05:59:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:25.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869995+0000", 2024-09-14T05:59:25.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T05:59:25.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:25.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.869997+0000", 2024-09-14T05:59:25.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0040000000000002e-06 2024-09-14T05:59:25.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:25.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870004+0000", 2024-09-14T05:59:25.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6959999999999999e-06 2024-09-14T05:59:25.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870015+0000", 2024-09-14T05:59:25.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1021e-05 2024-09-14T05:59:25.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:25.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882354+0000", 2024-09-14T05:59:25.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012338948000000001 2024-09-14T05:59:25.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:25.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882441+0000", 2024-09-14T05:59:25.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6877000000000002e-05 2024-09-14T05:59:25.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:25.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882555+0000", 2024-09-14T05:59:25.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011357 2024-09-14T05:59:25.977 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.977 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:25.977 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.977 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5988 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 1015808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.977 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870023+0000", 2024-09-14T05:59:25.978 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0663263740000009, 2024-09-14T05:59:25.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012808669, 2024-09-14T05:59:25.978 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:25.978 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:25.978 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:25.978 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:25.978 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:25.978 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.978 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5988 2024-09-14T05:59:25.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.978 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:25.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:25.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870023+0000", 2024-09-14T05:59:25.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:25.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870023+0000", 2024-09-14T05:59:25.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:25.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870023+0000", 2024-09-14T05:59:25.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2e-07 2024-09-14T05:59:25.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:25.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870026+0000", 2024-09-14T05:59:25.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6139999999999999e-06 2024-09-14T05:59:25.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:25.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870034+0000", 2024-09-14T05:59:25.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9710000000000004e-06 2024-09-14T05:59:25.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870039+0000", 2024-09-14T05:59:25.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4700000000000001e-06 2024-09-14T05:59:25.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:25.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882603+0000", 2024-09-14T05:59:25.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012563138999999999 2024-09-14T05:59:25.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:25.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882697+0000", 2024-09-14T05:59:25.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4158000000000002e-05 2024-09-14T05:59:25.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:25.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882832+0000", 2024-09-14T05:59:25.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013489700000000001 2024-09-14T05:59:25.982 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.982 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:25.982 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.982 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6024 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 110592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.983 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870236+0000", 2024-09-14T05:59:25.983 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0661129349999996, 2024-09-14T05:59:25.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01286999, 2024-09-14T05:59:25.983 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:25.983 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:25.983 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:25.983 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:25.983 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:25.983 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.983 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6024 2024-09-14T05:59:25.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.983 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:25.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870236+0000", 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870236+0000", 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870237+0000", 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.65e-07 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870239+0000", 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870245+0000", 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3010000000000003e-06 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870256+0000", 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1267000000000001e-05 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882882+0000", 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012625994999999999 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882966+0000", 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4007999999999999e-05 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883106+0000", 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014023400000000001 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.986 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:25.987 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.987 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6025 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 262144~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.987 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870265+0000", 2024-09-14T05:59:25.987 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0660846740000007, 2024-09-14T05:59:25.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013131543000000001, 2024-09-14T05:59:25.987 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:25.987 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:25.987 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:25.987 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:25.987 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:25.987 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.987 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6025 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870265+0000", 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870265+0000", 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:25.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870265+0000", 2024-09-14T05:59:25.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7999999999999995e-07 2024-09-14T05:59:25.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:25.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870268+0000", 2024-09-14T05:59:25.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.587e-06 2024-09-14T05:59:25.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:25.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870274+0000", 2024-09-14T05:59:25.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5100000000000004e-06 2024-09-14T05:59:25.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870286+0000", 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1184e-05 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883151+0000", 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012865829000000001 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883253+0000", 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101326 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:25.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883396+0000", 2024-09-14T05:59:25.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014342700000000001 2024-09-14T05:59:25.991 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.991 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:25.991 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.991 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6026 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 413696~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.991 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870294+0000", 2024-09-14T05:59:25.991 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0660549790000005, 2024-09-14T05:59:25.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013341486, 2024-09-14T05:59:25.991 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:25.992 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:25.992 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:25.992 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:25.992 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:25.992 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.992 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6026 2024-09-14T05:59:25.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.993 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:25.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:25.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870294+0000", 2024-09-14T05:59:25.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:25.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870294+0000", 2024-09-14T05:59:25.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:25.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:25.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870295+0000", 2024-09-14T05:59:25.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5300000000000004e-07 2024-09-14T05:59:25.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:25.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870297+0000", 2024-09-14T05:59:25.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4710000000000001e-06 2024-09-14T05:59:25.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:25.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870304+0000", 2024-09-14T05:59:25.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7750000000000004e-06 2024-09-14T05:59:25.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:25.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870309+0000", 2024-09-14T05:59:25.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1109999999999999e-06 2024-09-14T05:59:25.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:25.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883451+0000", 2024-09-14T05:59:25.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013142167 2024-09-14T05:59:25.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:25.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883541+0000", 2024-09-14T05:59:25.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9672000000000005e-05 2024-09-14T05:59:25.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:25.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883636+0000", 2024-09-14T05:59:25.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4736999999999998e-05 2024-09-14T05:59:25.998 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.998 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:25.998 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:25.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:25.999 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6027 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 569344~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:25.999 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870317+0000", 2024-09-14T05:59:25.999 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0660321929999999, 2024-09-14T05:59:25.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013635599, 2024-09-14T05:59:25.999 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:25.999 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:25.999 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:25.999 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:25.999 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:25.999 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:25.999 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6027 2024-09-14T05:59:25.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:25.999 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870317+0000", 2024-09-14T05:59:26.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870317+0000", 2024-09-14T05:59:26.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870318+0000", 2024-09-14T05:59:26.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4700000000000002e-07 2024-09-14T05:59:26.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870320+0000", 2024-09-14T05:59:26.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2790000000000001e-06 2024-09-14T05:59:26.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870327+0000", 2024-09-14T05:59:26.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4460000000000004e-06 2024-09-14T05:59:26.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870332+0000", 2024-09-14T05:59:26.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0289999999999996e-06 2024-09-14T05:59:26.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883677+0000", 2024-09-14T05:59:26.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013344765 2024-09-14T05:59:26.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883794+0000", 2024-09-14T05:59:26.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116668 2024-09-14T05:59:26.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883953+0000", 2024-09-14T05:59:26.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015896500000000001 2024-09-14T05:59:26.003 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.003 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.003 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.003 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6028 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 720896~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.004 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870340+0000", 2024-09-14T05:59:26.004 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0660095740000006, 2024-09-14T05:59:26.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013748082999999999, 2024-09-14T05:59:26.004 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.004 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.004 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.004 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.004 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.004 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.004 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6028 2024-09-14T05:59:26.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.004 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870340+0000", 2024-09-14T05:59:26.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870340+0000", 2024-09-14T05:59:26.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870340+0000", 2024-09-14T05:59:26.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4499999999999997e-07 2024-09-14T05:59:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870342+0000", 2024-09-14T05:59:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.244e-06 2024-09-14T05:59:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870349+0000", 2024-09-14T05:59:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5640000000000002e-06 2024-09-14T05:59:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870354+0000", 2024-09-14T05:59:26.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3029999999999999e-06 2024-09-14T05:59:26.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.883970+0000", 2024-09-14T05:59:26.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013615304 2024-09-14T05:59:26.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884014+0000", 2024-09-14T05:59:26.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3912000000000002e-05 2024-09-14T05:59:26.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884088+0000", 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4311000000000001e-05 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6029 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 872448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870386+0000", 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.0659630250000003, 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013989418999999999, 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.008 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.009 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.009 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.009 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6029 2024-09-14T05:59:26.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.009 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870386+0000", 2024-09-14T05:59:26.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870386+0000", 2024-09-14T05:59:26.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870387+0000", 2024-09-14T05:59:26.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4400000000000001e-07 2024-09-14T05:59:26.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870389+0000", 2024-09-14T05:59:26.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3649999999999998e-06 2024-09-14T05:59:26.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870403+0000", 2024-09-14T05:59:26.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3603e-05 2024-09-14T05:59:26.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870409+0000", 2024-09-14T05:59:26.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.767e-06 2024-09-14T05:59:26.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884135+0000", 2024-09-14T05:59:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01372603 2024-09-14T05:59:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884239+0000", 2024-09-14T05:59:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104141 2024-09-14T05:59:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884376+0000", 2024-09-14T05:59:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000137069 2024-09-14T05:59:26.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.013 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.013 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6030 3.1 3:8700b01b:::rbd_data.1127c133286b.0000000000000050:4 [read 1028096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.013 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870419+0000", 2024-09-14T05:59:26.013 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.065930753, 2024-09-14T05:59:26.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014083284, 2024-09-14T05:59:26.013 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.013 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.013 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.013 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.014 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.014 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.014 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6030 2024-09-14T05:59:26.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.014 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870419+0000", 2024-09-14T05:59:26.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870419+0000", 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870419+0000", 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3000000000000001e-07 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870422+0000", 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4219999999999999e-06 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870435+0000", 2024-09-14T05:59:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3729e-05 2024-09-14T05:59:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870441+0000", 2024-09-14T05:59:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3900000000000001e-06 2024-09-14T05:59:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884391+0000", 2024-09-14T05:59:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013950786999999999 2024-09-14T05:59:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884433+0000", 2024-09-14T05:59:26.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1559e-05 2024-09-14T05:59:26.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.884502+0000", 2024-09-14T05:59:26.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8867000000000003e-05 2024-09-14T05:59:26.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.017 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.017 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:8133 3.3 3:c6f36cf7:::rbd_data.112766adc194.0000000000000003:6 [sparse-read 4718592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T05:59:26.018 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:20.977211+0000", 2024-09-14T05:59:26.018 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.9591384529999996, 2024-09-14T05:59:26.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012271931999999999, 2024-09-14T05:59:26.018 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.018 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.018 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.018 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.018 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.018 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.018 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 8133 2024-09-14T05:59:26.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.018 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977211+0000", 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977211+0000", 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977212+0000", 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.327e-06 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977246+0000", 2024-09-14T05:59:26.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4173e-05 2024-09-14T05:59:26.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977266+0000", 2024-09-14T05:59:26.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0023000000000001e-05 2024-09-14T05:59:26.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977281+0000", 2024-09-14T05:59:26.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4589999999999999e-05 2024-09-14T05:59:26.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.988770+0000", 2024-09-14T05:59:26.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011489291 2024-09-14T05:59:26.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.989045+0000", 2024-09-14T05:59:26.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000274672 2024-09-14T05:59:26.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.989483+0000", 2024-09-14T05:59:26.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00043785599999999998 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:8144 3.3 3:c6f36cf7:::rbd_data.112766adc194.0000000000000003:6 [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:20.977303+0000", 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.9590465469999998, 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012937881, 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 8144 2024-09-14T05:59:26.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.023 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977303+0000", 2024-09-14T05:59:26.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977303+0000", 2024-09-14T05:59:26.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977304+0000", 2024-09-14T05:59:26.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.42e-06 2024-09-14T05:59:26.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977310+0000", 2024-09-14T05:59:26.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0399999999999998e-06 2024-09-14T05:59:26.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977328+0000", 2024-09-14T05:59:26.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7895999999999999e-05 2024-09-14T05:59:26.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977342+0000", 2024-09-14T05:59:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3859999999999999e-05 2024-09-14T05:59:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.989580+0000", 2024-09-14T05:59:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01223773 2024-09-14T05:59:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.989835+0000", 2024-09-14T05:59:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025570399999999999 2024-09-14T05:59:26.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.990241+0000", 2024-09-14T05:59:26.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00040523099999999998 2024-09-14T05:59:26.026 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.026 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.026 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.026 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:8145 3.3 3:c6f36cf7:::rbd_data.112766adc194.0000000000000003:6 [sparse-read 4849664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-14T05:59:26.026 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:20.977445+0000", 2024-09-14T05:59:26.026 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.9589040349999998, 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013340134999999999, 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 8145 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977445+0000", 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977445+0000", 2024-09-14T05:59:26.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977447+0000", 2024-09-14T05:59:26.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0030000000000001e-06 2024-09-14T05:59:26.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977452+0000", 2024-09-14T05:59:26.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9570000000000001e-06 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977471+0000", 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9017000000000001e-05 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.977487+0000", 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5376e-05 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.990331+0000", 2024-09-14T05:59:26.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012844288000000001 2024-09-14T05:59:26.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.990477+0000", 2024-09-14T05:59:26.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014558600000000001 2024-09-14T05:59:26.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:20.990785+0000", 2024-09-14T05:59:26.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030890799999999999 2024-09-14T05:59:26.030 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.031 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.031 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.031 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.031 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.031 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:26.033 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:26.033 INFO:teuthology.orchestra.run.smithi006.stdout:1021 read 0x81fe281 thru 0x8202b96 (0x4916 bytes) 2024-09-14T05:59:26.033 INFO:teuthology.orchestra.run.smithi006.stdout:1022 read 0x6ed6b69 thru 0x6edc8f1 (0x5d89 bytes) 2024-09-14T05:59:26.033 INFO:teuthology.orchestra.run.smithi006.stdout:1023 read 0x3473d87 thru 0x347fc8f (0xbf09 bytes) 2024-09-14T05:59:26.033 INFO:teuthology.orchestra.run.smithi006.stdout:1025 read 0x1594e92 thru 0x1596105 (0x1274 bytes) 2024-09-14T05:59:26.033 INFO:teuthology.orchestra.run.smithi006.stdout:1027 read 0x489220d thru 0x4892695 (0x489 bytes) 2024-09-14T05:59:26.033 INFO:teuthology.orchestra.run.smithi006.stdout:1028 write 0x962cdde thru 0x9637d39 (0xaf5c bytes) 2024-09-14T05:59:26.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:59:26.034 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:26.031+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:26.050 INFO:teuthology.orchestra.run.smithi006.stdout:1030 read 0x500ba10 thru 0x5018d6f (0xd360 bytes) 2024-09-14T05:59:26.052 INFO:teuthology.orchestra.run.smithi006.stdout:1031 write 0x273c0d9 thru 0x27445c3 (0x84eb bytes) 2024-09-14T05:59:26.091 INFO:teuthology.orchestra.run.smithi006.stdout:1032 read 0x799f774 thru 0x79a8dd0 (0x965d bytes) 2024-09-14T05:59:26.099 INFO:teuthology.orchestra.run.smithi006.stdout:1033 trunc from 0xc877cbe to 0x9c26785 2024-09-14T05:59:26.131 INFO:teuthology.orchestra.run.smithi006.stdout:1034 trunc from 0x9c26785 to 0xbde500c 2024-09-14T05:59:26.133 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:26.129+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:26.139 INFO:teuthology.orchestra.run.smithi006.stdout:1035 write 0x737ad17 thru 0x7387a6d (0xcd57 bytes) 2024-09-14T05:59:26.163 INFO:teuthology.orchestra.run.smithi006.stdout:1036 write 0x11eefd2 thru 0x11fa24f (0xb27e bytes) 2024-09-14T05:59:26.225 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:26.225 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:26.225 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:26.225 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:26.233 INFO:teuthology.orchestra.run.smithi006.stdout:1037 read 0xacbeae9 thru 0xacca511 (0xba29 bytes) 2024-09-14T05:59:26.233 INFO:teuthology.orchestra.run.smithi006.stdout:1038 write 0x66786f3 thru 0x6683bf5 (0xb503 bytes) 2024-09-14T05:59:26.234 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:26.229+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:26.241 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:59:26.252 INFO:teuthology.orchestra.run.smithi006.stdout:1039 write 0xc7adf thru 0xc9866 (0x1d88 bytes) 2024-09-14T05:59:26.288 INFO:teuthology.orchestra.run.smithi006.stdout:1040 punch from 0x3fa2cfd to 0x3fabe5f, (0x9162 bytes) 2024-09-14T05:59:26.288 INFO:teuthology.orchestra.run.smithi006.stdout:1041 read 0x5c5db9 thru 0x5cce17 (0x705f bytes) 2024-09-14T05:59:26.308 INFO:teuthology.orchestra.run.smithi006.stdout:1042 trunc from 0xbde500c to 0x2c553a8 2024-09-14T05:59:26.335 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:26.335+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:26.374 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:26.374 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:26.390 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:59:26.392 INFO:teuthology.orchestra.run.smithi006.stdout:1043 punch from 0x272cb82 to 0x2735c4b, (0x90c9 bytes) 2024-09-14T05:59:26.392 INFO:teuthology.orchestra.run.smithi006.stdout:1044 punch from 0x269cfae to 0x269d428, (0x47a bytes) 2024-09-14T05:59:26.412 INFO:teuthology.orchestra.run.smithi006.stdout:1045 writesame 0x6aec33e thru 0x6aed8cf data_size 0xb(0x1592 bytes) 2024-09-14T05:59:26.413 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:26.436 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:26.433+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:26.441 INFO:teuthology.orchestra.run.smithi006.stdout:1047 write 0xdb06d2c thru 0xdb15f64 (0xf239 bytes) 2024-09-14T05:59:26.453 INFO:teuthology.orchestra.run.smithi006.stdout:1049 trunc from 0xdb15f65 to 0xe0c2ac1 2024-09-14T05:59:26.462 INFO:teuthology.orchestra.run.smithi006.stdout:1051 punch from 0x2e54306 to 0x2e59286, (0x4f80 bytes) 2024-09-14T05:59:26.462 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:26.464 INFO:teuthology.orchestra.run.smithi006.stdout:1053 trunc from 0xe0c2ac1 to 0xd54af96 2024-09-14T05:59:26.482 INFO:teuthology.orchestra.run.smithi006.stdout:1054 writesame 0x6568fcc thru 0x6574c76 data_size 0x1(0xbcab bytes) 2024-09-14T05:59:26.519 INFO:teuthology.orchestra.run.smithi006.stdout:1056 read 0x8f6402f thru 0x8f727aa (0xe77c bytes) 2024-09-14T05:59:26.519 INFO:teuthology.orchestra.run.smithi006.stdout:1057 write 0xa94ddc6 thru 0xa954ff1 (0x722c bytes) 2024-09-14T05:59:26.527 INFO:teuthology.orchestra.run.smithi006.stdout:1058 writesame 0xd2408e4 thru 0xd24b5a3 data_size 0x20(0xacc0 bytes) 2024-09-14T05:59:26.536 INFO:teuthology.orchestra.run.smithi006.stdout:1059 read 0x622d6e9 thru 0x6237998 (0xa2b0 bytes) 2024-09-14T05:59:26.536 INFO:teuthology.orchestra.run.smithi006.stdout:1060 writesame 0x8af1f1b thru 0x8b00468 data_size 0x31(0xe54e bytes) 2024-09-14T05:59:26.536 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:26.535+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:26.557 INFO:teuthology.orchestra.run.smithi006.stdout:1061 write 0xdbf88e2 thru 0xdbfe481 (0x5ba0 bytes) 2024-09-14T05:59:26.565 INFO:teuthology.orchestra.run.smithi006.stdout:1062 trunc from 0xdbfe482 to 0xdfb7cba 2024-09-14T05:59:26.571 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4224 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 229376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.759977+0000", 2024-09-14T05:59:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8114414169999993, 2024-09-14T05:59:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.026699262000000001, 2024-09-14T05:59:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.571 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.572 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.572 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.572 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4224 2024-09-14T05:59:26.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.572 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.759977+0000", 2024-09-14T05:59:26.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.759977+0000", 2024-09-14T05:59:26.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.759978+0000", 2024-09-14T05:59:26.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.133e-06 2024-09-14T05:59:26.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.759983+0000", 2024-09-14T05:59:26.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9359999999999998e-06 2024-09-14T05:59:26.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760000+0000", 2024-09-14T05:59:26.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7124000000000001e-05 2024-09-14T05:59:26.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760013+0000", 2024-09-14T05:59:26.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.361e-05 2024-09-14T05:59:26.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786376+0000", 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.026363055999999999 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786458+0000", 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1427999999999994e-05 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786676+0000", 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000217975 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.575 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4225 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 380928~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760032+0000", 2024-09-14T05:59:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8113863210000005, 2024-09-14T05:59:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027212358999999998, 2024-09-14T05:59:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4225 2024-09-14T05:59:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760032+0000", 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760032+0000", 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760033+0000", 2024-09-14T05:59:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.217e-06 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760038+0000", 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1100000000000002e-06 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760056+0000", 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7595999999999999e-05 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760069+0000", 2024-09-14T05:59:26.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.293e-05 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786745+0000", 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.026676294999999999 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786878+0000", 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013333299999999999 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787244+0000", 2024-09-14T05:59:26.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036587799999999998 2024-09-14T05:59:26.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.580 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.580 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4226 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 532480~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.580 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760098+0000", 2024-09-14T05:59:26.580 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8113200450000004, 2024-09-14T05:59:26.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027297739000000001, 2024-09-14T05:59:26.580 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.580 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.580 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.580 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.581 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4226 2024-09-14T05:59:26.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.581 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760098+0000", 2024-09-14T05:59:26.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760098+0000", 2024-09-14T05:59:26.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760099+0000", 2024-09-14T05:59:26.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T05:59:26.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760105+0000", 2024-09-14T05:59:26.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3900000000000001e-06 2024-09-14T05:59:26.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760123+0000", 2024-09-14T05:59:26.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7853e-05 2024-09-14T05:59:26.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760136+0000", 2024-09-14T05:59:26.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3293e-05 2024-09-14T05:59:26.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787278+0000", 2024-09-14T05:59:26.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027142287000000001 2024-09-14T05:59:26.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787325+0000", 2024-09-14T05:59:26.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6663999999999999e-05 2024-09-14T05:59:26.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787396+0000", 2024-09-14T05:59:26.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0945000000000006e-05 2024-09-14T05:59:26.588 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.588 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.588 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.589 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4227 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 688128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.589 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760155+0000", 2024-09-14T05:59:26.589 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8112634589999992, 2024-09-14T05:59:26.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027419176, 2024-09-14T05:59:26.589 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.589 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.590 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.590 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.590 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.590 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.590 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4227 2024-09-14T05:59:26.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.591 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760155+0000", 2024-09-14T05:59:26.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760155+0000", 2024-09-14T05:59:26.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760156+0000", 2024-09-14T05:59:26.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0640000000000001e-06 2024-09-14T05:59:26.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760161+0000", 2024-09-14T05:59:26.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259999999999998e-06 2024-09-14T05:59:26.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760178+0000", 2024-09-14T05:59:26.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7577000000000001e-05 2024-09-14T05:59:26.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760191+0000", 2024-09-14T05:59:26.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2666999999999999e-05 2024-09-14T05:59:26.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787444+0000", 2024-09-14T05:59:26.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027253042000000002 2024-09-14T05:59:26.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787493+0000", 2024-09-14T05:59:26.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8942e-05 2024-09-14T05:59:26.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787574+0000", 2024-09-14T05:59:26.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0858000000000004e-05 2024-09-14T05:59:26.597 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.597 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.597 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.597 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4228 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 839680~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.597 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760209+0000", 2024-09-14T05:59:26.597 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8112094649999992, 2024-09-14T05:59:26.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027666842000000001, 2024-09-14T05:59:26.597 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.597 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.597 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.598 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.598 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.598 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.598 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4228 2024-09-14T05:59:26.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.598 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760209+0000", 2024-09-14T05:59:26.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760209+0000", 2024-09-14T05:59:26.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760210+0000", 2024-09-14T05:59:26.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1090000000000001e-06 2024-09-14T05:59:26.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760215+0000", 2024-09-14T05:59:26.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8840000000000002e-06 2024-09-14T05:59:26.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760232+0000", 2024-09-14T05:59:26.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7088999999999999e-05 2024-09-14T05:59:26.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760278+0000", 2024-09-14T05:59:26.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6853e-05 2024-09-14T05:59:26.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787640+0000", 2024-09-14T05:59:26.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027361143000000001 2024-09-14T05:59:26.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787757+0000", 2024-09-14T05:59:26.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117501 2024-09-14T05:59:26.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787875+0000", 2024-09-14T05:59:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118263 2024-09-14T05:59:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4229 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 991232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760299+0000", 2024-09-14T05:59:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8111192099999993, 2024-09-14T05:59:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027803151000000002, 2024-09-14T05:59:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.603 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.603 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.603 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4229 2024-09-14T05:59:26.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.603 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760299+0000", 2024-09-14T05:59:26.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760299+0000", 2024-09-14T05:59:26.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760300+0000", 2024-09-14T05:59:26.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4899999999999999e-06 2024-09-14T05:59:26.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760305+0000", 2024-09-14T05:59:26.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1769999999999997e-06 2024-09-14T05:59:26.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760325+0000", 2024-09-14T05:59:26.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9616999999999999e-05 2024-09-14T05:59:26.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760338+0000", 2024-09-14T05:59:26.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2903e-05 2024-09-14T05:59:26.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787925+0000", 2024-09-14T05:59:26.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027586658 2024-09-14T05:59:26.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.788008+0000", 2024-09-14T05:59:26.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3796999999999997e-05 2024-09-14T05:59:26.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.788102+0000", 2024-09-14T05:59:26.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3509000000000002e-05 2024-09-14T05:59:26.607 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.607 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.607 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.608 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4271 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 86016~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.608 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760417+0000", 2024-09-14T05:59:26.608 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8110010469999995, 2024-09-14T05:59:26.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030270609, 2024-09-14T05:59:26.608 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.608 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.608 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.608 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.608 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.608 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.608 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4271 2024-09-14T05:59:26.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760417+0000", 2024-09-14T05:59:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760417+0000", 2024-09-14T05:59:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760418+0000", 2024-09-14T05:59:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1230000000000001e-06 2024-09-14T05:59:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760436+0000", 2024-09-14T05:59:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.825e-05 2024-09-14T05:59:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760454+0000", 2024-09-14T05:59:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7759999999999999e-05 2024-09-14T05:59:26.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760468+0000", 2024-09-14T05:59:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3783e-05 2024-09-14T05:59:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.788193+0000", 2024-09-14T05:59:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027725428999999999 2024-09-14T05:59:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.788792+0000", 2024-09-14T05:59:26.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059851200000000005 2024-09-14T05:59:26.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.790688+0000", 2024-09-14T05:59:26.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0018957519999999999 2024-09-14T05:59:26.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.612 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.612 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4272 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 237568~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.612 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760488+0000", 2024-09-14T05:59:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8109297180000006, 2024-09-14T05:59:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030663546999999999, 2024-09-14T05:59:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4272 2024-09-14T05:59:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760488+0000", 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760488+0000", 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760489+0000", 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1400000000000001e-06 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760495+0000", 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.13e-06 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760512+0000", 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7056000000000001e-05 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760524+0000", 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2683999999999999e-05 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.790738+0000", 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030213509 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.790836+0000", 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8252999999999996e-05 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791152+0000", 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031577500000000002 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4273 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 393216~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760542+0000", 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8108759919999997, 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031086694000000002, 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4273 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760542+0000", 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760542+0000", 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760543+0000", 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2300000000000001e-06 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760548+0000", 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0039999999999999e-06 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760565+0000", 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7045999999999999e-05 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760578+0000", 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.276e-05 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791207+0000", 2024-09-14T05:59:26.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030628566999999999 2024-09-14T05:59:26.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791302+0000", 2024-09-14T05:59:26.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5870000000000002e-05 2024-09-14T05:59:26.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791629+0000", 2024-09-14T05:59:26.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032621700000000001 2024-09-14T05:59:26.620 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4274 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 544768~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760596+0000", 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8108222279999993, 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031394564999999999, 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4274 2024-09-14T05:59:26.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760596+0000", 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760596+0000", 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760597+0000", 2024-09-14T05:59:26.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760602+0000", 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9760000000000003e-06 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760619+0000", 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7430000000000001e-05 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760632+0000", 2024-09-14T05:59:26.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2856e-05 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791696+0000", 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031063666 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791810+0000", 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011434699999999999 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791990+0000", 2024-09-14T05:59:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018011000000000001 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4275 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 696320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760650+0000", 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8107682389999997, 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031562075000000002, 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4275 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760650+0000", 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760650+0000", 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760651+0000", 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7000000000000003e-07 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760656+0000", 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9629999999999997e-06 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760672+0000", 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6787e-05 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760685+0000", 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2706e-05 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792041+0000", 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031355782999999998 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792123+0000", 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2142000000000001e-05 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792212+0000", 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8724e-05 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4276 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 851968~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760703+0000", 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8107153959999991, 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031786208000000003, 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.630 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4276 2024-09-14T05:59:26.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.630 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760703+0000", 2024-09-14T05:59:26.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760703+0000", 2024-09-14T05:59:26.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760704+0000", 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.17e-06 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760723+0000", 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8940000000000002e-05 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760741+0000", 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7932999999999999e-05 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760758+0000", 2024-09-14T05:59:26.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7560000000000001e-05 2024-09-14T05:59:26.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792269+0000", 2024-09-14T05:59:26.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031510479000000001 2024-09-14T05:59:26.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792375+0000", 2024-09-14T05:59:26.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010609500000000001 2024-09-14T05:59:26.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792489+0000", 2024-09-14T05:59:26.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011403100000000001 2024-09-14T05:59:26.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.633 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.633 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4277 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 1003520~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.633 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760829+0000", 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8105893040000005, 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031877567000000002, 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4277 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760829+0000", 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760829+0000", 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760830+0000", 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6840000000000001e-06 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760849+0000", 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8542999999999998e-05 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760869+0000", 2024-09-14T05:59:26.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.967e-05 2024-09-14T05:59:26.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760900+0000", 2024-09-14T05:59:26.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1572999999999997e-05 2024-09-14T05:59:26.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792541+0000", 2024-09-14T05:59:26.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031640692999999998 2024-09-14T05:59:26.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792605+0000", 2024-09-14T05:59:26.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4339999999999997e-05 2024-09-14T05:59:26.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792706+0000", 2024-09-14T05:59:26.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010106399999999999 2024-09-14T05:59:26.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.638 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.638 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4319 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 98304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.638 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760993+0000", 2024-09-14T05:59:26.639 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8104248779999992, 2024-09-14T05:59:26.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032127042000000001, 2024-09-14T05:59:26.639 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.639 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.639 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.640 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4319 2024-09-14T05:59:26.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.640 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760993+0000", 2024-09-14T05:59:26.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760993+0000", 2024-09-14T05:59:26.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760994+0000", 2024-09-14T05:59:26.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.133e-06 2024-09-14T05:59:26.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761001+0000", 2024-09-14T05:59:26.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4269999999999996e-06 2024-09-14T05:59:26.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761018+0000", 2024-09-14T05:59:26.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7640000000000001e-05 2024-09-14T05:59:26.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761032+0000", 2024-09-14T05:59:26.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3399e-05 2024-09-14T05:59:26.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792742+0000", 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031710473000000003 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792835+0000", 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3105999999999999e-05 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793120+0000", 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028486400000000002 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4320 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 249856~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761051+0000", 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8103669520000008, 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032569796999999998, 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4320 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761051+0000", 2024-09-14T05:59:26.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761051+0000", 2024-09-14T05:59:26.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761052+0000", 2024-09-14T05:59:26.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.133e-06 2024-09-14T05:59:26.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761057+0000", 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.797e-06 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761073+0000", 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6160000000000001e-05 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761086+0000", 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793160+0000", 2024-09-14T05:59:26.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032073664000000002 2024-09-14T05:59:26.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793249+0000", 2024-09-14T05:59:26.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9473000000000002e-05 2024-09-14T05:59:26.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793621+0000", 2024-09-14T05:59:26.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037151399999999998 2024-09-14T05:59:26.648 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.649 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.649 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.649 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4321 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 401408~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.649 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761106+0000", 2024-09-14T05:59:26.649 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8103120859999997, 2024-09-14T05:59:26.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032930359999999999, 2024-09-14T05:59:26.649 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.649 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.649 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.649 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.649 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.649 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4321 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761106+0000", 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761106+0000", 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761107+0000", 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.037e-06 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761112+0000", 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9130000000000002e-06 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761129+0000", 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7144000000000001e-05 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761142+0000", 2024-09-14T05:59:26.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2926e-05 2024-09-14T05:59:26.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793654+0000", 2024-09-14T05:59:26.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032512438999999997 2024-09-14T05:59:26.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793765+0000", 2024-09-14T05:59:26.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111042 2024-09-14T05:59:26.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794036+0000", 2024-09-14T05:59:26.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027085899999999998 2024-09-14T05:59:26.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.653 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.653 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4322 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 557056~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.653 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761160+0000", 2024-09-14T05:59:26.654 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8102581000000004, 2024-09-14T05:59:26.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033073877000000002, 2024-09-14T05:59:26.654 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.654 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.654 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.654 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4322 2024-09-14T05:59:26.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.654 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761160+0000", 2024-09-14T05:59:26.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761160+0000", 2024-09-14T05:59:26.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761161+0000", 2024-09-14T05:59:26.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0499999999999999e-06 2024-09-14T05:59:26.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761181+0000", 2024-09-14T05:59:26.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0353e-05 2024-09-14T05:59:26.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761200+0000", 2024-09-14T05:59:26.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-09-14T05:59:26.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761213+0000", 2024-09-14T05:59:26.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2979999999999999e-05 2024-09-14T05:59:26.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794092+0000", 2024-09-14T05:59:26.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032878978000000003 2024-09-14T05:59:26.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794158+0000", 2024-09-14T05:59:26.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6026999999999997e-05 2024-09-14T05:59:26.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794234+0000", 2024-09-14T05:59:26.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5389000000000006e-05 2024-09-14T05:59:26.657 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.658 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.658 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.658 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4323 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 708608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.658 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761233+0000", 2024-09-14T05:59:26.658 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8101854300000007, 2024-09-14T05:59:26.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033143201999999997, 2024-09-14T05:59:26.658 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.658 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.658 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4323 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761233+0000", 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761233+0000", 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761234+0000", 2024-09-14T05:59:26.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.13e-06 2024-09-14T05:59:26.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761239+0000", 2024-09-14T05:59:26.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9869999999999999e-06 2024-09-14T05:59:26.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761255+0000", 2024-09-14T05:59:26.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6492999999999999e-05 2024-09-14T05:59:26.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761268+0000", 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2796000000000001e-05 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794276+0000", 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033008505 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794322+0000", 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5852000000000001e-05 2024-09-14T05:59:26.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794376+0000", 2024-09-14T05:59:26.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3439000000000001e-05 2024-09-14T05:59:26.662 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.662 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.662 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.662 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4324 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 860160~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.662 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761286+0000", 2024-09-14T05:59:26.662 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8101316870000002, 2024-09-14T05:59:26.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033242971000000003, 2024-09-14T05:59:26.662 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4324 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761286+0000", 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761286+0000", 2024-09-14T05:59:26.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761287+0000", 2024-09-14T05:59:26.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.133e-06 2024-09-14T05:59:26.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761292+0000", 2024-09-14T05:59:26.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7369999999999997e-06 2024-09-14T05:59:26.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761309+0000", 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7218999999999999e-05 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761322+0000", 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.278e-05 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794409+0000", 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033087111000000002 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794454+0000", 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4814000000000002e-05 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794529+0000", 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5177000000000002e-05 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4325 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 1015808~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761339+0000", 2024-09-14T05:59:26.666 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8100786679999992, 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033372190000000003, 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4325 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761339+0000", 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:26.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761339+0000", 2024-09-14T05:59:26.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:26.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:26.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761340+0000", 2024-09-14T05:59:26.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9000000000000005e-07 2024-09-14T05:59:26.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:26.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761345+0000", 2024-09-14T05:59:26.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2370000000000003e-06 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761362+0000", 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7842999999999998e-05 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761375+0000", 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2864000000000001e-05 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794569+0000", 2024-09-14T05:59:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033193328000000001 2024-09-14T05:59:26.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:26.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794641+0000", 2024-09-14T05:59:26.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2071999999999997e-05 2024-09-14T05:59:26.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:26.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:26.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:26.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794712+0000", 2024-09-14T05:59:26.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0856000000000001e-05 2024-09-14T05:59:26.670 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.670 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.671 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.671 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:26.671 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:26.671 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:26.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T05:59:26.673 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:26.671+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:26.674 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:26.674 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:26.674 INFO:teuthology.orchestra.run.smithi006.stdout:1065 read 0x25d34a4 thru 0x25da4b1 (0x700e bytes) 2024-09-14T05:59:26.674 INFO:teuthology.orchestra.run.smithi006.stdout:1066 read 0x5e7c864 thru 0x5e8967f (0xce1c bytes) 2024-09-14T05:59:26.674 INFO:teuthology.orchestra.run.smithi006.stdout:1067 writesame 0xa779020 thru 0xa77e0c7 data_size 0x59(0x50a8 bytes) 2024-09-14T05:59:26.674 INFO:teuthology.orchestra.run.smithi006.stdout:1068 write 0xb42ba3a thru 0xb433d5f (0x8326 bytes) 2024-09-14T05:59:26.674 INFO:teuthology.orchestra.run.smithi006.stdout:1069 read 0x482833c thru 0x4835016 (0xccdb bytes) 2024-09-14T05:59:26.674 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:26.674 INFO:teuthology.orchestra.run.smithi006.stdout:1071 read 0x24f468a thru 0x24f5948 (0x12bf bytes) 2024-09-14T05:59:26.675 INFO:teuthology.orchestra.run.smithi006.stdout:1072 trunc from 0xdfb7cba to 0xd7d4002 2024-09-14T05:59:26.675 INFO:teuthology.orchestra.run.smithi006.stdout:1074 writesame 0x64d56e0 thru 0x64d6b9e data_size 0x1(0x14bf bytes) 2024-09-14T05:59:26.675 INFO:teuthology.orchestra.run.smithi006.stdout:1075 write 0x4c959a0 thru 0x4ca10d7 (0xb738 bytes) 2024-09-14T05:59:26.675 INFO:teuthology.orchestra.run.smithi006.stdout:1076 writesame 0xd53cb34 thru 0xd5484b7 data_size 0x3e(0xb984 bytes) 2024-09-14T05:59:26.675 INFO:teuthology.orchestra.run.smithi006.stdout:1077 punch from 0x4e2be31 to 0x4e36d7a, (0xaf49 bytes) 2024-09-14T05:59:26.675 INFO:teuthology.orchestra.run.smithi006.stdout:1078 trunc from 0xd7d4002 to 0xe7b31df 2024-09-14T05:59:26.675 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2024-09-14T05:59:26.676 INFO:teuthology.orchestra.run.smithi006.stdout:1079 read 0x5f3b058 thru 0x5f41ca7 (0x6c50 bytes) 2024-09-14T05:59:26.676 INFO:teuthology.orchestra.run.smithi006.stdout:1081 writesame 0x5ff6618 thru 0x5ff6fe5 data_size 0x5(0x9ce bytes) 2024-09-14T05:59:26.676 INFO:teuthology.orchestra.run.smithi006.stdout:1082 writesame 0x5cf9163 thru 0x5cfc17a data_size 0x51(0x3018 bytes) 2024-09-14T05:59:26.676 INFO:teuthology.orchestra.run.smithi006.stdout:1083 trunc from 0xe7b31df to 0xec1ffe9 2024-09-14T05:59:26.680 INFO:teuthology.orchestra.run.smithi006.stdout:1084 read 0xa6146f1 thru 0xa62005f (0xb96f bytes) 2024-09-14T05:59:26.681 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:26.681 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:26.681 INFO:teuthology.orchestra.run.smithi006.stdout:1087 write 0x7105375 thru 0x7114343 (0xefcf bytes) 2024-09-14T05:59:26.692 INFO:teuthology.orchestra.run.smithi006.stdout:1088 write 0x2a39db thru 0x2aa0c0 (0x66e6 bytes) 2024-09-14T05:59:26.711 INFO:teuthology.orchestra.run.smithi006.stdout:1089 write 0xd1daeb7 thru 0xd1e5525 (0xa66f bytes) 2024-09-14T05:59:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:1090 read 0x13bb67f thru 0x13c5bd2 (0xa554 bytes) 2024-09-14T05:59:26.718 INFO:teuthology.orchestra.run.smithi006.stdout:1091 writesame 0xc3d4026 thru 0xc3e05be data_size 0x5(0xc599 bytes) 2024-09-14T05:59:26.732 INFO:teuthology.orchestra.run.smithi006.stdout:1092 read 0xb5fecd2 thru 0xb609430 (0xa75f bytes) 2024-09-14T05:59:26.733 INFO:teuthology.orchestra.run.smithi006.stdout:1093 writesame 0x7184ceb thru 0x7189a69 data_size 0x11(0x4d7f bytes) 2024-09-14T05:59:26.735 INFO:teuthology.orchestra.run.smithi006.stdout:1094 writesame 0x55f06d8 thru 0x55f7bff data_size 0x5c(0x7528 bytes) 2024-09-14T05:59:26.742 INFO:teuthology.orchestra.run.smithi006.stdout:1097 writesame 0x59737d3 thru 0x59745ea data_size 0xb(0xe18 bytes) 2024-09-14T05:59:26.750 INFO:teuthology.orchestra.run.smithi006.stdout:1100 write 0xe8058f9 thru 0xe811e3d (0xc545 bytes) 2024-09-14T05:59:26.761 INFO:teuthology.orchestra.run.smithi006.stdout:1101 read 0x10c61f1 thru 0x10c6e46 (0xc56 bytes) 2024-09-14T05:59:26.761 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:26.762 INFO:teuthology.orchestra.run.smithi006.stdout:1104 writesame 0x3faae5f thru 0x3fba55b data_size 0x1(0xf6fd bytes) 2024-09-14T05:59:26.773 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:26.771+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:26.790 INFO:teuthology.orchestra.run.smithi006.stdout:1106 write 0xa100152 thru 0xa10aff7 (0xaea6 bytes) 2024-09-14T05:59:26.799 INFO:teuthology.orchestra.run.smithi006.stdout:1107 write 0xd475b2e thru 0xd4786c1 (0x2b94 bytes) 2024-09-14T05:59:26.814 INFO:teuthology.orchestra.run.smithi006.stdout:1108 trunc from 0xec1ffe9 to 0xa0835e3 2024-09-14T05:59:26.840 INFO:teuthology.orchestra.run.smithi006.stdout:1109 punch from 0x3303bb8 to 0x3305375, (0x17bd bytes) 2024-09-14T05:59:26.852 INFO:teuthology.orchestra.run.smithi006.stdout:1110 write 0xb97e105 thru 0xb980008 (0x1f04 bytes) 2024-09-14T05:59:26.858 INFO:teuthology.orchestra.run.smithi006.stdout:1111 read 0x5f3795b thru 0x5f3dbf8 (0x629e bytes) 2024-09-14T05:59:26.859 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:26.859 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:26.859 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:26.859 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:26.868 INFO:teuthology.orchestra.run.smithi006.stdout:1114 write 0xbd86f3d thru 0xbd913fb (0xa4bf bytes) 2024-09-14T05:59:26.873 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:26.871+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:26.874 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T05:59:26.877 INFO:teuthology.orchestra.run.smithi006.stdout:1115 punch from 0xa938f10 to 0xa941b28, (0x8c18 bytes) 2024-09-14T05:59:26.877 INFO:teuthology.orchestra.run.smithi006.stdout:1116 read 0x80df9f2 thru 0x80e8967 (0x8f76 bytes) 2024-09-14T05:59:26.877 INFO:teuthology.orchestra.run.smithi006.stdout:1118 punch from 0x7f3bccc to 0x7f43ad3, (0x7e07 bytes) 2024-09-14T05:59:26.878 INFO:teuthology.orchestra.run.smithi006.stdout:1120 flatten 2024-09-14T05:59:26.944 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [0] live_osds: [1, 2, 3, 4, 5, 6, 7] 2024-09-14T05:59:26.944 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:59:26.945 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-14T05:59:26.945 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T05:59:26.945 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T05:59:26.945 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-14T05:59:26.974 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:26.971+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:27.061 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:27.117 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:27.117 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:27.117 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:27.117 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:27.118 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T05:59:27.119 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:27.115+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:27.123 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:27.123 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T05:59:27.123 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:27.144 INFO:teuthology.orchestra.run.smithi006.stdout:1121 read 0x754ae7a thru 0x7556c9b (0xbe22 bytes) 2024-09-14T05:59:27.144 INFO:teuthology.orchestra.run.smithi006.stdout:1122 read 0x53dd4c2 thru 0x53e8416 (0xaf55 bytes) 2024-09-14T05:59:27.144 INFO:teuthology.orchestra.run.smithi006.stdout:1126 write 0x9aa9434 thru 0x9aaa86d (0x143a bytes) 2024-09-14T05:59:27.150 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:27.150 INFO:teuthology.orchestra.run.smithi006.stdout:1129 writesame 0xac8415b thru 0xac8cddf data_size 0x15(0x8c85 bytes) 2024-09-14T05:59:27.170 INFO:teuthology.orchestra.run.smithi006.stdout:1130 trunc from 0xbd913fc to 0x27b0c54 2024-09-14T05:59:27.209 INFO:teuthology.orchestra.run.smithi006.stdout:1131 trunc from 0x27b0c54 to 0x557518d 2024-09-14T05:59:27.216 INFO:teuthology.orchestra.run.smithi006.stdout:1133 punch from 0x78fc50 to 0x79b057, (0xb407 bytes) 2024-09-14T05:59:27.219 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:27.219+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:27.234 INFO:teuthology.orchestra.run.smithi006.stdout:1135 write 0x90c26e8 thru 0x90c89f6 (0x630f bytes) 2024-09-14T05:59:27.246 INFO:teuthology.orchestra.run.smithi006.stdout:1136 trunc from 0x90c89f7 to 0xb39ca3c 2024-09-14T05:59:27.256 INFO:teuthology.orchestra.run.smithi006.stdout:1137 punch from 0x6b3bf58 to 0x6b4ae70, (0xef18 bytes) 2024-09-14T05:59:27.256 INFO:teuthology.orchestra.run.smithi006.stdout:1138 write 0x933ceed thru 0x934582e (0x8942 bytes) 2024-09-14T05:59:27.262 INFO:teuthology.orchestra.run.smithi006.stdout:1140 punch from 0x656d994 to 0x6571057, (0x36c3 bytes) 2024-09-14T05:59:27.262 INFO:teuthology.orchestra.run.smithi006.stdout:1141 write 0x46f26ed thru 0x47011b2 (0xeac6 bytes) 2024-09-14T05:59:27.280 INFO:teuthology.orchestra.run.smithi006.stdout:1143 trunc from 0xb39ca3c to 0x82c7117 2024-09-14T05:59:27.298 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:27.298 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:27.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:27.298 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:27.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.298 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5955 3.10 3:0c43f9fc:::rbd_data.1127c133286b.0000000000000052:4 [read 237568~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:27.298 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.868016+0000", 2024-09-14T05:59:27.298 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.4306155860000001, 2024-09-14T05:59:27.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010859529, 2024-09-14T05:59:27.299 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.299 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.299 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:27.299 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.299 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.299 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.299 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5955 2024-09-14T05:59:27.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.299 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868016+0000", 2024-09-14T05:59:27.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868016+0000", 2024-09-14T05:59:27.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868017+0000", 2024-09-14T05:59:27.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0499999999999999e-07 2024-09-14T05:59:27.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868019+0000", 2024-09-14T05:59:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8980000000000001e-06 2024-09-14T05:59:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868024+0000", 2024-09-14T05:59:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7309999999999998e-06 2024-09-14T05:59:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868030+0000", 2024-09-14T05:59:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4389999999999999e-06 2024-09-14T05:59:27.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.877356+0000", 2024-09-14T05:59:27.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093264720000000006 2024-09-14T05:59:27.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.877433+0000", 2024-09-14T05:59:27.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6922999999999995e-05 2024-09-14T05:59:27.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.878876+0000", 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001442661 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5958 3.10 3:0c43f9fc:::rbd_data.1127c133286b.0000000000000052:4 [read 696320~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.868080+0000", 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.4305517989999998, 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010236191, 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:27.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.304 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.304 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.304 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5958 2024-09-14T05:59:27.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.304 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868080+0000", 2024-09-14T05:59:27.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868080+0000", 2024-09-14T05:59:27.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868080+0000", 2024-09-14T05:59:27.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9499999999999998e-07 2024-09-14T05:59:27.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868083+0000", 2024-09-14T05:59:27.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1579999999999999e-06 2024-09-14T05:59:27.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868097+0000", 2024-09-14T05:59:27.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4161e-05 2024-09-14T05:59:27.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868103+0000", 2024-09-14T05:59:27.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0039999999999996e-06 2024-09-14T05:59:27.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.878129+0000", 2024-09-14T05:59:27.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010026424000000001 2024-09-14T05:59:27.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.878204+0000", 2024-09-14T05:59:27.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4955000000000003e-05 2024-09-14T05:59:27.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.878316+0000", 2024-09-14T05:59:27.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112094 2024-09-14T05:59:27.307 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.307 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.307 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.308 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5959 3.10 3:0c43f9fc:::rbd_data.1127c133286b.0000000000000052:4 [read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:27.308 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.868111+0000", 2024-09-14T05:59:27.308 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.4305206150000007, 2024-09-14T05:59:27.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010350142, 2024-09-14T05:59:27.308 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.308 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.308 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:27.308 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.308 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.308 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.308 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5959 2024-09-14T05:59:27.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.309 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868111+0000", 2024-09-14T05:59:27.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868111+0000", 2024-09-14T05:59:27.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868112+0000", 2024-09-14T05:59:27.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6199999999999998e-07 2024-09-14T05:59:27.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868118+0000", 2024-09-14T05:59:27.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5509999999999996e-06 2024-09-14T05:59:27.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868126+0000", 2024-09-14T05:59:27.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9840000000000001e-06 2024-09-14T05:59:27.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868131+0000", 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1710000000000001e-06 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.878331+0000", 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010199534 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.878372+0000", 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0732000000000002e-05 2024-09-14T05:59:27.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.878461+0000", 2024-09-14T05:59:27.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9608e-05 2024-09-14T05:59:27.312 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.312 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.312 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.312 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:5960 3.10 3:0c43f9fc:::rbd_data.1127c133286b.0000000000000052:4 [read 1003520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:27.312 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.868140+0000", 2024-09-14T05:59:27.312 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.4304919849999997, 2024-09-14T05:59:27.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010531366, 2024-09-14T05:59:27.313 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.313 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.313 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:27.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.313 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 5960 2024-09-14T05:59:27.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.313 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868140+0000", 2024-09-14T05:59:27.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868140+0000", 2024-09-14T05:59:27.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868140+0000", 2024-09-14T05:59:27.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6899999999999998e-07 2024-09-14T05:59:27.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868142+0000", 2024-09-14T05:59:27.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9700000000000002e-06 2024-09-14T05:59:27.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868149+0000", 2024-09-14T05:59:27.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3539999999999996e-06 2024-09-14T05:59:27.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.868152+0000", 2024-09-14T05:59:27.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8940000000000002e-06 2024-09-14T05:59:27.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.878486+0000", 2024-09-14T05:59:27.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01033426 2024-09-14T05:59:27.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.878560+0000", 2024-09-14T05:59:27.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3998000000000005e-05 2024-09-14T05:59:27.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.878671+0000", 2024-09-14T05:59:27.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111421 2024-09-14T05:59:27.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.316 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.317 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.317 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6001 3.10 3:0c43f9fc:::rbd_data.1127c133286b.0000000000000052:4 [read 860160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:27.317 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870077+0000", 2024-09-14T05:59:27.317 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.4285551339999998, 2024-09-14T05:59:27.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010064330999999999, 2024-09-14T05:59:27.317 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.317 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.317 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:27.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.318 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6001 2024-09-14T05:59:27.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.318 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870077+0000", 2024-09-14T05:59:27.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870077+0000", 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870077+0000", 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5200000000000002e-07 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870079+0000", 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1550000000000001e-06 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870086+0000", 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4670000000000001e-06 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870091+0000", 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0250000000000002e-06 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.879947+0000", 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009856386 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880023+0000", 2024-09-14T05:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5386e-05 2024-09-14T05:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880141+0000", 2024-09-14T05:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011846 2024-09-14T05:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6002 3.10 3:0c43f9fc:::rbd_data.1127c133286b.0000000000000052:4 [read 1015808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870098+0000", 2024-09-14T05:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.428533796, 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010268183, 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6002 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870098+0000", 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870098+0000", 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870098+0000", 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.27e-07 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870101+0000", 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.187e-06 2024-09-14T05:59:27.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870107+0000", 2024-09-14T05:59:27.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2829999999999998e-06 2024-09-14T05:59:27.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870112+0000", 2024-09-14T05:59:27.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8500000000000002e-06 2024-09-14T05:59:27.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880171+0000", 2024-09-14T05:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010059471 2024-09-14T05:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880254+0000", 2024-09-14T05:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2354000000000005e-05 2024-09-14T05:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880366+0000", 2024-09-14T05:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112611 2024-09-14T05:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6038 3.10 3:0c43f9fc:::rbd_data.1127c133286b.0000000000000052:4 [read 106496~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870119+0000", 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.4285130820000003, 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010499972, 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6038 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870119+0000", 2024-09-14T05:59:27.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870119+0000", 2024-09-14T05:59:27.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870119+0000", 2024-09-14T05:59:27.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870121+0000", 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1129999999999999e-06 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870127+0000", 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870132+0000", 2024-09-14T05:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880397+0000", 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010264966 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880476+0000", 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8920999999999999e-05 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880619+0000", 2024-09-14T05:59:27.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014267500000000001 2024-09-14T05:59:27.330 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.330 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.330 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.330 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6039 3.10 3:0c43f9fc:::rbd_data.1127c133286b.0000000000000052:4 [read 262144~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:27.330 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870139+0000", 2024-09-14T05:59:27.330 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.4284926700000007, 2024-09-14T05:59:27.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010713561, 2024-09-14T05:59:27.330 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.330 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.330 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:27.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6039 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870139+0000", 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870139+0000", 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870140+0000", 2024-09-14T05:59:27.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8099999999999998e-07 2024-09-14T05:59:27.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870142+0000", 2024-09-14T05:59:27.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0059999999999999e-06 2024-09-14T05:59:27.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870148+0000", 2024-09-14T05:59:27.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3409999999999999e-06 2024-09-14T05:59:27.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870153+0000", 2024-09-14T05:59:27.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3090000000000003e-06 2024-09-14T05:59:27.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880649+0000", 2024-09-14T05:59:27.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010495694 2024-09-14T05:59:27.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880722+0000", 2024-09-14T05:59:27.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2639999999999996e-05 2024-09-14T05:59:27.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880853+0000", 2024-09-14T05:59:27.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013119 2024-09-14T05:59:27.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.334 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.334 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6040 3.10 3:0c43f9fc:::rbd_data.1127c133286b.0000000000000052:4 [read 413696~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:27.334 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870160+0000", 2024-09-14T05:59:27.334 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.4284717669999996, 2024-09-14T05:59:27.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010933302000000001, 2024-09-14T05:59:27.335 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.335 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.335 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:27.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.335 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6040 2024-09-14T05:59:27.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.335 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870160+0000", 2024-09-14T05:59:27.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870160+0000", 2024-09-14T05:59:27.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870160+0000", 2024-09-14T05:59:27.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T05:59:27.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870162+0000", 2024-09-14T05:59:27.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8929999999999999e-06 2024-09-14T05:59:27.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870169+0000", 2024-09-14T05:59:27.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.195e-06 2024-09-14T05:59:27.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870173+0000", 2024-09-14T05:59:27.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7439999999999998e-06 2024-09-14T05:59:27.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880884+0000", 2024-09-14T05:59:27.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010710503999999999 2024-09-14T05:59:27.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.880959+0000", 2024-09-14T05:59:27.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5646e-05 2024-09-14T05:59:27.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881093+0000", 2024-09-14T05:59:27.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013397100000000001 2024-09-14T05:59:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6041 3.10 3:0c43f9fc:::rbd_data.1127c133286b.0000000000000052:4 [read 565248~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870180+0000", 2024-09-14T05:59:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.4284514480000006, 2024-09-14T05:59:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011148521, 2024-09-14T05:59:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:27.339 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6041 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870180+0000", 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870180+0000", 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870181+0000", 2024-09-14T05:59:27.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.08e-07 2024-09-14T05:59:27.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870183+0000", 2024-09-14T05:59:27.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.661e-06 2024-09-14T05:59:27.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870190+0000", 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5039999999999999e-06 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870195+0000", 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0300000000000001e-06 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881126+0000", 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010931309 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881199+0000", 2024-09-14T05:59:27.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2607000000000005e-05 2024-09-14T05:59:27.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881329+0000", 2024-09-14T05:59:27.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013000199999999999 2024-09-14T05:59:27.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.343 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.343 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6042 3.10 3:0c43f9fc:::rbd_data.1127c133286b.0000000000000052:4 [read 720896~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:27.343 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870202+0000", 2024-09-14T05:59:27.343 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.4284298149999994, 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011358513000000001, 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6042 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870202+0000", 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870202+0000", 2024-09-14T05:59:27.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870202+0000", 2024-09-14T05:59:27.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2100000000000002e-07 2024-09-14T05:59:27.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870205+0000", 2024-09-14T05:59:27.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3089999999999998e-06 2024-09-14T05:59:27.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870211+0000", 2024-09-14T05:59:27.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T05:59:27.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870216+0000", 2024-09-14T05:59:27.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8409999999999999e-06 2024-09-14T05:59:27.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881359+0000", 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011143156 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881435+0000", 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5811999999999999e-05 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881561+0000", 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012556899999999999 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6043 3.10 3:0c43f9fc:::rbd_data.1127c133286b.0000000000000052:4 [read 872448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870237+0000", 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.4283943969999999, 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011543272, 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6043 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870237+0000", 2024-09-14T05:59:27.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870237+0000", 2024-09-14T05:59:27.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870238+0000", 2024-09-14T05:59:27.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.68e-07 2024-09-14T05:59:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870240+0000", 2024-09-14T05:59:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3360000000000002e-06 2024-09-14T05:59:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870247+0000", 2024-09-14T05:59:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.007e-06 2024-09-14T05:59:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870257+0000", 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4809999999999995e-06 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881595+0000", 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011337763000000001 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881669+0000", 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4721000000000005e-05 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881781+0000", 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111296 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:6044 3.10 3:0c43f9fc:::rbd_data.1127c133286b.0000000000000052:4 [read 1024000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.870266+0000", 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.4283659439999994, 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011738528, 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.352 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 6044 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870266+0000", 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870266+0000", 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870266+0000", 2024-09-14T05:59:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5899999999999996e-07 2024-09-14T05:59:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870269+0000", 2024-09-14T05:59:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8449999999999999e-06 2024-09-14T05:59:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870276+0000", 2024-09-14T05:59:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.409e-06 2024-09-14T05:59:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.870280+0000", 2024-09-14T05:59:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7520000000000004e-06 2024-09-14T05:59:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881812+0000", 2024-09-14T05:59:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011531183 2024-09-14T05:59:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.881893+0000", 2024-09-14T05:59:27.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0865999999999995e-05 2024-09-14T05:59:27.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.882004+0000", 2024-09-14T05:59:27.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111914 2024-09-14T05:59:27.356 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.356 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.356 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.356 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:10194 3.10 3:0b248e4b:::rbd_object_map.1127368d46aa:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-14T05:59:27.356 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:25.800465+0000", 2024-09-14T05:59:27.356 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.498166796, 2024-09-14T05:59:27.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010334902, 2024-09-14T05:59:27.357 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.357 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.357 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:27.357 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.357 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.357 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.357 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 10194 2024-09-14T05:59:27.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.357 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800465+0000", 2024-09-14T05:59:27.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800465+0000", 2024-09-14T05:59:27.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800466+0000", 2024-09-14T05:59:27.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.057e-06 2024-09-14T05:59:27.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800473+0000", 2024-09-14T05:59:27.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0999999999999998e-06 2024-09-14T05:59:27.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800490+0000", 2024-09-14T05:59:27.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7240000000000001e-05 2024-09-14T05:59:27.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800509+0000", 2024-09-14T05:59:27.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.88e-05 2024-09-14T05:59:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.803474+0000", 2024-09-14T05:59:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029647789999999999 2024-09-14T05:59:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.803617+0000", 2024-09-14T05:59:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000143265 2024-09-14T05:59:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.810610+0000", 2024-09-14T05:59:27.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069927990000000001 2024-09-14T05:59:27.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:27.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.810691+0000", 2024-09-14T05:59:27.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0778999999999993e-05 2024-09-14T05:59:27.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.810800+0000", 2024-09-14T05:59:27.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109083 2024-09-14T05:59:27.361 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.361 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.362 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.362 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:10195 3.10 3:0b248e4b:::rbd_object_map.1127368d46aa:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-14T05:59:27.362 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:25.800530+0000", 2024-09-14T05:59:27.362 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.498102168, 2024-09-14T05:59:27.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010484376, 2024-09-14T05:59:27.362 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.362 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.362 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:27.362 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.362 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.362 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.363 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 10195 2024-09-14T05:59:27.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.363 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800530+0000", 2024-09-14T05:59:27.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800530+0000", 2024-09-14T05:59:27.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800531+0000", 2024-09-14T05:59:27.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:59:27.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800537+0000", 2024-09-14T05:59:27.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0229999999999998e-06 2024-09-14T05:59:27.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800553+0000", 2024-09-14T05:59:27.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6497000000000001e-05 2024-09-14T05:59:27.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800567+0000", 2024-09-14T05:59:27.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3142999999999999e-05 2024-09-14T05:59:27.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.804785+0000", 2024-09-14T05:59:27.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042182809999999999 2024-09-14T05:59:27.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.804909+0000", 2024-09-14T05:59:27.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012453599999999999 2024-09-14T05:59:27.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:27.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.810823+0000", 2024-09-14T05:59:27.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059139500000000003 2024-09-14T05:59:27.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:27.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.810916+0000", 2024-09-14T05:59:27.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3072999999999995e-05 2024-09-14T05:59:27.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.811014+0000", 2024-09-14T05:59:27.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7693000000000001e-05 2024-09-14T05:59:27.367 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.367 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.367 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.367 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:10196 3.10 3:0b248e4b:::rbd_object_map.1127368d46aa:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-14T05:59:27.367 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:25.800585+0000", 2024-09-14T05:59:27.367 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.4980466539999999, 2024-09-14T05:59:27.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010615527, 2024-09-14T05:59:27.367 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.367 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.368 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:27.368 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.368 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.368 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.368 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 10196 2024-09-14T05:59:27.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.368 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800585+0000", 2024-09-14T05:59:27.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800585+0000", 2024-09-14T05:59:27.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800586+0000", 2024-09-14T05:59:27.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7399999999999991e-07 2024-09-14T05:59:27.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800593+0000", 2024-09-14T05:59:27.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8689999999999998e-06 2024-09-14T05:59:27.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800609+0000", 2024-09-14T05:59:27.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.632e-05 2024-09-14T05:59:27.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800622+0000", 2024-09-14T05:59:27.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2921999999999999e-05 2024-09-14T05:59:27.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.806024+0000", 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054017429999999996 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.806165+0000", 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014061499999999999 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.811041+0000", 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048764949999999998 2024-09-14T05:59:27.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:27.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.811106+0000", 2024-09-14T05:59:27.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5376000000000006e-05 2024-09-14T05:59:27.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.811201+0000", 2024-09-14T05:59:27.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4213000000000001e-05 2024-09-14T05:59:27.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.372 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.373 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:10197 3.10 3:0b248e4b:::rbd_object_map.1127368d46aa:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-14T05:59:27.373 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:25.800645+0000", 2024-09-14T05:59:27.373 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.4979867119999999, 2024-09-14T05:59:27.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015457383999999999, 2024-09-14T05:59:27.373 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.373 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.373 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:27.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.373 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 10197 2024-09-14T05:59:27.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800645+0000", 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800645+0000", 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800646+0000", 2024-09-14T05:59:27.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.037e-06 2024-09-14T05:59:27.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800656+0000", 2024-09-14T05:59:27.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4229999999999994e-06 2024-09-14T05:59:27.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800672+0000", 2024-09-14T05:59:27.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6328999999999999e-05 2024-09-14T05:59:27.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800685+0000", 2024-09-14T05:59:27.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2954e-05 2024-09-14T05:59:27.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.807897+0000", 2024-09-14T05:59:27.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072125710000000001 2024-09-14T05:59:27.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.808057+0000", 2024-09-14T05:59:27.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000160049 2024-09-14T05:59:27.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:27.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.815741+0000", 2024-09-14T05:59:27.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076839600000000001 2024-09-14T05:59:27.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:27.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.815870+0000", 2024-09-14T05:59:27.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128279 2024-09-14T05:59:27.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.816103+0000", 2024-09-14T05:59:27.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023278200000000001 2024-09-14T05:59:27.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.378 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.378 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:10198 3.10 3:0b248e4b:::rbd_object_map.1127368d46aa:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-14T05:59:27.378 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:25.800703+0000", 2024-09-14T05:59:27.378 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.497929244, 2024-09-14T05:59:27.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016048064000000001, 2024-09-14T05:59:27.378 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.378 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.378 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:27.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.379 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 10198 2024-09-14T05:59:27.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.379 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800703+0000", 2024-09-14T05:59:27.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800703+0000", 2024-09-14T05:59:27.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800703+0000", 2024-09-14T05:59:27.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6600000000000005e-07 2024-09-14T05:59:27.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800710+0000", 2024-09-14T05:59:27.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1319999999999999e-06 2024-09-14T05:59:27.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800725+0000", 2024-09-14T05:59:27.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5557e-05 2024-09-14T05:59:27.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800738+0000", 2024-09-14T05:59:27.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2699e-05 2024-09-14T05:59:27.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.809275+0000", 2024-09-14T05:59:27.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085369209999999994 2024-09-14T05:59:27.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.809412+0000", 2024-09-14T05:59:27.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013702199999999999 2024-09-14T05:59:27.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:27.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.816393+0000", 2024-09-14T05:59:27.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069813460000000003 2024-09-14T05:59:27.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:27.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.816547+0000", 2024-09-14T05:59:27.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015353900000000001 2024-09-14T05:59:27.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.816751+0000", 2024-09-14T05:59:27.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020398200000000001 2024-09-14T05:59:27.383 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.383 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.383 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.383 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:10199 3.10 3:0b248e4b:::rbd_object_map.1127368d46aa:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-14T05:59:27.383 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:25.800755+0000", 2024-09-14T05:59:27.384 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.4978772579999999, 2024-09-14T05:59:27.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016223062999999999, 2024-09-14T05:59:27.384 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.384 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.384 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:27.384 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.384 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.384 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.384 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 10199 2024-09-14T05:59:27.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.384 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800755+0000", 2024-09-14T05:59:27.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800755+0000", 2024-09-14T05:59:27.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800756+0000", 2024-09-14T05:59:27.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0079999999999999e-06 2024-09-14T05:59:27.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800762+0000", 2024-09-14T05:59:27.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3230000000000003e-06 2024-09-14T05:59:27.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800778+0000", 2024-09-14T05:59:27.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5996999999999999e-05 2024-09-14T05:59:27.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.800790+0000", 2024-09-14T05:59:27.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2431e-05 2024-09-14T05:59:27.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.811243+0000", 2024-09-14T05:59:27.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010452873999999999 2024-09-14T05:59:27.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.811330+0000", 2024-09-14T05:59:27.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6533000000000007e-05 2024-09-14T05:59:27.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:27.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.816770+0000", 2024-09-14T05:59:27.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054404350000000004 2024-09-14T05:59:27.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:27.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.816846+0000", 2024-09-14T05:59:27.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5786999999999998e-05 2024-09-14T05:59:27.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:25.816978+0000", 2024-09-14T05:59:27.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013167499999999999 2024-09-14T05:59:27.389 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.389 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.389 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.389 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:11936 3.a 3:54a355e1:::rbd_data.1127ff8b71e0.000000000000003c:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:27.389 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:26.771778+0000", 2024-09-14T05:59:27.389 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.52685425100000005, 2024-09-14T05:59:27.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010963407, 2024-09-14T05:59:27.389 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.389 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.389 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:27.389 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.390 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.390 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.390 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 11936 2024-09-14T05:59:27.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.390 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:26.771778+0000", 2024-09-14T05:59:27.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:26.771778+0000", 2024-09-14T05:59:27.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:26.771779+0000", 2024-09-14T05:59:27.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5570000000000001e-06 2024-09-14T05:59:27.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:26.771787+0000", 2024-09-14T05:59:27.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1110000000000008e-06 2024-09-14T05:59:27.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:26.771805+0000", 2024-09-14T05:59:27.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8002000000000001e-05 2024-09-14T05:59:27.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:26.771815+0000", 2024-09-14T05:59:27.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8339999999999994e-06 2024-09-14T05:59:27.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:26.771870+0000", 2024-09-14T05:59:27.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5170000000000002e-05 2024-09-14T05:59:27.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:26.771986+0000", 2024-09-14T05:59:27.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115816 2024-09-14T05:59:27.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T05:59:27.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:26.773301+0000", 2024-09-14T05:59:27.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001315323 2024-09-14T05:59:27.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:27.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:26.782615+0000", 2024-09-14T05:59:27.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093138379999999996 2024-09-14T05:59:27.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:27.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:26.782658+0000", 2024-09-14T05:59:27.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2837999999999999e-05 2024-09-14T05:59:27.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:27.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:26.782698+0000", 2024-09-14T05:59:27.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9566e-05 2024-09-14T05:59:27.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:27.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:26.782741+0000", 2024-09-14T05:59:27.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3352000000000001e-05 2024-09-14T05:59:27.395 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.395 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.395 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.395 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.395 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.395 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:27.397 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T05:59:27.397 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:27.395+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:27.398 INFO:teuthology.orchestra.run.smithi006.stdout:1144 write 0x6c9e18f thru 0x6cabf1f (0xdd91 bytes) 2024-09-14T05:59:27.398 INFO:teuthology.orchestra.run.smithi006.stdout:1145 trunc from 0x82c7117 to 0x1de4f5f 2024-09-14T05:59:27.398 INFO:teuthology.orchestra.run.smithi006.stdout:1146 read 0x9e1b40 thru 0x9e9de3 (0x82a4 bytes) 2024-09-14T05:59:27.398 INFO:teuthology.orchestra.run.smithi006.stdout:1147 read 0x256d48 thru 0x260339 (0x95f2 bytes) 2024-09-14T05:59:27.398 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:27.398 INFO:teuthology.orchestra.run.smithi006.stdout:1149 punch from 0x9a8e to 0x18b65, (0xf0d7 bytes) 2024-09-14T05:59:27.398 INFO:teuthology.orchestra.run.smithi006.stdout:1150 write 0xb0a1260 thru 0xb0a683f (0x55e0 bytes) 2024-09-14T05:59:27.398 INFO:teuthology.orchestra.run.smithi006.stdout:1152 punch from 0x1c283b3 to 0x1c2dca7, (0x58f4 bytes) 2024-09-14T05:59:27.398 INFO:teuthology.orchestra.run.smithi006.stdout:1153 read 0x79e2515 thru 0x79edef1 (0xb9dd bytes) 2024-09-14T05:59:27.413 INFO:teuthology.orchestra.run.smithi006.stdout:1154 write 0xd4ae20a thru 0xd4aea47 (0x83e bytes) 2024-09-14T05:59:27.421 INFO:teuthology.orchestra.run.smithi006.stdout:1155 punch from 0x47f7592 to 0x480634e, (0xedbc bytes) 2024-09-14T05:59:27.421 INFO:teuthology.orchestra.run.smithi006.stdout:1158 write 0x7927369 thru 0x7927d9d (0xa35 bytes) 2024-09-14T05:59:27.443 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:59:27.455 INFO:teuthology.orchestra.run.smithi006.stdout:1159 trunc from 0xd4aea48 to 0x2e09b28 2024-09-14T05:59:27.487 INFO:teuthology.orchestra.run.smithi006.stdout:1160 write 0x5d94576 thru 0x5d9c2f7 (0x7d82 bytes) 2024-09-14T05:59:27.494 INFO:teuthology.orchestra.run.smithi006.stdout:1161 read 0x19416d4 thru 0x19476bd (0x5fea bytes) 2024-09-14T05:59:27.497 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:27.495+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:27.504 INFO:teuthology.orchestra.run.smithi006.stdout:1162 trunc from 0x5d9c2f8 to 0xa4f196 2024-09-14T05:59:27.543 INFO:teuthology.orchestra.run.smithi006.stdout:1164 trunc from 0xa4f196 to 0xb81476a 2024-09-14T05:59:27.554 INFO:teuthology.orchestra.run.smithi006.stdout:1165 write 0x94cfa90 thru 0x94dc0c5 (0xc636 bytes) 2024-09-14T05:59:27.563 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:27.563 INFO:teuthology.orchestra.run.smithi006.stdout:1167 read 0x9a2f31a thru 0x9a39dae (0xaa95 bytes) 2024-09-14T05:59:27.563 INFO:teuthology.orchestra.run.smithi006.stdout:1168 write 0x5172aa6 thru 0x517f327 (0xc882 bytes) 2024-09-14T05:59:27.582 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:27.582 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:27.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.582 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:14499 3.d 3:b17c29e1:::rbd_header.1127ff8b71e0:head [call rbd.set_size in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:27.582 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:27.584108+0000", 2024-09-14T05:59:27.582 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00154255, 2024-09-14T05:59:27.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001567487, 2024-09-14T05:59:27.583 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:27.583 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:27.583 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-09-14T05:59:27.583 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:27.583 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:27.583 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:27.583 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 14499 2024-09-14T05:59:27.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.583 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:27.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:27.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:27.584108+0000", 2024-09-14T05:59:27.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:27.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:27.584108+0000", 2024-09-14T05:59:27.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:27.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:27.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:27.584111+0000", 2024-09-14T05:59:27.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2879999999999999e-06 2024-09-14T05:59:27.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:27.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:27.584118+0000", 2024-09-14T05:59:27.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4780000000000002e-06 2024-09-14T05:59:27.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:27.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:27.584137+0000", 2024-09-14T05:59:27.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9406999999999999e-05 2024-09-14T05:59:27.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:27.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:27.584148+0000", 2024-09-14T05:59:27.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0438999999999999e-05 2024-09-14T05:59:27.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:27.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:27.584312+0000", 2024-09-14T05:59:27.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000164215 2024-09-14T05:59:27.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:27.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:27.584451+0000", 2024-09-14T05:59:27.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013891899999999999 2024-09-14T05:59:27.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:27.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:27.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 5", 2024-09-14T05:59:27.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:27.584746+0000", 2024-09-14T05:59:27.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029514100000000001 2024-09-14T05:59:27.587 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.587 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:27.587 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.587 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:27.587 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-09-14T05:59:27.587 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 1 2024-09-14T05:59:27.587 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:27.588 INFO:teuthology.orchestra.run.smithi006.stdout:1169 write 0xedbdab9 thru 0xedc16cd (0x3c15 bytes) 2024-09-14T05:59:27.595 INFO:teuthology.orchestra.run.smithi006.stdout:1171 punch from 0x26275fb to 0x262ec75, (0x767a bytes) 2024-09-14T05:59:27.595 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:27.595 INFO:teuthology.orchestra.run.smithi006.stdout:1174 read 0xc0a8f96 thru 0xc0b6db4 (0xde1f bytes) 2024-09-14T05:59:27.595 INFO:teuthology.orchestra.run.smithi006.stdout:1175 read 0x5f494a2 thru 0x5f51876 (0x83d5 bytes) 2024-09-14T05:59:27.595 INFO:teuthology.orchestra.run.smithi006.stdout:1176 read 0xc9c822b thru 0xc9d1a43 (0x9819 bytes) 2024-09-14T05:59:27.595 INFO:teuthology.orchestra.run.smithi006.stdout:1178 read 0xad5e224 thru 0xad62183 (0x3f60 bytes) 2024-09-14T05:59:27.595 INFO:teuthology.orchestra.run.smithi006.stdout:1179 read 0x41a4b18 thru 0x41ae264 (0x974d bytes) 2024-09-14T05:59:27.595 INFO:teuthology.orchestra.run.smithi006.stdout:1180 write 0x75db7f5 thru 0x75df9a6 (0x41b2 bytes) 2024-09-14T05:59:27.598 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:27.593+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:27.599 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T05:59:27.601 INFO:teuthology.orchestra.run.smithi006.stdout:1182 read 0x33837ac thru 0x3383ca0 (0x4f5 bytes) 2024-09-14T05:59:27.611 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T05:59:27.617 INFO:teuthology.orchestra.run.smithi006.stdout:1183 trunc from 0xedc16ce to 0x415e465 2024-09-14T05:59:27.632 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:27.638 INFO:teuthology.orchestra.run.smithi006.stdout:1184 trunc from 0x415e465 to 0x579d5d8 2024-09-14T05:59:27.645 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:27.645 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:27.645 INFO:teuthology.orchestra.run.smithi006.stdout:1189 write 0x38c93af thru 0x38d64a2 (0xd0f4 bytes) 2024-09-14T05:59:27.649 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:27.657 INFO:teuthology.orchestra.run.smithi006.stdout:1190 read 0xa17f45 thru 0xa24b1d (0xcbd9 bytes) 2024-09-14T05:59:27.659 INFO:teuthology.orchestra.run.smithi006.stdout:1191 punch from 0x2f55c73 to 0x2f583f0, (0x277d bytes) 2024-09-14T05:59:27.664 INFO:teuthology.orchestra.run.smithi006.stdout:1194 trunc from 0x579d5d8 to 0x27e14c0 2024-09-14T05:59:27.668 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:27.669 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:27.680 INFO:teuthology.orchestra.run.smithi006.stdout:1195 trunc from 0x27e14c0 to 0xd25ea 2024-09-14T05:59:27.689 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:27.689 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:27.698 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:27.693+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:27.700 INFO:teuthology.orchestra.run.smithi006.stdout:1196 read 0x7a3cc thru 0x87308 (0xcf3d bytes) 2024-09-14T05:59:27.708 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:27.708 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:27.709 INFO:teuthology.orchestra.run.smithi006.stdout:1197 write 0x62eb51 thru 0x6390a8 (0xa558 bytes) 2024-09-14T05:59:27.728 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:27.729 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:27.736 INFO:teuthology.orchestra.run.smithi006.stdout:1198 write 0x6c2c66d thru 0x6c32089 (0x5a1d bytes) 2024-09-14T05:59:27.742 INFO:teuthology.orchestra.run.smithi006.stdout:1201 read 0x2d1c455 thru 0x2d20203 (0x3daf bytes) 2024-09-14T05:59:27.742 INFO:teuthology.orchestra.run.smithi006.stdout:1203 write 0xe73fb1 thru 0xe753d9 (0x1429 bytes) 2024-09-14T05:59:27.749 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:27.750 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:27.753 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T05:59:27.753 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T05:59:27.761 INFO:teuthology.orchestra.run.smithi006.stdout:1206 writesame 0x75ff1d3 thru 0x7605ee0 data_size 0x8d(0x6d0e bytes) 2024-09-14T05:59:27.767 INFO:teuthology.orchestra.run.smithi006.stdout:1207 trunc from 0x7605ee1 to 0xba78f11 2024-09-14T05:59:27.778 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:27.778 INFO:teuthology.orchestra.run.smithi006.stdout:1209 read 0x624b051 thru 0x6257c27 (0xcbd7 bytes) 2024-09-14T05:59:27.778 INFO:teuthology.orchestra.run.smithi006.stdout:1210 writesame 0x69e1f24 thru 0x69ef2be data_size 0x27(0xd39b bytes) 2024-09-14T05:59:27.782 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:27.782 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:27.788 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:27.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T05:59:27.799 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:27.797+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:27.804 INFO:teuthology.orchestra.run.smithi006.stdout:1213 writesame 0xe9ee401 thru 0xe9f5625 data_size 0x1(0x7225 bytes) 2024-09-14T05:59:27.804 INFO:teuthology.orchestra.run.smithi006.stdout:1215 write 0x64fc934 thru 0x64fff59 (0x3626 bytes) 2024-09-14T05:59:27.809 INFO:teuthology.orchestra.run.smithi006.stdout:1216 writesame 0x51d8a thru 0x54b60 data_size 0x1(0x2dd7 bytes) 2024-09-14T05:59:27.817 INFO:teuthology.orchestra.run.smithi006.stdout:1218 writesame 0x47cadc3 thru 0x47d2d2c data_size 0x2(0x7f6a bytes) 2024-09-14T05:59:27.834 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:27.834 INFO:teuthology.orchestra.run.smithi006.stdout:1223 write 0xac5431a thru 0xac562c4 (0x1fab bytes) 2024-09-14T05:59:27.839 INFO:teuthology.orchestra.run.smithi006.stdout:1224 writesame 0xe75eb51 thru 0xe762453 data_size 0x23(0x3903 bytes) 2024-09-14T05:59:27.846 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:27.879 INFO:teuthology.orchestra.run.smithi006.stdout:1226 trunc from 0xe9f5626 to 0x22ad584 2024-09-14T05:59:27.899 INFO:teuthology.orchestra.run.smithi006.stdout:1228 read 0x1159333 thru 0x115ac57 (0x1925 bytes) 2024-09-14T05:59:27.899 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:27.899+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:27.919 INFO:teuthology.orchestra.run.smithi006.stdout:1229 writesame 0x5ba4c8c thru 0x5bb3a10 data_size 0x1(0xed85 bytes) 2024-09-14T05:59:27.919 INFO:teuthology.orchestra.run.smithi006.stdout:1230 writesame 0x32e3159 thru 0x32ebd60 data_size 0x4(0x8c08 bytes) 2024-09-14T05:59:27.924 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:27.924 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:27.933 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:27.933 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:27.940 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:59:27.962 INFO:teuthology.orchestra.run.smithi006.stdout:1234 write 0xc7f32fd thru 0xc7f388d (0x591 bytes) 2024-09-14T05:59:27.967 INFO:teuthology.orchestra.run.smithi006.stdout:1235 trunc from 0xc7f388e to 0xc55df85 2024-09-14T05:59:27.997 INFO:teuthology.orchestra.run.smithi006.stdout:1236 trunc from 0xc55df85 to 0xa673a2 2024-09-14T05:59:28.001 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:27.997+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:28.016 INFO:teuthology.orchestra.run.smithi006.stdout:1237 read 0x5c1174 thru 0x5c5a95 (0x4922 bytes) 2024-09-14T05:59:28.017 INFO:teuthology.orchestra.run.smithi006.stdout:1239 punch from 0x591ae9 to 0x595b5e, (0x4075 bytes) 2024-09-14T05:59:28.018 INFO:teuthology.orchestra.run.smithi006.stdout:1240 read 0x11aee0 thru 0x11db7e (0x2c9f bytes) 2024-09-14T05:59:28.018 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:28.028 INFO:teuthology.orchestra.run.smithi006.stdout:1243 trunc from 0xa673a2 to 0x6ec11e6 2024-09-14T05:59:28.066 INFO:teuthology.orchestra.run.smithi006.stdout:1244 writesame 0xcf368fe thru 0xcf43d54 data_size 0x1(0xd457 bytes) 2024-09-14T05:59:28.066 INFO:teuthology.orchestra.run.smithi006.stdout:1246 read 0x9662997 thru 0x96642bc (0x1926 bytes) 2024-09-14T05:59:28.073 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:28.074 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:28.083 INFO:teuthology.orchestra.run.smithi006.stdout:1248 writesame 0xe55c966 thru 0xe5631a3 data_size 0xb(0x683e bytes) 2024-09-14T05:59:28.083 INFO:teuthology.orchestra.run.smithi006.stdout:1249 read 0x79bc180 thru 0x79cb750 (0xf5d1 bytes) 2024-09-14T05:59:28.083 INFO:teuthology.orchestra.run.smithi006.stdout:1250 read 0xb9c2937 thru 0xb9c7633 (0x4cfd bytes) 2024-09-14T05:59:28.084 INFO:teuthology.orchestra.run.smithi006.stdout:1251 write 0xb480fde thru 0xb48a69f (0x96c2 bytes) 2024-09-14T05:59:28.088 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:59:28.095 INFO:teuthology.orchestra.run.smithi006.stdout:1253 write 0x42efa0a thru 0x42f7cd0 (0x82c7 bytes) 2024-09-14T05:59:28.105 INFO:teuthology.orchestra.run.smithi006.stdout:1254 write 0x2f8db55 thru 0x2f8e0da (0x586 bytes) 2024-09-14T05:59:28.105 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:28.101+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:28.112 INFO:teuthology.orchestra.run.smithi006.stdout:1258 writesame 0xb1f7c38 thru 0xb2016a4 data_size 0x1(0x9a6d bytes) 2024-09-14T05:59:28.151 INFO:teuthology.orchestra.run.smithi006.stdout:1259 punch from 0xbb892f1 to 0xbb8e536, (0x5245 bytes) 2024-09-14T05:59:28.152 INFO:teuthology.orchestra.run.smithi006.stdout:1260 read 0x6c90d40 thru 0x6c9af90 (0xa251 bytes) 2024-09-14T05:59:28.152 INFO:teuthology.orchestra.run.smithi006.stdout:1261 write 0x28df1b thru 0x29943e (0xb524 bytes) 2024-09-14T05:59:28.155 INFO:teuthology.orchestra.run.smithi006.stdout:1262 writesame 0xbbd5b7 thru 0xbc7b77 data_size 0x1(0xa5c1 bytes) 2024-09-14T05:59:28.186 INFO:teuthology.orchestra.run.smithi006.stdout:1263 read 0xb44fbaa thru 0xb457821 (0x7c78 bytes) 2024-09-14T05:59:28.188 INFO:teuthology.orchestra.run.smithi006.stdout:1264 read 0xc0eb05b thru 0xc0ec3db (0x1381 bytes) 2024-09-14T05:59:28.188 INFO:teuthology.orchestra.run.smithi006.stdout:1265 punch from 0x6453bf9 to 0x6460f3c, (0xd343 bytes) 2024-09-14T05:59:28.188 INFO:teuthology.orchestra.run.smithi006.stdout:1266 read 0x7c30f15 thru 0x7c3d1ed (0xc2d9 bytes) 2024-09-14T05:59:28.188 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:28.188 INFO:teuthology.orchestra.run.smithi006.stdout:1268 read 0xda99dfe thru 0xda9cdf9 (0x2ffc bytes) 2024-09-14T05:59:28.190 INFO:teuthology.orchestra.run.smithi006.stdout:1270 trunc from 0xe5631a4 to 0xd527b5a 2024-09-14T05:59:28.202 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:28.197+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:28.203 INFO:teuthology.orchestra.run.smithi006.stdout:1271 writesame 0x3257a02 thru 0x325f45f data_size 0x45(0x7a5e bytes) 2024-09-14T05:59:28.214 INFO:teuthology.orchestra.run.smithi006.stdout:1273 punch from 0xa486fc1 to 0xa48e7e9, (0x7828 bytes) 2024-09-14T05:59:28.214 INFO:teuthology.orchestra.run.smithi006.stdout:1274 writesame 0xe66d73 thru 0xe6b1dc data_size 0x3f(0x446a bytes) 2024-09-14T05:59:28.223 INFO:teuthology.orchestra.run.smithi006.stdout:1275 read 0x34fa39b thru 0x34fba36 (0x169c bytes) 2024-09-14T05:59:28.223 INFO:teuthology.orchestra.run.smithi006.stdout:1276 read 0x22b8345 thru 0x22c75fd (0xf2b9 bytes) 2024-09-14T05:59:28.223 INFO:teuthology.orchestra.run.smithi006.stdout:1278 write 0xb824194 thru 0xb826fa3 (0x2e10 bytes) 2024-09-14T05:59:28.227 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:28.227 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:28.230 INFO:teuthology.orchestra.run.smithi006.stdout:1279 read 0x93f12cb thru 0x93f93fc (0x8132 bytes) 2024-09-14T05:59:28.230 INFO:teuthology.orchestra.run.smithi006.stdout:1280 read 0xbe1f66a thru 0xbe2838c (0x8d23 bytes) 2024-09-14T05:59:28.230 INFO:teuthology.orchestra.run.smithi006.stdout:1282 punch from 0xb9299c4 to 0xb93377b, (0x9db7 bytes) 2024-09-14T05:59:28.230 INFO:teuthology.orchestra.run.smithi006.stdout:1283 write 0xb633325 thru 0xb63ac7e (0x795a bytes) 2024-09-14T05:59:28.245 INFO:teuthology.orchestra.run.smithi006.stdout:1284 trunc from 0xd527b5a to 0x7e0a533 2024-09-14T05:59:28.246 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:59:28.270 INFO:teuthology.orchestra.run.smithi006.stdout:1285 punch from 0x5358f06 to 0x536254c, (0x9646 bytes) 2024-09-14T05:59:28.271 INFO:teuthology.orchestra.run.smithi006.stdout:1287 punch from 0x2194024 to 0x21a02ec, (0xc2c8 bytes) 2024-09-14T05:59:28.271 INFO:teuthology.orchestra.run.smithi006.stdout:1288 write 0x690018 thru 0x697a5e (0x7a47 bytes) 2024-09-14T05:59:28.285 INFO:teuthology.orchestra.run.smithi006.stdout:1289 trunc from 0x7e0a533 to 0x357444d 2024-09-14T05:59:28.304 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:28.303+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:28.309 INFO:teuthology.orchestra.run.smithi006.stdout:1290 read 0x256aa77 thru 0x256caa5 (0x202f bytes) 2024-09-14T05:59:28.309 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:28.309 INFO:teuthology.orchestra.run.smithi006.stdout:1292 read 0x199d203 thru 0x19a865d (0xb45b bytes) 2024-09-14T05:59:28.343 INFO:teuthology.orchestra.run.smithi006.stdout:1293 writesame 0xb82c363 thru 0xb833a58 data_size 0x1(0x76f6 bytes) 2024-09-14T05:59:28.343 INFO:teuthology.orchestra.run.smithi006.stdout:1294 read 0x2cf01a1 thru 0x2cfe98c (0xe7ec bytes) 2024-09-14T05:59:28.344 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:28.345 INFO:teuthology.orchestra.run.smithi006.stdout:1299 read 0x69a67f4 thru 0x69aba36 (0x5243 bytes) 2024-09-14T05:59:28.345 INFO:teuthology.orchestra.run.smithi006.stdout:1300 write 0x9202cc7 thru 0x92114b4 (0xe7ee bytes) 2024-09-14T05:59:28.359 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:28.359 INFO:teuthology.orchestra.run.smithi006.stdout:1302 punch from 0x8e67ee8 to 0x8e6d4fa, (0x5612 bytes) 2024-09-14T05:59:28.360 INFO:teuthology.orchestra.run.smithi006.stdout:1303 write 0x41fc94e thru 0x4206bbf (0xa272 bytes) 2024-09-14T05:59:28.370 INFO:teuthology.orchestra.run.smithi006.stdout:1306 read 0x5f33796 thru 0x5f35db9 (0x2624 bytes) 2024-09-14T05:59:28.370 INFO:teuthology.orchestra.run.smithi006.stdout:1307 read 0x72922e1 thru 0x72a0399 (0xe0b9 bytes) 2024-09-14T05:59:28.388 INFO:teuthology.orchestra.run.smithi006.stdout:1310 writesame 0xe2972fa thru 0xe29f304 data_size 0x1(0x800b bytes) 2024-09-14T05:59:28.388 INFO:teuthology.orchestra.run.smithi006.stdout:1311 write 0x7c9b426 thru 0x7ca04cf (0x50aa bytes) 2024-09-14T05:59:28.398 INFO:teuthology.orchestra.run.smithi006.stdout:1314 read 0xc42db1e thru 0xc43079b (0x2c7e bytes) 2024-09-14T05:59:28.399 INFO:teuthology.orchestra.run.smithi006.stdout:1315 writesame 0x9bc23eb thru 0x9bd18ff data_size 0x1(0xf515 bytes) 2024-09-14T05:59:28.402 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:28.402 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:28.405 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:28.401+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:28.418 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:59:28.428 INFO:teuthology.orchestra.run.smithi006.stdout:1316 read 0xd98d158 thru 0xd99903b (0xbee4 bytes) 2024-09-14T05:59:28.428 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:28.428 INFO:teuthology.orchestra.run.smithi006.stdout:1318 read 0x6402a6c thru 0x6404a50 (0x1fe5 bytes) 2024-09-14T05:59:28.428 INFO:teuthology.orchestra.run.smithi006.stdout:1319 write 0x4c97134 thru 0x4ca0be0 (0x9aad bytes) 2024-09-14T05:59:28.440 INFO:teuthology.orchestra.run.smithi006.stdout:1321 writesame 0x7f5617c thru 0x7f65243 data_size 0x5c(0xf0c8 bytes) 2024-09-14T05:59:28.446 INFO:teuthology.orchestra.run.smithi006.stdout:1322 read 0x2053405 thru 0x205d06a (0x9c66 bytes) 2024-09-14T05:59:28.446 INFO:teuthology.orchestra.run.smithi006.stdout:1323 write 0xd7ddaf2 thru 0xd7eba33 (0xdf42 bytes) 2024-09-14T05:59:28.460 INFO:teuthology.orchestra.run.smithi006.stdout:1324 writesame 0x5ef241b thru 0x5ef4f84 data_size 0x1(0x2b6a bytes) 2024-09-14T05:59:28.477 INFO:teuthology.orchestra.run.smithi006.stdout:1325 trunc from 0xe29f305 to 0xc882a3b 2024-09-14T05:59:28.506 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:28.501+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:28.521 INFO:teuthology.orchestra.run.smithi006.stdout:1326 trunc from 0xc882a3b to 0x4c29202 2024-09-14T05:59:28.552 INFO:teuthology.orchestra.run.smithi006.stdout:1327 clone 9 order 18 su 2048 sc 7 2024-09-14T05:59:28.560 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:28.561 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:28.575 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:59:28.619 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:28.617+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:28.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:59:28.723 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:28.721+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:28.751 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:28.751 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:28.767 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:59:28.808 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:28.807+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:28.908 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:28.905+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:28.909 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-14T05:59:28.943 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:28.943 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:28.959 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:59:28.976 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:28.976 INFO:teuthology.orchestra.run.smithi006.stdout:1329 read 0x2f233d9 thru 0x2f28a3a (0x5662 bytes) 2024-09-14T05:59:28.978 INFO:teuthology.orchestra.run.smithi006.stdout:1330 punch from 0x46fd0e0 to 0x47009c2, (0x38e2 bytes) 2024-09-14T05:59:28.984 INFO:teuthology.orchestra.run.smithi006.stdout:1332 writesame 0x30a6b6c thru 0x30b49b9 data_size 0x69(0xde4e bytes) 2024-09-14T05:59:29.009 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:29.007+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:29.073 INFO:teuthology.orchestra.run.smithi006.stdout:1333 writesame 0x23cc4df thru 0x23dc36a data_size 0x16(0xfe8c bytes) 2024-09-14T05:59:29.089 INFO:teuthology.orchestra.run.smithi006.stdout:1334 write 0x105f4d0 thru 0x106c757 (0xd288 bytes) 2024-09-14T05:59:29.102 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:29.102 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:29.110 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:29.107+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:29.111 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:29.111 INFO:teuthology.orchestra.run.smithi006.stdout:1336 read 0x59d00a thru 0x5a44a3 (0x749a bytes) 2024-09-14T05:59:29.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:59:29.137 INFO:teuthology.orchestra.run.smithi006.stdout:1338 write 0xb6b52a5 thru 0xb6bb727 (0x6483 bytes) 2024-09-14T05:59:29.174 INFO:teuthology.orchestra.run.smithi006.stdout:1342 write 0xd4d96a3 thru 0xd4e29a6 (0x9304 bytes) 2024-09-14T05:59:29.190 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:29.191 INFO:teuthology.orchestra.run.smithi006.stdout:1344 writesame 0x4db5454 thru 0x4db9807 data_size 0xe(0x43b4 bytes) 2024-09-14T05:59:29.209 INFO:teuthology.orchestra.run.smithi006.stdout:1345 write 0xc97af98 thru 0xc982570 (0x75d9 bytes) 2024-09-14T05:59:29.210 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:29.207+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:29.229 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:29.229 INFO:teuthology.orchestra.run.smithi006.stdout:1347 write 0xa1d80f3 thru 0xa1dc3c7 (0x42d5 bytes) 2024-09-14T05:59:29.244 INFO:teuthology.orchestra.run.smithi006.stdout:1351 clone 10 order 24 su 262144 sc 2 2024-09-14T05:59:29.270 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:29.270 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:29.285 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:59:29.327 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:29.325+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:29.413 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:29.409+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:29.454 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:29.454 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:29.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:59:29.513 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:29.509+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:29.601 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:29.601 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:29.615 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:59:29.616 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:29.613+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:29.683 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2024-09-14T05:59:29.738 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:29.738 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:29.751 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:29.749+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:29.754 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:59:29.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:59:29.791 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone9 from 0xd4e29a7 (overlap 0x4c29202) to 0x1e76d9a 2024-09-14T05:59:29.817 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:29.815+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:29.913 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T05:59:29.916 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:29.917 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:29.917 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:29.915+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:29.934 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:29.934 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:29.937 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:59:29.955 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:29.956 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:29.979 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:29.979 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:30.002 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:30.002 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:30.022 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:30.022 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:30.024 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:30.023+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:30.047 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:30.047 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:30.091 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:30.095 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T05:59:30.095 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T05:59:30.119 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:30.115+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:30.163 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:30.163 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:30.163 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:30.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:59:30.231 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:30.231+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:30.305 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-14T05:59:30.320 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:30.319+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:30.351 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:30.351 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:30.352 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:30.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:59:30.451 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:30.450+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:30.522 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:30.518+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:30.532 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:30.532 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:30.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:30.532 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:30.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.532 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4224 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 229376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.532 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.759977+0000", 2024-09-14T05:59:30.533 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.772943890000001, 2024-09-14T05:59:30.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.026699262000000001, 2024-09-14T05:59:30.533 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.533 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.533 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.533 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.533 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.533 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.533 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4224 2024-09-14T05:59:30.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.533 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.759977+0000", 2024-09-14T05:59:30.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.759977+0000", 2024-09-14T05:59:30.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.759978+0000", 2024-09-14T05:59:30.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.133e-06 2024-09-14T05:59:30.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.759983+0000", 2024-09-14T05:59:30.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9359999999999998e-06 2024-09-14T05:59:30.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760000+0000", 2024-09-14T05:59:30.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7124000000000001e-05 2024-09-14T05:59:30.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760013+0000", 2024-09-14T05:59:30.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.361e-05 2024-09-14T05:59:30.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786376+0000", 2024-09-14T05:59:30.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.026363055999999999 2024-09-14T05:59:30.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786458+0000", 2024-09-14T05:59:30.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1427999999999994e-05 2024-09-14T05:59:30.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786676+0000", 2024-09-14T05:59:30.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000217975 2024-09-14T05:59:30.538 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.538 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.538 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.538 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4225 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 380928~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.538 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760032+0000", 2024-09-14T05:59:30.538 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.772888794, 2024-09-14T05:59:30.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027212358999999998, 2024-09-14T05:59:30.539 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.539 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.539 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.539 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.539 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.539 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.539 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4225 2024-09-14T05:59:30.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.539 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760032+0000", 2024-09-14T05:59:30.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760032+0000", 2024-09-14T05:59:30.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760033+0000", 2024-09-14T05:59:30.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.217e-06 2024-09-14T05:59:30.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760038+0000", 2024-09-14T05:59:30.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1100000000000002e-06 2024-09-14T05:59:30.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760056+0000", 2024-09-14T05:59:30.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7595999999999999e-05 2024-09-14T05:59:30.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760069+0000", 2024-09-14T05:59:30.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.293e-05 2024-09-14T05:59:30.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786745+0000", 2024-09-14T05:59:30.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.026676294999999999 2024-09-14T05:59:30.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.786878+0000", 2024-09-14T05:59:30.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013333299999999999 2024-09-14T05:59:30.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787244+0000", 2024-09-14T05:59:30.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036587799999999998 2024-09-14T05:59:30.543 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.543 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.543 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.544 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4226 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 532480~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.544 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760098+0000", 2024-09-14T05:59:30.544 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.772822518, 2024-09-14T05:59:30.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027297739000000001, 2024-09-14T05:59:30.544 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.544 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.544 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.544 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.544 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.545 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4226 2024-09-14T05:59:30.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.545 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760098+0000", 2024-09-14T05:59:30.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760098+0000", 2024-09-14T05:59:30.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760099+0000", 2024-09-14T05:59:30.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T05:59:30.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760105+0000", 2024-09-14T05:59:30.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3900000000000001e-06 2024-09-14T05:59:30.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760123+0000", 2024-09-14T05:59:30.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7853e-05 2024-09-14T05:59:30.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760136+0000", 2024-09-14T05:59:30.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3293e-05 2024-09-14T05:59:30.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787278+0000", 2024-09-14T05:59:30.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027142287000000001 2024-09-14T05:59:30.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787325+0000", 2024-09-14T05:59:30.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6663999999999999e-05 2024-09-14T05:59:30.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787396+0000", 2024-09-14T05:59:30.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0945000000000006e-05 2024-09-14T05:59:30.549 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.549 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.549 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.549 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4227 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 688128~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.549 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760155+0000", 2024-09-14T05:59:30.550 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.772765932, 2024-09-14T05:59:30.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027419176, 2024-09-14T05:59:30.550 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.550 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.550 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.550 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.550 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.550 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.550 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4227 2024-09-14T05:59:30.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.550 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760155+0000", 2024-09-14T05:59:30.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760155+0000", 2024-09-14T05:59:30.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760156+0000", 2024-09-14T05:59:30.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0640000000000001e-06 2024-09-14T05:59:30.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760161+0000", 2024-09-14T05:59:30.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259999999999998e-06 2024-09-14T05:59:30.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760178+0000", 2024-09-14T05:59:30.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7577000000000001e-05 2024-09-14T05:59:30.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760191+0000", 2024-09-14T05:59:30.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2666999999999999e-05 2024-09-14T05:59:30.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787444+0000", 2024-09-14T05:59:30.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027253042000000002 2024-09-14T05:59:30.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787493+0000", 2024-09-14T05:59:30.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8942e-05 2024-09-14T05:59:30.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787574+0000", 2024-09-14T05:59:30.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0858000000000004e-05 2024-09-14T05:59:30.554 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.554 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.554 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.555 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4228 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 839680~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.555 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760209+0000", 2024-09-14T05:59:30.555 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.772711938, 2024-09-14T05:59:30.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027666842000000001, 2024-09-14T05:59:30.555 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.555 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.555 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.555 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.555 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.555 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.555 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4228 2024-09-14T05:59:30.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.556 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760209+0000", 2024-09-14T05:59:30.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760209+0000", 2024-09-14T05:59:30.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760210+0000", 2024-09-14T05:59:30.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1090000000000001e-06 2024-09-14T05:59:30.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760215+0000", 2024-09-14T05:59:30.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8840000000000002e-06 2024-09-14T05:59:30.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760232+0000", 2024-09-14T05:59:30.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7088999999999999e-05 2024-09-14T05:59:30.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760278+0000", 2024-09-14T05:59:30.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6853e-05 2024-09-14T05:59:30.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787640+0000", 2024-09-14T05:59:30.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027361143000000001 2024-09-14T05:59:30.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787757+0000", 2024-09-14T05:59:30.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117501 2024-09-14T05:59:30.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787875+0000", 2024-09-14T05:59:30.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118263 2024-09-14T05:59:30.560 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.560 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.560 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.560 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4229 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 991232~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.560 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760299+0000", 2024-09-14T05:59:30.560 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.772621683000001, 2024-09-14T05:59:30.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027803151000000002, 2024-09-14T05:59:30.560 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.560 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.560 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.561 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.561 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.561 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.561 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4229 2024-09-14T05:59:30.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.561 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760299+0000", 2024-09-14T05:59:30.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760299+0000", 2024-09-14T05:59:30.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760300+0000", 2024-09-14T05:59:30.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4899999999999999e-06 2024-09-14T05:59:30.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760305+0000", 2024-09-14T05:59:30.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1769999999999997e-06 2024-09-14T05:59:30.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760325+0000", 2024-09-14T05:59:30.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9616999999999999e-05 2024-09-14T05:59:30.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760338+0000", 2024-09-14T05:59:30.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2903e-05 2024-09-14T05:59:30.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.787925+0000", 2024-09-14T05:59:30.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027586658 2024-09-14T05:59:30.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.788008+0000", 2024-09-14T05:59:30.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3796999999999997e-05 2024-09-14T05:59:30.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.788102+0000", 2024-09-14T05:59:30.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3509000000000002e-05 2024-09-14T05:59:30.565 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.565 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.565 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.565 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4271 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 86016~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.565 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760417+0000", 2024-09-14T05:59:30.565 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.772503520000001, 2024-09-14T05:59:30.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030270609, 2024-09-14T05:59:30.566 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.566 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.566 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.566 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4271 2024-09-14T05:59:30.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.566 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760417+0000", 2024-09-14T05:59:30.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760417+0000", 2024-09-14T05:59:30.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760418+0000", 2024-09-14T05:59:30.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1230000000000001e-06 2024-09-14T05:59:30.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760436+0000", 2024-09-14T05:59:30.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.825e-05 2024-09-14T05:59:30.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760454+0000", 2024-09-14T05:59:30.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7759999999999999e-05 2024-09-14T05:59:30.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760468+0000", 2024-09-14T05:59:30.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3783e-05 2024-09-14T05:59:30.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.788193+0000", 2024-09-14T05:59:30.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027725428999999999 2024-09-14T05:59:30.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.788792+0000", 2024-09-14T05:59:30.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059851200000000005 2024-09-14T05:59:30.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.790688+0000", 2024-09-14T05:59:30.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0018957519999999999 2024-09-14T05:59:30.570 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.570 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.570 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.571 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4272 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 237568~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.571 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760488+0000", 2024-09-14T05:59:30.571 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.772432191, 2024-09-14T05:59:30.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030663546999999999, 2024-09-14T05:59:30.571 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.571 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.571 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.571 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.571 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.571 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.571 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4272 2024-09-14T05:59:30.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.572 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760488+0000", 2024-09-14T05:59:30.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760488+0000", 2024-09-14T05:59:30.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760489+0000", 2024-09-14T05:59:30.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1400000000000001e-06 2024-09-14T05:59:30.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760495+0000", 2024-09-14T05:59:30.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.13e-06 2024-09-14T05:59:30.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760512+0000", 2024-09-14T05:59:30.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7056000000000001e-05 2024-09-14T05:59:30.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760524+0000", 2024-09-14T05:59:30.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2683999999999999e-05 2024-09-14T05:59:30.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.790738+0000", 2024-09-14T05:59:30.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030213509 2024-09-14T05:59:30.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.790836+0000", 2024-09-14T05:59:30.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8252999999999996e-05 2024-09-14T05:59:30.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791152+0000", 2024-09-14T05:59:30.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031577500000000002 2024-09-14T05:59:30.575 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.576 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.576 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.576 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4273 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 393216~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.576 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760542+0000", 2024-09-14T05:59:30.576 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.772378464999999, 2024-09-14T05:59:30.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031086694000000002, 2024-09-14T05:59:30.576 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.576 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.576 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.577 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.577 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.577 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.577 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4273 2024-09-14T05:59:30.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.577 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760542+0000", 2024-09-14T05:59:30.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760542+0000", 2024-09-14T05:59:30.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760543+0000", 2024-09-14T05:59:30.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2300000000000001e-06 2024-09-14T05:59:30.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760548+0000", 2024-09-14T05:59:30.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0039999999999999e-06 2024-09-14T05:59:30.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760565+0000", 2024-09-14T05:59:30.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7045999999999999e-05 2024-09-14T05:59:30.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760578+0000", 2024-09-14T05:59:30.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.276e-05 2024-09-14T05:59:30.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791207+0000", 2024-09-14T05:59:30.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.030628566999999999 2024-09-14T05:59:30.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791302+0000", 2024-09-14T05:59:30.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5870000000000002e-05 2024-09-14T05:59:30.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791629+0000", 2024-09-14T05:59:30.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032621700000000001 2024-09-14T05:59:30.581 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.581 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.581 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.582 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4274 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 544768~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.582 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760596+0000", 2024-09-14T05:59:30.582 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.772324701000001, 2024-09-14T05:59:30.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031394564999999999, 2024-09-14T05:59:30.582 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.582 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.582 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.582 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.582 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.582 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.582 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4274 2024-09-14T05:59:30.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.583 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760596+0000", 2024-09-14T05:59:30.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760596+0000", 2024-09-14T05:59:30.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760597+0000", 2024-09-14T05:59:30.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:59:30.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760602+0000", 2024-09-14T05:59:30.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9760000000000003e-06 2024-09-14T05:59:30.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760619+0000", 2024-09-14T05:59:30.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7430000000000001e-05 2024-09-14T05:59:30.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760632+0000", 2024-09-14T05:59:30.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2856e-05 2024-09-14T05:59:30.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791696+0000", 2024-09-14T05:59:30.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031063666 2024-09-14T05:59:30.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791810+0000", 2024-09-14T05:59:30.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011434699999999999 2024-09-14T05:59:30.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.791990+0000", 2024-09-14T05:59:30.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018011000000000001 2024-09-14T05:59:30.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.586 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.587 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.587 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4275 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 696320~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.587 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760650+0000", 2024-09-14T05:59:30.587 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.772270711999999, 2024-09-14T05:59:30.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031562075000000002, 2024-09-14T05:59:30.587 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.587 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.587 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.588 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.588 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.588 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4275 2024-09-14T05:59:30.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.588 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760650+0000", 2024-09-14T05:59:30.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760650+0000", 2024-09-14T05:59:30.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760651+0000", 2024-09-14T05:59:30.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7000000000000003e-07 2024-09-14T05:59:30.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760656+0000", 2024-09-14T05:59:30.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9629999999999997e-06 2024-09-14T05:59:30.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760672+0000", 2024-09-14T05:59:30.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6787e-05 2024-09-14T05:59:30.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760685+0000", 2024-09-14T05:59:30.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2706e-05 2024-09-14T05:59:30.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792041+0000", 2024-09-14T05:59:30.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031355782999999998 2024-09-14T05:59:30.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792123+0000", 2024-09-14T05:59:30.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2142000000000001e-05 2024-09-14T05:59:30.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792212+0000", 2024-09-14T05:59:30.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8724e-05 2024-09-14T05:59:30.592 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.592 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.592 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.592 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4276 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 851968~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.593 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760703+0000", 2024-09-14T05:59:30.593 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.772217869, 2024-09-14T05:59:30.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031786208000000003, 2024-09-14T05:59:30.593 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.593 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.593 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.593 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.593 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.593 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.593 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4276 2024-09-14T05:59:30.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.593 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760703+0000", 2024-09-14T05:59:30.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760703+0000", 2024-09-14T05:59:30.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760704+0000", 2024-09-14T05:59:30.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.17e-06 2024-09-14T05:59:30.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760723+0000", 2024-09-14T05:59:30.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8940000000000002e-05 2024-09-14T05:59:30.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760741+0000", 2024-09-14T05:59:30.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7932999999999999e-05 2024-09-14T05:59:30.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760758+0000", 2024-09-14T05:59:30.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7560000000000001e-05 2024-09-14T05:59:30.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792269+0000", 2024-09-14T05:59:30.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031510479000000001 2024-09-14T05:59:30.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792375+0000", 2024-09-14T05:59:30.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010609500000000001 2024-09-14T05:59:30.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792489+0000", 2024-09-14T05:59:30.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011403100000000001 2024-09-14T05:59:30.597 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.597 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.597 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.598 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4277 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 1003520~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.598 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760829+0000", 2024-09-14T05:59:30.598 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.772091777, 2024-09-14T05:59:30.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031877567000000002, 2024-09-14T05:59:30.598 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.598 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.598 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.598 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.598 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.598 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.598 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4277 2024-09-14T05:59:30.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.599 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760829+0000", 2024-09-14T05:59:30.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760829+0000", 2024-09-14T05:59:30.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760830+0000", 2024-09-14T05:59:30.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6840000000000001e-06 2024-09-14T05:59:30.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760849+0000", 2024-09-14T05:59:30.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8542999999999998e-05 2024-09-14T05:59:30.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760869+0000", 2024-09-14T05:59:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.967e-05 2024-09-14T05:59:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760900+0000", 2024-09-14T05:59:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1572999999999997e-05 2024-09-14T05:59:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792541+0000", 2024-09-14T05:59:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031640692999999998 2024-09-14T05:59:30.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792605+0000", 2024-09-14T05:59:30.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4339999999999997e-05 2024-09-14T05:59:30.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792706+0000", 2024-09-14T05:59:30.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010106399999999999 2024-09-14T05:59:30.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.603 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.603 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.603 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4319 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 98304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.603 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.760993+0000", 2024-09-14T05:59:30.603 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.771927351, 2024-09-14T05:59:30.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032127042000000001, 2024-09-14T05:59:30.603 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.603 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.603 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.603 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.603 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.604 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.604 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4319 2024-09-14T05:59:30.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.604 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760993+0000", 2024-09-14T05:59:30.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760993+0000", 2024-09-14T05:59:30.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.760994+0000", 2024-09-14T05:59:30.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.133e-06 2024-09-14T05:59:30.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761001+0000", 2024-09-14T05:59:30.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4269999999999996e-06 2024-09-14T05:59:30.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761018+0000", 2024-09-14T05:59:30.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7640000000000001e-05 2024-09-14T05:59:30.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761032+0000", 2024-09-14T05:59:30.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3399e-05 2024-09-14T05:59:30.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792742+0000", 2024-09-14T05:59:30.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.031710473000000003 2024-09-14T05:59:30.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.792835+0000", 2024-09-14T05:59:30.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3105999999999999e-05 2024-09-14T05:59:30.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793120+0000", 2024-09-14T05:59:30.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028486400000000002 2024-09-14T05:59:30.607 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.607 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.608 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.608 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4320 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 249856~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.608 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761051+0000", 2024-09-14T05:59:30.608 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.771869425, 2024-09-14T05:59:30.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032569796999999998, 2024-09-14T05:59:30.608 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.608 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.608 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.608 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.608 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.608 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.609 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4320 2024-09-14T05:59:30.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.609 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761051+0000", 2024-09-14T05:59:30.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761051+0000", 2024-09-14T05:59:30.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761052+0000", 2024-09-14T05:59:30.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.133e-06 2024-09-14T05:59:30.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761057+0000", 2024-09-14T05:59:30.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.797e-06 2024-09-14T05:59:30.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761073+0000", 2024-09-14T05:59:30.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6160000000000001e-05 2024-09-14T05:59:30.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761086+0000", 2024-09-14T05:59:30.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-09-14T05:59:30.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793160+0000", 2024-09-14T05:59:30.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032073664000000002 2024-09-14T05:59:30.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793249+0000", 2024-09-14T05:59:30.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9473000000000002e-05 2024-09-14T05:59:30.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793621+0000", 2024-09-14T05:59:30.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037151399999999998 2024-09-14T05:59:30.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.612 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.613 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.613 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4321 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 401408~12288] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.613 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761106+0000", 2024-09-14T05:59:30.613 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.771814558999999, 2024-09-14T05:59:30.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032930359999999999, 2024-09-14T05:59:30.613 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.613 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.613 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.614 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4321 2024-09-14T05:59:30.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.614 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761106+0000", 2024-09-14T05:59:30.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761106+0000", 2024-09-14T05:59:30.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761107+0000", 2024-09-14T05:59:30.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.037e-06 2024-09-14T05:59:30.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761112+0000", 2024-09-14T05:59:30.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9130000000000002e-06 2024-09-14T05:59:30.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761129+0000", 2024-09-14T05:59:30.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7144000000000001e-05 2024-09-14T05:59:30.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761142+0000", 2024-09-14T05:59:30.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2926e-05 2024-09-14T05:59:30.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793654+0000", 2024-09-14T05:59:30.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032512438999999997 2024-09-14T05:59:30.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.793765+0000", 2024-09-14T05:59:30.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111042 2024-09-14T05:59:30.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794036+0000", 2024-09-14T05:59:30.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027085899999999998 2024-09-14T05:59:30.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.617 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.618 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.618 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4322 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 557056~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.618 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761160+0000", 2024-09-14T05:59:30.618 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.771760573, 2024-09-14T05:59:30.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033073877000000002, 2024-09-14T05:59:30.618 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.618 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.618 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.618 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.619 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4322 2024-09-14T05:59:30.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.619 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761160+0000", 2024-09-14T05:59:30.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761160+0000", 2024-09-14T05:59:30.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761161+0000", 2024-09-14T05:59:30.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0499999999999999e-06 2024-09-14T05:59:30.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761181+0000", 2024-09-14T05:59:30.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0353e-05 2024-09-14T05:59:30.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761200+0000", 2024-09-14T05:59:30.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-09-14T05:59:30.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761213+0000", 2024-09-14T05:59:30.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2979999999999999e-05 2024-09-14T05:59:30.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794092+0000", 2024-09-14T05:59:30.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.032878978000000003 2024-09-14T05:59:30.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794158+0000", 2024-09-14T05:59:30.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6026999999999997e-05 2024-09-14T05:59:30.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794234+0000", 2024-09-14T05:59:30.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5389000000000006e-05 2024-09-14T05:59:30.623 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.623 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.623 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.623 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4323 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 708608~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.623 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761233+0000", 2024-09-14T05:59:30.623 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.771687903, 2024-09-14T05:59:30.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033143201999999997, 2024-09-14T05:59:30.623 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.623 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.623 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.624 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4323 2024-09-14T05:59:30.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.624 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761233+0000", 2024-09-14T05:59:30.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761233+0000", 2024-09-14T05:59:30.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761234+0000", 2024-09-14T05:59:30.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.13e-06 2024-09-14T05:59:30.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761239+0000", 2024-09-14T05:59:30.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9869999999999999e-06 2024-09-14T05:59:30.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761255+0000", 2024-09-14T05:59:30.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6492999999999999e-05 2024-09-14T05:59:30.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761268+0000", 2024-09-14T05:59:30.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2796000000000001e-05 2024-09-14T05:59:30.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794276+0000", 2024-09-14T05:59:30.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033008505 2024-09-14T05:59:30.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794322+0000", 2024-09-14T05:59:30.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5852000000000001e-05 2024-09-14T05:59:30.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794376+0000", 2024-09-14T05:59:30.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3439000000000001e-05 2024-09-14T05:59:30.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.628 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.628 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4324 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 860160~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.628 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761286+0000", 2024-09-14T05:59:30.628 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.77163416, 2024-09-14T05:59:30.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033242971000000003, 2024-09-14T05:59:30.628 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.629 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.629 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.629 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4324 2024-09-14T05:59:30.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.629 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761286+0000", 2024-09-14T05:59:30.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761286+0000", 2024-09-14T05:59:30.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761287+0000", 2024-09-14T05:59:30.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.133e-06 2024-09-14T05:59:30.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761292+0000", 2024-09-14T05:59:30.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7369999999999997e-06 2024-09-14T05:59:30.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761309+0000", 2024-09-14T05:59:30.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7218999999999999e-05 2024-09-14T05:59:30.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761322+0000", 2024-09-14T05:59:30.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.278e-05 2024-09-14T05:59:30.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794409+0000", 2024-09-14T05:59:30.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033087111000000002 2024-09-14T05:59:30.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794454+0000", 2024-09-14T05:59:30.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4814000000000002e-05 2024-09-14T05:59:30.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794529+0000", 2024-09-14T05:59:30.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5177000000000002e-05 2024-09-14T05:59:30.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.633 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.634 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4325 3.1c 3:3d69b68b:::rbd_data.1127c133286b.0000000000000005:4 [read 1015808~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:30.634 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.761339+0000", 2024-09-14T05:59:30.634 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.771581141, 2024-09-14T05:59:30.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033372190000000003, 2024-09-14T05:59:30.634 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:30.634 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:30.634 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:30.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:30.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:30.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:30.634 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4325 2024-09-14T05:59:30.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.635 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:30.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:30.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761339+0000", 2024-09-14T05:59:30.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:30.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761339+0000", 2024-09-14T05:59:30.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:30.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:30.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761340+0000", 2024-09-14T05:59:30.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9000000000000005e-07 2024-09-14T05:59:30.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:30.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761345+0000", 2024-09-14T05:59:30.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2370000000000003e-06 2024-09-14T05:59:30.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:30.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761362+0000", 2024-09-14T05:59:30.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7842999999999998e-05 2024-09-14T05:59:30.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:30.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.761375+0000", 2024-09-14T05:59:30.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2864000000000001e-05 2024-09-14T05:59:30.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:30.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794569+0000", 2024-09-14T05:59:30.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.033193328000000001 2024-09-14T05:59:30.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:30.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794641+0000", 2024-09-14T05:59:30.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2071999999999997e-05 2024-09-14T05:59:30.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:30.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:30.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:30.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.794712+0000", 2024-09-14T05:59:30.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0856000000000001e-05 2024-09-14T05:59:30.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.638 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:30.638 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:30.638 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:30.640 INFO:teuthology.orchestra.run.smithi006.stdout:1353 read 0xa0ff75d thru 0xa10a14d (0xa9f1 bytes) 2024-09-14T05:59:30.640 INFO:teuthology.orchestra.run.smithi006.stdout:1354 read 0x3e85a11 thru 0x3e88812 (0x2e02 bytes) 2024-09-14T05:59:30.640 INFO:teuthology.orchestra.run.smithi006.stdout:1355 writesame 0xc5f0cd4 thru 0xc5f6b07 data_size 0x2(0x5e34 bytes) 2024-09-14T05:59:30.640 INFO:teuthology.orchestra.run.smithi006.stdout:1356 write 0xa3af972 thru 0xa3be2dd (0xe96c bytes) 2024-09-14T05:59:30.641 INFO:teuthology.orchestra.run.smithi006.stdout:1357 writesame 0x401f7ea thru 0x4022ccc data_size 0x1(0x34e3 bytes) 2024-09-14T05:59:30.641 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:30.637+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:30.641 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T05:59:30.740 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:30.737+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:30.780 INFO:teuthology.orchestra.run.smithi006.stdout:1358 write 0x6e6b20d thru 0x6e749e9 (0x97dd bytes) 2024-09-14T05:59:30.795 INFO:teuthology.orchestra.run.smithi006.stdout:1359 punch from 0x97a4969 to 0x97a7f4a, (0x35e1 bytes) 2024-09-14T05:59:30.796 INFO:teuthology.orchestra.run.smithi006.stdout:1360 read 0x9eb5b8d thru 0x9ebb77d (0x5bf1 bytes) 2024-09-14T05:59:30.796 INFO:teuthology.orchestra.run.smithi006.stdout:1362 write 0x8c7bec8 thru 0x8c82a16 (0x6b4f bytes) 2024-09-14T05:59:30.819 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:30.819 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:30.819 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:30.819 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:30.830 INFO:teuthology.orchestra.run.smithi006.stdout:1363 write 0xdf5d471 thru 0xdf6a873 (0xd403 bytes) 2024-09-14T05:59:30.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T05:59:30.834 INFO:teuthology.orchestra.run.smithi006.stdout:1364 writesame 0x115b953 thru 0x115cb14 data_size 0x1(0x11c2 bytes) 2024-09-14T05:59:30.843 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:30.837+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:30.941 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:30.937+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:31.010 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:31.011 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:31.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T05:59:31.042 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:31.037+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:31.143 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:31.142+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:31.145 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18872 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063266+0000", 2024-09-14T05:59:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0826452, 2024-09-14T05:59:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.065524572000000003, 2024-09-14T05:59:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18872 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063266+0000", 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063266+0000", 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063267+0000", 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7700000000000004e-07 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063269+0000", 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1679999999999998e-06 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063275+0000", 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7640000000000002e-06 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063280+0000", 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9339999999999997e-06 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.120159+0000", 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.056879196 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.120245+0000", 2024-09-14T05:59:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6376000000000001e-05 2024-09-14T05:59:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.128791+0000", 2024-09-14T05:59:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085454569999999994 2024-09-14T05:59:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18885 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 401408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063574+0000", 2024-09-14T05:59:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0823370370000001, 2024-09-14T05:59:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.060583399000000003, 2024-09-14T05:59:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18885 2024-09-14T05:59:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063574+0000", 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063574+0000", 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063575+0000", 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2199999999999999e-07 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063577+0000", 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1830000000000001e-06 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063583+0000", 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2859999999999996e-06 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063588+0000", 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.318e-06 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124025+0000", 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.060436996999999999 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124088+0000", 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3046000000000006e-05 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124158+0000", 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0147000000000004e-05 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18886 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 409600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063594+0000", 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0823179970000001, 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.060741871000000003, 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18886 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063594+0000", 2024-09-14T05:59:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063594+0000", 2024-09-14T05:59:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063594+0000", 2024-09-14T05:59:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6600000000000002e-07 2024-09-14T05:59:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063603+0000", 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9570000000000008e-06 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063609+0000", 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7049999999999996e-06 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063613+0000", 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4789999999999998e-06 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124188+0000", 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.060575174000000002 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124251+0000", 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2527999999999995e-05 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124335+0000", 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4661999999999997e-05 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18887 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 423936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063620+0000", 2024-09-14T05:59:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0822911930000001, 2024-09-14T05:59:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.060894049999999998, 2024-09-14T05:59:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18887 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063620+0000", 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063620+0000", 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063621+0000", 2024-09-14T05:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T05:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063623+0000", 2024-09-14T05:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1720000000000001e-06 2024-09-14T05:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063629+0000", 2024-09-14T05:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0399999999999998e-06 2024-09-14T05:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063633+0000", 2024-09-14T05:59:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4449999999999998e-06 2024-09-14T05:59:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124362+0000", 2024-09-14T05:59:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.060728735999999998 2024-09-14T05:59:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124425+0000", 2024-09-14T05:59:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3144000000000004e-05 2024-09-14T05:59:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124514+0000", 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9097000000000004e-05 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18888 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 432128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063641+0000", 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0822703810000001, 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061037256999999998, 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18888 2024-09-14T05:59:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063641+0000", 2024-09-14T05:59:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063641+0000", 2024-09-14T05:59:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063642+0000", 2024-09-14T05:59:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2100000000000002e-07 2024-09-14T05:59:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063644+0000", 2024-09-14T05:59:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9740000000000001e-06 2024-09-14T05:59:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063649+0000", 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7610000000000004e-06 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063654+0000", 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.267e-06 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124546+0000", 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.060892437000000001 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124590+0000", 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3955999999999997e-05 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124678+0000", 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8441000000000002e-05 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18889 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063659+0000", 2024-09-14T05:59:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.082252306, 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061205042000000001, 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18889 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063659+0000", 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063659+0000", 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063660+0000", 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.89e-07 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063661+0000", 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.708e-06 2024-09-14T05:59:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063666+0000", 2024-09-14T05:59:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1159999999999998e-06 2024-09-14T05:59:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063677+0000", 2024-09-14T05:59:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0698e-05 2024-09-14T05:59:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124706+0000", 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061028701999999997 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124773+0000", 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.724e-05 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124864+0000", 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1188999999999997e-05 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18890 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 462848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063685+0000", 2024-09-14T05:59:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0822269799999999, 2024-09-14T05:59:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061376145, 2024-09-14T05:59:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18890 2024-09-14T05:59:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063685+0000", 2024-09-14T05:59:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063685+0000", 2024-09-14T05:59:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063685+0000", 2024-09-14T05:59:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9800000000000004e-07 2024-09-14T05:59:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063687+0000", 2024-09-14T05:59:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0530000000000001e-06 2024-09-14T05:59:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063693+0000", 2024-09-14T05:59:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T05:59:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063698+0000", 2024-09-14T05:59:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7339999999999999e-06 2024-09-14T05:59:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124895+0000", 2024-09-14T05:59:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061197328000000002 2024-09-14T05:59:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124961+0000", 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5852999999999994e-05 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125061+0000", 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9906000000000002e-05 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18891 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063704+0000", 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0822075040000001, 2024-09-14T05:59:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061547644999999998, 2024-09-14T05:59:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18891 2024-09-14T05:59:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063704+0000", 2024-09-14T05:59:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063704+0000", 2024-09-14T05:59:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063704+0000", 2024-09-14T05:59:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.08e-07 2024-09-14T05:59:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063706+0000", 2024-09-14T05:59:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7859999999999999e-06 2024-09-14T05:59:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063714+0000", 2024-09-14T05:59:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.452e-06 2024-09-14T05:59:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063719+0000", 2024-09-14T05:59:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9799999999999998e-06 2024-09-14T05:59:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125092+0000", 2024-09-14T05:59:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061372909000000003 2024-09-14T05:59:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125152+0000", 2024-09-14T05:59:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0251000000000003e-05 2024-09-14T05:59:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125252+0000", 2024-09-14T05:59:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9858999999999994e-05 2024-09-14T05:59:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18892 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 493568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063726+0000", 2024-09-14T05:59:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.082185282, 2024-09-14T05:59:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061779235000000002, 2024-09-14T05:59:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18892 2024-09-14T05:59:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063726+0000", 2024-09-14T05:59:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063726+0000", 2024-09-14T05:59:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063727+0000", 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063729+0000", 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.198e-06 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063737+0000", 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5830000000000001e-06 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063742+0000", 2024-09-14T05:59:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0769999999999998e-06 2024-09-14T05:59:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125283+0000", 2024-09-14T05:59:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061541762999999999 2024-09-14T05:59:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125346+0000", 2024-09-14T05:59:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2843999999999997e-05 2024-09-14T05:59:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125505+0000", 2024-09-14T05:59:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159259 2024-09-14T05:59:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18893 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063749+0000", 2024-09-14T05:59:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0821626529999999, 2024-09-14T05:59:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061776180999999999, 2024-09-14T05:59:31.184 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18893 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063749+0000", 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063749+0000", 2024-09-14T05:59:31.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063749+0000", 2024-09-14T05:59:31.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6699999999999999e-07 2024-09-14T05:59:31.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063757+0000", 2024-09-14T05:59:31.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8839999999999994e-06 2024-09-14T05:59:31.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063763+0000", 2024-09-14T05:59:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4140000000000002e-06 2024-09-14T05:59:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063775+0000", 2024-09-14T05:59:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2113000000000001e-05 2024-09-14T05:59:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125521+0000", 2024-09-14T05:59:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061745995999999997 2024-09-14T05:59:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125525+0000", 2024-09-14T05:59:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3069999999999996e-06 2024-09-14T05:59:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18894 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063783+0000", 2024-09-14T05:59:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.082128524, 2024-09-14T05:59:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061755953000000002, 2024-09-14T05:59:31.188 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.189 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.189 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:31.189 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.189 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.189 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.189 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18894 2024-09-14T05:59:31.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.189 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063783+0000", 2024-09-14T05:59:31.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063783+0000", 2024-09-14T05:59:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063783+0000", 2024-09-14T05:59:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:59:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063786+0000", 2024-09-14T05:59:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.345e-06 2024-09-14T05:59:31.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063792+0000", 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5760000000000002e-06 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063797+0000", 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0130000000000001e-06 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125535+0000", 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061737904000000003 2024-09-14T05:59:31.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125539+0000", 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.647e-06 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18895 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063805+0000", 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.082106923, 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061773364999999997, 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.192 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18895 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063805+0000", 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063805+0000", 2024-09-14T05:59:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063805+0000", 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.46e-07 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063807+0000", 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.933e-06 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063814+0000", 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6930000000000001e-06 2024-09-14T05:59:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063819+0000", 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8640000000000004e-06 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125573+0000", 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061754521999999999 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125578+0000", 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9069999999999998e-06 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18896 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063825+0000", 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.082086272, 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061768625000000001, 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18896 2024-09-14T05:59:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063825+0000", 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063825+0000", 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063826+0000", 2024-09-14T05:59:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4700000000000002e-07 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063828+0000", 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063836+0000", 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1550000000000007e-06 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063843+0000", 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1409999999999999e-06 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125590+0000", 2024-09-14T05:59:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061746884000000002 2024-09-14T05:59:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125594+0000", 2024-09-14T05:59:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7220000000000001e-06 2024-09-14T05:59:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18897 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063851+0000", 2024-09-14T05:59:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.082060518, 2024-09-14T05:59:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061756057000000003, 2024-09-14T05:59:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18897 2024-09-14T05:59:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063851+0000", 2024-09-14T05:59:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063851+0000", 2024-09-14T05:59:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063851+0000", 2024-09-14T05:59:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5900000000000002e-07 2024-09-14T05:59:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063859+0000", 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4019999999999996e-06 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063864+0000", 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2170000000000002e-06 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063869+0000", 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8849999999999998e-06 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125604+0000", 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061734636000000002 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125607+0000", 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4580000000000002e-06 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18898 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063876+0000", 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.082035106, 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061744131000000001, 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18898 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063876+0000", 2024-09-14T05:59:31.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063876+0000", 2024-09-14T05:59:31.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063877+0000", 2024-09-14T05:59:31.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1900000000000002e-07 2024-09-14T05:59:31.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063879+0000", 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.12e-06 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063886+0000", 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1609999999999997e-06 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063891+0000", 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9420000000000003e-06 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125617+0000", 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061725742 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125621+0000", 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5470000000000001e-06 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18899 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063898+0000", 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0820130510000001, 2024-09-14T05:59:31.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061734497999999999, 2024-09-14T05:59:31.208 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.208 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.208 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:31.208 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.208 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.208 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.208 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18899 2024-09-14T05:59:31.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.208 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063898+0000", 2024-09-14T05:59:31.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063898+0000", 2024-09-14T05:59:31.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063899+0000", 2024-09-14T05:59:31.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4400000000000001e-07 2024-09-14T05:59:31.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063901+0000", 2024-09-14T05:59:31.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9759999999999998e-06 2024-09-14T05:59:31.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063908+0000", 2024-09-14T05:59:31.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.776e-06 2024-09-14T05:59:31.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063913+0000", 2024-09-14T05:59:31.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8520000000000003e-06 2024-09-14T05:59:31.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125630+0000", 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061716989 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125633+0000", 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.461e-06 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18900 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063919+0000", 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0819921029999999, 2024-09-14T05:59:31.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061725646000000002, 2024-09-14T05:59:31.212 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.212 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.212 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:31.212 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.212 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.212 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.212 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18900 2024-09-14T05:59:31.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.212 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063919+0000", 2024-09-14T05:59:31.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063919+0000", 2024-09-14T05:59:31.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063920+0000", 2024-09-14T05:59:31.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7199999999999999e-07 2024-09-14T05:59:31.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063927+0000", 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2749999999999998e-06 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063935+0000", 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6179999999999997e-06 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063940+0000", 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.091e-06 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125642+0000", 2024-09-14T05:59:31.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061701789999999999 2024-09-14T05:59:31.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125645+0000", 2024-09-14T05:59:31.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4000000000000001e-06 2024-09-14T05:59:31.215 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.215 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.215 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.215 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18901 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.215 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063948+0000", 2024-09-14T05:59:31.215 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0819639599999999, 2024-09-14T05:59:31.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061714496000000001, 2024-09-14T05:59:31.216 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.216 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.216 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:31.216 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.216 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.216 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.216 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18901 2024-09-14T05:59:31.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.216 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063948+0000", 2024-09-14T05:59:31.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063948+0000", 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063948+0000", 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.63e-07 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063950+0000", 2024-09-14T05:59:31.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.311e-06 2024-09-14T05:59:31.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063957+0000", 2024-09-14T05:59:31.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.472e-06 2024-09-14T05:59:31.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063962+0000", 2024-09-14T05:59:31.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8280000000000002e-06 2024-09-14T05:59:31.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125655+0000", 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061693634999999997 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125662+0000", 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7870000000000004e-06 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18902 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063969+0000", 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0819425520000001, 2024-09-14T05:59:31.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061719545000000001, 2024-09-14T05:59:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18902 2024-09-14T05:59:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063969+0000", 2024-09-14T05:59:31.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063969+0000", 2024-09-14T05:59:31.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063969+0000", 2024-09-14T05:59:31.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.63e-07 2024-09-14T05:59:31.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063971+0000", 2024-09-14T05:59:31.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9139999999999998e-06 2024-09-14T05:59:31.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063979+0000", 2024-09-14T05:59:31.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1489999999999997e-06 2024-09-14T05:59:31.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063991+0000", 2024-09-14T05:59:31.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2038000000000001e-05 2024-09-14T05:59:31.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125685+0000", 2024-09-14T05:59:31.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061694000999999998 2024-09-14T05:59:31.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125689+0000", 2024-09-14T05:59:31.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.98e-06 2024-09-14T05:59:31.223 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.223 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.223 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.224 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18903 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.224 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063999+0000", 2024-09-14T05:59:31.224 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.081912991, 2024-09-14T05:59:31.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061703557999999999, 2024-09-14T05:59:31.224 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.224 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.224 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:31.224 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.224 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.224 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.224 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18903 2024-09-14T05:59:31.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.224 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063999+0000", 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063999+0000", 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063999+0000", 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6600000000000002e-07 2024-09-14T05:59:31.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.064001+0000", 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2050000000000001e-06 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.064009+0000", 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.379e-06 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.064013+0000", 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8779999999999997e-06 2024-09-14T05:59:31.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125699+0000", 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061685313999999998 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125702+0000", 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3160000000000001e-06 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.227 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:31.228 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T05:59:31.244 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:31.241+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:31.345 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:31.346+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:31.398 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:31.398 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:31.398 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:31.398 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:31.413 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T05:59:31.445 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:31.441+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:31.547 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:31.550+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:31.583 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:31.583 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:31.610 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T05:59:31.633 INFO:teuthology.orchestra.run.smithi006.stdout:1365 trunc from 0xdf6a874 to 0xd564d41 2024-09-14T05:59:31.655 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:31.658+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:31.658 INFO:teuthology.orchestra.run.smithi006.stdout:1366 writesame 0xbf8bcf5 thru 0xbf9b671 data_size 0x11(0xf97d bytes) 2024-09-14T05:59:31.662 INFO:teuthology.orchestra.run.smithi006.stdout:1367 punch from 0xca4f5b6 to 0xca5965a, (0xa0a4 bytes) 2024-09-14T05:59:31.663 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:31.663 INFO:teuthology.orchestra.run.smithi006.stdout:1369 writesame 0x22ab39d thru 0x22baa48 data_size 0x2(0xf6ac bytes) 2024-09-14T05:59:31.709 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:59:31.748 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:31.750+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:31.795 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:31.795 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:31.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:31.795 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:31.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.795 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4301 3.13 3:cd7a3116:::rbd_data.1127c133286b.0000000000000002:4 [read 557056~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:31.795 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.763301+0000", 2024-09-14T05:59:31.795 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.03311222, 2024-09-14T05:59:31.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048252252000000002, 2024-09-14T05:59:31.795 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.796 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.796 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.796 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.796 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.796 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.796 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4301 2024-09-14T05:59:31.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.796 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763301+0000", 2024-09-14T05:59:31.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763301+0000", 2024-09-14T05:59:31.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763301+0000", 2024-09-14T05:59:31.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2500000000000005e-07 2024-09-14T05:59:31.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763305+0000", 2024-09-14T05:59:31.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T05:59:31.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763314+0000", 2024-09-14T05:59:31.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8210000000000008e-06 2024-09-14T05:59:31.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763323+0000", 2024-09-14T05:59:31.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0049999999999993e-06 2024-09-14T05:59:31.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811338+0000", 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048015557 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811442+0000", 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010388899999999999 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811553+0000", 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011092899999999999 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.800 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4302 3.13 3:cd7a3116:::rbd_data.1127c133286b.0000000000000002:4 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:31.800 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.763333+0000", 2024-09-14T05:59:31.800 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.033080191, 2024-09-14T05:59:31.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048350935999999997, 2024-09-14T05:59:31.800 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.800 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.800 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.800 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.800 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.800 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.801 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4302 2024-09-14T05:59:31.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.801 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763333+0000", 2024-09-14T05:59:31.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763333+0000", 2024-09-14T05:59:31.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763333+0000", 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763336+0000", 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9299999999999999e-06 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763345+0000", 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6649999999999992e-06 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763353+0000", 2024-09-14T05:59:31.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T05:59:31.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811587+0000", 2024-09-14T05:59:31.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048233971 2024-09-14T05:59:31.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811636+0000", 2024-09-14T05:59:31.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9200999999999999e-05 2024-09-14T05:59:31.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811684+0000", 2024-09-14T05:59:31.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7577999999999997e-05 2024-09-14T05:59:31.804 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.804 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.804 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.804 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4303 3.13 3:cd7a3116:::rbd_data.1127c133286b.0000000000000002:4 [read 864256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:31.804 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.763366+0000", 2024-09-14T05:59:31.804 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.03304749, 2024-09-14T05:59:31.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048532156999999999, 2024-09-14T05:59:31.804 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4303 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763366+0000", 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763366+0000", 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763366+0000", 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1799999999999995e-07 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763370+0000", 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4800000000000001e-06 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763380+0000", 2024-09-14T05:59:31.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0385e-05 2024-09-14T05:59:31.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763387+0000", 2024-09-14T05:59:31.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-09-14T05:59:31.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811725+0000", 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048337506000000002 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811811+0000", 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6537000000000002e-05 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811898+0000", 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6507000000000004e-05 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4304 3.13 3:cd7a3116:::rbd_data.1127c133286b.0000000000000002:4 [read 1015808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.763398+0000", 2024-09-14T05:59:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.033014828000001, 2024-09-14T05:59:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048631691999999997, 2024-09-14T05:59:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4304 2024-09-14T05:59:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763398+0000", 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763398+0000", 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763399+0000", 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6499999999999999e-07 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763410+0000", 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1331999999999999e-05 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763420+0000", 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0215e-05 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763428+0000", 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5059999999999998e-06 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811933+0000", 2024-09-14T05:59:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048505020000000003 2024-09-14T05:59:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811978+0000", 2024-09-14T05:59:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5232999999999999e-05 2024-09-14T05:59:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.812030+0000", 2024-09-14T05:59:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1820999999999997e-05 2024-09-14T05:59:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.812 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21320 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.855646+0000", 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.94076680599999996, 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048117163999999997, 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21320 2024-09-14T05:59:31.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855646+0000", 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855646+0000", 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855647+0000", 2024-09-14T05:59:31.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.96e-07 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855648+0000", 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1599999999999999e-06 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855651+0000", 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.591e-06 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855655+0000", 2024-09-14T05:59:31.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7960000000000002e-06 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.903481+0000", 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047826022000000003 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.903569+0000", 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7919999999999998e-05 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.903763+0000", 2024-09-14T05:59:31.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194379 2024-09-14T05:59:31.817 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.817 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.817 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.817 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21378 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 989184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.817 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858445+0000", 2024-09-14T05:59:31.817 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.93796775700000001, 2024-09-14T05:59:31.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048213651000000003, 2024-09-14T05:59:31.817 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.817 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.817 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.817 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.817 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21378 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858445+0000", 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858445+0000", 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858446+0000", 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858448+0000", 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.441e-06 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858454+0000", 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1449999999999996e-06 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858460+0000", 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9680000000000003e-06 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906484+0000", 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048023983999999999 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906556+0000", 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1802000000000001e-05 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906659+0000", 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102768 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21379 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 864256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858467+0000", 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.93794623600000004, 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048414881999999999, 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.821 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21379 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858467+0000", 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858467+0000", 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858467+0000", 2024-09-14T05:59:31.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9999999999999998e-07 2024-09-14T05:59:31.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858476+0000", 2024-09-14T05:59:31.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1020000000000003e-06 2024-09-14T05:59:31.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858484+0000", 2024-09-14T05:59:31.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1960000000000002e-06 2024-09-14T05:59:31.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858489+0000", 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1710000000000001e-06 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906690+0000", 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048201386999999998 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906765+0000", 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5119999999999999e-05 2024-09-14T05:59:31.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906882+0000", 2024-09-14T05:59:31.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116506 2024-09-14T05:59:31.825 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.825 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.825 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.825 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21380 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1011712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.825 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858496+0000", 2024-09-14T05:59:31.825 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.937917157, 2024-09-14T05:59:31.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048605175, 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21380 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858496+0000", 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858496+0000", 2024-09-14T05:59:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858496+0000", 2024-09-14T05:59:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6400000000000003e-07 2024-09-14T05:59:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858499+0000", 2024-09-14T05:59:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.948e-06 2024-09-14T05:59:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858505+0000", 2024-09-14T05:59:31.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1070000000000001e-06 2024-09-14T05:59:31.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858523+0000", 2024-09-14T05:59:31.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7992999999999999e-05 2024-09-14T05:59:31.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906911+0000", 2024-09-14T05:59:31.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048387905000000002 2024-09-14T05:59:31.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906982+0000", 2024-09-14T05:59:31.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0253000000000007e-05 2024-09-14T05:59:31.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907101+0000", 2024-09-14T05:59:31.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119505 2024-09-14T05:59:31.829 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.829 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.829 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21381 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 872448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858531+0000", 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.93788188900000002, 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048794176000000002, 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21381 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858531+0000", 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858531+0000", 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858532+0000", 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.82e-07 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858534+0000", 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6189999999999998e-06 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858541+0000", 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6540000000000002e-06 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858559+0000", 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8357999999999999e-05 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907141+0000", 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048581910999999998 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907216+0000", 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4975000000000006e-05 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907325+0000", 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109177 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21382 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1019904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858574+0000", 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.93783953200000003, 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048966019, 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21382 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858574+0000", 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858574+0000", 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858574+0000", 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3e-07 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858577+0000", 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7640000000000001e-06 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858593+0000", 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5687000000000001e-05 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858599+0000", 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907357+0000", 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048757308999999999 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907435+0000", 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7949999999999997e-05 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907540+0000", 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010501399999999999 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21383 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 894976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858608+0000", 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.93780493499999995, 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049138063000000003, 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21383 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858608+0000", 2024-09-14T05:59:31.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858608+0000", 2024-09-14T05:59:31.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858609+0000", 2024-09-14T05:59:31.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8599999999999998e-07 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858611+0000", 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5220000000000002e-06 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858618+0000", 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7460000000000003e-06 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858623+0000", 2024-09-14T05:59:31.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0699999999999997e-06 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907569+0000", 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946167999999998 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907644+0000", 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5093999999999996e-05 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907746+0000", 2024-09-14T05:59:31.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101777 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21384 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1042432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858645+0000", 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.93776780800000004, 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049308495000000001, 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.842 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21384 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858645+0000", 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858645+0000", 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858646+0000", 2024-09-14T05:59:31.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3000000000000001e-07 2024-09-14T05:59:31.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858663+0000", 2024-09-14T05:59:31.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6852000000000001e-05 2024-09-14T05:59:31.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858672+0000", 2024-09-14T05:59:31.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0340000000000002e-06 2024-09-14T05:59:31.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858677+0000", 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7899999999999996e-06 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907775+0000", 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049097663999999999 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907848+0000", 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3223e-05 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907954+0000", 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105402 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21385 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 903168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858687+0000", 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.93772610300000003, 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049479466999999999, 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.846 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21385 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858687+0000", 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858687+0000", 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858688+0000", 2024-09-14T05:59:31.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.75e-07 2024-09-14T05:59:31.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858690+0000", 2024-09-14T05:59:31.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6510000000000001e-06 2024-09-14T05:59:31.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858697+0000", 2024-09-14T05:59:31.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5950000000000004e-06 2024-09-14T05:59:31.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858702+0000", 2024-09-14T05:59:31.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8620000000000002e-06 2024-09-14T05:59:31.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907987+0000", 2024-09-14T05:59:31.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049284954999999998 2024-09-14T05:59:31.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908061+0000", 2024-09-14T05:59:31.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4655999999999998e-05 2024-09-14T05:59:31.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908166+0000", 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105073 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21435 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 991232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859055+0000", 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.93735772399999995, 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049328565999999997, 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.850 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21435 2024-09-14T05:59:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859055+0000", 2024-09-14T05:59:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859055+0000", 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859056+0000", 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.34e-07 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859058+0000", 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2010000000000002e-06 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859064+0000", 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5169999999999996e-06 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859071+0000", 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1140000000000002e-06 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908196+0000", 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049125294 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908273+0000", 2024-09-14T05:59:31.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6953999999999995e-05 2024-09-14T05:59:31.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908384+0000", 2024-09-14T05:59:31.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011105200000000001 2024-09-14T05:59:31.854 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.854 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.854 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.854 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21436 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.854 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859078+0000", 2024-09-14T05:59:31.854 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.93733553599999997, 2024-09-14T05:59:31.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049529658999999997, 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21436 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859078+0000", 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859078+0000", 2024-09-14T05:59:31.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859078+0000", 2024-09-14T05:59:31.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5200000000000002e-07 2024-09-14T05:59:31.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859080+0000", 2024-09-14T05:59:31.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2929999999999999e-06 2024-09-14T05:59:31.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859087+0000", 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3060000000000003e-06 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859091+0000", 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8160000000000001e-06 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908418+0000", 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049326548999999997 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908494+0000", 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5655999999999995e-05 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908607+0000", 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000113587 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21438 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1013760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859119+0000", 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.93729392499999997, 2024-09-14T05:59:31.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049705669000000001, 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21438 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859119+0000", 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859119+0000", 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859120+0000", 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.51e-07 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859122+0000", 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0530000000000001e-06 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859140+0000", 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8321999999999998e-05 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859146+0000", 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.156e-06 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908639+0000", 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049493176999999999 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908716+0000", 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6314000000000002e-05 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908825+0000", 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109196 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21439 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1021952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859155+0000", 2024-09-14T05:59:31.862 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.93725850300000002, 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049882120000000002, 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21439 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859155+0000", 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859155+0000", 2024-09-14T05:59:31.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859155+0000", 2024-09-14T05:59:31.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1200000000000003e-07 2024-09-14T05:59:31.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859158+0000", 2024-09-14T05:59:31.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4199999999999999e-06 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859166+0000", 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2099999999999996e-06 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859171+0000", 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1880000000000001e-06 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908856+0000", 2024-09-14T05:59:31.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049684796000000003 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908932+0000", 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6052999999999998e-05 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909037+0000", 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104941 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21440 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859178+0000", 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.93723467800000004, 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050075400999999999, 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21440 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859178+0000", 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859178+0000", 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859179+0000", 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859181+0000", 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9989999999999998e-06 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859187+0000", 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8370000000000002e-06 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859191+0000", 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3229999999999999e-06 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909069+0000", 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049877719000000001 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909146+0000", 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7415000000000003e-05 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909254+0000", 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000107494 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.871 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21492 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 993280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.871 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859743+0000", 2024-09-14T05:59:31.871 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.93667051999999995, 2024-09-14T05:59:31.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049728715999999999, 2024-09-14T05:59:31.871 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.871 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.871 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.871 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.871 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.871 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.871 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21492 2024-09-14T05:59:31.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.871 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859743+0000", 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859743+0000", 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859743+0000", 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1399999999999997e-07 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859745+0000", 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8330000000000001e-06 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859751+0000", 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9859999999999999e-06 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859756+0000", 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8910000000000003e-06 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909286+0000", 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049529918999999999 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909364+0000", 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8211e-05 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909471+0000", 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000107462 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21666 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1038336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.865630+0000", 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.93078300199999997, 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048103458000000002, 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21666 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865630+0000", 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865630+0000", 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865631+0000", 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6599999999999996e-07 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865633+0000", 2024-09-14T05:59:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.475e-06 2024-09-14T05:59:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865641+0000", 2024-09-14T05:59:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6029999999999999e-06 2024-09-14T05:59:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865647+0000", 2024-09-14T05:59:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1770000000000003e-06 2024-09-14T05:59:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.913567+0000", 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047919727000000002 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.913636+0000", 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9303999999999999e-05 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.913734+0000", 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7505999999999998e-05 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.878 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:31.879 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:31.879 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:31.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:59:31.880 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:31.882+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:31.981 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:31.977+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:32.012 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:32.012 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:32.012 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:32.012 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:32.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:59:32.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:59:32.115 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:32.113+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:32.140 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [0] live_osds: [1, 2, 3, 4, 5, 6, 7] 2024-09-14T05:59:32.140 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-09-14T05:59:32.140 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T05:59:32.140 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T05:59:32.160 INFO:tasks.ceph.osd.0:Started 2024-09-14T05:59:32.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:59:32.201 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:32.201 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:32.201 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:32.201 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:32.201 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:32.201 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:32.197+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:32.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:59:32.225 INFO:teuthology.orchestra.run.smithi006.stdout:1371 writesame 0xd62c9c8 thru 0xd63ac60 data_size 0x1(0xe299 bytes) 2024-09-14T05:59:32.242 INFO:teuthology.orchestra.run.smithi006.stdout:1374 trunc from 0xd63ac61 to 0x2be4529 2024-09-14T05:59:32.259 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T05:59:32.283 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:32.286+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:32.292 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T05:59:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T05:59:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T05:59:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T05:59:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T05:59:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T05:59:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:config diff 2024-09-14T05:59:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:config diff get 2024-09-14T05:59:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:config get 2024-09-14T05:59:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:config help [] 2024-09-14T05:59:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:config set ... 2024-09-14T05:59:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:admin_socket: invalid command 2024-09-14T05:59:32.299 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T05:59:32.299 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-14T05:59:32.311 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:32.311 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:32.329 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:32.329 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:32.351 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:32.351 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:32.351 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:32.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:59:32.373 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:32.373 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:32.384 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:32.386+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:32.397 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:32.397 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:32.418 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:32.418 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:32.422 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T05:59:32.423 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T05:59:32.431 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:32.447 INFO:teuthology.orchestra.run.smithi006.stdout:1377 write 0x9017cb2 thru 0x9021c5c (0x9fab bytes) 2024-09-14T05:59:32.452 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:32.452 INFO:teuthology.orchestra.run.smithi006.stdout:1379 write 0x3c33170 thru 0x3c417a2 (0xe633 bytes) 2024-09-14T05:59:32.464 INFO:teuthology.orchestra.run.smithi006.stdout:1380 trunc from 0x9021c5d to 0x37fb19c 2024-09-14T05:59:32.483 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:32.483 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:32.484 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:32.486+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:32.492 INFO:teuthology.orchestra.run.smithi006.stdout:1384 write 0x54bf6e5 thru 0x54cb820 (0xc13c bytes) 2024-09-14T05:59:32.497 INFO:teuthology.orchestra.run.smithi006.stdout:1385 writesame 0x16c13e4 thru 0x16d0c84 data_size 0x1(0xf8a1 bytes) 2024-09-14T05:59:32.499 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:32.499 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:32.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:59:32.581 INFO:teuthology.orchestra.run.smithi006.stdout:1386 write 0x54c0372 thru 0x54c9ee8 (0x9b77 bytes) 2024-09-14T05:59:32.584 INFO:teuthology.orchestra.run.smithi006.stdout:1387 read 0x467410a thru 0x4674535 (0x42c bytes) 2024-09-14T05:59:32.585 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:32.586+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:32.601 INFO:teuthology.orchestra.run.smithi006.stdout:1388 write 0x9e8656d thru 0x9e8ce6d (0x6901 bytes) 2024-09-14T05:59:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:1389 write 0x1fb58ef thru 0x1fc0532 (0xac44 bytes) 2024-09-14T05:59:32.686 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:32.685+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2024-09-14T05:59:32.709 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:32.709 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:32.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:59:32.787 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:32.790+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:32.887 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:32.888 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:32.888 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:32.890+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:32.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:59:32.989 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:32.985+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:33.031 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:33.032 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:33.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:59:33.095 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:33.093+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:33.191 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:33.189+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:33.214 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:33.214 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:33.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:59:33.291 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:33.294+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:33.392 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:33.394+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:33.398 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:33.398 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:33.413 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:59:33.493 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:33.494+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:33.546 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:33.546 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:33.560 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:59:33.580 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:33.577+0000 7f8a7d8967c0 -1 Falling back to public interface 2024-09-14T05:59:33.593 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:33.589+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:33.688 INFO:teuthology.orchestra.run.smithi006.stdout:1390 write 0x2fe31bd thru 0x2fea165 (0x6fa9 bytes) 2024-09-14T05:59:33.692 INFO:teuthology.orchestra.run.smithi006.stdout:1391 writesame 0x441fa5b thru 0x442d582 data_size 0x4(0xdb28 bytes) 2024-09-14T05:59:33.694 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:33.689+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:33.711 INFO:teuthology.orchestra.run.smithi006.stdout:1393 write 0x56e0c14 thru 0x56ee44f (0xd83c bytes) 2024-09-14T05:59:33.715 INFO:teuthology.orchestra.run.smithi006.stdout:1394 read 0x93c813b thru 0x93d1a34 (0x98fa bytes) 2024-09-14T05:59:33.715 INFO:teuthology.orchestra.run.smithi006.stdout:1395 write 0x3b2f6db thru 0x3b30835 (0x115b bytes) 2024-09-14T05:59:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:33.719 INFO:teuthology.orchestra.run.smithi006.stdout:1398 read 0x29df401 thru 0x29e3858 (0x4458 bytes) 2024-09-14T05:59:33.720 INFO:teuthology.orchestra.run.smithi006.stdout:1399 write 0x5b581d7 thru 0x5b58b0e (0x938 bytes) 2024-09-14T05:59:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:1401 read 0x72adeac thru 0x72b32f7 (0x544c bytes) 2024-09-14T05:59:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:1403 punch from 0x80b3765 to 0x80bdc50, (0xa4eb bytes) 2024-09-14T05:59:33.738 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:33.738 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:33.750 INFO:teuthology.orchestra.run.smithi006.stdout:1404 write 0xe1591c5 thru 0xe15ba1f (0x285b bytes) 2024-09-14T05:59:33.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:59:33.757 INFO:teuthology.orchestra.run.smithi006.stdout:1408 read 0x274eb1b thru 0x274fc1f (0x1105 bytes) 2024-09-14T05:59:33.773 INFO:teuthology.orchestra.run.smithi006.stdout:1410 writesame 0xe4d002a thru 0xe4d75aa data_size 0x25(0x7581 bytes) 2024-09-14T05:59:33.774 INFO:teuthology.orchestra.run.smithi006.stdout:1411 read 0x110d0be thru 0x1119fcb (0xcf0e bytes) 2024-09-14T05:59:33.775 INFO:teuthology.orchestra.run.smithi006.stdout:1412 read 0x6a967b1 thru 0x6a9a498 (0x3ce8 bytes) 2024-09-14T05:59:33.775 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:33.775 INFO:teuthology.orchestra.run.smithi006.stdout:1414 read 0x8abe635 thru 0x8ac9d1d (0xb6e9 bytes) 2024-09-14T05:59:33.776 INFO:teuthology.orchestra.run.smithi006.stdout:1415 write 0x1e31af4 thru 0x1e3d77c (0xbc89 bytes) 2024-09-14T05:59:33.795 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:33.793+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:33.813 INFO:teuthology.orchestra.run.smithi006.stdout:1417 trunc from 0xe4d75ab to 0x16f62b0 2024-09-14T05:59:33.845 INFO:teuthology.orchestra.run.smithi006.stdout:1419 read 0x93cb66 thru 0x93ee16 (0x22b1 bytes) 2024-09-14T05:59:33.846 INFO:teuthology.orchestra.run.smithi006.stdout:1420 read 0x982d9b thru 0x982f4a (0x1b0 bytes) 2024-09-14T05:59:33.847 INFO:teuthology.orchestra.run.smithi006.stdout:1422 punch from 0x3cc976 to 0x3cf7c3, (0x2e4d bytes) 2024-09-14T05:59:33.847 INFO:teuthology.orchestra.run.smithi006.stdout:1424 punch from 0xf3bd91 to 0xf49174, (0xd3e3 bytes) 2024-09-14T05:59:33.847 INFO:teuthology.orchestra.run.smithi006.stdout:1425 punch from 0x35eae8 to 0x365c11, (0x7129 bytes) 2024-09-14T05:59:33.848 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:33.848 INFO:teuthology.orchestra.run.smithi006.stdout:1427 punch from 0xc0825f to 0xc095cb, (0x136c bytes) 2024-09-14T05:59:33.877 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:33.877 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:33.880 INFO:teuthology.orchestra.run.smithi006.stdout:1428 write 0x8d7b7c3 thru 0x8d7e324 (0x2b62 bytes) 2024-09-14T05:59:33.887 INFO:teuthology.orchestra.run.smithi006.stdout:1429 read 0x4ba2d41 thru 0x4bb10e1 (0xe3a1 bytes) 2024-09-14T05:59:33.892 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:59:33.908 INFO:teuthology.orchestra.run.smithi006.stdout:1430 trunc from 0x8d7e325 to 0x725bef 2024-09-14T05:59:33.933 INFO:teuthology.orchestra.run.smithi006.stdout:1431 punch from 0x13e089 to 0x1465f7, (0x856e bytes) 2024-09-14T05:59:33.939 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:33.942+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:33.953 INFO:teuthology.orchestra.run.smithi006.stdout:1432 trunc from 0x725bef to 0x883b340 2024-09-14T05:59:33.966 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:33.966 INFO:teuthology.orchestra.run.smithi006.stdout:1434 write 0x7a9d9c1 thru 0x7aa4d60 (0x73a0 bytes) 2024-09-14T05:59:33.972 INFO:teuthology.orchestra.run.smithi006.stdout:1435 read 0x590f631 thru 0x591f62b (0xfffb bytes) 2024-09-14T05:59:33.972 INFO:teuthology.orchestra.run.smithi006.stdout:1436 write 0x13f900b thru 0x13fc947 (0x393d bytes) 2024-09-14T05:59:33.995 INFO:teuthology.orchestra.run.smithi006.stdout:1438 writesame 0xa2832c7 thru 0xa28d612 data_size 0xe(0xa34c bytes) 2024-09-14T05:59:33.995 INFO:teuthology.orchestra.run.smithi006.stdout:1439 punch from 0x12fa7bc to 0x12fff55, (0x5799 bytes) 2024-09-14T05:59:33.995 INFO:teuthology.orchestra.run.smithi006.stdout:1440 read 0x1bcd1be thru 0x1bdcbc9 (0xfa0c bytes) 2024-09-14T05:59:33.996 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:33.993+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:33.996 INFO:teuthology.orchestra.run.smithi006.stdout:1441 read 0x64a5295 thru 0x64a6328 (0x1094 bytes) 2024-09-14T05:59:33.997 INFO:teuthology.orchestra.run.smithi006.stdout:1444 read 0x2b212eb thru 0x2b2763f (0x6355 bytes) 2024-09-14T05:59:33.997 INFO:teuthology.orchestra.run.smithi006.stdout:1445 read 0x179152e thru 0x179f0fe (0xdbd1 bytes) 2024-09-14T05:59:33.998 INFO:teuthology.orchestra.run.smithi006.stdout:1447 punch from 0x1273cec to 0x12756b6, (0x19ca bytes) 2024-09-14T05:59:34.016 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:34.016 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:34.018 INFO:teuthology.orchestra.run.smithi006.stdout:1448 write 0xc7e6ce7 thru 0xc7f2e32 (0xc14c bytes) 2024-09-14T05:59:34.028 INFO:teuthology.orchestra.run.smithi006.stdout:1449 write 0x747ccca thru 0x74886d6 (0xba0d bytes) 2024-09-14T05:59:34.031 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:59:34.051 INFO:teuthology.orchestra.run.smithi006.stdout:1450 write 0xdebb75f thru 0xdebf596 (0x3e38 bytes) 2024-09-14T05:59:34.058 INFO:teuthology.orchestra.run.smithi006.stdout:1451 read 0x875b26 thru 0x876a5d (0xf38 bytes) 2024-09-14T05:59:34.059 INFO:teuthology.orchestra.run.smithi006.stdout:1454 read 0x260aaa3 thru 0x2619d25 (0xf283 bytes) 2024-09-14T05:59:34.060 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.060 INFO:teuthology.orchestra.run.smithi006.stdout:1457 read 0x78fd440 thru 0x7903a35 (0x65f6 bytes) 2024-09-14T05:59:34.069 INFO:teuthology.orchestra.run.smithi006.stdout:1458 trunc from 0xdebf597 to 0xad7e7c8 2024-09-14T05:59:34.092 INFO:teuthology.orchestra.run.smithi006.stdout:1459 read 0x25c0f90 thru 0x25c7ec2 (0x6f33 bytes) 2024-09-14T05:59:34.092 INFO:teuthology.orchestra.run.smithi006.stdout:1460 read 0x6552c3f thru 0x6555106 (0x24c8 bytes) 2024-09-14T05:59:34.096 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:34.093+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:34.115 INFO:teuthology.orchestra.run.smithi006.stdout:1463 write 0xdf5b642 thru 0xdf6193f (0x62fe bytes) 2024-09-14T05:59:34.121 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.129 INFO:teuthology.orchestra.run.smithi006.stdout:1465 trunc from 0xdf61940 to 0xb0a8750 2024-09-14T05:59:34.166 INFO:teuthology.orchestra.run.smithi006.stdout:1466 trunc from 0xb0a8750 to 0x55eb594 2024-09-14T05:59:34.188 INFO:teuthology.orchestra.run.smithi006.stdout:1468 punch from 0x2da0091 to 0x2da4ab4, (0x4a23 bytes) 2024-09-14T05:59:34.188 INFO:teuthology.orchestra.run.smithi006.stdout:1469 read 0x401cce8 thru 0x402b7ec (0xeb05 bytes) 2024-09-14T05:59:34.188 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.188 INFO:teuthology.orchestra.run.smithi006.stdout:1471 read 0x3bf0c59 thru 0x3bf800e (0x73b6 bytes) 2024-09-14T05:59:34.188 INFO:teuthology.orchestra.run.smithi006.stdout:1473 read 0xc330b6 thru 0xc40f38 (0xde83 bytes) 2024-09-14T05:59:34.191 INFO:teuthology.orchestra.run.smithi006.stdout:1474 trunc from 0x55eb594 to 0x5f38b04 2024-09-14T05:59:34.196 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:34.198+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:34.202 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:34.202 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:34.203 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.203 INFO:teuthology.orchestra.run.smithi006.stdout:1477 write 0x55d4ef3 thru 0x55d6e4d (0x1f5b bytes) 2024-09-14T05:59:34.210 INFO:teuthology.orchestra.run.smithi006.stdout:1480 read 0x33102d7 thru 0x331a8f7 (0xa621 bytes) 2024-09-14T05:59:34.210 INFO:teuthology.orchestra.run.smithi006.stdout:1481 write 0x18aab88 thru 0x18b9e50 (0xf2c9 bytes) 2024-09-14T05:59:34.214 INFO:teuthology.orchestra.run.smithi006.stdout:1483 read 0x20449d thru 0x205624 (0x1188 bytes) 2024-09-14T05:59:34.215 INFO:teuthology.orchestra.run.smithi006.stdout:1484 punch from 0x257a75e to 0x2586cbd, (0xc55f bytes) 2024-09-14T05:59:34.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:59:34.251 INFO:teuthology.orchestra.run.smithi006.stdout:1486 write 0xecc0169 thru 0xecc157d (0x1415 bytes) 2024-09-14T05:59:34.256 INFO:teuthology.orchestra.run.smithi006.stdout:1488 punch from 0x418f32d to 0x419208c, (0x2d5f bytes) 2024-09-14T05:59:34.256 INFO:teuthology.orchestra.run.smithi006.stdout:1489 read 0xb90497c thru 0xb9092ec (0x4971 bytes) 2024-09-14T05:59:34.257 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.257 INFO:teuthology.orchestra.run.smithi006.stdout:1492 punch from 0xae54544 to 0xae5fe03, (0xb8bf bytes) 2024-09-14T05:59:34.257 INFO:teuthology.orchestra.run.smithi006.stdout:1493 writesame 0x7f46c48 thru 0x7f560af data_size 0x9e(0xf468 bytes) 2024-09-14T05:59:34.263 INFO:teuthology.orchestra.run.smithi006.stdout:1494 punch from 0xe6e8d97 to 0xe6f0a5e, (0x7cc7 bytes) 2024-09-14T05:59:34.275 INFO:teuthology.orchestra.run.smithi006.stdout:1495 trunc from 0xecc157e to 0xa4051d8 2024-09-14T05:59:34.294 INFO:teuthology.orchestra.run.smithi006.stdout:1496 writesame 0x214f854 thru 0x215e7e4 data_size 0x1(0xef91 bytes) 2024-09-14T05:59:34.303 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:34.306+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:34.346 INFO:teuthology.orchestra.run.smithi006.stdout:1498 write 0x23dd3e2 thru 0x23e1985 (0x45a4 bytes) 2024-09-14T05:59:34.349 INFO:teuthology.orchestra.run.smithi006.stdout:1499 write 0x45c4aa7 thru 0x45d39bb (0xef15 bytes) 2024-09-14T05:59:34.353 INFO:teuthology.orchestra.run.smithi006.stdout:1501 write 0xdcbadf thru 0xdd8f4e (0xd470 bytes) 2024-09-14T05:59:34.357 INFO:teuthology.orchestra.run.smithi006.stdout:1503 writesame 0x92d1f52 thru 0x92d71ab data_size 0x2(0x525a bytes) 2024-09-14T05:59:34.380 INFO:teuthology.orchestra.run.smithi006.stdout:1506 trunc from 0xa4051d8 to 0xb40a159 2024-09-14T05:59:34.392 INFO:teuthology.orchestra.run.smithi006.stdout:1507 punch from 0xa69e02b to 0xa6a36bc, (0x5691 bytes) 2024-09-14T05:59:34.392 INFO:teuthology.orchestra.run.smithi006.stdout:1508 write 0x92c4a0e thru 0x92c52d4 (0x8c7 bytes) 2024-09-14T05:59:34.395 INFO:teuthology.orchestra.run.smithi006.stdout:1509 read 0xa5e15a2 thru 0xa5e6ea8 (0x5907 bytes) 2024-09-14T05:59:34.395 INFO:teuthology.orchestra.run.smithi006.stdout:1510 write 0xa2d269c thru 0xa2d8cf8 (0x665d bytes) 2024-09-14T05:59:34.399 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:34.397+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:34.402 INFO:teuthology.orchestra.run.smithi006.stdout:1511 punch from 0x6551f14 to 0x655727b, (0x5367 bytes) 2024-09-14T05:59:34.402 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.402 INFO:teuthology.orchestra.run.smithi006.stdout:1514 write 0x380f857 thru 0x38110a9 (0x1853 bytes) 2024-09-14T05:59:34.403 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:34.403 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:34.418 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T05:59:34.423 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:59:34.424 INFO:teuthology.orchestra.run.smithi006.stdout:1515 trunc from 0xb40a159 to 0x5e25ba5 2024-09-14T05:59:34.461 INFO:teuthology.orchestra.run.smithi006.stdout:1516 write 0xa2d3560 thru 0xa2d7d72 (0x4813 bytes) 2024-09-14T05:59:34.466 INFO:teuthology.orchestra.run.smithi006.stdout:1517 read 0x47cac27 thru 0x47ced7e (0x4158 bytes) 2024-09-14T05:59:34.466 INFO:teuthology.orchestra.run.smithi006.stdout:1518 write 0x239346b thru 0x239b319 (0x7eaf bytes) 2024-09-14T05:59:34.469 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.469 INFO:teuthology.orchestra.run.smithi006.stdout:1520 punch from 0x2e596f2 to 0x2e5b324, (0x1c32 bytes) 2024-09-14T05:59:34.484 INFO:teuthology.orchestra.run.smithi006.stdout:1521 write 0xced9790 thru 0xcee8d4b (0xf5bc bytes) 2024-09-14T05:59:34.488 INFO:teuthology.orchestra.run.smithi006.stdout:1522 writesame 0xc6c6861 thru 0xc6d1186 data_size 0x15(0xa926 bytes) 2024-09-14T05:59:34.503 INFO:teuthology.orchestra.run.smithi006.stdout:1525 write 0xee683c1 thru 0xee6b27f (0x2ebf bytes) 2024-09-14T05:59:34.503 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:34.506+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:34.508 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.508 INFO:teuthology.orchestra.run.smithi006.stdout:1527 read 0xa41dc33 thru 0xa42ba2f (0xddfd bytes) 2024-09-14T05:59:34.508 INFO:teuthology.orchestra.run.smithi006.stdout:1530 punch from 0x3fea6c9 to 0x3ffa4e7, (0xfe1e bytes) 2024-09-14T05:59:34.508 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.508 INFO:teuthology.orchestra.run.smithi006.stdout:1532 write 0x46ebc3d thru 0x46ef043 (0x3407 bytes) 2024-09-14T05:59:34.510 INFO:teuthology.orchestra.run.smithi006.stdout:1533 write 0xde54556 thru 0xde5959b (0x5046 bytes) 2024-09-14T05:59:34.511 INFO:teuthology.orchestra.run.smithi006.stdout:1534 write 0x7fa4113 thru 0x7fa8405 (0x42f3 bytes) 2024-09-14T05:59:34.526 INFO:teuthology.orchestra.run.smithi006.stdout:1536 trunc from 0xee6b280 to 0x9ede4ce 2024-09-14T05:59:34.545 INFO:teuthology.orchestra.run.smithi006.stdout:1537 trunc from 0x9ede4ce to 0xb5514e1 2024-09-14T05:59:34.559 INFO:teuthology.orchestra.run.smithi006.stdout:1539 write 0xb8dbf9c thru 0xb8e905d (0xd0c2 bytes) 2024-09-14T05:59:34.563 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.563 INFO:teuthology.orchestra.run.smithi006.stdout:1541 read 0x402c979 thru 0x4030baa (0x4232 bytes) 2024-09-14T05:59:34.563 INFO:teuthology.orchestra.run.smithi006.stdout:1542 read 0x8b2648 thru 0x8b7d85 (0x573e bytes) 2024-09-14T05:59:34.564 INFO:teuthology.orchestra.run.smithi006.stdout:1544 read 0x388a76b thru 0x3891afb (0x7391 bytes) 2024-09-14T05:59:34.564 INFO:teuthology.orchestra.run.smithi006.stdout:1546 write 0x577c780 thru 0x5782c99 (0x651a bytes) 2024-09-14T05:59:34.566 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T05:59:34.571 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.571 INFO:teuthology.orchestra.run.smithi006.stdout:1551 writesame 0x6ebd07a thru 0x6ebe1b4 data_size 0x1(0x113b bytes) 2024-09-14T05:59:34.576 INFO:teuthology.orchestra.run.smithi006.stdout:1552 read 0x6f19759 thru 0x6f1f7cd (0x6075 bytes) 2024-09-14T05:59:34.576 INFO:teuthology.orchestra.run.smithi006.stdout:1553 write 0x83a20f3 thru 0x83ad977 (0xb885 bytes) 2024-09-14T05:59:34.581 INFO:teuthology.orchestra.run.smithi006.stdout:1555 read 0x83762fd thru 0x8381991 (0xb695 bytes) 2024-09-14T05:59:34.581 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.581 INFO:teuthology.orchestra.run.smithi006.stdout:1557 writesame 0x408efb4 thru 0x40984bb data_size 0x26(0x9508 bytes) 2024-09-14T05:59:34.584 INFO:teuthology.orchestra.run.smithi006.stdout:1559 writesame 0x3d6f6b6 thru 0x3d77ac5 data_size 0x8(0x8410 bytes) 2024-09-14T05:59:34.585 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:34.585 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:34.593 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:34.593 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:34.593 INFO:teuthology.orchestra.run.smithi006.stdout:1560 trunc from 0xb8e905e to 0x81b39b4 2024-09-14T05:59:34.600 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:34.597+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:34.603 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:34.603 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:34.606 INFO:teuthology.orchestra.run.smithi006.stdout:1562 read 0x46e3ee0 thru 0x46eeccc (0xaded bytes) 2024-09-14T05:59:34.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T05:59:34.618 INFO:teuthology.orchestra.run.smithi006.stdout:1563 writesame 0xc2417da thru 0xc24776d data_size 0x6(0x5f94 bytes) 2024-09-14T05:59:34.618 INFO:teuthology.orchestra.run.smithi006.stdout:1565 read 0x2015016 thru 0x201aa66 (0x5a51 bytes) 2024-09-14T05:59:34.618 INFO:teuthology.orchestra.run.smithi006.stdout:1570 writesame 0x53c2a4d thru 0x53d19a3 data_size 0x1(0xef57 bytes) 2024-09-14T05:59:34.624 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:34.624 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:34.644 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:34.645 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:34.653 INFO:teuthology.orchestra.run.smithi006.stdout:1571 read 0x63f3cb1 thru 0x63f9927 (0x5c77 bytes) 2024-09-14T05:59:34.653 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.653 INFO:teuthology.orchestra.run.smithi006.stdout:1573 writesame 0x7578d0d thru 0x757c075 data_size 0x29(0x3369 bytes) 2024-09-14T05:59:34.657 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.657 INFO:teuthology.orchestra.run.smithi006.stdout:1577 read 0x4ebccf thru 0x4efced (0x401f bytes) 2024-09-14T05:59:34.658 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.663 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:34.664 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:34.668 INFO:teuthology.orchestra.run.smithi006.stdout:1580 writesame 0xe8abdc1 thru 0xe8b95e2 data_size 0x37(0xd822 bytes) 2024-09-14T05:59:34.685 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:34.685 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:34.687 INFO:teuthology.orchestra.run.smithi006.stdout:1581 trunc from 0xe8b95e3 to 0x129c3f6 2024-09-14T05:59:34.702 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:34.702+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:34.702 INFO:teuthology.orchestra.run.smithi006.stdout:1583 read 0x1152768 thru 0x1161dbc (0xf655 bytes) 2024-09-14T05:59:34.703 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.703 INFO:teuthology.orchestra.run.smithi006.stdout:1586 punch from 0x6e3e84 to 0x6e450d, (0x689 bytes) 2024-09-14T05:59:34.710 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:34.710 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:34.714 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T05:59:34.714 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T05:59:34.717 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:59:34.724 INFO:teuthology.orchestra.run.smithi006.stdout:1587 writesame 0x9b2dd8f thru 0x9b3b28a data_size 0x56(0xd4fc bytes) 2024-09-14T05:59:34.724 INFO:teuthology.orchestra.run.smithi006.stdout:1590 read 0x22ffa61 thru 0x23018ff (0x1e9f bytes) 2024-09-14T05:59:34.733 INFO:teuthology.orchestra.run.smithi006.stdout:1591 trunc from 0x9b3b28b to 0x39bfc63 2024-09-14T05:59:34.739 INFO:teuthology.orchestra.run.smithi006.stdout:1592 read 0x3382c42 thru 0x339276a (0xfb29 bytes) 2024-09-14T05:59:34.739 INFO:teuthology.orchestra.run.smithi006.stdout:1593 read 0x16ae86d thru 0x16b2efa (0x468e bytes) 2024-09-14T05:59:34.739 INFO:teuthology.orchestra.run.smithi006.stdout:1594 read 0x1fa2cc8 thru 0x1fac970 (0x9ca9 bytes) 2024-09-14T05:59:34.740 INFO:teuthology.orchestra.run.smithi006.stdout:1595 read 0x7333b5 thru 0x73fef7 (0xcb43 bytes) 2024-09-14T05:59:34.740 INFO:teuthology.orchestra.run.smithi006.stdout:1596 read 0x21f4df0 thru 0x21fa607 (0x5818 bytes) 2024-09-14T05:59:34.740 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.763 INFO:teuthology.orchestra.run.smithi006.stdout:1599 write 0xdb3bc73 thru 0xdb3f559 (0x38e7 bytes) 2024-09-14T05:59:34.767 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:34.771 INFO:teuthology.orchestra.run.smithi006.stdout:1602 trunc from 0xdb3f55a to 0xafab7e3 2024-09-14T05:59:34.776 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:34.776 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:34.776 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:34.790 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T05:59:34.796 INFO:teuthology.orchestra.run.smithi006.stdout:1603 trunc from 0xafab7e3 to 0x197a347 2024-09-14T05:59:34.802 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:34.797+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:34.816 INFO:teuthology.orchestra.run.smithi006.stdout:1605 write 0x42bbfd9 thru 0x42c5487 (0x94af bytes) 2024-09-14T05:59:34.834 INFO:teuthology.orchestra.run.smithi006.stdout:1606 write 0x7853557 thru 0x7862281 (0xed2b bytes) 2024-09-14T05:59:34.840 INFO:teuthology.orchestra.run.smithi006.stdout:1607 trunc from 0x7862282 to 0x8e41a12 2024-09-14T05:59:34.848 INFO:teuthology.orchestra.run.smithi006.stdout:1608 writesame 0x5d95c6b thru 0x5da316f data_size 0x1(0xd505 bytes) 2024-09-14T05:59:34.879 INFO:teuthology.orchestra.run.smithi006.stdout:1609 read 0x8723694 thru 0x8725b3c (0x24a9 bytes) 2024-09-14T05:59:34.879 INFO:teuthology.orchestra.run.smithi006.stdout:1610 write 0x2cfa048 thru 0x2cfee4c (0x4e05 bytes) 2024-09-14T05:59:34.882 INFO:teuthology.orchestra.run.smithi006.stdout:1611 read 0x5d24ad6 thru 0x5d3048a (0xb9b5 bytes) 2024-09-14T05:59:34.883 INFO:teuthology.orchestra.run.smithi006.stdout:1612 punch from 0x6d65aa4 to 0x6d6a047, (0x45a3 bytes) 2024-09-14T05:59:34.883 INFO:teuthology.orchestra.run.smithi006.stdout:1613 write 0x623fa05 thru 0x62482a0 (0x889c bytes) 2024-09-14T05:59:34.887 INFO:teuthology.orchestra.run.smithi006.stdout:1614 trunc from 0x8e41a12 to 0x83a0d83 2024-09-14T05:59:34.892 INFO:teuthology.orchestra.run.smithi006.stdout:1615 read 0x61f2e97 thru 0x61ff92b (0xca95 bytes) 2024-09-14T05:59:34.893 INFO:teuthology.orchestra.run.smithi006.stdout:1616 read 0x5fd3474 thru 0x5fdcc7e (0x980b bytes) 2024-09-14T05:59:34.893 INFO:teuthology.orchestra.run.smithi006.stdout:1617 punch from 0x65c6279 to 0x65d00a1, (0x9e28 bytes) 2024-09-14T05:59:34.899 INFO:teuthology.orchestra.run.smithi006.stdout:1619 trunc from 0x83a0d83 to 0xbd992fd 2024-09-14T05:59:34.903 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:34.906+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:34.904 INFO:teuthology.orchestra.run.smithi006.stdout:1620 read 0x34f4562 thru 0x34faf96 (0x6a35 bytes) 2024-09-14T05:59:34.904 INFO:teuthology.orchestra.run.smithi006.stdout:1621 writesame 0x6b18465 thru 0x6b1b238 data_size 0xe(0x2dd4 bytes) 2024-09-14T05:59:34.906 INFO:teuthology.orchestra.run.smithi006.stdout:1622 punch from 0x27ecb6a to 0x27ed347, (0x7dd bytes) 2024-09-14T05:59:34.908 INFO:teuthology.orchestra.run.smithi006.stdout:1624 trunc from 0xbd992fd to 0xcfbc655 2024-09-14T05:59:34.913 INFO:teuthology.orchestra.run.smithi006.stdout:1628 read 0xce3ddf2 thru 0xce4106a (0x3279 bytes) 2024-09-14T05:59:34.913 INFO:teuthology.orchestra.run.smithi006.stdout:1630 writesame 0x9d6d9c9 thru 0x9d7a8e5 data_size 0x1(0xcf1d bytes) 2024-09-14T05:59:34.950 INFO:teuthology.orchestra.run.smithi006.stdout:1631 read 0x6ff92c7 thru 0x7004c5e (0xb998 bytes) 2024-09-14T05:59:34.951 INFO:teuthology.orchestra.run.smithi006.stdout:1632 write 0x38b12e2 thru 0x38be3c1 (0xd0e0 bytes) 2024-09-14T05:59:34.956 INFO:teuthology.orchestra.run.smithi006.stdout:1633 writesame 0x9a60fd thru 0x9ab602 data_size 0x1(0x5506 bytes) 2024-09-14T05:59:34.959 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:34.959 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:34.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:34.960 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:34.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.960 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18872 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:34.960 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063266+0000", 2024-09-14T05:59:34.960 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8968196840000004, 2024-09-14T05:59:34.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.065524572000000003, 2024-09-14T05:59:34.960 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:34.960 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:34.960 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:34.960 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:34.960 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:34.961 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:34.961 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18872 2024-09-14T05:59:34.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.961 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:34.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:34.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063266+0000", 2024-09-14T05:59:34.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:34.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063266+0000", 2024-09-14T05:59:34.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063267+0000", 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7700000000000004e-07 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063269+0000", 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1679999999999998e-06 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063275+0000", 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7640000000000002e-06 2024-09-14T05:59:34.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063280+0000", 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9339999999999997e-06 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.120159+0000", 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.056879196 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.120245+0000", 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6376000000000001e-05 2024-09-14T05:59:34.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:34.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.128791+0000", 2024-09-14T05:59:34.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085454569999999994 2024-09-14T05:59:34.964 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.964 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:34.964 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.964 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18885 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 401408~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:34.964 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063574+0000", 2024-09-14T05:59:34.964 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8965115209999999, 2024-09-14T05:59:34.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.060583399000000003, 2024-09-14T05:59:34.965 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:34.965 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:34.965 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:34.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:34.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:34.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:34.965 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18885 2024-09-14T05:59:34.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.965 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:34.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:34.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063574+0000", 2024-09-14T05:59:34.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063574+0000", 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063575+0000", 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2199999999999999e-07 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063577+0000", 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1830000000000001e-06 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063583+0000", 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2859999999999996e-06 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063588+0000", 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.318e-06 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124025+0000", 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.060436996999999999 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:34.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124088+0000", 2024-09-14T05:59:34.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3046000000000006e-05 2024-09-14T05:59:34.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:34.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124158+0000", 2024-09-14T05:59:34.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0147000000000004e-05 2024-09-14T05:59:34.968 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.968 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:34.968 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.968 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18886 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 409600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:34.969 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063594+0000", 2024-09-14T05:59:34.969 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8964924810000001, 2024-09-14T05:59:34.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.060741871000000003, 2024-09-14T05:59:34.969 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:34.969 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:34.969 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:34.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:34.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:34.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:34.969 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18886 2024-09-14T05:59:34.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.969 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063594+0000", 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063594+0000", 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063594+0000", 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6600000000000002e-07 2024-09-14T05:59:34.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063603+0000", 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9570000000000008e-06 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063609+0000", 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7049999999999996e-06 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063613+0000", 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4789999999999998e-06 2024-09-14T05:59:34.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:34.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124188+0000", 2024-09-14T05:59:34.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.060575174000000002 2024-09-14T05:59:34.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:34.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124251+0000", 2024-09-14T05:59:34.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2527999999999995e-05 2024-09-14T05:59:34.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:34.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124335+0000", 2024-09-14T05:59:34.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4661999999999997e-05 2024-09-14T05:59:34.973 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.973 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:34.973 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.973 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18887 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 423936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:34.973 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063620+0000", 2024-09-14T05:59:34.973 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8964656770000001, 2024-09-14T05:59:34.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.060894049999999998, 2024-09-14T05:59:34.973 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:34.973 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:34.973 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:34.973 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:34.974 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:34.974 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:34.974 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18887 2024-09-14T05:59:34.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.974 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:34.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:34.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063620+0000", 2024-09-14T05:59:34.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:34.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063620+0000", 2024-09-14T05:59:34.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:34.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063621+0000", 2024-09-14T05:59:34.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T05:59:34.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:34.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063623+0000", 2024-09-14T05:59:34.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1720000000000001e-06 2024-09-14T05:59:34.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:34.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063629+0000", 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0399999999999998e-06 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063633+0000", 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4449999999999998e-06 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124362+0000", 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.060728735999999998 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:34.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124425+0000", 2024-09-14T05:59:34.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3144000000000004e-05 2024-09-14T05:59:34.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:34.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124514+0000", 2024-09-14T05:59:34.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9097000000000004e-05 2024-09-14T05:59:34.977 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.977 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:34.977 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.977 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18888 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 432128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:34.977 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063641+0000", 2024-09-14T05:59:34.977 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8964448650000003, 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061037256999999998, 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18888 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063641+0000", 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063641+0000", 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063642+0000", 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2100000000000002e-07 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063644+0000", 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9740000000000001e-06 2024-09-14T05:59:34.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063649+0000", 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7610000000000004e-06 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063654+0000", 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.267e-06 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124546+0000", 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.060892437000000001 2024-09-14T05:59:34.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:34.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124590+0000", 2024-09-14T05:59:34.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3955999999999997e-05 2024-09-14T05:59:34.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:34.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124678+0000", 2024-09-14T05:59:34.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8441000000000002e-05 2024-09-14T05:59:34.981 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.981 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:34.981 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18889 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063659+0000", 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8964267899999996, 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061205042000000001, 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18889 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:34.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063659+0000", 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063659+0000", 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063660+0000", 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.89e-07 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:34.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063661+0000", 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.708e-06 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063666+0000", 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1159999999999998e-06 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063677+0000", 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0698e-05 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:34.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124706+0000", 2024-09-14T05:59:34.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061028701999999997 2024-09-14T05:59:34.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:34.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124773+0000", 2024-09-14T05:59:34.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.724e-05 2024-09-14T05:59:34.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:34.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124864+0000", 2024-09-14T05:59:34.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1188999999999997e-05 2024-09-14T05:59:34.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.985 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:34.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18890 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 462848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063685+0000", 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8964014640000002, 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061376145, 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18890 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:34.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063685+0000", 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063685+0000", 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063685+0000", 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9800000000000004e-07 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:34.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063687+0000", 2024-09-14T05:59:34.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0530000000000001e-06 2024-09-14T05:59:34.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:34.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063693+0000", 2024-09-14T05:59:34.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T05:59:34.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:34.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063698+0000", 2024-09-14T05:59:34.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7339999999999999e-06 2024-09-14T05:59:34.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124895+0000", 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061197328000000002 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.124961+0000", 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5852999999999994e-05 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125061+0000", 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9906000000000002e-05 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:34.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18891 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063704+0000", 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8963819879999999, 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061547644999999998, 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18891 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.990 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063704+0000", 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063704+0000", 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063704+0000", 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.08e-07 2024-09-14T05:59:34.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063706+0000", 2024-09-14T05:59:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7859999999999999e-06 2024-09-14T05:59:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063714+0000", 2024-09-14T05:59:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.452e-06 2024-09-14T05:59:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063719+0000", 2024-09-14T05:59:34.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9799999999999998e-06 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125092+0000", 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061372909000000003 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125152+0000", 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0251000000000003e-05 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125252+0000", 2024-09-14T05:59:34.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9858999999999994e-05 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18892 3.10 3:0cc869a3:::rbd_data.1127ff8b71e0.0000000000000043:b [read 493568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063726+0000", 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8963597659999998, 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061779235000000002, 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:34.994 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18892 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063726+0000", 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063726+0000", 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:34.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063727+0000", 2024-09-14T05:59:34.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:59:34.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:34.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063729+0000", 2024-09-14T05:59:34.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.198e-06 2024-09-14T05:59:34.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:34.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063737+0000", 2024-09-14T05:59:34.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5830000000000001e-06 2024-09-14T05:59:34.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:34.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063742+0000", 2024-09-14T05:59:34.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0769999999999998e-06 2024-09-14T05:59:34.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:34.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125283+0000", 2024-09-14T05:59:34.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061541762999999999 2024-09-14T05:59:34.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:34.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125346+0000", 2024-09-14T05:59:34.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2843999999999997e-05 2024-09-14T05:59:34.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:34.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125505+0000", 2024-09-14T05:59:34.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159259 2024-09-14T05:59:34.998 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.998 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:34.998 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:34.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.998 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18893 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:34.998 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063749+0000", 2024-09-14T05:59:34.998 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8963371369999997, 2024-09-14T05:59:34.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061776180999999999, 2024-09-14T05:59:34.998 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18893 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063749+0000", 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:34.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063749+0000", 2024-09-14T05:59:35.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063749+0000", 2024-09-14T05:59:35.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6699999999999999e-07 2024-09-14T05:59:35.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063757+0000", 2024-09-14T05:59:35.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8839999999999994e-06 2024-09-14T05:59:35.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063763+0000", 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4140000000000002e-06 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063775+0000", 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2113000000000001e-05 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125521+0000", 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061745995999999997 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125525+0000", 2024-09-14T05:59:35.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3069999999999996e-06 2024-09-14T05:59:35.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.002 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.002 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18894 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.002 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063783+0000", 2024-09-14T05:59:35.002 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8963030080000003, 2024-09-14T05:59:35.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061755953000000002, 2024-09-14T05:59:35.002 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18894 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063783+0000", 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063783+0000", 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063783+0000", 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063786+0000", 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.345e-06 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063792+0000", 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5760000000000002e-06 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063797+0000", 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0130000000000001e-06 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125535+0000", 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061737904000000003 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125539+0000", 2024-09-14T05:59:35.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.647e-06 2024-09-14T05:59:35.006 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.006 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.006 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.006 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18895 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.006 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063805+0000", 2024-09-14T05:59:35.006 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.896281407, 2024-09-14T05:59:35.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061773364999999997, 2024-09-14T05:59:35.006 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.006 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.006 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:35.007 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.007 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.007 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.007 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18895 2024-09-14T05:59:35.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.007 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063805+0000", 2024-09-14T05:59:35.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063805+0000", 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063805+0000", 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.46e-07 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063807+0000", 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.933e-06 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063814+0000", 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6930000000000001e-06 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063819+0000", 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8640000000000004e-06 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125573+0000", 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061754521999999999 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125578+0000", 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9069999999999998e-06 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18896 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063825+0000", 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8962607560000002, 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061768625000000001, 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.010 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18896 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063825+0000", 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063825+0000", 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063826+0000", 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4700000000000002e-07 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063828+0000", 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063836+0000", 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1550000000000007e-06 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063843+0000", 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1409999999999999e-06 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125590+0000", 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061746884000000002 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125594+0000", 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7220000000000001e-06 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.013 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.014 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.014 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18897 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.014 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063851+0000", 2024-09-14T05:59:35.014 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8962350020000001, 2024-09-14T05:59:35.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061756057000000003, 2024-09-14T05:59:35.014 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.014 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.014 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:35.014 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.014 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.014 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.014 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18897 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063851+0000", 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063851+0000", 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063851+0000", 2024-09-14T05:59:35.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5900000000000002e-07 2024-09-14T05:59:35.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063859+0000", 2024-09-14T05:59:35.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4019999999999996e-06 2024-09-14T05:59:35.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063864+0000", 2024-09-14T05:59:35.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2170000000000002e-06 2024-09-14T05:59:35.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063869+0000", 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8849999999999998e-06 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125604+0000", 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061734636000000002 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125607+0000", 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4580000000000002e-06 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.018 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18898 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.018 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063876+0000", 2024-09-14T05:59:35.018 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8962095899999998, 2024-09-14T05:59:35.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061744131000000001, 2024-09-14T05:59:35.018 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.018 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.018 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:35.018 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.018 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.018 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.018 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18898 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063876+0000", 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063876+0000", 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063877+0000", 2024-09-14T05:59:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1900000000000002e-07 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063879+0000", 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.12e-06 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063886+0000", 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1609999999999997e-06 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063891+0000", 2024-09-14T05:59:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9420000000000003e-06 2024-09-14T05:59:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125617+0000", 2024-09-14T05:59:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061725742 2024-09-14T05:59:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125621+0000", 2024-09-14T05:59:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5470000000000001e-06 2024-09-14T05:59:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18899 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063898+0000", 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8961875350000001, 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061734497999999999, 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18899 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063898+0000", 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063898+0000", 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063899+0000", 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4400000000000001e-07 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063901+0000", 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9759999999999998e-06 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063908+0000", 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.776e-06 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063913+0000", 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8520000000000003e-06 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125630+0000", 2024-09-14T05:59:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061716989 2024-09-14T05:59:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125633+0000", 2024-09-14T05:59:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.461e-06 2024-09-14T05:59:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18900 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063919+0000", 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8961665869999997, 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061725646000000002, 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18900 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063919+0000", 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063919+0000", 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063920+0000", 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7199999999999999e-07 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063927+0000", 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2749999999999998e-06 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063935+0000", 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6179999999999997e-06 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063940+0000", 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.091e-06 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125642+0000", 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061701789999999999 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125645+0000", 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4000000000000001e-06 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18901 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063948+0000", 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.896138444, 2024-09-14T05:59:35.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061714496000000001, 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18901 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063948+0000", 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063948+0000", 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063948+0000", 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.63e-07 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063950+0000", 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.311e-06 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063957+0000", 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.472e-06 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063962+0000", 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8280000000000002e-06 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125655+0000", 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061693634999999997 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125662+0000", 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7870000000000004e-06 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18902 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063969+0000", 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8961170359999997, 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061719545000000001, 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.034 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.034 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18902 2024-09-14T05:59:35.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.034 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063969+0000", 2024-09-14T05:59:35.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063969+0000", 2024-09-14T05:59:35.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063969+0000", 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.63e-07 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063971+0000", 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9139999999999998e-06 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063979+0000", 2024-09-14T05:59:35.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1489999999999997e-06 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063991+0000", 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2038000000000001e-05 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125685+0000", 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061694000999999998 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125689+0000", 2024-09-14T05:59:35.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.98e-06 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:18903 3.10 3.c5961330 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.063999+0000", 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8960874749999999, 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061703557999999999, 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.037 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 18903 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063999+0000", 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063999+0000", 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.063999+0000", 2024-09-14T05:59:35.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6600000000000002e-07 2024-09-14T05:59:35.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.064001+0000", 2024-09-14T05:59:35.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2050000000000001e-06 2024-09-14T05:59:35.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.064009+0000", 2024-09-14T05:59:35.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.379e-06 2024-09-14T05:59:35.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.064013+0000", 2024-09-14T05:59:35.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8779999999999997e-06 2024-09-14T05:59:35.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125699+0000", 2024-09-14T05:59:35.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.061685313999999998 2024-09-14T05:59:35.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.125702+0000", 2024-09-14T05:59:35.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3160000000000001e-06 2024-09-14T05:59:35.041 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.041 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.041 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.041 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.041 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.041 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:35.043 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T05:59:35.043 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:35.042+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:35.043 INFO:teuthology.orchestra.run.smithi006.stdout:1634 read 0x5cf7716 thru 0x5d053c2 (0xdcad bytes) 2024-09-14T05:59:35.043 INFO:teuthology.orchestra.run.smithi006.stdout:1635 read 0xb756934 thru 0xb765a7c (0xf149 bytes) 2024-09-14T05:59:35.043 INFO:teuthology.orchestra.run.smithi006.stdout:1636 write 0xa332c42 thru 0xa341cc6 (0xf085 bytes) 2024-09-14T05:59:35.043 INFO:teuthology.orchestra.run.smithi006.stdout:1637 write 0xeae17a8 thru 0xeaeb7bd (0xa016 bytes) 2024-09-14T05:59:35.044 INFO:teuthology.orchestra.run.smithi006.stdout:1638 writesame 0x888367 thru 0x8901e8 data_size 0x1(0x7e82 bytes) 2024-09-14T05:59:35.044 INFO:teuthology.orchestra.run.smithi006.stdout:1639 read 0x1435493 thru 0x144291d (0xd48b bytes) 2024-09-14T05:59:35.044 INFO:teuthology.orchestra.run.smithi006.stdout:1640 trunc from 0xeaeb7be to 0x902f66c 2024-09-14T05:59:35.052 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:35.052 INFO:teuthology.orchestra.run.smithi006.stdout:1643 read 0x65d3e7e thru 0x65e0adf (0xcc62 bytes) 2024-09-14T05:59:35.053 INFO:teuthology.orchestra.run.smithi006.stdout:1644 punch from 0x127274d to 0x1275832, (0x30e5 bytes) 2024-09-14T05:59:35.073 INFO:teuthology.orchestra.run.smithi006.stdout:1645 write 0xdfb3602 thru 0xdfc053a (0xcf39 bytes) 2024-09-14T05:59:35.094 INFO:teuthology.orchestra.run.smithi006.stdout:1646 trunc from 0xdfc053b to 0x75ffb51 2024-09-14T05:59:35.111 INFO:teuthology.orchestra.run.smithi006.stdout:1647 read 0x4a5912f thru 0x4a5b8ba (0x278c bytes) 2024-09-14T05:59:35.112 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:35.112 INFO:teuthology.orchestra.run.smithi006.stdout:1650 punch from 0x7dcaa0 to 0x7e324e, (0x67ae bytes) 2024-09-14T05:59:35.112 INFO:teuthology.orchestra.run.smithi006.stdout:1652 writesame 0xc70268 thru 0xc7f068 data_size 0x1d(0xee01 bytes) 2024-09-14T05:59:35.115 INFO:teuthology.orchestra.run.smithi006.stdout:1653 read 0x3442910 thru 0x34452fd (0x29ee bytes) 2024-09-14T05:59:35.116 INFO:teuthology.orchestra.run.smithi006.stdout:1655 read 0x6b26f1d thru 0x6b27a06 (0xaea bytes) 2024-09-14T05:59:35.117 INFO:teuthology.orchestra.run.smithi006.stdout:1656 punch from 0x5c15fa4 to 0x5c25743, (0xf79f bytes) 2024-09-14T05:59:35.117 INFO:teuthology.orchestra.run.smithi006.stdout:1657 punch from 0x76cb43 to 0x76d81f, (0xcdc bytes) 2024-09-14T05:59:35.125 INFO:teuthology.orchestra.run.smithi006.stdout:1659 trunc from 0x75ffb51 to 0x3058f95 2024-09-14T05:59:35.143 INFO:teuthology.orchestra.run.smithi006.stdout:1661 read 0x1167eb thru 0x120de7 (0xa5fd bytes) 2024-09-14T05:59:35.143 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:35.146+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:35.144 INFO:teuthology.orchestra.run.smithi006.stdout:1665 read 0x23ff068 thru 0x24041b7 (0x5150 bytes) 2024-09-14T05:59:35.145 INFO:teuthology.orchestra.run.smithi006.stdout:1668 read 0x183b063 thru 0x183b4dc (0x47a bytes) 2024-09-14T05:59:35.158 INFO:teuthology.orchestra.run.smithi006.stdout:1669 write 0x47f6d17 thru 0x47fcda2 (0x608c bytes) 2024-09-14T05:59:35.163 INFO:teuthology.orchestra.run.smithi006.stdout:1670 read 0x390acfa thru 0x3913cd8 (0x8fdf bytes) 2024-09-14T05:59:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:1671 write 0xe0a388d thru 0xe0aabf8 (0x736c bytes) 2024-09-14T05:59:35.199 INFO:teuthology.orchestra.run.smithi006.stdout:1673 write 0x3a1dd05 thru 0x3a1f0c7 (0x13c3 bytes) 2024-09-14T05:59:35.213 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:35.213 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:35.213 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:35.214 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:35.224 INFO:teuthology.orchestra.run.smithi006.stdout:1674 trunc from 0xe0aabf9 to 0x48db2cd 2024-09-14T05:59:35.228 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T05:59:35.244 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:35.241+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:35.278 INFO:teuthology.orchestra.run.smithi006.stdout:1675 writesame 0xbd70cdb thru 0xbd7a29d data_size 0x1(0x95c3 bytes) 2024-09-14T05:59:35.278 INFO:teuthology.orchestra.run.smithi006.stdout:1676 read 0x1ecc801 thru 0x1edb9ba (0xf1ba bytes) 2024-09-14T05:59:35.279 INFO:teuthology.orchestra.run.smithi006.stdout:1679 write 0xade93a3 thru 0xadf7916 (0xe574 bytes) 2024-09-14T05:59:35.285 INFO:teuthology.orchestra.run.smithi006.stdout:1680 writesame 0x9d9e72d thru 0x9da9b23 data_size 0x3(0xb3f7 bytes) 2024-09-14T05:59:35.322 INFO:teuthology.orchestra.run.smithi006.stdout:1681 trunc from 0xbd7a29e to 0x3edb8c8 2024-09-14T05:59:35.345 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:35.341+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:35.349 INFO:teuthology.orchestra.run.smithi006.stdout:1682 write 0x1d974ee thru 0x1da02be (0x8dd1 bytes) 2024-09-14T05:59:35.352 INFO:teuthology.orchestra.run.smithi006.stdout:1683 writesame 0x2d86780 thru 0x2d8e48e data_size 0x13(0x7d0f bytes) 2024-09-14T05:59:35.374 INFO:teuthology.orchestra.run.smithi006.stdout:1684 write 0x545c785 thru 0x54625c4 (0x5e40 bytes) 2024-09-14T05:59:35.395 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:35.395 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:35.395 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:35.395 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:35.395 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:35.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T05:59:35.413 INFO:teuthology.orchestra.run.smithi006.stdout:1686 write 0xc984c80 thru 0xc986344 (0x16c5 bytes) 2024-09-14T05:59:35.416 INFO:teuthology.orchestra.run.smithi006.stdout:1687 read 0x5d46f2e thru 0x5d4f045 (0x8118 bytes) 2024-09-14T05:59:35.417 INFO:teuthology.orchestra.run.smithi006.stdout:1688 write 0x4123e9a thru 0x412ad10 (0x6e77 bytes) 2024-09-14T05:59:35.422 INFO:teuthology.orchestra.run.smithi006.stdout:1689 punch from 0x9f32c7 to 0x9fc05b, (0x8d94 bytes) 2024-09-14T05:59:35.423 INFO:teuthology.orchestra.run.smithi006.stdout:1691 write 0x4399515 thru 0x43a91d7 (0xfcc3 bytes) 2024-09-14T05:59:35.425 INFO:teuthology.orchestra.run.smithi006.stdout:1692 write 0xc837702 thru 0xc83830c (0xc0b bytes) 2024-09-14T05:59:35.427 INFO:teuthology.orchestra.run.smithi006.stdout:1693 punch from 0x8bb637e to 0x8bc3466, (0xd0e8 bytes) 2024-09-14T05:59:35.427 INFO:teuthology.orchestra.run.smithi006.stdout:1694 read 0x694041f thru 0x694f1ac (0xed8e bytes) 2024-09-14T05:59:35.427 INFO:teuthology.orchestra.run.smithi006.stdout:1696 punch from 0x98c2b6c to 0x98d1d22, (0xf1b6 bytes) 2024-09-14T05:59:35.428 INFO:teuthology.orchestra.run.smithi006.stdout:1698 write 0x611e34d thru 0x6122026 (0x3cda bytes) 2024-09-14T05:59:35.433 INFO:teuthology.orchestra.run.smithi006.stdout:1699 writesame 0x8ea68c6 thru 0x8eaaf5a data_size 0x13(0x4695 bytes) 2024-09-14T05:59:35.439 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:35.439 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:35.440 INFO:teuthology.orchestra.run.smithi006.stdout:1702 flatten 2024-09-14T05:59:35.453 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:35.453 INFO:teuthology.orchestra.run.smithi006.stdout:1704 writesame 0xb2af27 thru 0xb2eb45 data_size 0x1(0x3c1f bytes) 2024-09-14T05:59:35.455 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:35.458+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:35.467 INFO:teuthology.orchestra.run.smithi006.stdout:1705 write 0x35085b thru 0x35e64e (0xddf4 bytes) 2024-09-14T05:59:35.487 INFO:teuthology.orchestra.run.smithi006.stdout:1706 write 0xd9efdb1 thru 0xd9f8fff (0x924f bytes) 2024-09-14T05:59:35.515 INFO:teuthology.orchestra.run.smithi006.stdout:1707 trunc from 0xd9f9000 to 0x63f6b2f 2024-09-14T05:59:35.539 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4301 3.13 3:cd7a3116:::rbd_data.1127c133286b.0000000000000002:4 [read 557056~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.763301+0000", 2024-09-14T05:59:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.775850310999999, 2024-09-14T05:59:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048252252000000002, 2024-09-14T05:59:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4301 2024-09-14T05:59:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763301+0000", 2024-09-14T05:59:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763301+0000", 2024-09-14T05:59:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763301+0000", 2024-09-14T05:59:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2500000000000005e-07 2024-09-14T05:59:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763305+0000", 2024-09-14T05:59:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T05:59:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763314+0000", 2024-09-14T05:59:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8210000000000008e-06 2024-09-14T05:59:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763323+0000", 2024-09-14T05:59:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0049999999999993e-06 2024-09-14T05:59:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811338+0000", 2024-09-14T05:59:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048015557 2024-09-14T05:59:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811442+0000", 2024-09-14T05:59:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010388899999999999 2024-09-14T05:59:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811553+0000", 2024-09-14T05:59:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011092899999999999 2024-09-14T05:59:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4302 3.13 3:cd7a3116:::rbd_data.1127c133286b.0000000000000002:4 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.763333+0000", 2024-09-14T05:59:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.775818281999999, 2024-09-14T05:59:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048350935999999997, 2024-09-14T05:59:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4302 2024-09-14T05:59:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763333+0000", 2024-09-14T05:59:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763333+0000", 2024-09-14T05:59:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763333+0000", 2024-09-14T05:59:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:59:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763336+0000", 2024-09-14T05:59:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9299999999999999e-06 2024-09-14T05:59:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763345+0000", 2024-09-14T05:59:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6649999999999992e-06 2024-09-14T05:59:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763353+0000", 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811587+0000", 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048233971 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811636+0000", 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9200999999999999e-05 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811684+0000", 2024-09-14T05:59:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7577999999999997e-05 2024-09-14T05:59:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4303 3.13 3:cd7a3116:::rbd_data.1127c133286b.0000000000000002:4 [read 864256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.763366+0000", 2024-09-14T05:59:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.775785581000001, 2024-09-14T05:59:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048532156999999999, 2024-09-14T05:59:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4303 2024-09-14T05:59:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763366+0000", 2024-09-14T05:59:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763366+0000", 2024-09-14T05:59:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763366+0000", 2024-09-14T05:59:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1799999999999995e-07 2024-09-14T05:59:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763370+0000", 2024-09-14T05:59:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4800000000000001e-06 2024-09-14T05:59:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763380+0000", 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0385e-05 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763387+0000", 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811725+0000", 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048337506000000002 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811811+0000", 2024-09-14T05:59:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6537000000000002e-05 2024-09-14T05:59:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811898+0000", 2024-09-14T05:59:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6507000000000004e-05 2024-09-14T05:59:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4304 3.13 3:cd7a3116:::rbd_data.1127c133286b.0000000000000002:4 [read 1015808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.763398+0000", 2024-09-14T05:59:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.775752918999999, 2024-09-14T05:59:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048631691999999997, 2024-09-14T05:59:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4304 2024-09-14T05:59:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763398+0000", 2024-09-14T05:59:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763398+0000", 2024-09-14T05:59:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763399+0000", 2024-09-14T05:59:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6499999999999999e-07 2024-09-14T05:59:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763410+0000", 2024-09-14T05:59:35.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1331999999999999e-05 2024-09-14T05:59:35.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763420+0000", 2024-09-14T05:59:35.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0215e-05 2024-09-14T05:59:35.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763428+0000", 2024-09-14T05:59:35.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5059999999999998e-06 2024-09-14T05:59:35.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811933+0000", 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048505020000000003 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811978+0000", 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5232999999999999e-05 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.812030+0000", 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1820999999999997e-05 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.556 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21320 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.855646+0000", 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6835048969999997, 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048117163999999997, 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21320 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.557 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855646+0000", 2024-09-14T05:59:35.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855646+0000", 2024-09-14T05:59:35.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855647+0000", 2024-09-14T05:59:35.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.96e-07 2024-09-14T05:59:35.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855648+0000", 2024-09-14T05:59:35.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1599999999999999e-06 2024-09-14T05:59:35.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855651+0000", 2024-09-14T05:59:35.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.591e-06 2024-09-14T05:59:35.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855655+0000", 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7960000000000002e-06 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.903481+0000", 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047826022000000003 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.903569+0000", 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7919999999999998e-05 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.903763+0000", 2024-09-14T05:59:35.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194379 2024-09-14T05:59:35.561 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.561 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.561 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.561 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21378 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 989184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.561 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858445+0000", 2024-09-14T05:59:35.561 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6807058479999997, 2024-09-14T05:59:35.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048213651000000003, 2024-09-14T05:59:35.561 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.561 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.561 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21378 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858445+0000", 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858445+0000", 2024-09-14T05:59:35.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858446+0000", 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858448+0000", 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.441e-06 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858454+0000", 2024-09-14T05:59:35.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1449999999999996e-06 2024-09-14T05:59:35.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858460+0000", 2024-09-14T05:59:35.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9680000000000003e-06 2024-09-14T05:59:35.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906484+0000", 2024-09-14T05:59:35.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048023983999999999 2024-09-14T05:59:35.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906556+0000", 2024-09-14T05:59:35.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1802000000000001e-05 2024-09-14T05:59:35.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906659+0000", 2024-09-14T05:59:35.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102768 2024-09-14T05:59:35.565 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.565 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.565 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.565 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21379 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 864256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.565 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858467+0000", 2024-09-14T05:59:35.565 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6806843269999998, 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048414881999999999, 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21379 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858467+0000", 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858467+0000", 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858467+0000", 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9999999999999998e-07 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858476+0000", 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1020000000000003e-06 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858484+0000", 2024-09-14T05:59:35.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1960000000000002e-06 2024-09-14T05:59:35.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858489+0000", 2024-09-14T05:59:35.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1710000000000001e-06 2024-09-14T05:59:35.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906690+0000", 2024-09-14T05:59:35.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048201386999999998 2024-09-14T05:59:35.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906765+0000", 2024-09-14T05:59:35.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5119999999999999e-05 2024-09-14T05:59:35.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906882+0000", 2024-09-14T05:59:35.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116506 2024-09-14T05:59:35.569 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.569 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.569 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.570 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21380 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1011712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.570 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858496+0000", 2024-09-14T05:59:35.570 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6806552479999999, 2024-09-14T05:59:35.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048605175, 2024-09-14T05:59:35.570 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.570 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.570 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.570 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.570 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.570 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.570 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21380 2024-09-14T05:59:35.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.570 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858496+0000", 2024-09-14T05:59:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858496+0000", 2024-09-14T05:59:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858496+0000", 2024-09-14T05:59:35.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6400000000000003e-07 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858499+0000", 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.948e-06 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858505+0000", 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1070000000000001e-06 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858523+0000", 2024-09-14T05:59:35.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7992999999999999e-05 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906911+0000", 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048387905000000002 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906982+0000", 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0253000000000007e-05 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907101+0000", 2024-09-14T05:59:35.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119505 2024-09-14T05:59:35.574 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.574 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.574 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.574 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21381 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 872448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.574 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858531+0000", 2024-09-14T05:59:35.574 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6806199800000003, 2024-09-14T05:59:35.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048794176000000002, 2024-09-14T05:59:35.574 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.574 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.574 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.574 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.575 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.575 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.575 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21381 2024-09-14T05:59:35.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.575 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858531+0000", 2024-09-14T05:59:35.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858531+0000", 2024-09-14T05:59:35.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858532+0000", 2024-09-14T05:59:35.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.82e-07 2024-09-14T05:59:35.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858534+0000", 2024-09-14T05:59:35.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6189999999999998e-06 2024-09-14T05:59:35.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858541+0000", 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6540000000000002e-06 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858559+0000", 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8357999999999999e-05 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907141+0000", 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048581910999999998 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907216+0000", 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4975000000000006e-05 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907325+0000", 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109177 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21382 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1019904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858574+0000", 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6805776229999996, 2024-09-14T05:59:35.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048966019, 2024-09-14T05:59:35.579 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.579 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.579 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.579 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.579 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.579 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.579 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21382 2024-09-14T05:59:35.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.579 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858574+0000", 2024-09-14T05:59:35.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858574+0000", 2024-09-14T05:59:35.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858574+0000", 2024-09-14T05:59:35.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3e-07 2024-09-14T05:59:35.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858577+0000", 2024-09-14T05:59:35.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7640000000000001e-06 2024-09-14T05:59:35.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858593+0000", 2024-09-14T05:59:35.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5687000000000001e-05 2024-09-14T05:59:35.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858599+0000", 2024-09-14T05:59:35.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-09-14T05:59:35.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907357+0000", 2024-09-14T05:59:35.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048757308999999999 2024-09-14T05:59:35.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907435+0000", 2024-09-14T05:59:35.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7949999999999997e-05 2024-09-14T05:59:35.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907540+0000", 2024-09-14T05:59:35.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010501399999999999 2024-09-14T05:59:35.582 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.582 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.582 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21383 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 894976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858608+0000", 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6805430260000005, 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049138063000000003, 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21383 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858608+0000", 2024-09-14T05:59:35.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858608+0000", 2024-09-14T05:59:35.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858609+0000", 2024-09-14T05:59:35.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8599999999999998e-07 2024-09-14T05:59:35.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858611+0000", 2024-09-14T05:59:35.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5220000000000002e-06 2024-09-14T05:59:35.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858618+0000", 2024-09-14T05:59:35.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7460000000000003e-06 2024-09-14T05:59:35.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858623+0000", 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0699999999999997e-06 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907569+0000", 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946167999999998 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907644+0000", 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5093999999999996e-05 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907746+0000", 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101777 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21384 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1042432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858645+0000", 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6805058989999999, 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049308495000000001, 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21384 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858645+0000", 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858645+0000", 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858646+0000", 2024-09-14T05:59:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3000000000000001e-07 2024-09-14T05:59:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858663+0000", 2024-09-14T05:59:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6852000000000001e-05 2024-09-14T05:59:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858672+0000", 2024-09-14T05:59:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0340000000000002e-06 2024-09-14T05:59:35.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858677+0000", 2024-09-14T05:59:35.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7899999999999996e-06 2024-09-14T05:59:35.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907775+0000", 2024-09-14T05:59:35.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049097663999999999 2024-09-14T05:59:35.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907848+0000", 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3223e-05 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907954+0000", 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105402 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21385 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 903168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858687+0000", 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6804641939999998, 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049479466999999999, 2024-09-14T05:59:35.591 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.592 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.592 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.592 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21385 2024-09-14T05:59:35.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.592 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858687+0000", 2024-09-14T05:59:35.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858687+0000", 2024-09-14T05:59:35.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858688+0000", 2024-09-14T05:59:35.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.75e-07 2024-09-14T05:59:35.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858690+0000", 2024-09-14T05:59:35.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6510000000000001e-06 2024-09-14T05:59:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858697+0000", 2024-09-14T05:59:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5950000000000004e-06 2024-09-14T05:59:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858702+0000", 2024-09-14T05:59:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8620000000000002e-06 2024-09-14T05:59:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907987+0000", 2024-09-14T05:59:35.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049284954999999998 2024-09-14T05:59:35.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908061+0000", 2024-09-14T05:59:35.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4655999999999998e-05 2024-09-14T05:59:35.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908166+0000", 2024-09-14T05:59:35.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105073 2024-09-14T05:59:35.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.595 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.596 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21435 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 991232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.596 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859055+0000", 2024-09-14T05:59:35.596 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6800958149999996, 2024-09-14T05:59:35.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049328565999999997, 2024-09-14T05:59:35.596 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.596 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.596 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21435 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859055+0000", 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859055+0000", 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859056+0000", 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.34e-07 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859058+0000", 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2010000000000002e-06 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859064+0000", 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5169999999999996e-06 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859071+0000", 2024-09-14T05:59:35.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1140000000000002e-06 2024-09-14T05:59:35.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908196+0000", 2024-09-14T05:59:35.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049125294 2024-09-14T05:59:35.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908273+0000", 2024-09-14T05:59:35.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6953999999999995e-05 2024-09-14T05:59:35.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908384+0000", 2024-09-14T05:59:35.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011105200000000001 2024-09-14T05:59:35.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.600 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.600 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21436 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.600 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859078+0000", 2024-09-14T05:59:35.600 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6800736269999996, 2024-09-14T05:59:35.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049529658999999997, 2024-09-14T05:59:35.600 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.601 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.601 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.601 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.601 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.601 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.601 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21436 2024-09-14T05:59:35.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.601 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859078+0000", 2024-09-14T05:59:35.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859078+0000", 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859078+0000", 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5200000000000002e-07 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859080+0000", 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2929999999999999e-06 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859087+0000", 2024-09-14T05:59:35.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3060000000000003e-06 2024-09-14T05:59:35.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859091+0000", 2024-09-14T05:59:35.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8160000000000001e-06 2024-09-14T05:59:35.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908418+0000", 2024-09-14T05:59:35.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049326548999999997 2024-09-14T05:59:35.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908494+0000", 2024-09-14T05:59:35.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5655999999999995e-05 2024-09-14T05:59:35.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908607+0000", 2024-09-14T05:59:35.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000113587 2024-09-14T05:59:35.604 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.604 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.604 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.604 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21438 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1013760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.605 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859119+0000", 2024-09-14T05:59:35.605 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6800320160000002, 2024-09-14T05:59:35.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049705669000000001, 2024-09-14T05:59:35.605 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.605 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.605 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.605 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.605 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.605 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.605 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21438 2024-09-14T05:59:35.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.605 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859119+0000", 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859119+0000", 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859120+0000", 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.51e-07 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859122+0000", 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0530000000000001e-06 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859140+0000", 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8321999999999998e-05 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859146+0000", 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.156e-06 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908639+0000", 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049493176999999999 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908716+0000", 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6314000000000002e-05 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908825+0000", 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109196 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.608 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.609 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21439 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1021952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.609 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859155+0000", 2024-09-14T05:59:35.609 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6799965940000003, 2024-09-14T05:59:35.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049882120000000002, 2024-09-14T05:59:35.609 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.609 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.609 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.609 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.609 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.609 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.609 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21439 2024-09-14T05:59:35.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.610 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859155+0000", 2024-09-14T05:59:35.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859155+0000", 2024-09-14T05:59:35.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859155+0000", 2024-09-14T05:59:35.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1200000000000003e-07 2024-09-14T05:59:35.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859158+0000", 2024-09-14T05:59:35.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4199999999999999e-06 2024-09-14T05:59:35.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859166+0000", 2024-09-14T05:59:35.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2099999999999996e-06 2024-09-14T05:59:35.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859171+0000", 2024-09-14T05:59:35.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1880000000000001e-06 2024-09-14T05:59:35.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908856+0000", 2024-09-14T05:59:35.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049684796000000003 2024-09-14T05:59:35.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908932+0000", 2024-09-14T05:59:35.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6052999999999998e-05 2024-09-14T05:59:35.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909037+0000", 2024-09-14T05:59:35.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104941 2024-09-14T05:59:35.613 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.613 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.613 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.614 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21440 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.614 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859178+0000", 2024-09-14T05:59:35.614 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6799727689999999, 2024-09-14T05:59:35.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050075400999999999, 2024-09-14T05:59:35.614 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.614 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.614 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.614 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21440 2024-09-14T05:59:35.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.614 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859178+0000", 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859178+0000", 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859179+0000", 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T05:59:35.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859181+0000", 2024-09-14T05:59:35.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9989999999999998e-06 2024-09-14T05:59:35.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859187+0000", 2024-09-14T05:59:35.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8370000000000002e-06 2024-09-14T05:59:35.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859191+0000", 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3229999999999999e-06 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909069+0000", 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049877719000000001 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909146+0000", 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7415000000000003e-05 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909254+0000", 2024-09-14T05:59:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000107494 2024-09-14T05:59:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21492 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 993280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859743+0000", 2024-09-14T05:59:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6794086110000004, 2024-09-14T05:59:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049728715999999999, 2024-09-14T05:59:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.618 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21492 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859743+0000", 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859743+0000", 2024-09-14T05:59:35.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859743+0000", 2024-09-14T05:59:35.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1399999999999997e-07 2024-09-14T05:59:35.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859745+0000", 2024-09-14T05:59:35.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8330000000000001e-06 2024-09-14T05:59:35.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859751+0000", 2024-09-14T05:59:35.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9859999999999999e-06 2024-09-14T05:59:35.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859756+0000", 2024-09-14T05:59:35.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8910000000000003e-06 2024-09-14T05:59:35.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909286+0000", 2024-09-14T05:59:35.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049529918999999999 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909364+0000", 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8211e-05 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909471+0000", 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000107462 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.623 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21666 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1038336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:35.623 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.865630+0000", 2024-09-14T05:59:35.623 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6735210929999997, 2024-09-14T05:59:35.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048103458000000002, 2024-09-14T05:59:35.623 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:35.623 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:35.623 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:35.623 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:35.623 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:35.623 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:35.623 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21666 2024-09-14T05:59:35.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.623 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:35.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:35.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865630+0000", 2024-09-14T05:59:35.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:35.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865630+0000", 2024-09-14T05:59:35.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:35.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:35.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865631+0000", 2024-09-14T05:59:35.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6599999999999996e-07 2024-09-14T05:59:35.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:35.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865633+0000", 2024-09-14T05:59:35.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.475e-06 2024-09-14T05:59:35.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:35.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865641+0000", 2024-09-14T05:59:35.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6029999999999999e-06 2024-09-14T05:59:35.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:35.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865647+0000", 2024-09-14T05:59:35.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1770000000000003e-06 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.913567+0000", 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047919727000000002 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.913636+0000", 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9303999999999999e-05 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.913734+0000", 2024-09-14T05:59:35.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7505999999999998e-05 2024-09-14T05:59:35.627 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.627 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.627 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.627 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:35.627 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:35.627 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:35.629 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:35.630+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:35.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:59:35.630 INFO:teuthology.orchestra.run.smithi006.stdout:1709 punch from 0x27d4467 to 0x27dc299, (0x7e32 bytes) 2024-09-14T05:59:35.630 INFO:teuthology.orchestra.run.smithi006.stdout:1710 write 0x6f69c35 thru 0x6f6c8dc (0x2ca8 bytes) 2024-09-14T05:59:35.630 INFO:teuthology.orchestra.run.smithi006.stdout:1711 read 0x455fda3 thru 0x45690f6 (0x9354 bytes) 2024-09-14T05:59:35.630 INFO:teuthology.orchestra.run.smithi006.stdout:1712 write 0xa4027cc thru 0xa403f24 (0x1759 bytes) 2024-09-14T05:59:35.630 INFO:teuthology.orchestra.run.smithi006.stdout:1713 trunc from 0xa403f25 to 0x841697f 2024-09-14T05:59:35.630 INFO:teuthology.orchestra.run.smithi006.stdout:1714 punch from 0x19fe350 to 0x1a0aa02, (0xc6b2 bytes) 2024-09-14T05:59:35.630 INFO:teuthology.orchestra.run.smithi006.stdout:1715 write 0x4f0488e thru 0x4f13367 (0xeada bytes) 2024-09-14T05:59:35.630 INFO:teuthology.orchestra.run.smithi006.stdout:1717 punch from 0x3d1d555 to 0x3d26617, (0x90c2 bytes) 2024-09-14T05:59:35.631 INFO:teuthology.orchestra.run.smithi006.stdout:1718 punch from 0x7f91efa to 0x7f9e988, (0xca8e bytes) 2024-09-14T05:59:35.650 INFO:teuthology.orchestra.run.smithi006.stdout:1719 trunc from 0x841697f to 0xd3ca3 2024-09-14T05:59:35.695 INFO:teuthology.orchestra.run.smithi006.stdout:1720 write 0x61361e6 thru 0x6138527 (0x2342 bytes) 2024-09-14T05:59:35.701 INFO:teuthology.orchestra.run.smithi006.stdout:1722 read 0x5e5d62f thru 0x5e688b0 (0xb282 bytes) 2024-09-14T05:59:35.701 INFO:teuthology.orchestra.run.smithi006.stdout:1725 read 0x3daf57a thru 0x3db0b1c (0x15a3 bytes) 2024-09-14T05:59:35.701 INFO:teuthology.orchestra.run.smithi006.stdout:1726 punch from 0x41f23dd to 0x41f3fbf, (0x1be2 bytes) 2024-09-14T05:59:35.709 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2024-09-14T05:59:35.717 INFO:teuthology.orchestra.run.smithi006.stdout:1727 writesame 0x7f29a02 thru 0x7f3375f data_size 0x1(0x9d5e bytes) 2024-09-14T05:59:35.722 INFO:teuthology.orchestra.run.smithi006.stdout:1728 trunc from 0x7f33760 to 0x645eb1e 2024-09-14T05:59:35.729 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:35.730+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:35.731 INFO:teuthology.orchestra.run.smithi006.stdout:1729 read 0x32f12a1 thru 0x32ffd8f (0xeaef bytes) 2024-09-14T05:59:35.731 INFO:teuthology.orchestra.run.smithi006.stdout:1730 read 0x105ae5c thru 0x1065dcf (0xaf74 bytes) 2024-09-14T05:59:35.752 INFO:teuthology.orchestra.run.smithi006.stdout:1733 writesame 0xd8abd3f thru 0xd8b7a5b data_size 0x1(0xbd1d bytes) 2024-09-14T05:59:35.759 INFO:teuthology.orchestra.run.smithi006.stdout:1735 write 0xe078658 thru 0xe084273 (0xbc1c bytes) 2024-09-14T05:59:35.764 INFO:teuthology.orchestra.run.smithi006.stdout:1736 trunc from 0xe084274 to 0xdcc9825 2024-09-14T05:59:35.776 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:35.776 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:35.777 INFO:teuthology.orchestra.run.smithi006.stdout:1737 punch from 0xb3f0495 to 0xb3fcdd0, (0xc93b bytes) 2024-09-14T05:59:35.777 INFO:teuthology.orchestra.run.smithi006.stdout:1738 write 0x9d878a5 thru 0x9d89cb3 (0x240f bytes) 2024-09-14T05:59:35.782 INFO:teuthology.orchestra.run.smithi006.stdout:1739 write 0x8928d0f thru 0x892e528 (0x581a bytes) 2024-09-14T05:59:35.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:59:35.799 INFO:teuthology.orchestra.run.smithi006.stdout:1741 trunc from 0xdcc9825 to 0x6e1c2b1 2024-09-14T05:59:35.815 INFO:teuthology.orchestra.run.smithi006.stdout:1743 read 0x358f68f thru 0x3592ff5 (0x3967 bytes) 2024-09-14T05:59:35.815 INFO:teuthology.orchestra.run.smithi006.stdout:1744 read 0x633117 thru 0x641e66 (0xed50 bytes) 2024-09-14T05:59:35.827 INFO:teuthology.orchestra.run.smithi006.stdout:1745 writesame 0x7abf635 thru 0x7acc471 data_size 0x1(0xce3d bytes) 2024-09-14T05:59:35.829 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:35.830 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:35.830+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:35.833 INFO:teuthology.orchestra.run.smithi006.stdout:1747 trunc from 0x7acc472 to 0xaa7ddfe 2024-09-14T05:59:35.840 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:35.840 INFO:teuthology.orchestra.run.smithi006.stdout:1749 write 0x383941a thru 0x3847e3f (0xea26 bytes) 2024-09-14T05:59:35.847 INFO:teuthology.orchestra.run.smithi006.stdout:1750 punch from 0x688f8ec to 0x6899155, (0x9869 bytes) 2024-09-14T05:59:35.848 INFO:teuthology.orchestra.run.smithi006.stdout:1751 writesame 0x14e9ee6 thru 0x14eece2 data_size 0x21(0x4dfd bytes) 2024-09-14T05:59:35.851 INFO:teuthology.orchestra.run.smithi006.stdout:1752 read 0x5078f39 thru 0x5079435 (0x4fd bytes) 2024-09-14T05:59:35.860 INFO:teuthology.orchestra.run.smithi006.stdout:1753 writesame 0xc7f1b6f thru 0xc7ff115 data_size 0x1(0xd5a7 bytes) 2024-09-14T05:59:35.860 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:35.876 INFO:teuthology.orchestra.run.smithi006.stdout:1755 trunc from 0xc7ff116 to 0x141e0b0 2024-09-14T05:59:35.908 INFO:teuthology.orchestra.run.smithi006.stdout:1757 write 0x225bb94 thru 0x2264561 (0x89ce bytes) 2024-09-14T05:59:35.929 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:35.930 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:35.930 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:35.930 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:35.930 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:35.930 INFO:teuthology.orchestra.run.smithi006.stdout:1758 writesame 0x69fa1bb thru 0x6a0377d data_size 0x1(0x95c3 bytes) 2024-09-14T05:59:35.930 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:35.930+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:35.946 INFO:teuthology.orchestra.run.smithi006.stdout:1759 writesame 0xcce9f5a thru 0xccf31fd data_size 0xa(0x92a4 bytes) 2024-09-14T05:59:35.949 INFO:teuthology.orchestra.run.smithi006.stdout:1764 trunc from 0xccf31fe to 0xa6d10cd 2024-09-14T05:59:35.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:59:35.960 INFO:teuthology.orchestra.run.smithi006.stdout:1765 trunc from 0xa6d10cd to 0x8f05735 2024-09-14T05:59:35.969 INFO:teuthology.orchestra.run.smithi006.stdout:1766 punch from 0x5998043 to 0x59a325c, (0xb219 bytes) 2024-09-14T05:59:35.970 INFO:teuthology.orchestra.run.smithi006.stdout:1768 trunc from 0x8f05735 to 0x9a959de 2024-09-14T05:59:35.978 INFO:teuthology.orchestra.run.smithi006.stdout:1769 read 0x804bb9f thru 0x804ce9d (0x12ff bytes) 2024-09-14T05:59:35.978 INFO:teuthology.orchestra.run.smithi006.stdout:1770 punch from 0x721c00 to 0x728f9d, (0x739d bytes) 2024-09-14T05:59:35.978 INFO:teuthology.orchestra.run.smithi006.stdout:1771 write 0x24e4272 thru 0x24e7135 (0x2ec4 bytes) 2024-09-14T05:59:35.981 INFO:teuthology.orchestra.run.smithi006.stdout:1772 write 0x423e455 thru 0x424d77d (0xf329 bytes) 2024-09-14T05:59:35.991 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:35.999 INFO:teuthology.orchestra.run.smithi006.stdout:1774 trunc from 0x9a959de to 0x4d8077b 2024-09-14T05:59:36.009 INFO:teuthology.orchestra.run.smithi006.stdout:1776 trunc from 0x4d8077b to 0x48a131d 2024-09-14T05:59:36.018 INFO:teuthology.orchestra.run.smithi006.stdout:1777 writesame 0x2a8abbd thru 0x2a8b157 data_size 0x7(0x59b bytes) 2024-09-14T05:59:36.031 INFO:teuthology.orchestra.run.smithi006.stdout:1778 trunc from 0x48a131d to 0x9b13be3 2024-09-14T05:59:36.031 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:36.029+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:36.052 INFO:teuthology.orchestra.run.smithi006.stdout:1779 writesame 0xe4522c8 thru 0xe461c42 data_size 0x3d(0xf97b bytes) 2024-09-14T05:59:36.052 INFO:teuthology.orchestra.run.smithi006.stdout:truncating to largest ever: 0xee33a47 2024-09-14T05:59:36.053 INFO:teuthology.orchestra.run.smithi006.stdout:1780 trunc from 0xe461c43 to 0xee33a47 2024-09-14T05:59:36.060 INFO:teuthology.orchestra.run.smithi006.stdout:1781 write 0x7cd4e0 thru 0x7d3bc0 (0x66e1 bytes) 2024-09-14T05:59:36.064 INFO:teuthology.orchestra.run.smithi006.stdout:1782 writesame 0xe8041f8 thru 0xe80c5fe data_size 0x1(0x8407 bytes) 2024-09-14T05:59:36.110 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:36.111 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:36.111 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:36.111 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:36.111 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.111 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21567 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 993280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.111 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:36.111 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1892978369999998, 2024-09-14T05:59:36.111 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031237369000000001, 2024-09-14T05:59:36.111 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.111 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.111 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.111 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.111 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.112 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.112 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21567 2024-09-14T05:59:36.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.112 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.112 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.112 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.112 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:36.112 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.112 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.112 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.112 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:36.112 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.113 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.113 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.113 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.113 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918112+0000", 2024-09-14T05:59:36.113 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6000000000000004e-07 2024-09-14T05:59:36.113 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.113 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.113 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.113 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918113+0000", 2024-09-14T05:59:36.114 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:59:36.114 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.114 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.114 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.114 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918118+0000", 2024-09-14T05:59:36.114 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4789999999999998e-06 2024-09-14T05:59:36.114 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.114 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.114 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.114 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918122+0000", 2024-09-14T05:59:36.114 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7740000000000002e-06 2024-09-14T05:59:36.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.115 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.115 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.115 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949196+0000", 2024-09-14T05:59:36.115 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031074101 2024-09-14T05:59:36.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.115 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.115 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.115 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949239+0000", 2024-09-14T05:59:36.115 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3724999999999999e-05 2024-09-14T05:59:36.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.115 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.115 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.115 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949349+0000", 2024-09-14T05:59:36.116 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010916699999999999 2024-09-14T05:59:36.116 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.116 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.116 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.116 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.116 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.116 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21570 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1001472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.116 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:36.116 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1892651240000003, 2024-09-14T05:59:36.116 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031375860999999998, 2024-09-14T05:59:36.116 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.116 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.116 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.116 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.117 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.117 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.117 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21570 2024-09-14T05:59:36.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.117 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.117 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.117 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.117 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:36.117 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.117 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.117 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.118 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:36.118 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.118 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.118 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.118 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:36.118 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0499999999999999e-07 2024-09-14T05:59:36.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.118 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.118 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.118 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918146+0000", 2024-09-14T05:59:36.118 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1179999999999999e-06 2024-09-14T05:59:36.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.119 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.119 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.119 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918153+0000", 2024-09-14T05:59:36.119 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0299999999999999e-06 2024-09-14T05:59:36.119 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.119 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.119 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.119 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918157+0000", 2024-09-14T05:59:36.119 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0589999999999996e-06 2024-09-14T05:59:36.119 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.119 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.119 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.119 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949386+0000", 2024-09-14T05:59:36.120 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031229455999999999 2024-09-14T05:59:36.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.120 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.120 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.120 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949448+0000", 2024-09-14T05:59:36.120 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2291000000000004e-05 2024-09-14T05:59:36.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.120 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.120 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.120 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949520+0000", 2024-09-14T05:59:36.120 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1501999999999994e-05 2024-09-14T05:59:36.120 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.120 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.120 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.121 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.121 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21574 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1024000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.121 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:36.121 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1892463830000004, 2024-09-14T05:59:36.121 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031511174000000003, 2024-09-14T05:59:36.121 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.121 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.121 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.121 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.121 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.121 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.121 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21574 2024-09-14T05:59:36.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.122 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8500000000000002e-07 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918165+0000", 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.674e-06 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918169+0000", 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5709999999999999e-06 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.123 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918175+0000", 2024-09-14T05:59:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:59:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949555+0000", 2024-09-14T05:59:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031380230000000002 2024-09-14T05:59:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949606+0000", 2024-09-14T05:59:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0300000000000003e-05 2024-09-14T05:59:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.125 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949674+0000", 2024-09-14T05:59:36.125 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8175000000000004e-05 2024-09-14T05:59:36.125 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.125 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.125 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.125 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.125 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.125 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21576 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1032192~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.125 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:36.125 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1892230760000002, 2024-09-14T05:59:36.125 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031677479000000001, 2024-09-14T05:59:36.125 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.125 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.125 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.126 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.126 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.126 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.126 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21576 2024-09-14T05:59:36.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.126 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.126 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.126 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.126 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:36.126 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.126 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.126 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.126 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:36.127 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.127 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.127 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.127 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.127 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918187+0000", 2024-09-14T05:59:36.127 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7100000000000001e-07 2024-09-14T05:59:36.127 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.127 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.127 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.127 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918189+0000", 2024-09-14T05:59:36.127 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.43e-06 2024-09-14T05:59:36.127 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.127 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.127 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.128 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918198+0000", 2024-09-14T05:59:36.128 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1859999999999998e-06 2024-09-14T05:59:36.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.128 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.128 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.128 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918206+0000", 2024-09-14T05:59:36.128 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4939999999999997e-06 2024-09-14T05:59:36.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.128 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.128 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.128 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949716+0000", 2024-09-14T05:59:36.128 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031510428 2024-09-14T05:59:36.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.128 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.129 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.129 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949789+0000", 2024-09-14T05:59:36.129 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3233999999999997e-05 2024-09-14T05:59:36.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.129 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.129 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.129 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949863+0000", 2024-09-14T05:59:36.129 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4035999999999994e-05 2024-09-14T05:59:36.129 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.129 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.129 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.129 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.130 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21577 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1046528~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.130 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:36.130 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1891922429999999, 2024-09-14T05:59:36.130 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031830166999999999, 2024-09-14T05:59:36.130 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.130 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.130 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.130 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.130 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.130 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.130 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21577 2024-09-14T05:59:36.130 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.130 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.130 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.131 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.131 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:36.131 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.131 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.131 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.131 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:36.131 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.131 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.131 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.131 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:36.131 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3499999999999996e-07 2024-09-14T05:59:36.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.132 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.132 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.132 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918221+0000", 2024-09-14T05:59:36.132 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3179999999999998e-06 2024-09-14T05:59:36.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.132 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.132 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.132 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918230+0000", 2024-09-14T05:59:36.132 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9460000000000004e-06 2024-09-14T05:59:36.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.132 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.133 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.133 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918240+0000", 2024-09-14T05:59:36.133 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9580000000000002e-06 2024-09-14T05:59:36.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.133 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.133 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.133 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949896+0000", 2024-09-14T05:59:36.133 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031655839999999998 2024-09-14T05:59:36.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.133 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.133 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.133 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949944+0000", 2024-09-14T05:59:36.133 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8658000000000001e-05 2024-09-14T05:59:36.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.134 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.134 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.134 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950047+0000", 2024-09-14T05:59:36.134 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102812 2024-09-14T05:59:36.134 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.134 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.134 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.134 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.134 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21615 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 995328~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.134 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:36.134 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1889812449999999, 2024-09-14T05:59:36.134 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031807305000000001, 2024-09-14T05:59:36.135 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.135 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.135 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.135 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.135 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.135 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.135 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21615 2024-09-14T05:59:36.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.135 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.135 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.135 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.135 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:36.135 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.136 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.136 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.136 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:36.136 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.136 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.136 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.136 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:36.136 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6499999999999999e-07 2024-09-14T05:59:36.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.136 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.136 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.136 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918431+0000", 2024-09-14T05:59:36.137 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.948e-06 2024-09-14T05:59:36.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.137 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.137 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.137 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918440+0000", 2024-09-14T05:59:36.137 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9390000000000003e-06 2024-09-14T05:59:36.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.137 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.137 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.137 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918448+0000", 2024-09-14T05:59:36.137 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.233e-06 2024-09-14T05:59:36.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.137 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.137 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.138 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950088+0000", 2024-09-14T05:59:36.138 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031640922000000002 2024-09-14T05:59:36.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.138 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.138 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950153+0000", 2024-09-14T05:59:36.138 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4500999999999998e-05 2024-09-14T05:59:36.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.138 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.138 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950235+0000", 2024-09-14T05:59:36.138 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2196999999999999e-05 2024-09-14T05:59:36.138 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.138 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.139 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.139 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.139 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21618 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1003520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.139 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:36.139 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.188949976, 2024-09-14T05:59:36.139 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031945335999999998, 2024-09-14T05:59:36.139 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.139 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.139 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.139 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.139 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.139 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21618 2024-09-14T05:59:36.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.140 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.140 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.140 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.140 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:36.140 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.140 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.140 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.140 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:36.140 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.140 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.141 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.141 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918460+0000", 2024-09-14T05:59:36.141 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8400000000000002e-07 2024-09-14T05:59:36.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.141 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.141 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918464+0000", 2024-09-14T05:59:36.141 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4699999999999998e-06 2024-09-14T05:59:36.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.141 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.141 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918473+0000", 2024-09-14T05:59:36.141 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2159999999999995e-06 2024-09-14T05:59:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918480+0000", 2024-09-14T05:59:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2540000000000003e-06 2024-09-14T05:59:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950268+0000", 2024-09-14T05:59:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031787955 2024-09-14T05:59:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.142 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950327+0000", 2024-09-14T05:59:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9289000000000001e-05 2024-09-14T05:59:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950404+0000", 2024-09-14T05:59:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7168000000000004e-05 2024-09-14T05:59:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21620 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1026048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:36.143 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1889086259999999, 2024-09-14T05:59:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032089751, 2024-09-14T05:59:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21620 2024-09-14T05:59:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:36.144 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918501+0000", 2024-09-14T05:59:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.46e-07 2024-09-14T05:59:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918503+0000", 2024-09-14T05:59:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4940000000000002e-06 2024-09-14T05:59:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918509+0000", 2024-09-14T05:59:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0850000000000002e-06 2024-09-14T05:59:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918514+0000", 2024-09-14T05:59:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7219999999999999e-06 2024-09-14T05:59:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.146 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.147 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950435+0000", 2024-09-14T05:59:36.147 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031921161000000003 2024-09-14T05:59:36.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.147 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.147 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950518+0000", 2024-09-14T05:59:36.147 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2280999999999994e-05 2024-09-14T05:59:36.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.147 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.147 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950590+0000", 2024-09-14T05:59:36.147 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2562000000000001e-05 2024-09-14T05:59:36.147 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.147 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.148 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21622 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1034240~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.148 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:36.148 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1888883610000001, 2024-09-14T05:59:36.148 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032304393000000001, 2024-09-14T05:59:36.148 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.148 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.148 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.148 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.148 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.148 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.148 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21622 2024-09-14T05:59:36.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.149 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.149 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.149 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:36.149 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.149 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.149 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:36.149 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.149 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.150 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:36.150 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8299999999999997e-07 2024-09-14T05:59:36.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.150 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.150 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918523+0000", 2024-09-14T05:59:36.150 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7370000000000001e-06 2024-09-14T05:59:36.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.150 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.150 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918528+0000", 2024-09-14T05:59:36.150 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.87e-06 2024-09-14T05:59:36.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.151 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.151 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918532+0000", 2024-09-14T05:59:36.151 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8999999999999999e-06 2024-09-14T05:59:36.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.151 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.151 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.151 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950656+0000", 2024-09-14T05:59:36.151 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032123800000000001 2024-09-14T05:59:36.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.151 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.151 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.151 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950745+0000", 2024-09-14T05:59:36.151 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9044999999999999e-05 2024-09-14T05:59:36.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.152 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.152 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950825+0000", 2024-09-14T05:59:36.152 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0457999999999994e-05 2024-09-14T05:59:36.152 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.152 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.152 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.152 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21668 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 983040~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.152 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:36.152 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1887661339999998, 2024-09-14T05:59:36.152 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032333329000000001, 2024-09-14T05:59:36.153 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.153 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.153 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.153 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.153 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.153 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.153 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21668 2024-09-14T05:59:36.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.153 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.153 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.153 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.153 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:36.153 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.154 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.154 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:36.154 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.154 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.154 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:36.154 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9999999999999998e-07 2024-09-14T05:59:36.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.154 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.155 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918650+0000", 2024-09-14T05:59:36.155 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0779999999999998e-06 2024-09-14T05:59:36.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.155 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.155 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918656+0000", 2024-09-14T05:59:36.155 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.536e-06 2024-09-14T05:59:36.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.155 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.155 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918663+0000", 2024-09-14T05:59:36.155 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9480000000000002e-06 2024-09-14T05:59:36.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.156 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.156 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950856+0000", 2024-09-14T05:59:36.156 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032193580999999999 2024-09-14T05:59:36.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.156 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.156 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950908+0000", 2024-09-14T05:59:36.156 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1248999999999997e-05 2024-09-14T05:59:36.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.156 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.156 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950976+0000", 2024-09-14T05:59:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8536999999999998e-05 2024-09-14T05:59:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21671 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 997376~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1887353479999998, 2024-09-14T05:59:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032470855999999999, 2024-09-14T05:59:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.158 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.158 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.158 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21671 2024-09-14T05:59:36.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.158 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.158 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.158 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:36.158 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.158 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.158 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:36.158 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.159 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.159 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:36.159 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:59:36.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.159 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.159 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918677+0000", 2024-09-14T05:59:36.159 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.565e-06 2024-09-14T05:59:36.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.159 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.160 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918686+0000", 2024-09-14T05:59:36.160 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3309999999999993e-06 2024-09-14T05:59:36.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.160 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.160 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918694+0000", 2024-09-14T05:59:36.160 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6249999999999998e-06 2024-09-14T05:59:36.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.160 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.160 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951003+0000", 2024-09-14T05:59:36.160 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032308903 2024-09-14T05:59:36.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.161 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.161 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951059+0000", 2024-09-14T05:59:36.161 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:59:36.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.161 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.161 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951145+0000", 2024-09-14T05:59:36.161 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.53e-05 2024-09-14T05:59:36.161 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.161 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.161 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21673 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1005568~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1887041329999999, 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.03260818, 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21673 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.162 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.163 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:36.163 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.163 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.163 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:36.163 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.163 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.163 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918706+0000", 2024-09-14T05:59:36.163 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4199999999999995e-07 2024-09-14T05:59:36.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.164 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.164 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918715+0000", 2024-09-14T05:59:36.164 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7459999999999995e-06 2024-09-14T05:59:36.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.164 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.164 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918725+0000", 2024-09-14T05:59:36.164 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0077e-05 2024-09-14T05:59:36.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.164 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.164 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918733+0000", 2024-09-14T05:59:36.164 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9610000000000005e-06 2024-09-14T05:59:36.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951178+0000", 2024-09-14T05:59:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032444711000000001 2024-09-14T05:59:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951246+0000", 2024-09-14T05:59:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8256999999999994e-05 2024-09-14T05:59:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951313+0000", 2024-09-14T05:59:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6785999999999994e-05 2024-09-14T05:59:36.166 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.166 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.166 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.166 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21674 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1028096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.166 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:36.166 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1886640049999997, 2024-09-14T05:59:36.166 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032759020999999999, 2024-09-14T05:59:36.166 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.166 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.166 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.166 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.166 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21674 2024-09-14T05:59:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918746+0000", 2024-09-14T05:59:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6599999999999995e-07 2024-09-14T05:59:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918749+0000", 2024-09-14T05:59:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1489999999999998e-06 2024-09-14T05:59:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918758+0000", 2024-09-14T05:59:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2779999999999999e-06 2024-09-14T05:59:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918771+0000", 2024-09-14T05:59:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2799999999999999e-05 2024-09-14T05:59:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951346+0000", 2024-09-14T05:59:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032574573000000002 2024-09-14T05:59:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951426+0000", 2024-09-14T05:59:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0486000000000002e-05 2024-09-14T05:59:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951504+0000", 2024-09-14T05:59:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7968999999999998e-05 2024-09-14T05:59:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21676 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1036288~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1886264469999999, 2024-09-14T05:59:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032901069999999998, 2024-09-14T05:59:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21676 2024-09-14T05:59:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2600000000000002e-07 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918787+0000", 2024-09-14T05:59:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2430000000000001e-06 2024-09-14T05:59:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918796+0000", 2024-09-14T05:59:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5910000000000002e-06 2024-09-14T05:59:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918804+0000", 2024-09-14T05:59:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4050000000000003e-06 2024-09-14T05:59:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951539+0000", 2024-09-14T05:59:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032735383999999999 2024-09-14T05:59:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951611+0000", 2024-09-14T05:59:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1675999999999996e-05 2024-09-14T05:59:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951684+0000", 2024-09-14T05:59:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3045000000000003e-05 2024-09-14T05:59:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21723 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 985088~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1884243300000001, 2024-09-14T05:59:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032913915000000002, 2024-09-14T05:59:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21723 2024-09-14T05:59:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0499999999999999e-07 2024-09-14T05:59:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918987+0000", 2024-09-14T05:59:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.883e-06 2024-09-14T05:59:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918992+0000", 2024-09-14T05:59:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8550000000000001e-06 2024-09-14T05:59:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918996+0000", 2024-09-14T05:59:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8800000000000001e-06 2024-09-14T05:59:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951712+0000", 2024-09-14T05:59:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032715883000000001 2024-09-14T05:59:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951784+0000", 2024-09-14T05:59:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2484999999999995e-05 2024-09-14T05:59:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951899+0000", 2024-09-14T05:59:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000114524 2024-09-14T05:59:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21725 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1007616~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1884063170000001, 2024-09-14T05:59:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033063000000000002, 2024-09-14T05:59:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21725 2024-09-14T05:59:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3099999999999999e-07 2024-09-14T05:59:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919013+0000", 2024-09-14T05:59:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0222e-05 2024-09-14T05:59:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919019+0000", 2024-09-14T05:59:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5520000000000004e-06 2024-09-14T05:59:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919023+0000", 2024-09-14T05:59:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0779999999999997e-06 2024-09-14T05:59:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951932+0000", 2024-09-14T05:59:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032908958000000002 2024-09-14T05:59:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952000+0000", 2024-09-14T05:59:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8435000000000005e-05 2024-09-14T05:59:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952066+0000", 2024-09-14T05:59:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5424000000000002e-05 2024-09-14T05:59:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21726 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1015808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1883797950000003, 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033223673000000002, 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21726 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919030+0000", 2024-09-14T05:59:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9000000000000002e-07 2024-09-14T05:59:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919031+0000", 2024-09-14T05:59:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7060000000000001e-06 2024-09-14T05:59:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919036+0000", 2024-09-14T05:59:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7439999999999998e-06 2024-09-14T05:59:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919040+0000", 2024-09-14T05:59:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9559999999999999e-06 2024-09-14T05:59:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952093+0000", 2024-09-14T05:59:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033053355 2024-09-14T05:59:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952151+0000", 2024-09-14T05:59:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7352999999999998e-05 2024-09-14T05:59:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952253+0000", 2024-09-14T05:59:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102169 2024-09-14T05:59:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21727 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1030144~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1883637949999999, 2024-09-14T05:59:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033447573000000001, 2024-09-14T05:59:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21727 2024-09-14T05:59:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919046+0000", 2024-09-14T05:59:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.53e-07 2024-09-14T05:59:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919049+0000", 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5130000000000001e-06 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919055+0000", 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3280000000000002e-06 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919059+0000", 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9820000000000002e-06 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952280+0000", 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033220999000000001 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952358+0000", 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7941999999999993e-05 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952493+0000", 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000134456 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21729 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1038336~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.18834427, 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033604367000000003, 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21729 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.195 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:36.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.195 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:36.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.195 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:36.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1200000000000003e-07 2024-09-14T05:59:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919089+0000", 2024-09-14T05:59:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.332e-05 2024-09-14T05:59:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919096+0000", 2024-09-14T05:59:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5109999999999997e-06 2024-09-14T05:59:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919101+0000", 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8239999999999999e-06 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952524+0000", 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033422466999999997 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952599+0000", 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5074999999999995e-05 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.197 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952669+0000", 2024-09-14T05:59:36.198 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0557999999999998e-05 2024-09-14T05:59:36.198 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.198 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.198 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.198 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:28643 3.19 3:9c53e3bd:::rbd_data.11276864ec6c.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-14T05:59:36.198 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:36.198 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.487733422, 2024-09-14T05:59:36.198 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033793691000000001, 2024-09-14T05:59:36.198 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.198 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.198 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 28643 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619677+0000", 2024-09-14T05:59:36.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.717e-06 2024-09-14T05:59:36.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619683+0000", 2024-09-14T05:59:36.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5300000000000004e-06 2024-09-14T05:59:36.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619695+0000", 2024-09-14T05:59:36.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2211e-05 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619701+0000", 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9429999999999997e-06 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619754+0000", 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2899000000000003e-05 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619809+0000", 2024-09-14T05:59:36.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4783e-05 2024-09-14T05:59:36.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.202 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 3", 2024-09-14T05:59:36.202 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.625771+0000", 2024-09-14T05:59:36.202 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0059617960000000001 2024-09-14T05:59:36.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.202 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:36.202 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653329+0000", 2024-09-14T05:59:36.202 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.027558068000000002 2024-09-14T05:59:36.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.202 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653351+0000", 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2133e-05 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653409+0000", 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8687999999999998e-05 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653469+0000", 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9923000000000002e-05 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.203 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.204 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.204 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.204 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:36.205 INFO:teuthology.orchestra.run.smithi006.stdout:1783 punch from 0x988b31d to 0x98971ef, (0xbed2 bytes) 2024-09-14T05:59:36.205 INFO:teuthology.orchestra.run.smithi006.stdout:1784 trunc from 0xee33a47 to 0xeaa5968 2024-09-14T05:59:36.206 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:59:36.207 INFO:teuthology.orchestra.run.smithi006.stdout:1788 writesame 0xebcaba7 thru 0xebd5514 data_size 0x3(0xa96e bytes) 2024-09-14T05:59:36.207 INFO:teuthology.orchestra.run.smithi006.stdout:1790 write 0x185fb25 thru 0x186895f (0x8e3b bytes) 2024-09-14T05:59:36.207 INFO:teuthology.orchestra.run.smithi006.stdout:1791 writesame 0x6914bbf thru 0x6916b69 data_size 0x43(0x1fab bytes) 2024-09-14T05:59:36.207 INFO:teuthology.orchestra.run.smithi006.stdout:1792 read 0xc169236 thru 0xc170048 (0x6e13 bytes) 2024-09-14T05:59:36.207 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:36.207 INFO:teuthology.orchestra.run.smithi006.stdout:1794 read 0x7acacee thru 0x7ace579 (0x388c bytes) 2024-09-14T05:59:36.207 INFO:teuthology.orchestra.run.smithi006.stdout:1796 trunc from 0xebd5515 to 0xbfbca95 2024-09-14T05:59:36.207 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:36.208 INFO:teuthology.orchestra.run.smithi006.stdout:1798 punch from 0x788686b to 0x78910ff, (0xa894 bytes) 2024-09-14T05:59:36.208 INFO:teuthology.orchestra.run.smithi006.stdout:1801 writesame 0x71040e7 thru 0x71049d5 data_size 0x1(0x8ef bytes) 2024-09-14T05:59:36.208 INFO:teuthology.orchestra.run.smithi006.stdout:1803 punch from 0x3eb5b0b to 0x3eb930c, (0x3801 bytes) 2024-09-14T05:59:36.208 INFO:teuthology.orchestra.run.smithi006.stdout:1804 trunc from 0xbfbca95 to 0x1193a9 2024-09-14T05:59:36.208 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:36.201+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:36.223 INFO:teuthology.orchestra.run.smithi006.stdout:1808 trunc from 0x1193a9 to 0x109dca5 2024-09-14T05:59:36.236 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:36.241 INFO:teuthology.orchestra.run.smithi006.stdout:1812 trunc from 0x109dca5 to 0x37a9446 2024-09-14T05:59:36.249 INFO:teuthology.orchestra.run.smithi006.stdout:1813 read 0x1a73ba2 thru 0x1a764e6 (0x2945 bytes) 2024-09-14T05:59:36.250 INFO:teuthology.orchestra.run.smithi006.stdout:1814 punch from 0x372b0e4 to 0x3730dcc, (0x5ce8 bytes) 2024-09-14T05:59:36.272 INFO:teuthology.orchestra.run.smithi006.stdout:1815 write 0xa89f06e thru 0xa8a1748 (0x26db bytes) 2024-09-14T05:59:36.290 INFO:teuthology.orchestra.run.smithi006.stdout:1818 trunc from 0xa8a1749 to 0x4b566cf 2024-09-14T05:59:36.306 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:36.306+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:36.310 INFO:teuthology.orchestra.run.smithi006.stdout:1819 trunc from 0x4b566cf to 0x26ed762 2024-09-14T05:59:36.334 INFO:teuthology.orchestra.run.smithi006.stdout:1820 writesame 0x57f7b4c thru 0x5806236 data_size 0x23(0xe6eb bytes) 2024-09-14T05:59:36.334 INFO:teuthology.orchestra.run.smithi006.stdout:1821 read 0x569ae0a thru 0x56a47fc (0x99f3 bytes) 2024-09-14T05:59:36.334 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:36.334 INFO:teuthology.orchestra.run.smithi006.stdout:1823 punch from 0x19da544 to 0x19dc7f2, (0x22ae bytes) 2024-09-14T05:59:36.334 INFO:teuthology.orchestra.run.smithi006.stdout:1825 punch from 0x3fa02c6 to 0x3fa5193, (0x4ecd bytes) 2024-09-14T05:59:36.334 INFO:teuthology.orchestra.run.smithi006.stdout:1826 punch from 0x23ff85 to 0x244b52, (0x4bcd bytes) 2024-09-14T05:59:36.353 INFO:teuthology.orchestra.run.smithi006.stdout:1827 writesame 0xcd3ecd1 thru 0xcd41cc1 data_size 0x1(0x2ff1 bytes) 2024-09-14T05:59:36.354 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:36.354 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:36.354 INFO:teuthology.orchestra.run.smithi006.stdout:1830 punch from 0xb6011f3 to 0xb60a837, (0x9644 bytes) 2024-09-14T05:59:36.356 INFO:teuthology.orchestra.run.smithi006.stdout:1831 trunc from 0xcd41cc2 to 0xeb78e5c 2024-09-14T05:59:36.363 INFO:teuthology.orchestra.run.smithi006.stdout:1832 punch from 0x659411a to 0x65a15ad, (0xd493 bytes) 2024-09-14T05:59:36.363 INFO:teuthology.orchestra.run.smithi006.stdout:1833 write 0x8544063 thru 0x85494d7 (0x5475 bytes) 2024-09-14T05:59:36.368 INFO:teuthology.orchestra.run.smithi006.stdout:1835 read 0xe4c140b thru 0xe4c41cb (0x2dc1 bytes) 2024-09-14T05:59:36.368 INFO:teuthology.orchestra.run.smithi006.stdout:1836 read 0x446f43b thru 0x446f55f (0x125 bytes) 2024-09-14T05:59:36.368 INFO:teuthology.orchestra.run.smithi006.stdout:1839 read 0x15fec57 thru 0x160ac1f (0xbfc9 bytes) 2024-09-14T05:59:36.369 INFO:teuthology.orchestra.run.smithi006.stdout:1840 write 0x45675 thru 0x5242b (0xcdb7 bytes) 2024-09-14T05:59:36.373 INFO:teuthology.orchestra.run.smithi006.stdout:1841 writesame 0x3ed058 thru 0x3f223b data_size 0x6(0x51e4 bytes) 2024-09-14T05:59:36.379 INFO:teuthology.orchestra.run.smithi006.stdout:1842 write 0x6309ed9 thru 0x630c766 (0x288e bytes) 2024-09-14T05:59:36.386 INFO:teuthology.orchestra.run.smithi006.stdout:1843 trunc from 0xeb78e5c to 0xdab72c0 2024-09-14T05:59:36.387 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:36.388 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:36.388 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:36.388 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:36.392 INFO:teuthology.orchestra.run.smithi006.stdout:1844 read 0x7d98800 thru 0x7d9eae2 (0x62e3 bytes) 2024-09-14T05:59:36.393 INFO:teuthology.orchestra.run.smithi006.stdout:1845 write 0x8ba4de7 thru 0x8bb0874 (0xba8e bytes) 2024-09-14T05:59:36.401 INFO:teuthology.orchestra.run.smithi006.stdout:1847 trunc from 0xdab72c0 to 0xec5e704 2024-09-14T05:59:36.405 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:59:36.407 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:36.406+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:36.410 INFO:teuthology.orchestra.run.smithi006.stdout:1848 write 0x1dadc87 thru 0x1db6677 (0x89f1 bytes) 2024-09-14T05:59:36.413 INFO:teuthology.orchestra.run.smithi006.stdout:1849 read 0xac348ad thru 0xac37acc (0x3220 bytes) 2024-09-14T05:59:36.413 INFO:teuthology.orchestra.run.smithi006.stdout:1850 write 0x8e4fcd2 thru 0x8e50239 (0x568 bytes) 2024-09-14T05:59:36.420 INFO:teuthology.orchestra.run.smithi006.stdout:1851 trunc from 0xec5e704 to 0xc2a02e7 2024-09-14T05:59:36.427 INFO:teuthology.orchestra.run.smithi006.stdout:1852 read 0x805961e thru 0x805a819 (0x11fc bytes) 2024-09-14T05:59:36.427 INFO:teuthology.orchestra.run.smithi006.stdout:1853 read 0x66867c8 thru 0x6692057 (0xb890 bytes) 2024-09-14T05:59:36.428 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:36.438 INFO:teuthology.orchestra.run.smithi006.stdout:1855 writesame 0xe378f12 thru 0xe37d44c data_size 0x1(0x453b bytes) 2024-09-14T05:59:36.438 INFO:teuthology.orchestra.run.smithi006.stdout:1856 write 0x5a06f3a thru 0x5a0d149 (0x6210 bytes) 2024-09-14T05:59:36.443 INFO:teuthology.orchestra.run.smithi006.stdout:1857 read 0x379333 thru 0x37fd9d (0x6a6b bytes) 2024-09-14T05:59:36.444 INFO:teuthology.orchestra.run.smithi006.stdout:1858 writesame 0x207eff4 thru 0x2089f87 data_size 0x22(0xaf94 bytes) 2024-09-14T05:59:36.450 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:36.450 INFO:teuthology.orchestra.run.smithi006.stdout:1860 read 0xa3da4f4 thru 0xa3e4a74 (0xa581 bytes) 2024-09-14T05:59:36.450 INFO:teuthology.orchestra.run.smithi006.stdout:1861 read 0x183e2d5 thru 0x184d361 (0xf08d bytes) 2024-09-14T05:59:36.451 INFO:teuthology.orchestra.run.smithi006.stdout:1862 writesame 0x43039c7 thru 0x4305542 data_size 0x2(0x1b7c bytes) 2024-09-14T05:59:36.454 INFO:teuthology.orchestra.run.smithi006.stdout:1863 write 0x48bb674 thru 0x48c8852 (0xd1df bytes) 2024-09-14T05:59:36.458 INFO:teuthology.orchestra.run.smithi006.stdout:1864 read 0x418c50c thru 0x419abdc (0xe6d1 bytes) 2024-09-14T05:59:36.458 INFO:teuthology.orchestra.run.smithi006.stdout:1866 read 0x822a795 thru 0x8234401 (0x9c6d bytes) 2024-09-14T05:59:36.459 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:36.459 INFO:teuthology.orchestra.run.smithi006.stdout:1870 writesame 0x8f948fc thru 0x8fa20bb data_size 0x20(0xd7c0 bytes) 2024-09-14T05:59:36.464 INFO:teuthology.orchestra.run.smithi006.stdout:1873 write 0xd4bd36a thru 0xd4cab13 (0xd7aa bytes) 2024-09-14T05:59:36.473 INFO:teuthology.orchestra.run.smithi006.stdout:1874 read 0x18bd3f0 thru 0x18cbb8c (0xe79d bytes) 2024-09-14T05:59:36.474 INFO:teuthology.orchestra.run.smithi006.stdout:1876 punch from 0x6c64602 to 0x6c66ab2, (0x24b0 bytes) 2024-09-14T05:59:36.474 INFO:teuthology.orchestra.run.smithi006.stdout:1877 punch from 0x1b26731 to 0x1b2698a, (0x259 bytes) 2024-09-14T05:59:36.481 INFO:teuthology.orchestra.run.smithi006.stdout:1878 trunc from 0xe37d44d to 0x92d8451 2024-09-14T05:59:36.505 INFO:teuthology.orchestra.run.smithi006.stdout:1879 trunc from 0x92d8451 to 0xe6b3fbf 2024-09-14T05:59:36.507 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:36.505+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:36.511 INFO:teuthology.orchestra.run.smithi006.stdout:1880 read 0x3e026cc thru 0x3e068ae (0x41e3 bytes) 2024-09-14T05:59:36.512 INFO:teuthology.orchestra.run.smithi006.stdout:1881 write 0x53651e5 thru 0x536fe4a (0xac66 bytes) 2024-09-14T05:59:36.514 INFO:teuthology.orchestra.run.smithi006.stdout:1883 write 0x13f2d7a thru 0x13fe9e7 (0xbc6e bytes) 2024-09-14T05:59:36.517 INFO:teuthology.orchestra.run.smithi006.stdout:1884 write 0xe67b791 thru 0xe67fd47 (0x45b7 bytes) 2024-09-14T05:59:36.522 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:36.522 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:36.522 INFO:teuthology.orchestra.run.smithi006.stdout:1887 write 0xb73390b thru 0xb73fd57 (0xc44d bytes) 2024-09-14T05:59:36.527 INFO:teuthology.orchestra.run.smithi006.stdout:1888 write 0xd6b8b25 thru 0xd6bd6ec (0x4bc8 bytes) 2024-09-14T05:59:36.531 INFO:teuthology.orchestra.run.smithi006.stdout:1889 write 0xc2b262d thru 0xc2bf1dc (0xcbb0 bytes) 2024-09-14T05:59:36.534 INFO:teuthology.orchestra.run.smithi006.stdout:1890 punch from 0xa155fa5 to 0xa15ac76, (0x4cd1 bytes) 2024-09-14T05:59:36.534 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:36.534 INFO:teuthology.orchestra.run.smithi006.stdout:1892 write 0xc6d8a50 thru 0xc6dc97b (0x3f2c bytes) 2024-09-14T05:59:36.545 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:36.545 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:36.545 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:36.545 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:36.545 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:36.556 INFO:teuthology.orchestra.run.smithi006.stdout:1893 trunc from 0xe6b3fbf to 0x3a625c4 2024-09-14T05:59:36.568 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:59:36.589 INFO:teuthology.orchestra.run.smithi006.stdout:1894 write 0x43f1641 thru 0x43fdd0a (0xc6ca bytes) 2024-09-14T05:59:36.607 INFO:teuthology.orchestra.run.smithi006.stdout:1895 write 0x6e2b658 thru 0x6e36ea9 (0xb852 bytes) 2024-09-14T05:59:36.608 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:36.610+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:36.612 INFO:teuthology.orchestra.run.smithi006.stdout:1896 write 0x3e9afd7 thru 0x3ea54de (0xa508 bytes) 2024-09-14T05:59:36.633 INFO:teuthology.orchestra.run.smithi006.stdout:1897 write 0xca66a78 thru 0xca6e10e (0x7697 bytes) 2024-09-14T05:59:36.639 INFO:teuthology.orchestra.run.smithi006.stdout:1898 punch from 0x5a61bf4 to 0x5a61c43, (0x4f bytes) 2024-09-14T05:59:36.639 INFO:teuthology.orchestra.run.smithi006.stdout:1899 read 0x2c3fd26 thru 0x2c4168b (0x1966 bytes) 2024-09-14T05:59:36.640 INFO:teuthology.orchestra.run.smithi006.stdout:1900 read 0xb303382 thru 0xb312339 (0xefb8 bytes) 2024-09-14T05:59:36.640 INFO:teuthology.orchestra.run.smithi006.stdout:1901 read 0x67d3a80 thru 0x67d7d80 (0x4301 bytes) 2024-09-14T05:59:36.657 INFO:teuthology.orchestra.run.smithi006.stdout:1902 trunc from 0xca6e10f to 0xd806fc 2024-09-14T05:59:36.694 INFO:teuthology.orchestra.run.smithi006.stdout:1903 trunc from 0xd806fc to 0xc52d018 2024-09-14T05:59:36.704 INFO:teuthology.orchestra.run.smithi006.stdout:1904 write 0x90cdfdb thru 0x90d1e50 (0x3e76 bytes) 2024-09-14T05:59:36.708 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:36.710+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:36.710 INFO:teuthology.orchestra.run.smithi006.stdout:1905 clone 11 order 20 su 524288 sc 5 2024-09-14T05:59:36.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:59:36.728 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:36.729 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:36.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:36.729 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:36.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.729 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:468 3.9 e29/24 3:92497260:::rbd_data.11275e589b0d.0000000000000015:head v 29'6, mlcod=29'4)", 2024-09-14T05:59:36.729 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:36.729 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 24.159430297, 2024-09-14T05:59:36.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002991737, 2024-09-14T05:59:36.729 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.729 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.729 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.729 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.730 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.730 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:36.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.730 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.730 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:36.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.730 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.730 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568242+0000", 2024-09-14T05:59:36.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3970000000000001e-06 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568261+0000", 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9029999999999999e-05 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568302+0000", 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0756000000000001e-05 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568324+0000", 2024-09-14T05:59:36.731 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2293000000000002e-05 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568455+0000", 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000130784 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568479+0000", 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4119000000000001e-05 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.571135+0000", 2024-09-14T05:59:36.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0026556319999999998 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.571231+0000", 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6725999999999995e-05 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:858 3.0 e29/24 3:00d51ce4:::rbd_data.11275e589b0d.0000000000000009:head v 29'2, mlcod=0'0)", 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.053111643000001, 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003436171, 2024-09-14T05:59:36.733 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.734 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674560+0000", 2024-09-14T05:59:36.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.638e-06 2024-09-14T05:59:36.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674570+0000", 2024-09-14T05:59:36.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9890000000000004e-06 2024-09-14T05:59:36.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674594+0000", 2024-09-14T05:59:36.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4049e-05 2024-09-14T05:59:36.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.736 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.736 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674604+0000", 2024-09-14T05:59:36.736 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0165e-05 2024-09-14T05:59:36.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.736 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.736 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674720+0000", 2024-09-14T05:59:36.736 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000115993 2024-09-14T05:59:36.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.736 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674746+0000", 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5984000000000001e-05 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.677932+0000", 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031863669999999998 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.677994+0000", 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1985999999999999e-05 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.737 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3625 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'27, mlcod=31'25)", 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.325533+0000", 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.402137035999999, 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035513340000000002, 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325533+0000", 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325533+0000", 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325534+0000", 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.02e-06 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325542+0000", 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0339999999999997e-06 2024-09-14T05:59:36.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325560+0000", 2024-09-14T05:59:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8403e-05 2024-09-14T05:59:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325570+0000", 2024-09-14T05:59:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9010000000000006e-06 2024-09-14T05:59:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325639+0000", 2024-09-14T05:59:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8610999999999998e-05 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325661+0000", 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1848000000000002e-05 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329045+0000", 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0033840400000000001 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329084+0000", 2024-09-14T05:59:36.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9477000000000002e-05 2024-09-14T05:59:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3626 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'28, mlcod=31'25)", 2024-09-14T05:59:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.326628+0000", 2024-09-14T05:59:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.401041743, 2024-09-14T05:59:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003397672, 2024-09-14T05:59:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326628+0000", 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326628+0000", 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326630+0000", 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326637+0000", 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6420000000000007e-06 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326660+0000", 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2816999999999999e-05 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326671+0000", 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0862999999999999e-05 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326744+0000", 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3411999999999994e-05 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326763+0000", 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9049e-05 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329958+0000", 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031946909999999999 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330026+0000", 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7634999999999999e-05 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3628 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'30, mlcod=31'25)", 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.328532+0000", 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.399138041, 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037713170000000002, 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.746 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328532+0000", 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328532+0000", 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328533+0000", 2024-09-14T05:59:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8999999999999995e-07 2024-09-14T05:59:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328539+0000", 2024-09-14T05:59:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.913e-06 2024-09-14T05:59:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328551+0000", 2024-09-14T05:59:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2782999999999999e-05 2024-09-14T05:59:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328560+0000", 2024-09-14T05:59:36.749 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9400000000000008e-06 2024-09-14T05:59:36.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.749 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.749 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328620+0000", 2024-09-14T05:59:36.749 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9360000000000001e-05 2024-09-14T05:59:36.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.749 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.749 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328642+0000", 2024-09-14T05:59:36.749 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1891000000000001e-05 2024-09-14T05:59:36.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.750 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.750 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332262+0000", 2024-09-14T05:59:36.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0036202909999999999 2024-09-14T05:59:36.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.750 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.750 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332303+0000", 2024-09-14T05:59:36.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1349e-05 2024-09-14T05:59:36.750 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.750 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.750 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.750 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3629 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'31, mlcod=31'25)", 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.398187979999999, 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048071900000000002, 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:36.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.752 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329483+0000", 2024-09-14T05:59:36.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-07 2024-09-14T05:59:36.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.752 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329488+0000", 2024-09-14T05:59:36.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000004e-06 2024-09-14T05:59:36.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.752 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329496+0000", 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2209999999999997e-06 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329501+0000", 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8729999999999998e-06 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329545+0000", 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4382999999999998e-05 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.753 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329564+0000", 2024-09-14T05:59:36.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8947999999999999e-05 2024-09-14T05:59:36.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.754 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334225+0000", 2024-09-14T05:59:36.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004660923 2024-09-14T05:59:36.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.754 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334289+0000", 2024-09-14T05:59:36.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4041999999999994e-05 2024-09-14T05:59:36.754 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.754 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.754 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3630 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'32, mlcod=31'25)", 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.397439975000001, 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0040991680000000003, 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330231+0000", 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4099999999999998e-07 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330235+0000", 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.391e-06 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330245+0000", 2024-09-14T05:59:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:59:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330249+0000", 2024-09-14T05:59:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T05:59:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330301+0000", 2024-09-14T05:59:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1515999999999999e-05 2024-09-14T05:59:36.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330312+0000", 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1603000000000001e-05 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334293+0000", 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039809449999999996 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334329+0000", 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5763000000000003e-05 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.758 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3631 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'33, mlcod=31'27)", 2024-09-14T05:59:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.396284179999999, 2024-09-14T05:59:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035882079999999998, 2024-09-14T05:59:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.759 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3300000000000001e-07 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331392+0000", 2024-09-14T05:59:36.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7880000000000003e-06 2024-09-14T05:59:36.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331403+0000", 2024-09-14T05:59:36.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0703000000000001e-05 2024-09-14T05:59:36.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331420+0000", 2024-09-14T05:59:36.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6959000000000001e-05 2024-09-14T05:59:36.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.762 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.762 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331466+0000", 2024-09-14T05:59:36.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5867e-05 2024-09-14T05:59:36.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.762 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.762 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331486+0000", 2024-09-14T05:59:36.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0511000000000001e-05 2024-09-14T05:59:36.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.762 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.762 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334926+0000", 2024-09-14T05:59:36.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0034397490000000002 2024-09-14T05:59:36.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334974+0000", 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7898000000000001e-05 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3632 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'34, mlcod=31'27)", 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.395065792, 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047983469999999997, 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.763 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332605+0000", 2024-09-14T05:59:36.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5099999999999999e-07 2024-09-14T05:59:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332611+0000", 2024-09-14T05:59:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6999999999999996e-06 2024-09-14T05:59:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332623+0000", 2024-09-14T05:59:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2401e-05 2024-09-14T05:59:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332629+0000", 2024-09-14T05:59:36.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3720000000000001e-06 2024-09-14T05:59:36.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332691+0000", 2024-09-14T05:59:36.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1451000000000005e-05 2024-09-14T05:59:36.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332711+0000", 2024-09-14T05:59:36.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0285e-05 2024-09-14T05:59:36.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337341+0000", 2024-09-14T05:59:36.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046295900000000003 2024-09-14T05:59:36.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337402+0000", 2024-09-14T05:59:36.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1797000000000005e-05 2024-09-14T05:59:36.767 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.767 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.767 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3633 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'35, mlcod=31'27)", 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.394204346999999, 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039783919999999999, 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1500000000000004e-07 2024-09-14T05:59:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333479+0000", 2024-09-14T05:59:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2918999999999999e-05 2024-09-14T05:59:36.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.770 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.770 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333489+0000", 2024-09-14T05:59:36.770 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0068000000000001e-05 2024-09-14T05:59:36.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.770 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.770 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333494+0000", 2024-09-14T05:59:36.770 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9309999999999999e-06 2024-09-14T05:59:36.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.770 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.770 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333543+0000", 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9293999999999999e-05 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333555+0000", 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1467e-05 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337408+0000", 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038532549999999999 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.771 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337444+0000", 2024-09-14T05:59:36.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5843000000000002e-05 2024-09-14T05:59:36.772 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.772 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.772 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.772 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3634 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'36, mlcod=31'27)", 2024-09-14T05:59:36.772 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.334299+0000", 2024-09-14T05:59:36.772 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.393371316, 2024-09-14T05:59:36.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031846980000000001, 2024-09-14T05:59:36.772 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.772 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.772 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.772 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334299+0000", 2024-09-14T05:59:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334299+0000", 2024-09-14T05:59:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334299+0000", 2024-09-14T05:59:36.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0699999999999996e-07 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334306+0000", 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3849999999999999e-06 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334316+0000", 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9969999999999993e-06 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334322+0000", 2024-09-14T05:59:36.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2060000000000004e-06 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334414+0000", 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2650000000000002e-05 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334444+0000", 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9213e-05 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337447+0000", 2024-09-14T05:59:36.775 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0030035729999999998 2024-09-14T05:59:36.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.776 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.776 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337483+0000", 2024-09-14T05:59:36.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5967000000000003e-05 2024-09-14T05:59:36.776 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.776 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.776 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.776 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3638 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'40, mlcod=31'32)", 2024-09-14T05:59:36.776 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:36.776 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.388923877, 2024-09-14T05:59:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004283345, 2024-09-14T05:59:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:36.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338747+0000", 2024-09-14T05:59:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0279999999999999e-06 2024-09-14T05:59:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338756+0000", 2024-09-14T05:59:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5909999999999996e-06 2024-09-14T05:59:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338774+0000", 2024-09-14T05:59:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8073000000000001e-05 2024-09-14T05:59:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338785+0000", 2024-09-14T05:59:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1017e-05 2024-09-14T05:59:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338844+0000", 2024-09-14T05:59:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9292000000000001e-05 2024-09-14T05:59:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338864+0000", 2024-09-14T05:59:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9528999999999999e-05 2024-09-14T05:59:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.342984+0000", 2024-09-14T05:59:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041207809999999996 2024-09-14T05:59:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.343029+0000", 2024-09-14T05:59:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5034000000000003e-05 2024-09-14T05:59:36.781 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.781 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.781 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.781 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3692 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'47, mlcod=31'44)", 2024-09-14T05:59:36.781 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.394505+0000", 2024-09-14T05:59:36.781 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.333164498999999, 2024-09-14T05:59:36.781 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031415789999999998, 2024-09-14T05:59:36.781 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.781 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.781 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.781 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394505+0000", 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394505+0000", 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394506+0000", 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0100000000000004e-07 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394511+0000", 2024-09-14T05:59:36.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7709999999999997e-06 2024-09-14T05:59:36.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394522+0000", 2024-09-14T05:59:36.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1270999999999999e-05 2024-09-14T05:59:36.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394531+0000", 2024-09-14T05:59:36.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6309999999999992e-06 2024-09-14T05:59:36.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.784 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.784 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394598+0000", 2024-09-14T05:59:36.784 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7516999999999997e-05 2024-09-14T05:59:36.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.784 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.784 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394629+0000", 2024-09-14T05:59:36.784 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0380000000000001e-05 2024-09-14T05:59:36.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.784 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.784 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.397611+0000", 2024-09-14T05:59:36.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002982434 2024-09-14T05:59:36.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.785 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.785 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.397647+0000", 2024-09-14T05:59:36.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5874000000000002e-05 2024-09-14T05:59:36.785 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.785 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.785 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.785 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:11218 3.9 e38/24 3:967d83c0:::rbd_data.1127ff8b71e0.0000000000000064:head v 38'37, mlcod=38'35)", 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 10.482817764, 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004035416, 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:36.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244854+0000", 2024-09-14T05:59:36.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2350000000000002e-06 2024-09-14T05:59:36.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246114+0000", 2024-09-14T05:59:36.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012600980000000001 2024-09-14T05:59:36.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246158+0000", 2024-09-14T05:59:36.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3473000000000002e-05 2024-09-14T05:59:36.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.788 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246179+0000", 2024-09-14T05:59:36.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0738999999999999e-05 2024-09-14T05:59:36.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.788 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246306+0000", 2024-09-14T05:59:36.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000127238 2024-09-14T05:59:36.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.789 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246349+0000", 2024-09-14T05:59:36.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3211999999999999e-05 2024-09-14T05:59:36.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.789 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248780+0000", 2024-09-14T05:59:36.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0024304970000000002 2024-09-14T05:59:36.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.789 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248888+0000", 2024-09-14T05:59:36.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010792400000000001 2024-09-14T05:59:36.790 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.790 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.790 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.790 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:11359 3.9 e38/24 3:967d83c0:::rbd_data.1127ff8b71e0.0000000000000064:head v 38'38, mlcod=38'36)", 2024-09-14T05:59:36.790 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.313747+0000", 2024-09-14T05:59:36.790 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 10.413922978, 2024-09-14T05:59:36.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0030761819999999998, 2024-09-14T05:59:36.790 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.790 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.790 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.790 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.313747+0000", 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.313747+0000", 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.313749+0000", 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5730000000000002e-06 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.313766+0000", 2024-09-14T05:59:36.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6986999999999998e-05 2024-09-14T05:59:36.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.313814+0000", 2024-09-14T05:59:36.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7389000000000003e-05 2024-09-14T05:59:36.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.313836+0000", 2024-09-14T05:59:36.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1679999999999999e-05 2024-09-14T05:59:36.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.314044+0000", 2024-09-14T05:59:36.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020864500000000001 2024-09-14T05:59:36.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.314098+0000", 2024-09-14T05:59:36.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3936e-05 2024-09-14T05:59:36.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.316709+0000", 2024-09-14T05:59:36.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0026110460000000001 2024-09-14T05:59:36.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.794 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.794 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.316823+0000", 2024-09-14T05:59:36.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011392600000000001 2024-09-14T05:59:36.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.794 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.794 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:11892 3.4 e39/24 3:27ace2d5:::rbd_data.1127ff8b71e0.0000000000000000:head v 39'72, mlcod=38'70)", 2024-09-14T05:59:36.794 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.706452+0000", 2024-09-14T05:59:36.794 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 10.021217807999999, 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003757636, 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.706452+0000", 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.706452+0000", 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.706454+0000", 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.857e-06 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707127+0000", 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00067296299999999995 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707151+0000", 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3643999999999999e-05 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707161+0000", 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.064e-05 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707264+0000", 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102586 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707300+0000", 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5951000000000002e-05 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.710137+0000", 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002837184 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.710210+0000", 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2811000000000005e-05 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:14244 3.4 e39/24 3:26d89d63:::rbd_data.1127ff8b71e0.000000000000003e:head v 39'74, mlcod=39'72)", 2024-09-14T05:59:36.798 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:27.174207+0000", 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.5534625939999991, 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031170289999999999, 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174207+0000", 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174207+0000", 2024-09-14T05:59:36.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174209+0000", 2024-09-14T05:59:36.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4720000000000001e-06 2024-09-14T05:59:36.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174219+0000", 2024-09-14T05:59:36.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7710000000000001e-06 2024-09-14T05:59:36.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174240+0000", 2024-09-14T05:59:36.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1021000000000001e-05 2024-09-14T05:59:36.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174253+0000", 2024-09-14T05:59:36.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3385e-05 2024-09-14T05:59:36.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174322+0000", 2024-09-14T05:59:36.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9034000000000003e-05 2024-09-14T05:59:36.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174349+0000", 2024-09-14T05:59:36.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7475e-05 2024-09-14T05:59:36.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.177272+0000", 2024-09-14T05:59:36.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029221889999999999 2024-09-14T05:59:36.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.177324+0000", 2024-09-14T05:59:36.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2682000000000001e-05 2024-09-14T05:59:36.802 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.802 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.803 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:17596 3.4 e41/24 3:27f62511:::rbd_data.1127d65075f9.00000000000000ca:head v 41'97, mlcod=41'95)", 2024-09-14T05:59:36.803 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:36.803 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 6.7571713129999997, 2024-09-14T05:59:36.803 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049456559999999997, 2024-09-14T05:59:36.803 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.803 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.803 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.803 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.803 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.803 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:36.804 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.804 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.804 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:36.804 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.804 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.804 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970500+0000", 2024-09-14T05:59:36.804 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9600000000000008e-07 2024-09-14T05:59:36.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.804 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970614+0000", 2024-09-14T05:59:36.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000113956 2024-09-14T05:59:36.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970631+0000", 2024-09-14T05:59:36.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7150999999999999e-05 2024-09-14T05:59:36.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970643+0000", 2024-09-14T05:59:36.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1868999999999999e-05 2024-09-14T05:59:36.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970711+0000", 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8952e-05 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970738+0000", 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6055999999999999e-05 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975388+0000", 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046502499999999999 2024-09-14T05:59:36.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975444+0000", 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6425999999999998e-05 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24289 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'57, mlcod=41'54)", 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.5718791339999996, 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.060867738999999997, 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.807 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.808 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.808 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.808 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.808 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:36.808 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.808 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.808 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:36.808 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.808 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155793+0000", 2024-09-14T05:59:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9470000000000002e-06 2024-09-14T05:59:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181776+0000", 2024-09-14T05:59:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.02598313 2024-09-14T05:59:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181817+0000", 2024-09-14T05:59:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1440000000000003e-05 2024-09-14T05:59:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181834+0000", 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6979000000000001e-05 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181931+0000", 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7219999999999994e-05 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181964+0000", 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2094999999999997e-05 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216586+0000", 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034622503999999998 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216658+0000", 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24309 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'58, mlcod=41'56)", 2024-09-14T05:59:36.811 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.4726440289999996, 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044435519999999999, 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:36.812 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255027+0000", 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255040+0000", 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2773e-05 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255066+0000", 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5459000000000001e-05 2024-09-14T05:59:36.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255076+0000", 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0372e-05 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255151+0000", 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5444999999999993e-05 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255176+0000", 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5089e-05 2024-09-14T05:59:36.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259379+0000", 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042025439999999999 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259469+0000", 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0407000000000004e-05 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:36.815 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:36.817 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:59:36.817 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:36.813+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:36.845 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T05:59:36.864 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:36.881 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:36.898 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:36.898 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:36.917 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:36.918+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:36.919 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:36.919 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:36.939 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:36.940 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:36.960 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:36.960 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:36.962 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:36.962 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:36.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:59:36.982 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:36.982 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:36.988 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T05:59:36.988 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T05:59:37.019 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:37.018+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:37.099 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:37.099 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:37.113 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:59:37.119 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:37.118+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:37.220 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:37.217+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:37.239 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:37.239 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:37.253 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:59:37.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:59:37.347 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:37.345+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:37.388 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:37.388 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:37.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:59:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T05:59:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T05:59:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T05:59:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T05:59:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T05:59:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T05:59:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T05:59:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T05:59:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T05:59:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T05:59:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator fragmentation block 2024-09-14T05:59:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:admin_socket: invalid command 2024-09-14T05:59:37.433 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T05:59:37.433 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-09-14T05:59:37.448 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:37.450+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:37.522 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:37.522+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:37.525 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:37.525 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:37.539 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:59:37.622 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:37.621+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:37.703 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:37.703 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:37.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:59:37.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:59:37.763 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:37.766+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:37.824 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:37.826+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:37.849 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:37.849 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:37.864 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:59:37.952 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:37.954+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:38.000 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-14T05:59:38.025 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:38.026+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:38.058 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:38.058 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:38.079 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:59:38.126 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:38.121+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:38.226 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:38.226+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:38.327 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:38.326+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:38.370 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:38.370 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:38.385 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T05:59:38.428 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:38.430+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:38.436 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:38.433+0000 7f8a7d8967c0 -1 osd.0 27 log_to_monitors true 2024-09-14T05:59:38.438 INFO:teuthology.orchestra.run.smithi006.stdout:1906 write 0x60ea0cf thru 0x60f94fd (0xf42f bytes) 2024-09-14T05:59:38.446 INFO:teuthology.orchestra.run.smithi006.stdout:1907 writesame 0x5a2f5eb thru 0x5a3bc9e data_size 0x9d(0xc6b4 bytes) 2024-09-14T05:59:38.462 INFO:teuthology.orchestra.run.smithi006.stdout:1908 writesame 0xe901afb thru 0xe90b36b data_size 0x23(0x9871 bytes) 2024-09-14T05:59:38.463 INFO:teuthology.orchestra.run.smithi006.stdout:1909 punch from 0xd04b89c to 0xd05025b, (0x49bf bytes) 2024-09-14T05:59:38.463 INFO:teuthology.orchestra.run.smithi006.stdout:1910 write 0x5477e3b thru 0x547e4a1 (0x6667 bytes) 2024-09-14T05:59:38.465 INFO:teuthology.orchestra.run.smithi006.stdout:1911 read 0x5e88c50 thru 0x5e9768c (0xea3d bytes) 2024-09-14T05:59:38.466 INFO:teuthology.orchestra.run.smithi006.stdout:1914 write 0xdc1024b thru 0xdc158ec (0x56a2 bytes) 2024-09-14T05:59:38.469 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:38.470 INFO:teuthology.orchestra.run.smithi006.stdout:1917 writesame 0x15897c9 thru 0x1598521 data_size 0x1(0xed59 bytes) 2024-09-14T05:59:38.503 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:38.503 INFO:teuthology.orchestra.run.smithi006.stdout:1919 punch from 0x1ced45a to 0x1cf515e, (0x7d04 bytes) 2024-09-14T05:59:38.503 INFO:teuthology.orchestra.run.smithi006.stdout:1920 read 0x2a4c7fd thru 0x2a4cc84 (0x488 bytes) 2024-09-14T05:59:38.503 INFO:teuthology.orchestra.run.smithi006.stdout:1922 read 0x2a43e0e thru 0x2a4d35a (0x954d bytes) 2024-09-14T05:59:38.503 INFO:teuthology.orchestra.run.smithi006.stdout:1923 read 0xc83bce0 thru 0xc847c5b (0xbf7c bytes) 2024-09-14T05:59:38.503 INFO:teuthology.orchestra.run.smithi006.stdout:1924 read 0x38b0a38 thru 0x38b6949 (0x5f12 bytes) 2024-09-14T05:59:38.511 INFO:teuthology.orchestra.run.smithi006.stdout:1925 trunc from 0xe90b36c to 0xac41b8a 2024-09-14T05:59:38.529 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:38.530+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:38.543 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:38.543 INFO:teuthology.orchestra.run.smithi006.stdout:1928 punch from 0x6b8d212 to 0x6b953fd, (0x81eb bytes) 2024-09-14T05:59:38.543 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:38.543 INFO:teuthology.orchestra.run.smithi006.stdout:1930 write 0x94c3976 thru 0x94d1859 (0xdee4 bytes) 2024-09-14T05:59:38.551 INFO:teuthology.orchestra.run.smithi006.stdout:1931 punch from 0x3c80060 to 0x3c88553, (0x84f3 bytes) 2024-09-14T05:59:38.551 INFO:teuthology.orchestra.run.smithi006.stdout:1934 read 0xff7f1d thru 0xffa8c4 (0x29a8 bytes) 2024-09-14T05:59:38.551 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:38.551 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:38.551 INFO:teuthology.orchestra.run.smithi006.stdout:1938 write 0x17797bb thru 0x17855bc (0xbe02 bytes) 2024-09-14T05:59:38.559 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:38.559 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:38.562 INFO:teuthology.orchestra.run.smithi006.stdout:1939 read 0x601898a thru 0x6018e2c (0x4a3 bytes) 2024-09-14T05:59:38.573 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T05:59:38.580 INFO:teuthology.orchestra.run.smithi006.stdout:1941 trunc from 0xac41b8a to 0x43dc6d6 2024-09-14T05:59:38.609 INFO:teuthology.orchestra.run.smithi006.stdout:1942 read 0x11610d4 thru 0x116db81 (0xcaae bytes) 2024-09-14T05:59:38.614 INFO:teuthology.orchestra.run.smithi006.stdout:1943 trunc from 0x43dc6d6 to 0x29c9702 2024-09-14T05:59:38.630 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:38.625+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:38.649 INFO:teuthology.orchestra.run.smithi006.stdout:1944 trunc from 0x29c9702 to 0x5c3e57b 2024-09-14T05:59:38.659 INFO:teuthology.orchestra.run.smithi006.stdout:1946 read 0x2077864 thru 0x2078715 (0xeb2 bytes) 2024-09-14T05:59:38.659 INFO:teuthology.orchestra.run.smithi006.stdout:1947 read 0x1dec4ba thru 0x1defdce (0x3915 bytes) 2024-09-14T05:59:38.659 INFO:teuthology.orchestra.run.smithi006.stdout:1948 read 0xe70ab4 thru 0xe7b8c7 (0xae14 bytes) 2024-09-14T05:59:38.660 INFO:teuthology.orchestra.run.smithi006.stdout:1950 write 0x1a27732 thru 0x1a33c9f (0xc56e bytes) 2024-09-14T05:59:38.668 INFO:teuthology.orchestra.run.smithi006.stdout:1954 punch from 0x1814105 to 0x181d99e, (0x9899 bytes) 2024-09-14T05:59:38.668 INFO:teuthology.orchestra.run.smithi006.stdout:1955 write 0x19f70b4 thru 0x19fb207 (0x4154 bytes) 2024-09-14T05:59:38.681 INFO:teuthology.orchestra.run.smithi006.stdout:1957 trunc from 0x5c3e57b to 0x7b4a963 2024-09-14T05:59:38.712 INFO:teuthology.orchestra.run.smithi006.stdout:1961 write 0xc694949 thru 0xc698a1f (0x40d7 bytes) 2024-09-14T05:59:38.717 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2024-09-14T05:59:38.726 INFO:teuthology.orchestra.run.smithi006.stdout:1962 trunc from 0xc698a20 to 0x97fccef 2024-09-14T05:59:38.731 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:38.730+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:38.755 INFO:teuthology.orchestra.run.smithi006.stdout:1963 writesame 0x112138b thru 0x1128dd7 data_size 0x1(0x7a4d bytes) 2024-09-14T05:59:38.760 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:38.760 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:38.767 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:38.765+0000 7f8a71671640 -1 osd.0 27 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:59:38.776 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T05:59:38.785 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:38.790 INFO:teuthology.orchestra.run.smithi006.stdout:1966 trunc from 0x97fccef to 0x6a8a5e1 2024-09-14T05:59:38.802 INFO:teuthology.orchestra.run.smithi006.stdout:1967 read 0x5043f4b thru 0x5050967 (0xca1d bytes) 2024-09-14T05:59:38.802 INFO:teuthology.orchestra.run.smithi006.stdout:1969 write 0x1168e5f thru 0x116c0b2 (0x3254 bytes) 2024-09-14T05:59:38.804 INFO:teuthology.orchestra.run.smithi006.stdout:1970 writesame 0x16255d5 thru 0x162de3f data_size 0x7(0x886b bytes) 2024-09-14T05:59:38.811 INFO:teuthology.orchestra.run.smithi006.stdout:1971 read 0x307801e thru 0x30860aa (0xe08d bytes) 2024-09-14T05:59:38.811 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:38.811 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:38.812 INFO:teuthology.orchestra.run.smithi006.stdout:1977 read 0x79bb45 thru 0x7a3dbb (0x8277 bytes) 2024-09-14T05:59:38.826 INFO:teuthology.orchestra.run.smithi006.stdout:1979 writesame 0x89465cb thru 0x8952d54 data_size 0x1(0xc78a bytes) 2024-09-14T05:59:38.826 INFO:teuthology.orchestra.run.smithi006.stdout:1980 punch from 0x54b53a4 to 0x54b5564, (0x1c0 bytes) 2024-09-14T05:59:38.826 INFO:teuthology.orchestra.run.smithi006.stdout:1981 writesame 0x784d61f thru 0x785a36e data_size 0xb4(0xcd50 bytes) 2024-09-14T05:59:38.831 INFO:teuthology.orchestra.run.smithi006.stdout:1982 clone 12 order 21 su 16384 sc 11 2024-09-14T05:59:38.868 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:38.870+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:38.932 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:38.934+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:38.946 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:38.946 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:38.960 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T05:59:38.989 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:59:39.039 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:39.037+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:39.120 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:39.120 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-14T05:59:39.134 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T05:59:39.135 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:39.129+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:39.147 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:39.148 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:39.164 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:39.164 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:39.181 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:39.182 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:39.201 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:39.201 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:39.220 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:39.221 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:39.235 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:39.233+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:39.241 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:39.242 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:39.261 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:39.261 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:39.261 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:39.262 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:39.262 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:39.262 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:39.262 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:39.266 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-14T05:59:39.267 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-14T05:59:39.276 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T05:59:39.337 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:39.333+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:39.393 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4301 3.13 3:cd7a3116:::rbd_data.1127c133286b.0000000000000002:4 [read 557056~12288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.763301+0000", 2024-09-14T05:59:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.63119901, 2024-09-14T05:59:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048252252000000002, 2024-09-14T05:59:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.393 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.394 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.394 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4301 2024-09-14T05:59:39.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.394 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763301+0000", 2024-09-14T05:59:39.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763301+0000", 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763301+0000", 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2500000000000005e-07 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763305+0000", 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763314+0000", 2024-09-14T05:59:39.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8210000000000008e-06 2024-09-14T05:59:39.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763323+0000", 2024-09-14T05:59:39.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0049999999999993e-06 2024-09-14T05:59:39.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811338+0000", 2024-09-14T05:59:39.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048015557 2024-09-14T05:59:39.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811442+0000", 2024-09-14T05:59:39.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010388899999999999 2024-09-14T05:59:39.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811553+0000", 2024-09-14T05:59:39.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011092899999999999 2024-09-14T05:59:39.397 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.397 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.397 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.398 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4302 3.13 3:cd7a3116:::rbd_data.1127c133286b.0000000000000002:4 [read 708608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:39.398 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.763333+0000", 2024-09-14T05:59:39.398 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.631166981, 2024-09-14T05:59:39.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048350935999999997, 2024-09-14T05:59:39.398 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.398 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.398 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.398 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.398 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.398 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.398 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4302 2024-09-14T05:59:39.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.399 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763333+0000", 2024-09-14T05:59:39.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763333+0000", 2024-09-14T05:59:39.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763333+0000", 2024-09-14T05:59:39.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:59:39.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763336+0000", 2024-09-14T05:59:39.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9299999999999999e-06 2024-09-14T05:59:39.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763345+0000", 2024-09-14T05:59:39.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6649999999999992e-06 2024-09-14T05:59:39.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763353+0000", 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811587+0000", 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048233971 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811636+0000", 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9200999999999999e-05 2024-09-14T05:59:39.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811684+0000", 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7577999999999997e-05 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4303 3.13 3:cd7a3116:::rbd_data.1127c133286b.0000000000000002:4 [read 864256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.763366+0000", 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.631134280000001, 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048532156999999999, 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.402 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.403 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.403 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.403 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.403 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4303 2024-09-14T05:59:39.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.403 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763366+0000", 2024-09-14T05:59:39.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763366+0000", 2024-09-14T05:59:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763366+0000", 2024-09-14T05:59:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1799999999999995e-07 2024-09-14T05:59:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763370+0000", 2024-09-14T05:59:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4800000000000001e-06 2024-09-14T05:59:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763380+0000", 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0385e-05 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763387+0000", 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1239999999999999e-06 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811725+0000", 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048337506000000002 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811811+0000", 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6537000000000002e-05 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811898+0000", 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6507000000000004e-05 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:4304 3.13 3:cd7a3116:::rbd_data.1127c133286b.0000000000000002:4 [read 1015808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:17.763398+0000", 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.631101617999999, 2024-09-14T05:59:39.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048631691999999997, 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 4304 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763398+0000", 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763398+0000", 2024-09-14T05:59:39.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763399+0000", 2024-09-14T05:59:39.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6499999999999999e-07 2024-09-14T05:59:39.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763410+0000", 2024-09-14T05:59:39.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1331999999999999e-05 2024-09-14T05:59:39.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763420+0000", 2024-09-14T05:59:39.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0215e-05 2024-09-14T05:59:39.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.763428+0000", 2024-09-14T05:59:39.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5059999999999998e-06 2024-09-14T05:59:39.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811933+0000", 2024-09-14T05:59:39.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048505020000000003 2024-09-14T05:59:39.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.811978+0000", 2024-09-14T05:59:39.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5232999999999999e-05 2024-09-14T05:59:39.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:17.812030+0000", 2024-09-14T05:59:39.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1820999999999997e-05 2024-09-14T05:59:39.410 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.410 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.410 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.411 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21320 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.411 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.855646+0000", 2024-09-14T05:59:39.411 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5388535959999992, 2024-09-14T05:59:39.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048117163999999997, 2024-09-14T05:59:39.411 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.411 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.411 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.411 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.411 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.411 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.411 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21320 2024-09-14T05:59:39.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.412 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855646+0000", 2024-09-14T05:59:39.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855646+0000", 2024-09-14T05:59:39.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855647+0000", 2024-09-14T05:59:39.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.96e-07 2024-09-14T05:59:39.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855648+0000", 2024-09-14T05:59:39.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1599999999999999e-06 2024-09-14T05:59:39.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855651+0000", 2024-09-14T05:59:39.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.591e-06 2024-09-14T05:59:39.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.855655+0000", 2024-09-14T05:59:39.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7960000000000002e-06 2024-09-14T05:59:39.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.903481+0000", 2024-09-14T05:59:39.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047826022000000003 2024-09-14T05:59:39.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.903569+0000", 2024-09-14T05:59:39.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7919999999999998e-05 2024-09-14T05:59:39.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.903763+0000", 2024-09-14T05:59:39.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194379 2024-09-14T05:59:39.415 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.415 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.415 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.415 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21378 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 989184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.415 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858445+0000", 2024-09-14T05:59:39.415 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5360545469999991, 2024-09-14T05:59:39.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048213651000000003, 2024-09-14T05:59:39.416 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.416 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.416 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.416 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.416 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.416 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.416 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21378 2024-09-14T05:59:39.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.416 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858445+0000", 2024-09-14T05:59:39.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858445+0000", 2024-09-14T05:59:39.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858446+0000", 2024-09-14T05:59:39.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T05:59:39.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858448+0000", 2024-09-14T05:59:39.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.441e-06 2024-09-14T05:59:39.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858454+0000", 2024-09-14T05:59:39.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1449999999999996e-06 2024-09-14T05:59:39.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858460+0000", 2024-09-14T05:59:39.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9680000000000003e-06 2024-09-14T05:59:39.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906484+0000", 2024-09-14T05:59:39.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048023983999999999 2024-09-14T05:59:39.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906556+0000", 2024-09-14T05:59:39.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1802000000000001e-05 2024-09-14T05:59:39.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906659+0000", 2024-09-14T05:59:39.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102768 2024-09-14T05:59:39.419 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.419 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21379 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 864256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858467+0000", 2024-09-14T05:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5360330260000001, 2024-09-14T05:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048414881999999999, 2024-09-14T05:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.420 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21379 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858467+0000", 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858467+0000", 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858467+0000", 2024-09-14T05:59:39.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9999999999999998e-07 2024-09-14T05:59:39.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858476+0000", 2024-09-14T05:59:39.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1020000000000003e-06 2024-09-14T05:59:39.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858484+0000", 2024-09-14T05:59:39.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1960000000000002e-06 2024-09-14T05:59:39.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858489+0000", 2024-09-14T05:59:39.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1710000000000001e-06 2024-09-14T05:59:39.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906690+0000", 2024-09-14T05:59:39.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048201386999999998 2024-09-14T05:59:39.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906765+0000", 2024-09-14T05:59:39.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5119999999999999e-05 2024-09-14T05:59:39.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906882+0000", 2024-09-14T05:59:39.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116506 2024-09-14T05:59:39.424 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.424 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.424 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.424 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21380 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1011712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.424 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858496+0000", 2024-09-14T05:59:39.424 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5360039469999993, 2024-09-14T05:59:39.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048605175, 2024-09-14T05:59:39.424 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.425 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.425 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.425 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.425 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.425 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.425 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21380 2024-09-14T05:59:39.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.425 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858496+0000", 2024-09-14T05:59:39.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858496+0000", 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858496+0000", 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6400000000000003e-07 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858499+0000", 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.948e-06 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858505+0000", 2024-09-14T05:59:39.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1070000000000001e-06 2024-09-14T05:59:39.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858523+0000", 2024-09-14T05:59:39.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7992999999999999e-05 2024-09-14T05:59:39.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906911+0000", 2024-09-14T05:59:39.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048387905000000002 2024-09-14T05:59:39.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.906982+0000", 2024-09-14T05:59:39.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0253000000000007e-05 2024-09-14T05:59:39.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907101+0000", 2024-09-14T05:59:39.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119505 2024-09-14T05:59:39.428 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.428 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.428 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.429 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21381 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 872448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.429 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858531+0000", 2024-09-14T05:59:39.429 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5359686789999998, 2024-09-14T05:59:39.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048794176000000002, 2024-09-14T05:59:39.429 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.429 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.429 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.429 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.429 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.429 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.429 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21381 2024-09-14T05:59:39.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.430 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858531+0000", 2024-09-14T05:59:39.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858531+0000", 2024-09-14T05:59:39.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858532+0000", 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.82e-07 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858534+0000", 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6189999999999998e-06 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858541+0000", 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6540000000000002e-06 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858559+0000", 2024-09-14T05:59:39.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8357999999999999e-05 2024-09-14T05:59:39.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907141+0000", 2024-09-14T05:59:39.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048581910999999998 2024-09-14T05:59:39.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907216+0000", 2024-09-14T05:59:39.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4975000000000006e-05 2024-09-14T05:59:39.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907325+0000", 2024-09-14T05:59:39.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109177 2024-09-14T05:59:39.433 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.433 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.433 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.433 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21382 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1019904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.433 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858574+0000", 2024-09-14T05:59:39.433 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5359263219999999, 2024-09-14T05:59:39.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048966019, 2024-09-14T05:59:39.433 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.433 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.433 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.434 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.434 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.434 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.434 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21382 2024-09-14T05:59:39.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.434 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858574+0000", 2024-09-14T05:59:39.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858574+0000", 2024-09-14T05:59:39.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858574+0000", 2024-09-14T05:59:39.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3e-07 2024-09-14T05:59:39.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858577+0000", 2024-09-14T05:59:39.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7640000000000001e-06 2024-09-14T05:59:39.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858593+0000", 2024-09-14T05:59:39.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5687000000000001e-05 2024-09-14T05:59:39.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858599+0000", 2024-09-14T05:59:39.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-09-14T05:59:39.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907357+0000", 2024-09-14T05:59:39.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048757308999999999 2024-09-14T05:59:39.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907435+0000", 2024-09-14T05:59:39.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7949999999999997e-05 2024-09-14T05:59:39.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907540+0000", 2024-09-14T05:59:39.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010501399999999999 2024-09-14T05:59:39.437 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.437 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.437 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21383 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 894976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858608+0000", 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5358917250000008, 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049138063000000003, 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21383 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858608+0000", 2024-09-14T05:59:39.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858608+0000", 2024-09-14T05:59:39.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858609+0000", 2024-09-14T05:59:39.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8599999999999998e-07 2024-09-14T05:59:39.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858611+0000", 2024-09-14T05:59:39.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5220000000000002e-06 2024-09-14T05:59:39.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858618+0000", 2024-09-14T05:59:39.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7460000000000003e-06 2024-09-14T05:59:39.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858623+0000", 2024-09-14T05:59:39.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0699999999999997e-06 2024-09-14T05:59:39.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907569+0000", 2024-09-14T05:59:39.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946167999999998 2024-09-14T05:59:39.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907644+0000", 2024-09-14T05:59:39.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5093999999999996e-05 2024-09-14T05:59:39.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907746+0000", 2024-09-14T05:59:39.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101777 2024-09-14T05:59:39.442 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.442 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.442 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.442 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21384 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1042432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.442 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858645+0000", 2024-09-14T05:59:39.442 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5358545980000002, 2024-09-14T05:59:39.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049308495000000001, 2024-09-14T05:59:39.442 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.442 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.442 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.442 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.443 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.443 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.443 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21384 2024-09-14T05:59:39.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.443 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858645+0000", 2024-09-14T05:59:39.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858645+0000", 2024-09-14T05:59:39.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858646+0000", 2024-09-14T05:59:39.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3000000000000001e-07 2024-09-14T05:59:39.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858663+0000", 2024-09-14T05:59:39.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6852000000000001e-05 2024-09-14T05:59:39.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858672+0000", 2024-09-14T05:59:39.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0340000000000002e-06 2024-09-14T05:59:39.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858677+0000", 2024-09-14T05:59:39.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7899999999999996e-06 2024-09-14T05:59:39.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907775+0000", 2024-09-14T05:59:39.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049097663999999999 2024-09-14T05:59:39.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907848+0000", 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3223e-05 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907954+0000", 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105402 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21385 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 903168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.858687+0000", 2024-09-14T05:59:39.446 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5358128929999992, 2024-09-14T05:59:39.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049479466999999999, 2024-09-14T05:59:39.447 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.447 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.447 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.447 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.447 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.447 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.447 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21385 2024-09-14T05:59:39.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.447 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858687+0000", 2024-09-14T05:59:39.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858687+0000", 2024-09-14T05:59:39.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858688+0000", 2024-09-14T05:59:39.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.75e-07 2024-09-14T05:59:39.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858690+0000", 2024-09-14T05:59:39.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6510000000000001e-06 2024-09-14T05:59:39.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858697+0000", 2024-09-14T05:59:39.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5950000000000004e-06 2024-09-14T05:59:39.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.858702+0000", 2024-09-14T05:59:39.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8620000000000002e-06 2024-09-14T05:59:39.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.907987+0000", 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049284954999999998 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908061+0000", 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4655999999999998e-05 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908166+0000", 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105073 2024-09-14T05:59:39.450 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21435 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 991232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859055+0000", 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5354445139999999, 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049328565999999997, 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.451 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21435 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859055+0000", 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859055+0000", 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859056+0000", 2024-09-14T05:59:39.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.34e-07 2024-09-14T05:59:39.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859058+0000", 2024-09-14T05:59:39.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2010000000000002e-06 2024-09-14T05:59:39.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859064+0000", 2024-09-14T05:59:39.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5169999999999996e-06 2024-09-14T05:59:39.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859071+0000", 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1140000000000002e-06 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908196+0000", 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049125294 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908273+0000", 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6953999999999995e-05 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908384+0000", 2024-09-14T05:59:39.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011105200000000001 2024-09-14T05:59:39.455 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.455 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.455 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.455 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21436 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 999424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.455 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859078+0000", 2024-09-14T05:59:39.455 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5354223259999991, 2024-09-14T05:59:39.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049529658999999997, 2024-09-14T05:59:39.455 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.455 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.455 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21436 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859078+0000", 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859078+0000", 2024-09-14T05:59:39.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859078+0000", 2024-09-14T05:59:39.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5200000000000002e-07 2024-09-14T05:59:39.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859080+0000", 2024-09-14T05:59:39.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2929999999999999e-06 2024-09-14T05:59:39.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859087+0000", 2024-09-14T05:59:39.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3060000000000003e-06 2024-09-14T05:59:39.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859091+0000", 2024-09-14T05:59:39.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8160000000000001e-06 2024-09-14T05:59:39.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908418+0000", 2024-09-14T05:59:39.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049326548999999997 2024-09-14T05:59:39.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908494+0000", 2024-09-14T05:59:39.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5655999999999995e-05 2024-09-14T05:59:39.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908607+0000", 2024-09-14T05:59:39.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000113587 2024-09-14T05:59:39.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.459 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.459 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21438 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1013760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.459 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859119+0000", 2024-09-14T05:59:39.460 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5353807150000005, 2024-09-14T05:59:39.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049705669000000001, 2024-09-14T05:59:39.460 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.460 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.460 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.460 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21438 2024-09-14T05:59:39.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.460 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859119+0000", 2024-09-14T05:59:39.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859119+0000", 2024-09-14T05:59:39.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859120+0000", 2024-09-14T05:59:39.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.51e-07 2024-09-14T05:59:39.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859122+0000", 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0530000000000001e-06 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859140+0000", 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8321999999999998e-05 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859146+0000", 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.156e-06 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908639+0000", 2024-09-14T05:59:39.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049493176999999999 2024-09-14T05:59:39.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908716+0000", 2024-09-14T05:59:39.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6314000000000002e-05 2024-09-14T05:59:39.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908825+0000", 2024-09-14T05:59:39.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109196 2024-09-14T05:59:39.463 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.463 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.464 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.464 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21439 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1021952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.464 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859155+0000", 2024-09-14T05:59:39.464 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5353452930000007, 2024-09-14T05:59:39.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049882120000000002, 2024-09-14T05:59:39.464 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.464 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.464 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.464 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21439 2024-09-14T05:59:39.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.465 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859155+0000", 2024-09-14T05:59:39.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859155+0000", 2024-09-14T05:59:39.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859155+0000", 2024-09-14T05:59:39.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1200000000000003e-07 2024-09-14T05:59:39.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859158+0000", 2024-09-14T05:59:39.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4199999999999999e-06 2024-09-14T05:59:39.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859166+0000", 2024-09-14T05:59:39.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2099999999999996e-06 2024-09-14T05:59:39.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859171+0000", 2024-09-14T05:59:39.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1880000000000001e-06 2024-09-14T05:59:39.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908856+0000", 2024-09-14T05:59:39.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049684796000000003 2024-09-14T05:59:39.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.908932+0000", 2024-09-14T05:59:39.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6052999999999998e-05 2024-09-14T05:59:39.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909037+0000", 2024-09-14T05:59:39.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104941 2024-09-14T05:59:39.468 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.468 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.468 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.468 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21440 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1044480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.468 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859178+0000", 2024-09-14T05:59:39.468 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5353214679999994, 2024-09-14T05:59:39.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050075400999999999, 2024-09-14T05:59:39.469 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.469 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.469 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.469 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21440 2024-09-14T05:59:39.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.469 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859178+0000", 2024-09-14T05:59:39.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859178+0000", 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859179+0000", 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859181+0000", 2024-09-14T05:59:39.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9989999999999998e-06 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859187+0000", 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8370000000000002e-06 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859191+0000", 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3229999999999999e-06 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909069+0000", 2024-09-14T05:59:39.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049877719000000001 2024-09-14T05:59:39.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909146+0000", 2024-09-14T05:59:39.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7415000000000003e-05 2024-09-14T05:59:39.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909254+0000", 2024-09-14T05:59:39.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000107494 2024-09-14T05:59:39.472 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.472 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.472 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21492 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 993280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.859743+0000", 2024-09-14T05:59:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5347573099999998, 2024-09-14T05:59:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049728715999999999, 2024-09-14T05:59:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21492 2024-09-14T05:59:39.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.474 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859743+0000", 2024-09-14T05:59:39.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859743+0000", 2024-09-14T05:59:39.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859743+0000", 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1399999999999997e-07 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859745+0000", 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8330000000000001e-06 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859751+0000", 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9859999999999999e-06 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.859756+0000", 2024-09-14T05:59:39.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8910000000000003e-06 2024-09-14T05:59:39.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909286+0000", 2024-09-14T05:59:39.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049529918999999999 2024-09-14T05:59:39.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909364+0000", 2024-09-14T05:59:39.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8211e-05 2024-09-14T05:59:39.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.909471+0000", 2024-09-14T05:59:39.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000107462 2024-09-14T05:59:39.477 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.477 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.477 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.477 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:21666 3.12 3:4f639c0f:::rbd_data.1127ff8b71e0.0000000000000002:b [read 1038336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.477 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.865630+0000", 2024-09-14T05:59:39.477 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5288697920000001, 2024-09-14T05:59:39.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048103458000000002, 2024-09-14T05:59:39.477 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:39.477 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:39.477 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:39.477 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:39.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:39.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.478 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 21666 2024-09-14T05:59:39.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.478 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:39.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:39.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865630+0000", 2024-09-14T05:59:39.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:39.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865630+0000", 2024-09-14T05:59:39.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865631+0000", 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6599999999999996e-07 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865633+0000", 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.475e-06 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865641+0000", 2024-09-14T05:59:39.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6029999999999999e-06 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.865647+0000", 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1770000000000003e-06 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.913567+0000", 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047919727000000002 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.913636+0000", 2024-09-14T05:59:39.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9303999999999999e-05 2024-09-14T05:59:39.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:39.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:39.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:39.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.913734+0000", 2024-09-14T05:59:39.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7505999999999998e-05 2024-09-14T05:59:39.481 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.481 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.481 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.481 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:39.481 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:39.481 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:39.482 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:59:39.483 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:39.482+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:39.584 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:39.586+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:39.615 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:39.616 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:39.616 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:39.630 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:59:39.684 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:39.685+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:39.767 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:39.767 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:39.767 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:39.767 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:39.767 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:39.782 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:59:39.785 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:39.781+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:39.885 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:39.881+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:39.909 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:39.909 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:39.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:39.909 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:39.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.909 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21567 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 993280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.910 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:39.910 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9887979310000006, 2024-09-14T05:59:39.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031237369000000001, 2024-09-14T05:59:39.910 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.910 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.910 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.910 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.910 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.910 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.910 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21567 2024-09-14T05:59:39.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.910 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918112+0000", 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6000000000000004e-07 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918113+0000", 2024-09-14T05:59:39.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:59:39.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918118+0000", 2024-09-14T05:59:39.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4789999999999998e-06 2024-09-14T05:59:39.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918122+0000", 2024-09-14T05:59:39.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7740000000000002e-06 2024-09-14T05:59:39.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949196+0000", 2024-09-14T05:59:39.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031074101 2024-09-14T05:59:39.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949239+0000", 2024-09-14T05:59:39.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3724999999999999e-05 2024-09-14T05:59:39.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949349+0000", 2024-09-14T05:59:39.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010916699999999999 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21570 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1001472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9887652179999993, 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031375860999999998, 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.914 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.915 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21570 2024-09-14T05:59:39.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.915 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:39.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:39.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:39.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0499999999999999e-07 2024-09-14T05:59:39.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918146+0000", 2024-09-14T05:59:39.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1179999999999999e-06 2024-09-14T05:59:39.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918153+0000", 2024-09-14T05:59:39.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0299999999999999e-06 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918157+0000", 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0589999999999996e-06 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949386+0000", 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031229455999999999 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949448+0000", 2024-09-14T05:59:39.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2291000000000004e-05 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949520+0000", 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1501999999999994e-05 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21574 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1024000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9887464769999994, 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031511174000000003, 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.918 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.919 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.919 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.919 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.919 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.919 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21574 2024-09-14T05:59:39.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.919 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:39.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:39.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:39.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8500000000000002e-07 2024-09-14T05:59:39.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918165+0000", 2024-09-14T05:59:39.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.674e-06 2024-09-14T05:59:39.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918169+0000", 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5709999999999999e-06 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918175+0000", 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949555+0000", 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031380230000000002 2024-09-14T05:59:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949606+0000", 2024-09-14T05:59:39.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0300000000000003e-05 2024-09-14T05:59:39.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949674+0000", 2024-09-14T05:59:39.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8175000000000004e-05 2024-09-14T05:59:39.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.922 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.923 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21576 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1032192~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.923 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:39.923 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9887231700000001, 2024-09-14T05:59:39.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031677479000000001, 2024-09-14T05:59:39.923 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.923 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.923 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.923 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.923 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.923 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.923 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21576 2024-09-14T05:59:39.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.923 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:39.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:39.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918187+0000", 2024-09-14T05:59:39.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7100000000000001e-07 2024-09-14T05:59:39.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918189+0000", 2024-09-14T05:59:39.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.43e-06 2024-09-14T05:59:39.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918198+0000", 2024-09-14T05:59:39.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1859999999999998e-06 2024-09-14T05:59:39.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918206+0000", 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4939999999999997e-06 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949716+0000", 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031510428 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949789+0000", 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3233999999999997e-05 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949863+0000", 2024-09-14T05:59:39.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4035999999999994e-05 2024-09-14T05:59:39.927 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.927 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.927 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.927 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21577 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1046528~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.927 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:39.927 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9886923369999998, 2024-09-14T05:59:39.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031830166999999999, 2024-09-14T05:59:39.927 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.927 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.927 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.927 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21577 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:39.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3499999999999996e-07 2024-09-14T05:59:39.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918221+0000", 2024-09-14T05:59:39.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3179999999999998e-06 2024-09-14T05:59:39.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918230+0000", 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9460000000000004e-06 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918240+0000", 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9580000000000002e-06 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949896+0000", 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031655839999999998 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949944+0000", 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8658000000000001e-05 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950047+0000", 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102812 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21615 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 995328~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9884813389999998, 2024-09-14T05:59:39.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031807305000000001, 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21615 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6499999999999999e-07 2024-09-14T05:59:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918431+0000", 2024-09-14T05:59:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.948e-06 2024-09-14T05:59:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918440+0000", 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9390000000000003e-06 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918448+0000", 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.233e-06 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950088+0000", 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031640922000000002 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950153+0000", 2024-09-14T05:59:39.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4500999999999998e-05 2024-09-14T05:59:39.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950235+0000", 2024-09-14T05:59:39.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2196999999999999e-05 2024-09-14T05:59:39.935 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.935 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.935 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.935 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21618 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1003520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.936 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:39.936 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9884500700000007, 2024-09-14T05:59:39.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031945335999999998, 2024-09-14T05:59:39.936 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.936 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.936 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.936 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.936 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.936 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.936 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21618 2024-09-14T05:59:39.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.936 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:39.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:39.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918460+0000", 2024-09-14T05:59:39.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8400000000000002e-07 2024-09-14T05:59:39.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918464+0000", 2024-09-14T05:59:39.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4699999999999998e-06 2024-09-14T05:59:39.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918473+0000", 2024-09-14T05:59:39.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2159999999999995e-06 2024-09-14T05:59:39.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918480+0000", 2024-09-14T05:59:39.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2540000000000003e-06 2024-09-14T05:59:39.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950268+0000", 2024-09-14T05:59:39.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031787955 2024-09-14T05:59:39.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950327+0000", 2024-09-14T05:59:39.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9289000000000001e-05 2024-09-14T05:59:39.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950404+0000", 2024-09-14T05:59:39.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7168000000000004e-05 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21620 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1026048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9884087200000007, 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032089751, 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.940 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.941 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21620 2024-09-14T05:59:39.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.941 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:39.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:39.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918501+0000", 2024-09-14T05:59:39.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.46e-07 2024-09-14T05:59:39.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918503+0000", 2024-09-14T05:59:39.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4940000000000002e-06 2024-09-14T05:59:39.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918509+0000", 2024-09-14T05:59:39.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0850000000000002e-06 2024-09-14T05:59:39.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918514+0000", 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7219999999999999e-06 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950435+0000", 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031921161000000003 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950518+0000", 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2280999999999994e-05 2024-09-14T05:59:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950590+0000", 2024-09-14T05:59:39.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2562000000000001e-05 2024-09-14T05:59:39.944 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.944 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.944 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.944 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21622 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1034240~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.944 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:39.944 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9883884550000008, 2024-09-14T05:59:39.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032304393000000001, 2024-09-14T05:59:39.944 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.945 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.945 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.945 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.945 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.945 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.945 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21622 2024-09-14T05:59:39.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.945 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:39.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:39.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:39.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8299999999999997e-07 2024-09-14T05:59:39.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918523+0000", 2024-09-14T05:59:39.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7370000000000001e-06 2024-09-14T05:59:39.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918528+0000", 2024-09-14T05:59:39.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.87e-06 2024-09-14T05:59:39.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918532+0000", 2024-09-14T05:59:39.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8999999999999999e-06 2024-09-14T05:59:39.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950656+0000", 2024-09-14T05:59:39.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032123800000000001 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950745+0000", 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9044999999999999e-05 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950825+0000", 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0457999999999994e-05 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21668 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 983040~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9882662280000005, 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032333329000000001, 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21668 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:39.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:39.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:39.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9999999999999998e-07 2024-09-14T05:59:39.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918650+0000", 2024-09-14T05:59:39.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0779999999999998e-06 2024-09-14T05:59:39.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918656+0000", 2024-09-14T05:59:39.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.536e-06 2024-09-14T05:59:39.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918663+0000", 2024-09-14T05:59:39.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9480000000000002e-06 2024-09-14T05:59:39.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950856+0000", 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032193580999999999 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950908+0000", 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1248999999999997e-05 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950976+0000", 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8536999999999998e-05 2024-09-14T05:59:39.952 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21671 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 997376~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9882354420000006, 2024-09-14T05:59:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032470855999999999, 2024-09-14T05:59:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.954 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21671 2024-09-14T05:59:39.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.954 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:39.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:39.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918677+0000", 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.565e-06 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918686+0000", 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3309999999999993e-06 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918694+0000", 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6249999999999998e-06 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951003+0000", 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032308903 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951059+0000", 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951145+0000", 2024-09-14T05:59:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.53e-05 2024-09-14T05:59:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21673 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1005568~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9882042270000007, 2024-09-14T05:59:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.03260818, 2024-09-14T05:59:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.957 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.958 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.958 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.958 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.958 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.958 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21673 2024-09-14T05:59:39.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.958 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:39.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:39.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918706+0000", 2024-09-14T05:59:39.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4199999999999995e-07 2024-09-14T05:59:39.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918715+0000", 2024-09-14T05:59:39.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7459999999999995e-06 2024-09-14T05:59:39.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918725+0000", 2024-09-14T05:59:39.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0077e-05 2024-09-14T05:59:39.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918733+0000", 2024-09-14T05:59:39.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9610000000000005e-06 2024-09-14T05:59:39.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951178+0000", 2024-09-14T05:59:39.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032444711000000001 2024-09-14T05:59:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951246+0000", 2024-09-14T05:59:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8256999999999994e-05 2024-09-14T05:59:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951313+0000", 2024-09-14T05:59:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6785999999999994e-05 2024-09-14T05:59:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21674 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1028096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9881640990000005, 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032759020999999999, 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21674 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918746+0000", 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6599999999999995e-07 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918749+0000", 2024-09-14T05:59:39.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1489999999999998e-06 2024-09-14T05:59:39.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918758+0000", 2024-09-14T05:59:39.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2779999999999999e-06 2024-09-14T05:59:39.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918771+0000", 2024-09-14T05:59:39.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2799999999999999e-05 2024-09-14T05:59:39.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951346+0000", 2024-09-14T05:59:39.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032574573000000002 2024-09-14T05:59:39.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951426+0000", 2024-09-14T05:59:39.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0486000000000002e-05 2024-09-14T05:59:39.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951504+0000", 2024-09-14T05:59:39.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7968999999999998e-05 2024-09-14T05:59:39.966 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.966 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.966 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.966 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21676 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1036288~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.966 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:39.966 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9881265409999997, 2024-09-14T05:59:39.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032901069999999998, 2024-09-14T05:59:39.966 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.966 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21676 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:39.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:39.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2600000000000002e-07 2024-09-14T05:59:39.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918787+0000", 2024-09-14T05:59:39.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2430000000000001e-06 2024-09-14T05:59:39.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918796+0000", 2024-09-14T05:59:39.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5910000000000002e-06 2024-09-14T05:59:39.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918804+0000", 2024-09-14T05:59:39.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4050000000000003e-06 2024-09-14T05:59:39.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951539+0000", 2024-09-14T05:59:39.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032735383999999999 2024-09-14T05:59:39.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951611+0000", 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1675999999999996e-05 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951684+0000", 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3045000000000003e-05 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.970 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21723 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 985088~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9879244239999991, 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032913915000000002, 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21723 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:39.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:39.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:39.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0499999999999999e-07 2024-09-14T05:59:39.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918987+0000", 2024-09-14T05:59:39.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.883e-06 2024-09-14T05:59:39.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918992+0000", 2024-09-14T05:59:39.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8550000000000001e-06 2024-09-14T05:59:39.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918996+0000", 2024-09-14T05:59:39.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8800000000000001e-06 2024-09-14T05:59:39.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951712+0000", 2024-09-14T05:59:39.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032715883000000001 2024-09-14T05:59:39.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951784+0000", 2024-09-14T05:59:39.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2484999999999995e-05 2024-09-14T05:59:39.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951899+0000", 2024-09-14T05:59:39.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000114524 2024-09-14T05:59:39.974 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.974 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.975 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.975 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21725 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1007616~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.975 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:39.975 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9879064110000009, 2024-09-14T05:59:39.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033063000000000002, 2024-09-14T05:59:39.975 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.975 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.975 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.975 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.975 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.975 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.975 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21725 2024-09-14T05:59:39.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.976 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:39.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:39.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3099999999999999e-07 2024-09-14T05:59:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919013+0000", 2024-09-14T05:59:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0222e-05 2024-09-14T05:59:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919019+0000", 2024-09-14T05:59:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5520000000000004e-06 2024-09-14T05:59:39.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919023+0000", 2024-09-14T05:59:39.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0779999999999997e-06 2024-09-14T05:59:39.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951932+0000", 2024-09-14T05:59:39.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032908958000000002 2024-09-14T05:59:39.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952000+0000", 2024-09-14T05:59:39.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8435000000000005e-05 2024-09-14T05:59:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952066+0000", 2024-09-14T05:59:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5424000000000002e-05 2024-09-14T05:59:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21726 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1015808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9878798890000002, 2024-09-14T05:59:39.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033223673000000002, 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21726 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.980 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919030+0000", 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9000000000000002e-07 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919031+0000", 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7060000000000001e-06 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919036+0000", 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7439999999999998e-06 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919040+0000", 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9559999999999999e-06 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952093+0000", 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033053355 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952151+0000", 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7352999999999998e-05 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952253+0000", 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102169 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21727 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1030144~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.983 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:39.984 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9878638889999998, 2024-09-14T05:59:39.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033447573000000001, 2024-09-14T05:59:39.984 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.984 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.984 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.984 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.984 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.984 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.984 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21727 2024-09-14T05:59:39.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.984 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.984 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.984 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:39.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:39.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919046+0000", 2024-09-14T05:59:39.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.53e-07 2024-09-14T05:59:39.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919049+0000", 2024-09-14T05:59:39.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5130000000000001e-06 2024-09-14T05:59:39.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919055+0000", 2024-09-14T05:59:39.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3280000000000002e-06 2024-09-14T05:59:39.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919059+0000", 2024-09-14T05:59:39.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9820000000000002e-06 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952280+0000", 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033220999000000001 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952358+0000", 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7941999999999993e-05 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952493+0000", 2024-09-14T05:59:39.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000134456 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21729 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1038336~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9878443640000008, 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033604367000000003, 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.988 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21729 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:39.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1200000000000003e-07 2024-09-14T05:59:39.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919089+0000", 2024-09-14T05:59:39.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.332e-05 2024-09-14T05:59:39.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919096+0000", 2024-09-14T05:59:39.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5109999999999997e-06 2024-09-14T05:59:39.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919101+0000", 2024-09-14T05:59:39.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8239999999999999e-06 2024-09-14T05:59:39.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952524+0000", 2024-09-14T05:59:39.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033422466999999997 2024-09-14T05:59:39.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952599+0000", 2024-09-14T05:59:39.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5074999999999995e-05 2024-09-14T05:59:39.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.992 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.992 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952669+0000", 2024-09-14T05:59:39.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0557999999999998e-05 2024-09-14T05:59:39.992 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.992 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.992 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.992 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:28643 3.19 3:9c53e3bd:::rbd_data.11276864ec6c.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-14T05:59:39.992 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:39.992 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.2872335159999997, 2024-09-14T05:59:39.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033793691000000001, 2024-09-14T05:59:39.992 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:39.993 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:39.993 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:39.993 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:39.993 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:39.993 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:39.993 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 28643 2024-09-14T05:59:39.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.993 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:39.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:39.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:39.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:39.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:39.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:39.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:39.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619677+0000", 2024-09-14T05:59:39.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.717e-06 2024-09-14T05:59:39.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:39.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619683+0000", 2024-09-14T05:59:39.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5300000000000004e-06 2024-09-14T05:59:39.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619695+0000", 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2211e-05 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619701+0000", 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9429999999999997e-06 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619754+0000", 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2899000000000003e-05 2024-09-14T05:59:39.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:39.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619809+0000", 2024-09-14T05:59:39.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4783e-05 2024-09-14T05:59:39.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 3", 2024-09-14T05:59:39.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.625771+0000", 2024-09-14T05:59:39.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0059617960000000001 2024-09-14T05:59:39.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:39.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653329+0000", 2024-09-14T05:59:39.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.027558068000000002 2024-09-14T05:59:39.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:39.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653351+0000", 2024-09-14T05:59:39.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2133e-05 2024-09-14T05:59:39.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:39.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653409+0000", 2024-09-14T05:59:39.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8687999999999998e-05 2024-09-14T05:59:39.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:39.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:39.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:39.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653469+0000", 2024-09-14T05:59:39.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9923000000000002e-05 2024-09-14T05:59:39.998 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.998 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.998 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.998 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:39.998 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:39.998 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:39.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:59:40.000 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:39.997+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:40.100 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:40.097+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:40.175 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:40.175 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:40.175 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:40.175 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:40.190 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:59:40.235 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:40.233+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:40.302 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:40.297+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:40.363 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:40.363 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:40.363 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:40.363 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:40.363 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:40.377 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:59:40.419 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:40.417+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:40.504 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:40.505+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:40.550 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:40.550 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:40.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:468 3.9 e29/24 3:92497260:::rbd_data.11275e589b0d.0000000000000015:head v 29'6, mlcod=29'4)", 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.980106211999999, 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002991737, 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568240+0000", 2024-09-14T05:59:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568242+0000", 2024-09-14T05:59:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3970000000000001e-06 2024-09-14T05:59:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568261+0000", 2024-09-14T05:59:40.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9029999999999999e-05 2024-09-14T05:59:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568302+0000", 2024-09-14T05:59:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0756000000000001e-05 2024-09-14T05:59:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568324+0000", 2024-09-14T05:59:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2293000000000002e-05 2024-09-14T05:59:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568455+0000", 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000130784 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.568479+0000", 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4119000000000001e-05 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.571135+0000", 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0026556319999999998 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:12.571231+0000", 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6725999999999995e-05 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:858 3.0 e29/24 3:00d51ce4:::rbd_data.11275e589b0d.0000000000000009:head v 29'2, mlcod=0'0)", 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 26.873787558, 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003436171, 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:40.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:40.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674560+0000", 2024-09-14T05:59:40.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.638e-06 2024-09-14T05:59:40.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674570+0000", 2024-09-14T05:59:40.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9890000000000004e-06 2024-09-14T05:59:40.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674594+0000", 2024-09-14T05:59:40.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4049e-05 2024-09-14T05:59:40.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674604+0000", 2024-09-14T05:59:40.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0165e-05 2024-09-14T05:59:40.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674720+0000", 2024-09-14T05:59:40.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000115993 2024-09-14T05:59:40.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674746+0000", 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5984000000000001e-05 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.677932+0000", 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031863669999999998 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.677994+0000", 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1985999999999999e-05 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.561 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3625 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'27, mlcod=31'25)", 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.325533+0000", 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.222812951000002, 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035513340000000002, 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325533+0000", 2024-09-14T05:59:40.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325533+0000", 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325534+0000", 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.02e-06 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325542+0000", 2024-09-14T05:59:40.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0339999999999997e-06 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325560+0000", 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8403e-05 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325570+0000", 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9010000000000006e-06 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325639+0000", 2024-09-14T05:59:40.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8610999999999998e-05 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325661+0000", 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1848000000000002e-05 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329045+0000", 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0033840400000000001 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329084+0000", 2024-09-14T05:59:40.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9477000000000002e-05 2024-09-14T05:59:40.566 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.566 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.566 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.566 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3626 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'28, mlcod=31'25)", 2024-09-14T05:59:40.566 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.326628+0000", 2024-09-14T05:59:40.566 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.221717657999999, 2024-09-14T05:59:40.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003397672, 2024-09-14T05:59:40.566 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.566 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.566 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.566 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326628+0000", 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326628+0000", 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326630+0000", 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326637+0000", 2024-09-14T05:59:40.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6420000000000007e-06 2024-09-14T05:59:40.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326660+0000", 2024-09-14T05:59:40.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2816999999999999e-05 2024-09-14T05:59:40.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326671+0000", 2024-09-14T05:59:40.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0862999999999999e-05 2024-09-14T05:59:40.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326744+0000", 2024-09-14T05:59:40.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3411999999999994e-05 2024-09-14T05:59:40.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.326763+0000", 2024-09-14T05:59:40.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9049e-05 2024-09-14T05:59:40.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329958+0000", 2024-09-14T05:59:40.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031946909999999999 2024-09-14T05:59:40.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.570 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.570 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330026+0000", 2024-09-14T05:59:40.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7634999999999999e-05 2024-09-14T05:59:40.570 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.570 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.570 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.570 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3628 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'30, mlcod=31'25)", 2024-09-14T05:59:40.570 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.328532+0000", 2024-09-14T05:59:40.570 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.219813955999999, 2024-09-14T05:59:40.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037713170000000002, 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328532+0000", 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328532+0000", 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328533+0000", 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8999999999999995e-07 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328539+0000", 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.913e-06 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328551+0000", 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2782999999999999e-05 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328560+0000", 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9400000000000008e-06 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328620+0000", 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9360000000000001e-05 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328642+0000", 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1891000000000001e-05 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332262+0000", 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0036202909999999999 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332303+0000", 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1349e-05 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3629 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'31, mlcod=31'25)", 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:40.574 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.218863894999998, 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048071900000000002, 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329483+0000", 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-07 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329488+0000", 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000004e-06 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329496+0000", 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2209999999999997e-06 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.577 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.577 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329501+0000", 2024-09-14T05:59:40.577 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8729999999999998e-06 2024-09-14T05:59:40.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.577 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.577 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329545+0000", 2024-09-14T05:59:40.577 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4382999999999998e-05 2024-09-14T05:59:40.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.577 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.577 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329564+0000", 2024-09-14T05:59:40.577 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8947999999999999e-05 2024-09-14T05:59:40.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334225+0000", 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004660923 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334289+0000", 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4041999999999994e-05 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.578 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3630 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'32, mlcod=31'25)", 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.21811589, 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0040991680000000003, 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.579 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:40.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330231+0000", 2024-09-14T05:59:40.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4099999999999998e-07 2024-09-14T05:59:40.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330235+0000", 2024-09-14T05:59:40.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.391e-06 2024-09-14T05:59:40.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330245+0000", 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330249+0000", 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330301+0000", 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1515999999999999e-05 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.581 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330312+0000", 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1603000000000001e-05 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334293+0000", 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039809449999999996 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334329+0000", 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5763000000000003e-05 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3631 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'33, mlcod=31'27)", 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.216960095000001, 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035882079999999998, 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3300000000000001e-07 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331392+0000", 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7880000000000003e-06 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.585 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.585 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331403+0000", 2024-09-14T05:59:40.585 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0703000000000001e-05 2024-09-14T05:59:40.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.585 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.585 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.585 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331420+0000", 2024-09-14T05:59:40.585 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6959000000000001e-05 2024-09-14T05:59:40.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.585 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.585 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.585 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331466+0000", 2024-09-14T05:59:40.585 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5867e-05 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331486+0000", 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0511000000000001e-05 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334926+0000", 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0034397490000000002 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334974+0000", 2024-09-14T05:59:40.586 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7898000000000001e-05 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3632 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'34, mlcod=31'27)", 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.215741706999999, 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047983469999999997, 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332605+0000", 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5099999999999999e-07 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332611+0000", 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6999999999999996e-06 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332623+0000", 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2401e-05 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332629+0000", 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3720000000000001e-06 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.589 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332691+0000", 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1451000000000005e-05 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332711+0000", 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0285e-05 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337341+0000", 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046295900000000003 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.590 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337402+0000", 2024-09-14T05:59:40.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1797000000000005e-05 2024-09-14T05:59:40.591 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.591 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.591 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.591 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3633 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'35, mlcod=31'27)", 2024-09-14T05:59:40.591 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:40.591 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.214880262000001, 2024-09-14T05:59:40.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039783919999999999, 2024-09-14T05:59:40.591 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.591 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.591 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.591 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1500000000000004e-07 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333479+0000", 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2918999999999999e-05 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333489+0000", 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0068000000000001e-05 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333494+0000", 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9309999999999999e-06 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333543+0000", 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9293999999999999e-05 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333555+0000", 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1467e-05 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337408+0000", 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038532549999999999 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337444+0000", 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5843000000000002e-05 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3634 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'36, mlcod=31'27)", 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.334299+0000", 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.214047230999999, 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031846980000000001, 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.595 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334299+0000", 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334299+0000", 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334299+0000", 2024-09-14T05:59:40.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0699999999999996e-07 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334306+0000", 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3849999999999999e-06 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334316+0000", 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9969999999999993e-06 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334322+0000", 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2060000000000004e-06 2024-09-14T05:59:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334414+0000", 2024-09-14T05:59:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2650000000000002e-05 2024-09-14T05:59:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334444+0000", 2024-09-14T05:59:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9213e-05 2024-09-14T05:59:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337447+0000", 2024-09-14T05:59:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0030035729999999998 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337483+0000", 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5967000000000003e-05 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3638 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'40, mlcod=31'32)", 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.209599791999999, 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004283345, 2024-09-14T05:59:40.599 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.600 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.600 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.600 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.600 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.600 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:40.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.600 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.600 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:40.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338747+0000", 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0279999999999999e-06 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338756+0000", 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5909999999999996e-06 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338774+0000", 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8073000000000001e-05 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338785+0000", 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1017e-05 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338844+0000", 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9292000000000001e-05 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338864+0000", 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9528999999999999e-05 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.603 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.603 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.342984+0000", 2024-09-14T05:59:40.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041207809999999996 2024-09-14T05:59:40.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.603 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.603 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.343029+0000", 2024-09-14T05:59:40.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5034000000000003e-05 2024-09-14T05:59:40.603 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.603 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.603 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.603 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3692 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'47, mlcod=31'44)", 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.394505+0000", 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.153840414000001, 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031415789999999998, 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394505+0000", 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394505+0000", 2024-09-14T05:59:40.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394506+0000", 2024-09-14T05:59:40.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0100000000000004e-07 2024-09-14T05:59:40.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394511+0000", 2024-09-14T05:59:40.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7709999999999997e-06 2024-09-14T05:59:40.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394522+0000", 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1270999999999999e-05 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394531+0000", 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6309999999999992e-06 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394598+0000", 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7516999999999997e-05 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.394629+0000", 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0380000000000001e-05 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.397611+0000", 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002982434 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.397647+0000", 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5874000000000002e-05 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:11218 3.9 e38/24 3:967d83c0:::rbd_data.1127ff8b71e0.0000000000000064:head v 38'37, mlcod=38'35)", 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.303493679000001, 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004035416, 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244854+0000", 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2350000000000002e-06 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246114+0000", 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012600980000000001 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246158+0000", 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3473000000000002e-05 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246179+0000", 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0738999999999999e-05 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246306+0000", 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000127238 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246349+0000", 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3211999999999999e-05 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248780+0000", 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0024304970000000002 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248888+0000", 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010792400000000001 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.611 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:11359 3.9 e38/24 3:967d83c0:::rbd_data.1127ff8b71e0.0000000000000064:head v 38'38, mlcod=38'36)", 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.313747+0000", 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.234598892999999, 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0030761819999999998, 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.313747+0000", 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.313747+0000", 2024-09-14T05:59:40.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.313749+0000", 2024-09-14T05:59:40.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5730000000000002e-06 2024-09-14T05:59:40.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.313766+0000", 2024-09-14T05:59:40.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6986999999999998e-05 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.313814+0000", 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7389000000000003e-05 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.313836+0000", 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1679999999999999e-05 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.314044+0000", 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020864500000000001 2024-09-14T05:59:40.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.314098+0000", 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3936e-05 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.316709+0000", 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0026110460000000001 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.316823+0000", 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011392600000000001 2024-09-14T05:59:40.615 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:11892 3.4 e39/24 3:27ace2d5:::rbd_data.1127ff8b71e0.0000000000000000:head v 39'72, mlcod=38'70)", 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.706452+0000", 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.841893723, 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003757636, 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.706452+0000", 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.706452+0000", 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.706454+0000", 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.857e-06 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707127+0000", 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00067296299999999995 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707151+0000", 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3643999999999999e-05 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707161+0000", 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.064e-05 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707264+0000", 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102586 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707300+0000", 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5951000000000002e-05 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.710137+0000", 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002837184 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.710210+0000", 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2811000000000005e-05 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:14244 3.4 e39/24 3:26d89d63:::rbd_data.1127ff8b71e0.000000000000003e:head v 39'74, mlcod=39'72)", 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:27.174207+0000", 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.374138509, 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031170289999999999, 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174207+0000", 2024-09-14T05:59:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174207+0000", 2024-09-14T05:59:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174209+0000", 2024-09-14T05:59:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4720000000000001e-06 2024-09-14T05:59:40.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174219+0000", 2024-09-14T05:59:40.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7710000000000001e-06 2024-09-14T05:59:40.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174240+0000", 2024-09-14T05:59:40.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1021000000000001e-05 2024-09-14T05:59:40.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174253+0000", 2024-09-14T05:59:40.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3385e-05 2024-09-14T05:59:40.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.623 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.623 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174322+0000", 2024-09-14T05:59:40.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9034000000000003e-05 2024-09-14T05:59:40.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.623 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.623 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.174349+0000", 2024-09-14T05:59:40.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7475e-05 2024-09-14T05:59:40.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.623 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.177272+0000", 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029221889999999999 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:27.177324+0000", 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2682000000000001e-05 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:17596 3.4 e41/24 3:27f62511:::rbd_data.1127d65075f9.00000000000000ca:head v 41'97, mlcod=41'95)", 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:40.624 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 10.577847228, 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049456559999999997, 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970500+0000", 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9600000000000008e-07 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970614+0000", 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000113956 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970631+0000", 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7150999999999999e-05 2024-09-14T05:59:40.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970643+0000", 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1868999999999999e-05 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970711+0000", 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8952e-05 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970738+0000", 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6055999999999999e-05 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.628 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.628 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975388+0000", 2024-09-14T05:59:40.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046502499999999999 2024-09-14T05:59:40.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.628 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.628 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975444+0000", 2024-09-14T05:59:40.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6425999999999998e-05 2024-09-14T05:59:40.628 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.628 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.628 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24289 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'57, mlcod=41'54)", 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.3925550490000003, 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.060867738999999997, 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:40.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.630 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155793+0000", 2024-09-14T05:59:40.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9470000000000002e-06 2024-09-14T05:59:40.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.630 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181776+0000", 2024-09-14T05:59:40.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.02598313 2024-09-14T05:59:40.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181817+0000", 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1440000000000003e-05 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181834+0000", 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6979000000000001e-05 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181931+0000", 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7219999999999994e-05 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181964+0000", 2024-09-14T05:59:40.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2094999999999997e-05 2024-09-14T05:59:40.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216586+0000", 2024-09-14T05:59:40.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034622503999999998 2024-09-14T05:59:40.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216658+0000", 2024-09-14T05:59:40.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:59:40.632 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.632 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24309 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'58, mlcod=41'56)", 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.2933199440000003, 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044435519999999999, 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:40.633 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:40.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:40.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:40.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:40.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255027+0000", 2024-09-14T05:59:40.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T05:59:40.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:40.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255040+0000", 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2773e-05 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255066+0000", 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5459000000000001e-05 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255076+0000", 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0372e-05 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255151+0000", 2024-09-14T05:59:40.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5444999999999993e-05 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255176+0000", 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5089e-05 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259379+0000", 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042025439999999999 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259469+0000", 2024-09-14T05:59:40.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0407000000000004e-05 2024-09-14T05:59:40.637 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.637 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.637 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.637 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:40.637 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:40.637 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:40.638 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:59:40.639 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:40.637+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:40.739 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:40.737+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:40.746 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:59:40.780 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:40.780 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:40.781 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:40.781 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:40.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:59:40.843 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:40.841+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:40.941 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:40.937+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:40.989 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:40.990 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:40.990 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:40.990 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:40.990 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:41.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:59:41.047 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:41.045+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:41.143 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:41.141+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:41.176 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:41.176 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12600 3.18 3:1e8e1704:::rbd_data.1127368d46aa.0000000000000000:a [read 1835008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.899978+0000", 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.274248525000001, 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082577203000000002, 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12600 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.899978+0000", 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.899978+0000", 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.899980+0000", 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.26e-06 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.899986+0000", 2024-09-14T05:59:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0499999999999997e-06 2024-09-14T05:59:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900005+0000", 2024-09-14T05:59:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9162999999999999e-05 2024-09-14T05:59:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900019+0000", 2024-09-14T05:59:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3967e-05 2024-09-14T05:59:41.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982365+0000", 2024-09-14T05:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082346635000000001 2024-09-14T05:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982450+0000", 2024-09-14T05:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4486000000000004e-05 2024-09-14T05:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982556+0000", 2024-09-14T05:59:41.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105642 2024-09-14T05:59:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12601 3.18 3:1e8e1704:::rbd_data.1127368d46aa.0000000000000000:a [read 1900544~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900038+0000", 2024-09-14T05:59:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.274188694999999, 2024-09-14T05:59:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082708763000000005, 2024-09-14T05:59:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.181 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12601 2024-09-14T05:59:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900038+0000", 2024-09-14T05:59:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900038+0000", 2024-09-14T05:59:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900039+0000", 2024-09-14T05:59:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2300000000000001e-06 2024-09-14T05:59:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900061+0000", 2024-09-14T05:59:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1999999999999999e-05 2024-09-14T05:59:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900079+0000", 2024-09-14T05:59:41.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7883000000000001e-05 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900094+0000", 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4363e-05 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982599+0000", 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082505455000000005 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982659+0000", 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9960999999999997e-05 2024-09-14T05:59:41.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982747+0000", 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7870999999999999e-05 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12602 3.18 3:1e8e1704:::rbd_data.1127368d46aa.0000000000000000:a [read 1966080~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900115+0000", 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.274112313, 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082889114999999999, 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.185 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12602 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900115+0000", 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900115+0000", 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900116+0000", 2024-09-14T05:59:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6640000000000001e-06 2024-09-14T05:59:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900122+0000", 2024-09-14T05:59:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6799999999999998e-06 2024-09-14T05:59:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900139+0000", 2024-09-14T05:59:41.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7309999999999999e-05 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900153+0000", 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.429e-05 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982795+0000", 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082641362999999995 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982891+0000", 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6271e-05 2024-09-14T05:59:41.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983004+0000", 2024-09-14T05:59:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000112537 2024-09-14T05:59:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12603 3.18 3:1e8e1704:::rbd_data.1127368d46aa.0000000000000000:a [read 2031616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900172+0000", 2024-09-14T05:59:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.274055266, 2024-09-14T05:59:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083068960999999997, 2024-09-14T05:59:41.189 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12603 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900172+0000", 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.190 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900172+0000", 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900173+0000", 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4699999999999999e-06 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900200+0000", 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7243e-05 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900220+0000", 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0196000000000001e-05 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900235+0000", 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.487e-05 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983044+0000", 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082808549999999995 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983097+0000", 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2865999999999998e-05 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983241+0000", 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014376600000000001 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12604 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1572864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900256+0000", 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.27397079, 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083449791999999995, 2024-09-14T05:59:41.193 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12604 2024-09-14T05:59:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900256+0000", 2024-09-14T05:59:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900256+0000", 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900258+0000", 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900263+0000", 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8069999999999996e-06 2024-09-14T05:59:41.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900280+0000", 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.717e-05 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900296+0000", 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5642999999999999e-05 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983293+0000", 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082997258000000004 2024-09-14T05:59:41.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983483+0000", 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019005399999999999 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983706+0000", 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00022239699999999999 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.197 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12605 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1638400~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900320+0000", 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273906501000001, 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083560593000000002, 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12605 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.198 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900320+0000", 2024-09-14T05:59:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900320+0000", 2024-09-14T05:59:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900322+0000", 2024-09-14T05:59:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.226e-06 2024-09-14T05:59:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.199 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900327+0000", 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4700000000000001e-06 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900345+0000", 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8297000000000001e-05 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900359+0000", 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3793e-05 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983732+0000", 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083372486999999995 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983786+0000", 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3906999999999997e-05 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983881+0000", 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5413000000000003e-05 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12606 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1703936~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900377+0000", 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273849595, 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083968347999999998, 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12606 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.202 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900377+0000", 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900377+0000", 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900378+0000", 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0869999999999999e-06 2024-09-14T05:59:41.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900383+0000", 2024-09-14T05:59:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8269999999999997e-06 2024-09-14T05:59:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900401+0000", 2024-09-14T05:59:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7586000000000001e-05 2024-09-14T05:59:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900414+0000", 2024-09-14T05:59:41.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3616e-05 2024-09-14T05:59:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983926+0000", 2024-09-14T05:59:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083511964999999994 2024-09-14T05:59:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984100+0000", 2024-09-14T05:59:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000173647 2024-09-14T05:59:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984346+0000", 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024562 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12607 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900435+0000", 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273791482, 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084218643999999995, 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.206 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12607 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900435+0000", 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900435+0000", 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.207 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900437+0000", 2024-09-14T05:59:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.173e-06 2024-09-14T05:59:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900442+0000", 2024-09-14T05:59:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9569999999999999e-06 2024-09-14T05:59:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900462+0000", 2024-09-14T05:59:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9409999999999999e-05 2024-09-14T05:59:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900476+0000", 2024-09-14T05:59:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3842999999999999e-05 2024-09-14T05:59:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984377+0000", 2024-09-14T05:59:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083901341000000004 2024-09-14T05:59:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984523+0000", 2024-09-14T05:59:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014617800000000001 2024-09-14T05:59:41.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984654+0000", 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013074199999999999 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12608 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1835008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900495+0000", 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273731846, 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084429064999999998, 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.210 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12608 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900495+0000", 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900495+0000", 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900496+0000", 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3969999999999999e-06 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900502+0000", 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3369999999999999e-06 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900518+0000", 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6215999999999999e-05 2024-09-14T05:59:41.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900546+0000", 2024-09-14T05:59:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8089000000000002e-05 2024-09-14T05:59:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984684+0000", 2024-09-14T05:59:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084137637000000001 2024-09-14T05:59:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984816+0000", 2024-09-14T05:59:41.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013197799999999999 2024-09-14T05:59:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984924+0000", 2024-09-14T05:59:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108411 2024-09-14T05:59:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12609 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1900544~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900568+0000", 2024-09-14T05:59:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273658966999999, 2024-09-14T05:59:41.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084572639000000005, 2024-09-14T05:59:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12609 2024-09-14T05:59:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900568+0000", 2024-09-14T05:59:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900568+0000", 2024-09-14T05:59:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900569+0000", 2024-09-14T05:59:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5540000000000001e-06 2024-09-14T05:59:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900586+0000", 2024-09-14T05:59:41.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6079999999999999e-05 2024-09-14T05:59:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900609+0000", 2024-09-14T05:59:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3580000000000001e-05 2024-09-14T05:59:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900624+0000", 2024-09-14T05:59:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5173e-05 2024-09-14T05:59:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.217 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984993+0000", 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084369059999999996 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985055+0000", 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1346000000000005e-05 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985141+0000", 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5846000000000004e-05 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12610 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1966080~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900645+0000", 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273581574, 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084792891999999995, 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12610 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.219 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900645+0000", 2024-09-14T05:59:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900645+0000", 2024-09-14T05:59:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900647+0000", 2024-09-14T05:59:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6199999999999999e-06 2024-09-14T05:59:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900652+0000", 2024-09-14T05:59:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2100000000000001e-06 2024-09-14T05:59:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900669+0000", 2024-09-14T05:59:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7376000000000001e-05 2024-09-14T05:59:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900682+0000", 2024-09-14T05:59:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2284e-05 2024-09-14T05:59:41.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985177+0000", 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084495644999999994 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985322+0000", 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014503899999999999 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985438+0000", 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011571800000000001 2024-09-14T05:59:41.222 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12611 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 2031616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900701+0000", 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273525727999999, 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085063237999999999, 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12611 2024-09-14T05:59:41.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900701+0000", 2024-09-14T05:59:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900701+0000", 2024-09-14T05:59:41.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900702+0000", 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.097e-06 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900708+0000", 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0599999999999996e-06 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900729+0000", 2024-09-14T05:59:41.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1143000000000001e-05 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900744+0000", 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4953000000000001e-05 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985502+0000", 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084757543000000005 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985620+0000", 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000117644 2024-09-14T05:59:41.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985764+0000", 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014479799999999999 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12612 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1572864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900785+0000", 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273441652000001, 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085273510999999996, 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.227 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12612 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900785+0000", 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900785+0000", 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900787+0000", 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.327e-06 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900805+0000", 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8416000000000001e-05 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.229 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900826+0000", 2024-09-14T05:59:41.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0579999999999999e-05 2024-09-14T05:59:41.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.230 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900839+0000", 2024-09-14T05:59:41.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.38e-05 2024-09-14T05:59:41.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.230 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985790+0000", 2024-09-14T05:59:41.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084950345999999996 2024-09-14T05:59:41.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985918+0000", 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012817800000000001 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986059+0000", 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014086400000000001 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12613 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1638400~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900862+0000", 2024-09-14T05:59:41.231 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273364609, 2024-09-14T05:59:41.232 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085363869999999994, 2024-09-14T05:59:41.232 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.232 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.232 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.232 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.232 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.232 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12613 2024-09-14T05:59:41.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.232 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.232 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.232 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900862+0000", 2024-09-14T05:59:41.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.233 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900862+0000", 2024-09-14T05:59:41.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.233 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900864+0000", 2024-09-14T05:59:41.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3400000000000001e-06 2024-09-14T05:59:41.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900870+0000", 2024-09-14T05:59:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.246e-06 2024-09-14T05:59:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900889+0000", 2024-09-14T05:59:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.916e-05 2024-09-14T05:59:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900903+0000", 2024-09-14T05:59:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.448e-05 2024-09-14T05:59:41.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986080+0000", 2024-09-14T05:59:41.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085176475000000001 2024-09-14T05:59:41.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986129+0000", 2024-09-14T05:59:41.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9493000000000002e-05 2024-09-14T05:59:41.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986226+0000", 2024-09-14T05:59:41.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6675999999999994e-05 2024-09-14T05:59:41.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.236 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.236 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12614 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1703936~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.236 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900925+0000", 2024-09-14T05:59:41.236 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273301572999999, 2024-09-14T05:59:41.236 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085610173999999997, 2024-09-14T05:59:41.236 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.236 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.236 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.236 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.237 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.237 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12614 2024-09-14T05:59:41.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.237 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.237 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.237 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900925+0000", 2024-09-14T05:59:41.237 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.237 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.237 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900925+0000", 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900927+0000", 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3769999999999999e-06 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900933+0000", 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1829999999999999e-06 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.238 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900951+0000", 2024-09-14T05:59:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7810000000000001e-05 2024-09-14T05:59:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900966+0000", 2024-09-14T05:59:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5228999999999999e-05 2024-09-14T05:59:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986268+0000", 2024-09-14T05:59:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085302557000000001 2024-09-14T05:59:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.240 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.240 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986391+0000", 2024-09-14T05:59:41.240 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012244299999999999 2024-09-14T05:59:41.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.240 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.240 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986535+0000", 2024-09-14T05:59:41.240 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000144575 2024-09-14T05:59:41.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.240 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.241 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12615 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.241 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900988+0000", 2024-09-14T05:59:41.241 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273239304000001, 2024-09-14T05:59:41.241 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085798447, 2024-09-14T05:59:41.241 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.241 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.241 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.241 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.241 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12615 2024-09-14T05:59:41.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.241 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900988+0000", 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900988+0000", 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900989+0000", 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5200000000000001e-06 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.243 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900995+0000", 2024-09-14T05:59:41.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3069999999999999e-06 2024-09-14T05:59:41.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.243 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901014+0000", 2024-09-14T05:59:41.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.838e-05 2024-09-14T05:59:41.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.243 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901028+0000", 2024-09-14T05:59:41.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4752999999999999e-05 2024-09-14T05:59:41.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.244 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.244 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986560+0000", 2024-09-14T05:59:41.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085531441999999999 2024-09-14T05:59:41.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.244 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.244 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986678+0000", 2024-09-14T05:59:41.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118034 2024-09-14T05:59:41.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.244 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.244 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986786+0000", 2024-09-14T05:59:41.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010801100000000001 2024-09-14T05:59:41.245 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.245 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.245 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.245 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12616 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1835008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.245 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.901049+0000", 2024-09-14T05:59:41.245 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273178311000001, 2024-09-14T05:59:41.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085922076999999999, 2024-09-14T05:59:41.245 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.245 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.246 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.246 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.246 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.246 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12616 2024-09-14T05:59:41.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.246 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.246 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.246 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901049+0000", 2024-09-14T05:59:41.246 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.246 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.246 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901049+0000", 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901050+0000", 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5340000000000001e-06 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901055+0000", 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2730000000000002e-06 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901075+0000", 2024-09-14T05:59:41.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9346000000000001e-05 2024-09-14T05:59:41.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.248 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901089+0000", 2024-09-14T05:59:41.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4392999999999999e-05 2024-09-14T05:59:41.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.248 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986819+0000", 2024-09-14T05:59:41.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085730161999999999 2024-09-14T05:59:41.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.249 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986885+0000", 2024-09-14T05:59:41.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6217999999999995e-05 2024-09-14T05:59:41.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.249 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.249 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986971+0000", 2024-09-14T05:59:41.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5150999999999998e-05 2024-09-14T05:59:41.249 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.249 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.249 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.249 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12617 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1900544~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.249 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.901113+0000", 2024-09-14T05:59:41.250 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273114325, 2024-09-14T05:59:41.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086089867, 2024-09-14T05:59:41.250 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.250 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.250 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.250 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.250 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.250 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.250 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12617 2024-09-14T05:59:41.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.250 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901113+0000", 2024-09-14T05:59:41.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901113+0000", 2024-09-14T05:59:41.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901114+0000", 2024-09-14T05:59:41.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2130000000000001e-06 2024-09-14T05:59:41.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901119+0000", 2024-09-14T05:59:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5169999999999999e-06 2024-09-14T05:59:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901137+0000", 2024-09-14T05:59:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7819999999999999e-05 2024-09-14T05:59:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901151+0000", 2024-09-14T05:59:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3723000000000001e-05 2024-09-14T05:59:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987010+0000", 2024-09-14T05:59:41.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085858773999999999 2024-09-14T05:59:41.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987105+0000", 2024-09-14T05:59:41.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5091000000000001e-05 2024-09-14T05:59:41.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987202+0000", 2024-09-14T05:59:41.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7728999999999999e-05 2024-09-14T05:59:41.253 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12618 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1966080~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.901169+0000", 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273057739, 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086197516000000002, 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12618 2024-09-14T05:59:41.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.255 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901169+0000", 2024-09-14T05:59:41.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901169+0000", 2024-09-14T05:59:41.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901170+0000", 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.33e-06 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901176+0000", 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.22e-06 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901193+0000", 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7326999999999999e-05 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901206+0000", 2024-09-14T05:59:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2979000000000001e-05 2024-09-14T05:59:41.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987231+0000", 2024-09-14T05:59:41.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086025015999999996 2024-09-14T05:59:41.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987281+0000", 2024-09-14T05:59:41.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9740000000000001e-05 2024-09-14T05:59:41.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987367+0000", 2024-09-14T05:59:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5903999999999996e-05 2024-09-14T05:59:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12619 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 2031616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.901223+0000", 2024-09-14T05:59:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.273003642999999, 2024-09-14T05:59:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086375007000000004, 2024-09-14T05:59:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:41.258 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:41.259 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:41.259 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:41.259 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:41.259 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12619 2024-09-14T05:59:41.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.259 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:41.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:41.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901223+0000", 2024-09-14T05:59:41.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:41.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901223+0000", 2024-09-14T05:59:41.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:41.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:41.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901224+0000", 2024-09-14T05:59:41.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1000000000000001e-06 2024-09-14T05:59:41.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:41.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901229+0000", 2024-09-14T05:59:41.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8940000000000001e-06 2024-09-14T05:59:41.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:41.261 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901246+0000", 2024-09-14T05:59:41.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6863000000000001e-05 2024-09-14T05:59:41.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:41.261 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901259+0000", 2024-09-14T05:59:41.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3207000000000001e-05 2024-09-14T05:59:41.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:41.261 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987401+0000", 2024-09-14T05:59:41.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086141599999999999 2024-09-14T05:59:41.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987502+0000", 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000100654 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987598+0000", 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6688999999999995e-05 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:41.262 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:41.264 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:59:41.264 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:41.265+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:41.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:59:41.365 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:41.365+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:41.393 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:41.393 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:41.394 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:41.394 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:41.407 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:59:41.459 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T05:59:41.460 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-14T05:59:41.465 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:41.461+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:41.476 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:41.477 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:41.493 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:41.493 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:41.510 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:41.510 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:41.529 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:41.529 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:41.550 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:41.550 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:41.567 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:41.565+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:41.570 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:41.570 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:41.573 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:41.573 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:41.587 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:59:41.588 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:41.589 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:41.667 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:41.665+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:41.749 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:41.749 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:41.762 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2024-09-14T05:59:41.767 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:59:41.768 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:41.765+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:41.870 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:41.869+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:41.889 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:41.889 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:41.903 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:59:41.992 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:41.993+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:42.071 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:42.069+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:42.081 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:42.081 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:42.093 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone11 from 0x8952d55 (overlap 0x29c9702) to 0x1d4034e 2024-09-14T05:59:42.100 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:59:42.172 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:42.169+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:42.272 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:42.269+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:42.273 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:42.273 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:42.278 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-14T05:59:42.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T05:59:42.374 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:42.369+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:42.407 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:42.461 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:42.461 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:59:42.462 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T05:59:42.507 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:42.505+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:42.576 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:42.573+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:42.588 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:42.588 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:42.596 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:42.596 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:42.603 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T05:59:42.612 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T05:59:42.703 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:42.701+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:42.725 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:42.725 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:42.739 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T05:59:42.756 INFO:teuthology.orchestra.run.smithi006.stdout:1983 writesame 0xbfb2123 thru 0xbfbe62a data_size 0x68(0xc508 bytes) 2024-09-14T05:59:42.757 INFO:teuthology.orchestra.run.smithi006.stdout:1984 read 0x5df269e thru 0x5dfb7ad (0x9110 bytes) 2024-09-14T05:59:42.757 INFO:teuthology.orchestra.run.smithi006.stdout:1985 write 0x65bf078 thru 0x65c6531 (0x74ba bytes) 2024-09-14T05:59:42.767 INFO:teuthology.orchestra.run.smithi006.stdout:1986 write 0x8b1b1d3 thru 0x8b2acab (0xfad9 bytes) 2024-09-14T05:59:42.784 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:42.785+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:42.861 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:42.861 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:42.875 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T05:59:42.880 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:42.877+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:42.980 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:42.981+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:43.041 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:43.041 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:43.055 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T05:59:43.096 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:43.097+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:43.182 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:43.177+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:43.216 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:43.217 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:43.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:59:43.283 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:43.281+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:43.367 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:43.367 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:43.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:59:43.383 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:43.381+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:43.484 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:43.481+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:43.501 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:43.501 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:43.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:59:43.584 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:43.581+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:43.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:59:43.636 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:43.636 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:43.651 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:59:43.699 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:43.697+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:43.758 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T05:59:43.769 INFO:teuthology.orchestra.run.smithi006.stdout:1988 writesame 0x82b3697 thru 0x82bc069 data_size 0x13(0x89d3 bytes) 2024-09-14T05:59:43.776 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T05:59:43.776 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:59:43.783 INFO:teuthology.orchestra.run.smithi006.stdout:1993 read 0x8d5df32 thru 0x8d63ef5 (0x5fc4 bytes) 2024-09-14T05:59:43.784 INFO:teuthology.orchestra.run.smithi006.stdout:1994 read 0x8af0d82 thru 0x8afdd9b (0xd01a bytes) 2024-09-14T05:59:43.785 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:43.781+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:43.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:59:43.790 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T05:59:43.797 INFO:teuthology.orchestra.run.smithi006.stdout:1995 writesame 0xceefb68 thru 0xcef005f data_size 0xc(0x4f8 bytes) 2024-09-14T05:59:43.797 INFO:teuthology.orchestra.run.smithi006.stdout:1996 trunc from 0xcef0060 to 0xcd453b0 2024-09-14T05:59:43.798 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:43.799 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:43.807 INFO:teuthology.orchestra.run.smithi006.stdout:1997 write 0xb786077 thru 0xb7896a4 (0x362e bytes) 2024-09-14T05:59:43.813 INFO:teuthology.orchestra.run.smithi006.stdout:1998 read 0x3aa2151 thru 0x3aa7363 (0x5213 bytes) 2024-09-14T05:59:43.813 INFO:teuthology.orchestra.run.smithi006.stdout:1999 read 0x3a700de thru 0x3a722a1 (0x21c4 bytes) 2024-09-14T05:59:43.813 INFO:teuthology.orchestra.run.smithi006.stdout:2001 read 0x4eb03f9 thru 0x4ebd21a (0xce22 bytes) 2024-09-14T05:59:43.813 INFO:teuthology.orchestra.run.smithi006.stdout:2002 read 0xaac7930 thru 0xaacd1a3 (0x5874 bytes) 2024-09-14T05:59:43.814 INFO:teuthology.orchestra.run.smithi006.stdout:2003 writesame 0x192be32 thru 0x1934613 data_size 0x1(0x87e2 bytes) 2024-09-14T05:59:43.829 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:43.829 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:43.845 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:43.845 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:43.845 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:43.845 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:43.847 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:43.847 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:43.861 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:59:43.868 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:43.869 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:43.889 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:43.889 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:43.889 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:43.885+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:43.910 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:43.911 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:43.931 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:43.993 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:43.993 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:43.993 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:43.993 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:43.993 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:43.994 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:43.989+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:44.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:59:44.086 INFO:teuthology.orchestra.run.smithi006.stdout:2004 writesame 0x7bbe051 thru 0x7bc9589 data_size 0x1(0xb539 bytes) 2024-09-14T05:59:44.088 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:44.089+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:44.115 INFO:teuthology.orchestra.run.smithi006.stdout:2006 write 0x3d6f739 thru 0x3d77bdc (0x84a4 bytes) 2024-09-14T05:59:44.125 INFO:teuthology.orchestra.run.smithi006.stdout:2007 read 0x64d2d83 thru 0x64d8d94 (0x6012 bytes) 2024-09-14T05:59:44.125 INFO:teuthology.orchestra.run.smithi006.stdout:2009 writesame 0x615894c thru 0x615b813 data_size 0xc(0x2ec8 bytes) 2024-09-14T05:59:44.130 INFO:teuthology.orchestra.run.smithi006.stdout:2010 read 0x2b6a816 thru 0x2b754c4 (0xacaf bytes) 2024-09-14T05:59:44.131 INFO:teuthology.orchestra.run.smithi006.stdout:2011 read 0x69bc0dc thru 0x69c89c3 (0xc8e8 bytes) 2024-09-14T05:59:44.132 INFO:teuthology.orchestra.run.smithi006.stdout:2015 read 0x306711f thru 0x306eb12 (0x79f4 bytes) 2024-09-14T05:59:44.133 INFO:teuthology.orchestra.run.smithi006.stdout:2016 write 0x94cafa3 thru 0x94d3ac4 (0x8b22 bytes) 2024-09-14T05:59:44.140 INFO:teuthology.orchestra.run.smithi006.stdout:2017 punch from 0x483d99a to 0x484b7ae, (0xde14 bytes) 2024-09-14T05:59:44.140 INFO:teuthology.orchestra.run.smithi006.stdout:2018 read 0x990e9c7 thru 0x991a284 (0xb8be bytes) 2024-09-14T05:59:44.141 INFO:teuthology.orchestra.run.smithi006.stdout:2023 write 0x2596cae thru 0x259c2cb (0x561e bytes) 2024-09-14T05:59:44.174 INFO:teuthology.orchestra.run.smithi006.stdout:2024 trunc from 0xcd453b0 to 0xd906a1c 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21567 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 993280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.262725259, 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031237369000000001, 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.182 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.183 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21567 2024-09-14T05:59:44.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.183 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:44.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:44.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918112+0000", 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6000000000000004e-07 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918113+0000", 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918118+0000", 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4789999999999998e-06 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918122+0000", 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7740000000000002e-06 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949196+0000", 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031074101 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949239+0000", 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3724999999999999e-05 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949349+0000", 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010916699999999999 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21570 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1001472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.262692546, 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031375860999999998, 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.186 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21570 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0499999999999999e-07 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918146+0000", 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1179999999999999e-06 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918153+0000", 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0299999999999999e-06 2024-09-14T05:59:44.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.189 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.189 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918157+0000", 2024-09-14T05:59:44.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0589999999999996e-06 2024-09-14T05:59:44.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.189 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.189 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949386+0000", 2024-09-14T05:59:44.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031229455999999999 2024-09-14T05:59:44.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.189 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.189 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949448+0000", 2024-09-14T05:59:44.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2291000000000004e-05 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949520+0000", 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1501999999999994e-05 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21574 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1024000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.262673805, 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031511174000000003, 2024-09-14T05:59:44.190 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21574 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8500000000000002e-07 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918165+0000", 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.674e-06 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918169+0000", 2024-09-14T05:59:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5709999999999999e-06 2024-09-14T05:59:44.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.193 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.193 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918175+0000", 2024-09-14T05:59:44.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:59:44.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.193 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.193 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949555+0000", 2024-09-14T05:59:44.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031380230000000002 2024-09-14T05:59:44.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.193 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.193 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949606+0000", 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0300000000000003e-05 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949674+0000", 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8175000000000004e-05 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21576 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1032192~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.262650497999999, 2024-09-14T05:59:44.194 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031677479000000001, 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21576 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918187+0000", 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7100000000000001e-07 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918189+0000", 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.43e-06 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918198+0000", 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1859999999999998e-06 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918206+0000", 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4939999999999997e-06 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949716+0000", 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031510428 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949789+0000", 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3233999999999997e-05 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949863+0000", 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4035999999999994e-05 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21577 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1046528~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:44.198 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.262619665000001, 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031830166999999999, 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21577 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3499999999999996e-07 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918221+0000", 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3179999999999998e-06 2024-09-14T05:59:44.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918230+0000", 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9460000000000004e-06 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918240+0000", 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9580000000000002e-06 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949896+0000", 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031655839999999998 2024-09-14T05:59:44.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949944+0000", 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8658000000000001e-05 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950047+0000", 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102812 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.202 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21615 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 995328~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.262408667000001, 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031807305000000001, 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21615 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6499999999999999e-07 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918431+0000", 2024-09-14T05:59:44.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.948e-06 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918440+0000", 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9390000000000003e-06 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918448+0000", 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.233e-06 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950088+0000", 2024-09-14T05:59:44.205 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031640922000000002 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950153+0000", 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4500999999999998e-05 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950235+0000", 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2196999999999999e-05 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.206 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21618 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1003520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.262377398, 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031945335999999998, 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21618 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.207 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:44.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:44.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918460+0000", 2024-09-14T05:59:44.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8400000000000002e-07 2024-09-14T05:59:44.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918464+0000", 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4699999999999998e-06 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918473+0000", 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2159999999999995e-06 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918480+0000", 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2540000000000003e-06 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.209 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950268+0000", 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031787955 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950327+0000", 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9289000000000001e-05 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950404+0000", 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7168000000000004e-05 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21620 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1026048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.262336048, 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032089751, 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21620 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918501+0000", 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.46e-07 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918503+0000", 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4940000000000002e-06 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918509+0000", 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0850000000000002e-06 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918514+0000", 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7219999999999999e-06 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950435+0000", 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031921161000000003 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950518+0000", 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2280999999999994e-05 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950590+0000", 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2562000000000001e-05 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21622 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1034240~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.262315783, 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032304393000000001, 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21622 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8299999999999997e-07 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.217 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.217 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918523+0000", 2024-09-14T05:59:44.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7370000000000001e-06 2024-09-14T05:59:44.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.217 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.217 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918528+0000", 2024-09-14T05:59:44.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.87e-06 2024-09-14T05:59:44.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.217 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.217 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918532+0000", 2024-09-14T05:59:44.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8999999999999999e-06 2024-09-14T05:59:44.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950656+0000", 2024-09-14T05:59:44.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032123800000000001 2024-09-14T05:59:44.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950745+0000", 2024-09-14T05:59:44.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9044999999999999e-05 2024-09-14T05:59:44.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950825+0000", 2024-09-14T05:59:44.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0457999999999994e-05 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21668 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 983040~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.262193556, 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032333329000000001, 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.219 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.220 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21668 2024-09-14T05:59:44.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.220 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:44.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:44.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.221 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.221 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:44.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9999999999999998e-07 2024-09-14T05:59:44.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.221 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.221 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918650+0000", 2024-09-14T05:59:44.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0779999999999998e-06 2024-09-14T05:59:44.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.221 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.221 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918656+0000", 2024-09-14T05:59:44.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.536e-06 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918663+0000", 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9480000000000002e-06 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950856+0000", 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032193580999999999 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950908+0000", 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1248999999999997e-05 2024-09-14T05:59:44.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950976+0000", 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8536999999999998e-05 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21671 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 997376~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.26216277, 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032470855999999999, 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.223 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.224 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.224 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.224 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.224 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21671 2024-09-14T05:59:44.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.224 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:44.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918677+0000", 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.565e-06 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918686+0000", 2024-09-14T05:59:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3309999999999993e-06 2024-09-14T05:59:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918694+0000", 2024-09-14T05:59:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6249999999999998e-06 2024-09-14T05:59:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951003+0000", 2024-09-14T05:59:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032308903 2024-09-14T05:59:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951059+0000", 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951145+0000", 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.53e-05 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21673 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1005568~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.262131555, 2024-09-14T05:59:44.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.03260818, 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21673 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918706+0000", 2024-09-14T05:59:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4199999999999995e-07 2024-09-14T05:59:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918715+0000", 2024-09-14T05:59:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7459999999999995e-06 2024-09-14T05:59:44.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918725+0000", 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0077e-05 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918733+0000", 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9610000000000005e-06 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951178+0000", 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032444711000000001 2024-09-14T05:59:44.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951246+0000", 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8256999999999994e-05 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951313+0000", 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6785999999999994e-05 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21674 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1028096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.231 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.262091427, 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032759020999999999, 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21674 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918746+0000", 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6599999999999995e-07 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918749+0000", 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1489999999999998e-06 2024-09-14T05:59:44.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918758+0000", 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2779999999999999e-06 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918771+0000", 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2799999999999999e-05 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951346+0000", 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032574573000000002 2024-09-14T05:59:44.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951426+0000", 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0486000000000002e-05 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951504+0000", 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7968999999999998e-05 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.235 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21676 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1036288~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.262053869000001, 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032901069999999998, 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21676 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.236 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2600000000000002e-07 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.237 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918787+0000", 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2430000000000001e-06 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918796+0000", 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5910000000000002e-06 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918804+0000", 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4050000000000003e-06 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.238 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951539+0000", 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032735383999999999 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951611+0000", 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1675999999999996e-05 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951684+0000", 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3045000000000003e-05 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21723 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 985088~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.261851752, 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032913915000000002, 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21723 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0499999999999999e-07 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.241 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.242 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918987+0000", 2024-09-14T05:59:44.242 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.883e-06 2024-09-14T05:59:44.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.242 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.242 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918992+0000", 2024-09-14T05:59:44.242 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8550000000000001e-06 2024-09-14T05:59:44.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.242 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.242 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918996+0000", 2024-09-14T05:59:44.242 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8800000000000001e-06 2024-09-14T05:59:44.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951712+0000", 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032715883000000001 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951784+0000", 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2484999999999995e-05 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951899+0000", 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000114524 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.243 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21725 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1007616~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.261833739, 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033063000000000002, 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21725 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.244 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3099999999999999e-07 2024-09-14T05:59:44.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919013+0000", 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0222e-05 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919019+0000", 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5520000000000004e-06 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919023+0000", 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0779999999999997e-06 2024-09-14T05:59:44.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951932+0000", 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032908958000000002 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952000+0000", 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8435000000000005e-05 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952066+0000", 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5424000000000002e-05 2024-09-14T05:59:44.247 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.248 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.248 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.248 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21726 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1015808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.248 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:44.248 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.261807216999999, 2024-09-14T05:59:44.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033223673000000002, 2024-09-14T05:59:44.248 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.248 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.248 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.248 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.248 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21726 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.249 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919030+0000", 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9000000000000002e-07 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919031+0000", 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7060000000000001e-06 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919036+0000", 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7439999999999998e-06 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919040+0000", 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9559999999999999e-06 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952093+0000", 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033053355 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952151+0000", 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7352999999999998e-05 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952253+0000", 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102169 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21727 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1030144~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.261791217000001, 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033447573000000001, 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.252 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21727 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919046+0000", 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.53e-07 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919049+0000", 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5130000000000001e-06 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919055+0000", 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3280000000000002e-06 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.254 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919059+0000", 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9820000000000002e-06 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952280+0000", 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033220999000000001 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952358+0000", 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7941999999999993e-05 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952493+0000", 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000134456 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21729 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1038336~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.261771692, 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033604367000000003, 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.256 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.257 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.257 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21729 2024-09-14T05:59:44.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.257 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:44.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:44.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1200000000000003e-07 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919089+0000", 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.332e-05 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919096+0000", 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5109999999999997e-06 2024-09-14T05:59:44.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919101+0000", 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8239999999999999e-06 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952524+0000", 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033422466999999997 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952599+0000", 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5074999999999995e-05 2024-09-14T05:59:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952669+0000", 2024-09-14T05:59:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0557999999999998e-05 2024-09-14T05:59:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:28643 3.19 3:9c53e3bd:::rbd_data.11276864ec6c.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-14T05:59:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.5611608439999998, 2024-09-14T05:59:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033793691000000001, 2024-09-14T05:59:44.260 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 28643 2024-09-14T05:59:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619677+0000", 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.717e-06 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619683+0000", 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5300000000000004e-06 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619695+0000", 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2211e-05 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619701+0000", 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9429999999999997e-06 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619754+0000", 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2899000000000003e-05 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619809+0000", 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4783e-05 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 3", 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.625771+0000", 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0059617960000000001 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653329+0000", 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.027558068000000002 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:44.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653351+0000", 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2133e-05 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653409+0000", 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8687999999999998e-05 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653469+0000", 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9923000000000002e-05 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.265 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.266 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.266 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:44.266 INFO:teuthology.orchestra.run.smithi006.stdout:2025 write 0x51d06ef thru 0x51d6f6b (0x687d bytes) 2024-09-14T05:59:44.267 INFO:teuthology.orchestra.run.smithi006.stdout:2026 read 0xe3b0d7 thru 0xe44f7b (0x9ea5 bytes) 2024-09-14T05:59:44.267 INFO:teuthology.orchestra.run.smithi006.stdout:2027 write 0x679b177 thru 0x67a00d5 (0x4f5f bytes) 2024-09-14T05:59:44.267 INFO:teuthology.orchestra.run.smithi006.stdout:2028 writesame 0xa7684d2 thru 0xa76cebb data_size 0x1(0x49ea bytes) 2024-09-14T05:59:44.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:59:44.268 INFO:teuthology.orchestra.run.smithi006.stdout:2029 write 0x2e1f50b thru 0x2e25a0e (0x6504 bytes) 2024-09-14T05:59:44.268 INFO:teuthology.orchestra.run.smithi006.stdout:2031 writesame 0x8c9ee69 thru 0x8cadb55 data_size 0x1(0xeced bytes) 2024-09-14T05:59:44.268 INFO:teuthology.orchestra.run.smithi006.stdout:2032 punch from 0x92a64f4 to 0x92a99bb, (0x34c7 bytes) 2024-09-14T05:59:44.268 INFO:teuthology.orchestra.run.smithi006.stdout:2033 punch from 0x7bb6e0d to 0x7bbfaa0, (0x8c93 bytes) 2024-09-14T05:59:44.268 INFO:teuthology.orchestra.run.smithi006.stdout:2034 write 0x186734d thru 0x1870dc0 (0x9a74 bytes) 2024-09-14T05:59:44.269 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:44.265+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:44.300 INFO:teuthology.orchestra.run.smithi006.stdout:2035 write 0xd45673b thru 0xd45bf04 (0x57ca bytes) 2024-09-14T05:59:44.306 INFO:teuthology.orchestra.run.smithi006.stdout:2036 read 0x37e4776 thru 0x37eca62 (0x82ed bytes) 2024-09-14T05:59:44.307 INFO:teuthology.orchestra.run.smithi006.stdout:2037 write 0x44a919e thru 0x44b328b (0xa0ee bytes) 2024-09-14T05:59:44.328 INFO:teuthology.orchestra.run.smithi006.stdout:2038 trunc from 0xd906a1c to 0x2df0d34 2024-09-14T05:59:44.367 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:44.365+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:44.370 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:44.383 INFO:teuthology.orchestra.run.smithi006.stdout:2040 writesame 0x61a25ee thru 0x61af939 data_size 0x2(0xd34c bytes) 2024-09-14T05:59:44.402 INFO:teuthology.orchestra.run.smithi006.stdout:2041 writesame 0xda4c6cb thru 0xda52525 data_size 0x1(0x5e5b bytes) 2024-09-14T05:59:44.402 INFO:teuthology.orchestra.run.smithi006.stdout:2042 punch from 0x43b1a2e to 0x43bd86a, (0xbe3c bytes) 2024-09-14T05:59:44.402 INFO:teuthology.orchestra.run.smithi006.stdout:2043 write 0xbadc755 thru 0xbaded4a (0x25f6 bytes) 2024-09-14T05:59:44.407 INFO:teuthology.orchestra.run.smithi006.stdout:2045 read 0x5de046d thru 0x5de76fa (0x728e bytes) 2024-09-14T05:59:44.407 INFO:teuthology.orchestra.run.smithi006.stdout:2048 write 0x507d485 thru 0x507da43 (0x5bf bytes) 2024-09-14T05:59:44.413 INFO:teuthology.orchestra.run.smithi006.stdout:2050 write 0x46b03e2 thru 0x46b8e45 (0x8a64 bytes) 2024-09-14T05:59:44.432 INFO:teuthology.orchestra.run.smithi006.stdout:2052 trunc from 0xda52526 to 0x563431b 2024-09-14T05:59:44.437 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:44.437 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:44.437 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:44.437 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:44.453 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:59:44.457 INFO:teuthology.orchestra.run.smithi006.stdout:2053 writesame 0x3ea722b thru 0x3eab1b1 data_size 0xd(0x3f87 bytes) 2024-09-14T05:59:44.468 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:44.469+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:44.475 INFO:teuthology.orchestra.run.smithi006.stdout:2054 writesame 0x880124f thru 0x88087b7 data_size 0x2b(0x7569 bytes) 2024-09-14T05:59:44.486 INFO:teuthology.orchestra.run.smithi006.stdout:2055 trunc from 0x88087b8 to 0x1217cce 2024-09-14T05:59:44.569 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:44.565+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:44.586 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:44.586 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:44.586 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:44.586 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:44.586 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:44.601 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:59:44.670 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:44.669+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:44.703 INFO:teuthology.orchestra.run.smithi006.stdout:2056 trunc from 0x1217cce to 0x7a5150d 2024-09-14T05:59:44.713 INFO:teuthology.orchestra.run.smithi006.stdout:2058 read 0x56e9a9a thru 0x56f65b7 (0xcb1e bytes) 2024-09-14T05:59:44.728 INFO:teuthology.orchestra.run.smithi006.stdout:2059 writesame 0xbea6c61 thru 0xbea7f4b data_size 0x1(0x12eb bytes) 2024-09-14T05:59:44.741 INFO:teuthology.orchestra.run.smithi006.stdout:2060 write 0xe28c1dc thru 0xe296214 (0xa039 bytes) 2024-09-14T05:59:44.750 INFO:teuthology.orchestra.run.smithi006.stdout:2061 punch from 0xd13ad96 to 0xd13c3ab, (0x1615 bytes) 2024-09-14T05:59:44.750 INFO:teuthology.orchestra.run.smithi006.stdout:2063 writesame 0x4cc3229 thru 0x4ccafce data_size 0x9(0x7da6 bytes) 2024-09-14T05:59:44.759 INFO:teuthology.orchestra.run.smithi006.stdout:2065 write 0xb68ae23 thru 0xb696344 (0xb522 bytes) 2024-09-14T05:59:44.771 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:44.769+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:44.771 INFO:teuthology.orchestra.run.smithi006.stdout:2067 read 0xd3aee43 thru 0xd3bd1c5 (0xe383 bytes) 2024-09-14T05:59:44.771 INFO:teuthology.orchestra.run.smithi006.stdout:2071 punch from 0x38768fc to 0x3883e09, (0xd50d bytes) 2024-09-14T05:59:44.784 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T05:59:44.784 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:44.784 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:44.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:44.785 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:44.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.785 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:858 3.0 e29/24 3:00d51ce4:::rbd_data.11275e589b0d.0000000000000009:head v 29'2, mlcod=0'0)", 2024-09-14T05:59:44.785 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:44.785 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 31.105669251999998, 2024-09-14T05:59:44.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003436171, 2024-09-14T05:59:44.785 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.785 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.785 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.785 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674558+0000", 2024-09-14T05:59:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674560+0000", 2024-09-14T05:59:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.638e-06 2024-09-14T05:59:44.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674570+0000", 2024-09-14T05:59:44.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9890000000000004e-06 2024-09-14T05:59:44.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674594+0000", 2024-09-14T05:59:44.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4049e-05 2024-09-14T05:59:44.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674604+0000", 2024-09-14T05:59:44.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0165e-05 2024-09-14T05:59:44.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.788 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674720+0000", 2024-09-14T05:59:44.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000115993 2024-09-14T05:59:44.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.788 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.674746+0000", 2024-09-14T05:59:44.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5984000000000001e-05 2024-09-14T05:59:44.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.789 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.677932+0000", 2024-09-14T05:59:44.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031863669999999998 2024-09-14T05:59:44.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.789 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:13.677994+0000", 2024-09-14T05:59:44.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1985999999999999e-05 2024-09-14T05:59:44.789 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.789 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.789 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.789 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3625 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'27, mlcod=31'25)", 2024-09-14T05:59:44.790 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.325533+0000", 2024-09-14T05:59:44.790 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.454694645, 2024-09-14T05:59:44.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035513340000000002, 2024-09-14T05:59:44.790 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.790 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.790 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.790 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.790 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.790 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325533+0000", 2024-09-14T05:59:44.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325533+0000", 2024-09-14T05:59:44.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325534+0000", 2024-09-14T05:59:44.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.02e-06 2024-09-14T05:59:44.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325542+0000", 2024-09-14T05:59:44.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0339999999999997e-06 2024-09-14T05:59:44.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325560+0000", 2024-09-14T05:59:44.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8403e-05 2024-09-14T05:59:44.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325570+0000", 2024-09-14T05:59:44.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9010000000000006e-06 2024-09-14T05:59:44.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325639+0000", 2024-09-14T05:59:44.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8610999999999998e-05 2024-09-14T05:59:44.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.325661+0000", 2024-09-14T05:59:44.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1848000000000002e-05 2024-09-14T05:59:44.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329045+0000", 2024-09-14T05:59:44.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0033840400000000001 2024-09-14T05:59:44.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.794 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.794 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329084+0000", 2024-09-14T05:59:44.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9477000000000002e-05 2024-09-14T05:59:44.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.794 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.794 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3628 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'30, mlcod=31'25)", 2024-09-14T05:59:44.794 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.328532+0000", 2024-09-14T05:59:44.794 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.451695650000001, 2024-09-14T05:59:44.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037713170000000002, 2024-09-14T05:59:44.794 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328532+0000", 2024-09-14T05:59:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328532+0000", 2024-09-14T05:59:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328533+0000", 2024-09-14T05:59:44.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8999999999999995e-07 2024-09-14T05:59:44.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328539+0000", 2024-09-14T05:59:44.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.913e-06 2024-09-14T05:59:44.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328551+0000", 2024-09-14T05:59:44.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2782999999999999e-05 2024-09-14T05:59:44.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.797 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328560+0000", 2024-09-14T05:59:44.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9400000000000008e-06 2024-09-14T05:59:44.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.797 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328620+0000", 2024-09-14T05:59:44.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9360000000000001e-05 2024-09-14T05:59:44.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.797 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.328642+0000", 2024-09-14T05:59:44.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1891000000000001e-05 2024-09-14T05:59:44.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.798 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332262+0000", 2024-09-14T05:59:44.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0036202909999999999 2024-09-14T05:59:44.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.798 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332303+0000", 2024-09-14T05:59:44.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1349e-05 2024-09-14T05:59:44.799 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.799 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.799 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.799 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3629 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'31, mlcod=31'25)", 2024-09-14T05:59:44.799 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:44.799 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.450745589, 2024-09-14T05:59:44.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048071900000000002, 2024-09-14T05:59:44.799 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.799 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.799 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.799 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:44.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:44.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329483+0000", 2024-09-14T05:59:44.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-07 2024-09-14T05:59:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329488+0000", 2024-09-14T05:59:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000004e-06 2024-09-14T05:59:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329496+0000", 2024-09-14T05:59:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2209999999999997e-06 2024-09-14T05:59:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329501+0000", 2024-09-14T05:59:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8729999999999998e-06 2024-09-14T05:59:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329545+0000", 2024-09-14T05:59:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4382999999999998e-05 2024-09-14T05:59:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329564+0000", 2024-09-14T05:59:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8947999999999999e-05 2024-09-14T05:59:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334225+0000", 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004660923 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334289+0000", 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4041999999999994e-05 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3630 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'32, mlcod=31'25)", 2024-09-14T05:59:44.803 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:44.804 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.449997583999998, 2024-09-14T05:59:44.804 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0040991680000000003, 2024-09-14T05:59:44.804 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.804 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.804 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.804 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.804 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.804 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:44.804 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.804 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.804 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:44.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330231+0000", 2024-09-14T05:59:44.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4099999999999998e-07 2024-09-14T05:59:44.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330235+0000", 2024-09-14T05:59:44.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.391e-06 2024-09-14T05:59:44.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.806 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330245+0000", 2024-09-14T05:59:44.806 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:59:44.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.806 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.806 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330249+0000", 2024-09-14T05:59:44.806 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T05:59:44.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.806 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.806 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330301+0000", 2024-09-14T05:59:44.806 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1515999999999999e-05 2024-09-14T05:59:44.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.807 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.807 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330312+0000", 2024-09-14T05:59:44.807 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1603000000000001e-05 2024-09-14T05:59:44.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.807 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.807 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334293+0000", 2024-09-14T05:59:44.807 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039809449999999996 2024-09-14T05:59:44.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.807 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.807 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334329+0000", 2024-09-14T05:59:44.807 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5763000000000003e-05 2024-09-14T05:59:44.808 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.808 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.808 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.808 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3631 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'33, mlcod=31'27)", 2024-09-14T05:59:44.808 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:44.808 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.448841788999999, 2024-09-14T05:59:44.808 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035882079999999998, 2024-09-14T05:59:44.808 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.808 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.808 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.808 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.809 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:44.809 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.809 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:44.809 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.809 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331386+0000", 2024-09-14T05:59:44.809 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3300000000000001e-07 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331392+0000", 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7880000000000003e-06 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331403+0000", 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0703000000000001e-05 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331420+0000", 2024-09-14T05:59:44.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6959000000000001e-05 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331466+0000", 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5867e-05 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.331486+0000", 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0511000000000001e-05 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334926+0000", 2024-09-14T05:59:44.811 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0034397490000000002 2024-09-14T05:59:44.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.812 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.812 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334974+0000", 2024-09-14T05:59:44.812 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7898000000000001e-05 2024-09-14T05:59:44.812 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.812 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.812 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.812 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3632 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'34, mlcod=31'27)", 2024-09-14T05:59:44.812 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:44.812 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.447623401000001, 2024-09-14T05:59:44.812 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047983469999999997, 2024-09-14T05:59:44.813 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.813 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.813 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.813 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.813 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.813 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:44.813 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.813 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.813 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:44.813 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332605+0000", 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5099999999999999e-07 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332611+0000", 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6999999999999996e-06 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332623+0000", 2024-09-14T05:59:44.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2401e-05 2024-09-14T05:59:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332629+0000", 2024-09-14T05:59:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3720000000000001e-06 2024-09-14T05:59:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332691+0000", 2024-09-14T05:59:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1451000000000005e-05 2024-09-14T05:59:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332711+0000", 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0285e-05 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337341+0000", 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046295900000000003 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337402+0000", 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1797000000000005e-05 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3633 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'35, mlcod=31'27)", 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.446761956, 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039783919999999999, 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1500000000000004e-07 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333479+0000", 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2918999999999999e-05 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333489+0000", 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0068000000000001e-05 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333494+0000", 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9309999999999999e-06 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333543+0000", 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9293999999999999e-05 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.820 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.820 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333555+0000", 2024-09-14T05:59:44.820 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1467e-05 2024-09-14T05:59:44.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.820 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.820 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337408+0000", 2024-09-14T05:59:44.820 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038532549999999999 2024-09-14T05:59:44.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.820 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.820 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337444+0000", 2024-09-14T05:59:44.820 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5843000000000002e-05 2024-09-14T05:59:44.820 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.821 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.821 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.821 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3638 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'40, mlcod=31'32)", 2024-09-14T05:59:44.821 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:44.821 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.441481486000001, 2024-09-14T05:59:44.821 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004283345, 2024-09-14T05:59:44.821 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.821 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.821 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.821 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.821 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338747+0000", 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0279999999999999e-06 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.822 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338756+0000", 2024-09-14T05:59:44.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5909999999999996e-06 2024-09-14T05:59:44.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.823 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338774+0000", 2024-09-14T05:59:44.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8073000000000001e-05 2024-09-14T05:59:44.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.823 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338785+0000", 2024-09-14T05:59:44.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1017e-05 2024-09-14T05:59:44.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338844+0000", 2024-09-14T05:59:44.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9292000000000001e-05 2024-09-14T05:59:44.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.824 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338864+0000", 2024-09-14T05:59:44.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9528999999999999e-05 2024-09-14T05:59:44.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.824 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.342984+0000", 2024-09-14T05:59:44.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041207809999999996 2024-09-14T05:59:44.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.343029+0000", 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5034000000000003e-05 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:11218 3.9 e38/24 3:967d83c0:::rbd_data.1127ff8b71e0.0000000000000064:head v 38'37, mlcod=38'35)", 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.535375373000001, 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004035416, 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.825 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.826 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.826 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.826 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.826 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:44.826 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.826 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.826 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:44.826 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.826 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244854+0000", 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2350000000000002e-06 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246114+0000", 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012600980000000001 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246158+0000", 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3473000000000002e-05 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.827 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246179+0000", 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0738999999999999e-05 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246306+0000", 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000127238 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246349+0000", 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3211999999999999e-05 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.828 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.829 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248780+0000", 2024-09-14T05:59:44.829 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0024304970000000002 2024-09-14T05:59:44.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.829 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.829 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.829 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248888+0000", 2024-09-14T05:59:44.829 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010792400000000001 2024-09-14T05:59:44.829 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.829 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.829 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.829 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.829 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:11892 3.4 e39/24 3:27ace2d5:::rbd_data.1127ff8b71e0.0000000000000000:head v 39'72, mlcod=38'70)", 2024-09-14T05:59:44.830 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.706452+0000", 2024-09-14T05:59:44.830 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.073775417, 2024-09-14T05:59:44.830 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003757636, 2024-09-14T05:59:44.830 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.830 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.830 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.830 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.830 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.830 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.706452+0000", 2024-09-14T05:59:44.831 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.831 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.831 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.706452+0000", 2024-09-14T05:59:44.831 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.831 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.831 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.706454+0000", 2024-09-14T05:59:44.831 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.857e-06 2024-09-14T05:59:44.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.832 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.832 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707127+0000", 2024-09-14T05:59:44.832 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00067296299999999995 2024-09-14T05:59:44.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.832 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.832 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.832 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707151+0000", 2024-09-14T05:59:44.832 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3643999999999999e-05 2024-09-14T05:59:44.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.832 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.832 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.832 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707161+0000", 2024-09-14T05:59:44.832 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.064e-05 2024-09-14T05:59:44.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.833 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.833 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707264+0000", 2024-09-14T05:59:44.833 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102586 2024-09-14T05:59:44.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.833 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.833 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.707300+0000", 2024-09-14T05:59:44.833 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5951000000000002e-05 2024-09-14T05:59:44.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.834 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.834 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.710137+0000", 2024-09-14T05:59:44.834 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002837184 2024-09-14T05:59:44.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.834 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.834 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.834 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.710210+0000", 2024-09-14T05:59:44.834 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2811000000000005e-05 2024-09-14T05:59:44.834 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.834 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.834 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.834 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.834 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:17596 3.4 e41/24 3:27f62511:::rbd_data.1127d65075f9.00000000000000ca:head v 41'97, mlcod=41'95)", 2024-09-14T05:59:44.835 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:44.835 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.809728922, 2024-09-14T05:59:44.835 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049456559999999997, 2024-09-14T05:59:44.835 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.835 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.835 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.835 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.835 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.835 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.835 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:44.835 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.836 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.836 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.836 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:44.836 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.836 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.836 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.836 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970500+0000", 2024-09-14T05:59:44.836 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9600000000000008e-07 2024-09-14T05:59:44.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.837 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.837 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970614+0000", 2024-09-14T05:59:44.837 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000113956 2024-09-14T05:59:44.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.837 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.837 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970631+0000", 2024-09-14T05:59:44.837 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7150999999999999e-05 2024-09-14T05:59:44.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.838 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.838 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970643+0000", 2024-09-14T05:59:44.838 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1868999999999999e-05 2024-09-14T05:59:44.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.838 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.838 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.838 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970711+0000", 2024-09-14T05:59:44.838 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8952e-05 2024-09-14T05:59:44.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.838 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.838 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.838 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970738+0000", 2024-09-14T05:59:44.838 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6055999999999999e-05 2024-09-14T05:59:44.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.839 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.839 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975388+0000", 2024-09-14T05:59:44.839 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046502499999999999 2024-09-14T05:59:44.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.839 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.839 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975444+0000", 2024-09-14T05:59:44.839 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6425999999999998e-05 2024-09-14T05:59:44.839 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.839 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.839 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.840 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24289 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'57, mlcod=41'54)", 2024-09-14T05:59:44.840 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:44.840 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 12.624436743, 2024-09-14T05:59:44.840 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.060867738999999997, 2024-09-14T05:59:44.840 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.840 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.840 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.840 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.840 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.840 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:44.840 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.841 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.841 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:44.841 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.841 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.841 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155793+0000", 2024-09-14T05:59:44.841 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9470000000000002e-06 2024-09-14T05:59:44.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.841 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.841 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181776+0000", 2024-09-14T05:59:44.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.02598313 2024-09-14T05:59:44.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.842 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.842 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181817+0000", 2024-09-14T05:59:44.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1440000000000003e-05 2024-09-14T05:59:44.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.842 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.842 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181834+0000", 2024-09-14T05:59:44.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6979000000000001e-05 2024-09-14T05:59:44.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.843 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.843 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181931+0000", 2024-09-14T05:59:44.843 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7219999999999994e-05 2024-09-14T05:59:44.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.843 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.843 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181964+0000", 2024-09-14T05:59:44.843 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2094999999999997e-05 2024-09-14T05:59:44.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.843 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.843 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216586+0000", 2024-09-14T05:59:44.844 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034622503999999998 2024-09-14T05:59:44.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.844 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.844 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216658+0000", 2024-09-14T05:59:44.844 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:59:44.844 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.844 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.844 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.844 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24309 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'58, mlcod=41'56)", 2024-09-14T05:59:44.844 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:44.845 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 12.525201638, 2024-09-14T05:59:44.845 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044435519999999999, 2024-09-14T05:59:44.845 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.845 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.845 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.845 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.845 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.845 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.845 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:44.846 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.846 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.846 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:44.846 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.846 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.846 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255027+0000", 2024-09-14T05:59:44.846 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T05:59:44.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.847 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.847 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255040+0000", 2024-09-14T05:59:44.847 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2773e-05 2024-09-14T05:59:44.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.847 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.847 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255066+0000", 2024-09-14T05:59:44.847 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5459000000000001e-05 2024-09-14T05:59:44.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.847 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.847 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255076+0000", 2024-09-14T05:59:44.848 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0372e-05 2024-09-14T05:59:44.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.848 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.848 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255151+0000", 2024-09-14T05:59:44.848 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5444999999999993e-05 2024-09-14T05:59:44.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.848 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.848 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255176+0000", 2024-09-14T05:59:44.848 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5089e-05 2024-09-14T05:59:44.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.849 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259379+0000", 2024-09-14T05:59:44.849 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042025439999999999 2024-09-14T05:59:44.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.849 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259469+0000", 2024-09-14T05:59:44.849 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0407000000000004e-05 2024-09-14T05:59:44.849 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.849 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.849 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.849 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37361 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'280, mlcod=50'278)", 2024-09-14T05:59:44.850 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.041186+0000", 2024-09-14T05:59:44.850 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.73904137999999997, 2024-09-14T05:59:44.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075534590000000002, 2024-09-14T05:59:44.850 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.850 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.850 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.850 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.850 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.850 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T05:59:44.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.851 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T05:59:44.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.851 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041187+0000", 2024-09-14T05:59:44.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2160000000000001e-06 2024-09-14T05:59:44.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.851 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041208+0000", 2024-09-14T05:59:44.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0528999999999999e-05 2024-09-14T05:59:44.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.852 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.852 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041225+0000", 2024-09-14T05:59:44.852 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7255e-05 2024-09-14T05:59:44.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.852 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.852 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041235+0000", 2024-09-14T05:59:44.852 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4190000000000008e-06 2024-09-14T05:59:44.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.852 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.852 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041302+0000", 2024-09-14T05:59:44.852 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7774000000000005e-05 2024-09-14T05:59:44.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.853 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.853 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041330+0000", 2024-09-14T05:59:44.853 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7382999999999999e-05 2024-09-14T05:59:44.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.853 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.853 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048686+0000", 2024-09-14T05:59:44.853 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073564570000000003 2024-09-14T05:59:44.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.853 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.853 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048740+0000", 2024-09-14T05:59:44.854 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3426e-05 2024-09-14T05:59:44.854 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.854 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.854 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.854 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37362 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'281, mlcod=50'278)", 2024-09-14T05:59:44.854 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.046086+0000", 2024-09-14T05:59:44.854 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.73414098100000003, 2024-09-14T05:59:44.854 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047169380000000004, 2024-09-14T05:59:44.854 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.854 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.854 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.855 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T05:59:44.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T05:59:44.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046087+0000", 2024-09-14T05:59:44.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3600000000000003e-07 2024-09-14T05:59:44.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046093+0000", 2024-09-14T05:59:44.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7869999999999998e-06 2024-09-14T05:59:44.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046106+0000", 2024-09-14T05:59:44.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2636999999999999e-05 2024-09-14T05:59:44.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.857 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.857 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046113+0000", 2024-09-14T05:59:44.857 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0129999999999996e-06 2024-09-14T05:59:44.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.857 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.857 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046170+0000", 2024-09-14T05:59:44.857 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7819000000000003e-05 2024-09-14T05:59:44.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.857 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.858 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046194+0000", 2024-09-14T05:59:44.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3167999999999999e-05 2024-09-14T05:59:44.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.858 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.858 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050760+0000", 2024-09-14T05:59:44.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045665999999999997 2024-09-14T05:59:44.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.858 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.858 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050803+0000", 2024-09-14T05:59:44.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3177999999999999e-05 2024-09-14T05:59:44.859 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.859 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.859 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.859 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37949 3.0 e50/24 3:076937fd:::rbd_data.112781171282.000000000000000b:head v 50'307, mlcod=50'305)", 2024-09-14T05:59:44.859 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.267282+0000", 2024-09-14T05:59:44.859 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.51294520700000001, 2024-09-14T05:59:44.859 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037564180000000001, 2024-09-14T05:59:44.859 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.859 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.859 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.859 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.267282+0000", 2024-09-14T05:59:44.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.267282+0000", 2024-09-14T05:59:44.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.267283+0000", 2024-09-14T05:59:44.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:59:44.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.861 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.268018+0000", 2024-09-14T05:59:44.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00073487599999999998 2024-09-14T05:59:44.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.861 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.268031+0000", 2024-09-14T05:59:44.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3259e-05 2024-09-14T05:59:44.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.862 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.862 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.268038+0000", 2024-09-14T05:59:44.862 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.387e-06 2024-09-14T05:59:44.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.862 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.862 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.268087+0000", 2024-09-14T05:59:44.862 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9574999999999999e-05 2024-09-14T05:59:44.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.862 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.862 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.268111+0000", 2024-09-14T05:59:44.862 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3578e-05 2024-09-14T05:59:44.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.863 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.863 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.270973+0000", 2024-09-14T05:59:44.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002862477 2024-09-14T05:59:44.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.863 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.863 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.271039+0000", 2024-09-14T05:59:44.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5417000000000001e-05 2024-09-14T05:59:44.863 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.863 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.863 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.864 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39545 3.0 e50/24 3:06bdaf45:::rbd_data.112781171282.0000000000000002:head v 50'347, mlcod=50'345)", 2024-09-14T05:59:44.864 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.578467+0000", 2024-09-14T05:59:44.864 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.20176069899999999, 2024-09-14T05:59:44.864 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047008700000000002, 2024-09-14T05:59:44.864 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.864 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.864 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.864 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.864 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T05:59:44.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.865 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T05:59:44.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.865 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578468+0000", 2024-09-14T05:59:44.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1599999999999999e-06 2024-09-14T05:59:44.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579733+0000", 2024-09-14T05:59:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012647120000000001 2024-09-14T05:59:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579755+0000", 2024-09-14T05:59:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2637999999999999e-05 2024-09-14T05:59:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579766+0000", 2024-09-14T05:59:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0264e-05 2024-09-14T05:59:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579832+0000", 2024-09-14T05:59:44.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6531000000000004e-05 2024-09-14T05:59:44.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579859+0000", 2024-09-14T05:59:44.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6855999999999998e-05 2024-09-14T05:59:44.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583098+0000", 2024-09-14T05:59:44.868 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003238632 2024-09-14T05:59:44.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.868 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.868 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583168+0000", 2024-09-14T05:59:44.868 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0077e-05 2024-09-14T05:59:44.868 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.868 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.868 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.868 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39559 3.0 e50/24 3:01f5ba6d:::rbd_data.112781171282.0000000000000009:head v 50'355, mlcod=50'353)", 2024-09-14T05:59:44.868 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.674349+0000", 2024-09-14T05:59:44.869 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.10587853999999999, 2024-09-14T05:59:44.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0036547760000000002, 2024-09-14T05:59:44.869 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.869 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.869 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.869 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.869 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.674349+0000", 2024-09-14T05:59:44.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.674349+0000", 2024-09-14T05:59:44.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.674350+0000", 2024-09-14T05:59:44.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3399999999999997e-07 2024-09-14T05:59:44.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.675136+0000", 2024-09-14T05:59:44.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00078583400000000001 2024-09-14T05:59:44.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.871 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.871 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.675157+0000", 2024-09-14T05:59:44.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1602000000000001e-05 2024-09-14T05:59:44.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.871 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.871 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.675167+0000", 2024-09-14T05:59:44.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6709999999999994e-06 2024-09-14T05:59:44.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.675233+0000", 2024-09-14T05:59:44.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6284000000000004e-05 2024-09-14T05:59:44.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.675267+0000", 2024-09-14T05:59:44.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3553999999999998e-05 2024-09-14T05:59:44.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.677949+0000", 2024-09-14T05:59:44.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0026821470000000002 2024-09-14T05:59:44.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.873 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.873 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.678004+0000", 2024-09-14T05:59:44.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4750000000000003e-05 2024-09-14T05:59:44.873 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.873 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.873 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.873 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39602 3.9 e50/24 3:909cb01b:::rbd_data.112781171282.000000000000006f:head v 50'86, mlcod=50'84)", 2024-09-14T05:59:44.873 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.746165+0000", 2024-09-14T05:59:44.873 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.034062729, 2024-09-14T05:59:44.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041492480000000003, 2024-09-14T05:59:44.873 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:44.874 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:44.874 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:44.874 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:44.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.874 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:44.874 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746165+0000", 2024-09-14T05:59:44.874 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.874 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:44.874 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746165+0000", 2024-09-14T05:59:44.874 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:44.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:44.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746166+0000", 2024-09-14T05:59:44.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3600000000000002e-07 2024-09-14T05:59:44.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:44.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746287+0000", 2024-09-14T05:59:44.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000120927 2024-09-14T05:59:44.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:44.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746297+0000", 2024-09-14T05:59:44.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0395e-05 2024-09-14T05:59:44.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:44.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746302+0000", 2024-09-14T05:59:44.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2379999999999997e-06 2024-09-14T05:59:44.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:44.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746362+0000", 2024-09-14T05:59:44.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9765999999999997e-05 2024-09-14T05:59:44.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:44.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746385+0000", 2024-09-14T05:59:44.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3357999999999999e-05 2024-09-14T05:59:44.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:44.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.750213+0000", 2024-09-14T05:59:44.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038276019999999998 2024-09-14T05:59:44.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:44.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:44.878 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:44.878 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.750314+0000", 2024-09-14T05:59:44.878 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010112599999999999 2024-09-14T05:59:44.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.878 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:44.878 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:44.878 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:44.879 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2024-09-14T05:59:44.879 INFO:teuthology.orchestra.run.smithi006.stdout:2072 writesame 0xe882d07 thru 0xe88c46f data_size 0x1(0x9769 bytes) 2024-09-14T05:59:44.880 INFO:teuthology.orchestra.run.smithi006.stdout:2073 punch from 0x19ffe91 to 0x1a0d69b, (0xd80a bytes) 2024-09-14T05:59:44.880 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:44.880 INFO:teuthology.orchestra.run.smithi006.stdout:2076 read 0xd51b2a9 thru 0xd52009c (0x4df4 bytes) 2024-09-14T05:59:44.880 INFO:teuthology.orchestra.run.smithi006.stdout:2077 read 0xca1a85c thru 0xca20abb (0x6260 bytes) 2024-09-14T05:59:44.880 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:44.880 INFO:teuthology.orchestra.run.smithi006.stdout:2079 read 0xa9e418a thru 0xa9f2c2d (0xeaa4 bytes) 2024-09-14T05:59:44.880 INFO:teuthology.orchestra.run.smithi006.stdout:2080 write 0x8ee0e71 thru 0x8ee987e (0x8a0e bytes) 2024-09-14T05:59:44.880 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:44.880 INFO:teuthology.orchestra.run.smithi006.stdout:2082 writesame 0x1993479 thru 0x199ea46 data_size 0x3(0xb5ce bytes) 2024-09-14T05:59:44.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:59:44.883 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T05:59:44.884 INFO:teuthology.orchestra.run.smithi006.stdout:2083 trunc from 0xe88c470 to 0x5ac0ec0 2024-09-14T05:59:44.884 INFO:teuthology.orchestra.run.smithi006.stdout:2084 write 0x5cf9dde thru 0x5d029e2 (0x8c05 bytes) 2024-09-14T05:59:44.884 INFO:teuthology.orchestra.run.smithi006.stdout:2085 write 0x9266cfb thru 0x927674d (0xfa53 bytes) 2024-09-14T05:59:44.884 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:44.881+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:44.906 INFO:teuthology.orchestra.run.smithi006.stdout:2086 write 0xd7d4f50 thru 0xd7e0e1b (0xbecc bytes) 2024-09-14T05:59:44.921 INFO:teuthology.orchestra.run.smithi006.stdout:2088 trunc from 0xd7e0e1c to 0xa00b5df 2024-09-14T05:59:44.938 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:44.939 INFO:teuthology.orchestra.run.smithi006.stdout:2090 read 0x18d63e7 thru 0x18d7805 (0x141f bytes) 2024-09-14T05:59:44.939 INFO:teuthology.orchestra.run.smithi006.stdout:2091 read 0x5b2dedc thru 0x5b327b3 (0x48d8 bytes) 2024-09-14T05:59:44.939 INFO:teuthology.orchestra.run.smithi006.stdout:2092 punch from 0x7765921 to 0x776c179, (0x6858 bytes) 2024-09-14T05:59:44.939 INFO:teuthology.orchestra.run.smithi006.stdout:2093 write 0x193455b thru 0x193701b (0x2ac1 bytes) 2024-09-14T05:59:44.943 INFO:teuthology.orchestra.run.smithi006.stdout:2094 punch from 0x3b6ae94 to 0x3b7a8f3, (0xfa5f bytes) 2024-09-14T05:59:44.943 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:44.943 INFO:teuthology.orchestra.run.smithi006.stdout:2096 read 0x49a5c5d thru 0x49aae69 (0x520d bytes) 2024-09-14T05:59:44.955 INFO:teuthology.orchestra.run.smithi006.stdout:2098 trunc from 0xa00b5df to 0x38efa93 2024-09-14T05:59:44.978 INFO:teuthology.orchestra.run.smithi006.stdout:2099 read 0x2ca52e3 thru 0x2cb2f99 (0xdcb7 bytes) 2024-09-14T05:59:44.984 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:44.981+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:45.000 INFO:teuthology.orchestra.run.smithi006.stdout:2100 write 0x8f7e7f3 thru 0x8f88688 (0x9e96 bytes) 2024-09-14T05:59:45.012 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:45.012 INFO:teuthology.orchestra.run.smithi006.stdout:2104 writesame 0x668d806 thru 0x669694d data_size 0x4(0x9148 bytes) 2024-09-14T05:59:45.023 INFO:teuthology.orchestra.run.smithi006.stdout:2105 read 0x7150402 thru 0x71572dd (0x6edc bytes) 2024-09-14T05:59:45.023 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:45.023 INFO:teuthology.orchestra.run.smithi006.stdout:2109 read 0x2b52ccc thru 0x2b61cf7 (0xf02c bytes) 2024-09-14T05:59:45.023 INFO:teuthology.orchestra.run.smithi006.stdout:2111 write 0x74a269f thru 0x74ad4ae (0xae10 bytes) 2024-09-14T05:59:45.033 INFO:teuthology.orchestra.run.smithi006.stdout:2112 punch from 0x10843d2 to 0x1093c12, (0xf840 bytes) 2024-09-14T05:59:45.046 INFO:teuthology.orchestra.run.smithi006.stdout:2113 writesame 0xa3bcb02 thru 0xa3c7c7c data_size 0x41(0xb17b bytes) 2024-09-14T05:59:45.046 INFO:teuthology.orchestra.run.smithi006.stdout:2114 writesame 0x476c712 thru 0x4771078 data_size 0x17(0x4967 bytes) 2024-09-14T05:59:45.047 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:45.047 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:45.047 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:45.047 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:45.053 INFO:teuthology.orchestra.run.smithi006.stdout:2115 read 0x247a0be thru 0x24881d1 (0xe114 bytes) 2024-09-14T05:59:45.053 INFO:teuthology.orchestra.run.smithi006.stdout:2116 punch from 0x45efd75 to 0x45f7de6, (0x8071 bytes) 2024-09-14T05:59:45.053 INFO:teuthology.orchestra.run.smithi006.stdout:2118 trunc from 0xa3c7c7d to 0xa4ff9ab 2024-09-14T05:59:45.063 INFO:teuthology.orchestra.run.smithi006.stdout:2120 read 0x78c8fb6 thru 0x78c9f10 (0xf5b bytes) 2024-09-14T05:59:45.063 INFO:teuthology.orchestra.run.smithi006.stdout:2121 read 0x87d0e38 thru 0x87de1b8 (0xd381 bytes) 2024-09-14T05:59:45.066 INFO:teuthology.orchestra.run.smithi006.stdout:2123 trunc from 0xa4ff9ab to 0x8d8b202 2024-09-14T05:59:45.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:59:45.079 INFO:teuthology.orchestra.run.smithi006.stdout:2125 punch from 0x6070703 to 0x607a8eb, (0xa1e8 bytes) 2024-09-14T05:59:45.079 INFO:teuthology.orchestra.run.smithi006.stdout:2126 read 0x72dc386 thru 0x72e210f (0x5d8a bytes) 2024-09-14T05:59:45.079 INFO:teuthology.orchestra.run.smithi006.stdout:2127 punch from 0x54d4c3 to 0x55ad49, (0xd886 bytes) 2024-09-14T05:59:45.080 INFO:teuthology.orchestra.run.smithi006.stdout:2128 trunc from 0x8d8b202 to 0x9982003 2024-09-14T05:59:45.085 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:45.085+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:45.107 INFO:teuthology.orchestra.run.smithi006.stdout:2130 write 0xd8178dd thru 0xd8188f8 (0x101c bytes) 2024-09-14T05:59:45.113 INFO:teuthology.orchestra.run.smithi006.stdout:2131 writesame 0x390da76 thru 0x391ccdf data_size 0x3(0xf26a bytes) 2024-09-14T05:59:45.141 INFO:teuthology.orchestra.run.smithi006.stdout:2132 write 0xe878412 thru 0xe88823b (0xfe2a bytes) 2024-09-14T05:59:45.154 INFO:teuthology.orchestra.run.smithi006.stdout:2133 punch from 0x3b126a9 to 0x3b1ac22, (0x8579 bytes) 2024-09-14T05:59:45.154 INFO:teuthology.orchestra.run.smithi006.stdout:2134 read 0x693a834 thru 0x6945584 (0xad51 bytes) 2024-09-14T05:59:45.154 INFO:teuthology.orchestra.run.smithi006.stdout:2135 write 0x8727c44 thru 0x872acd5 (0x3092 bytes) 2024-09-14T05:59:45.159 INFO:teuthology.orchestra.run.smithi006.stdout:2138 punch from 0x180d4c2 to 0x1815972, (0x84b0 bytes) 2024-09-14T05:59:45.159 INFO:teuthology.orchestra.run.smithi006.stdout:2139 read 0x64ff585 thru 0x650bb80 (0xc5fc bytes) 2024-09-14T05:59:45.160 INFO:teuthology.orchestra.run.smithi006.stdout:2140 write 0x8ca14ae thru 0x8cb0427 (0xef7a bytes) 2024-09-14T05:59:45.168 INFO:teuthology.orchestra.run.smithi006.stdout:2141 write 0xcd6ea03 thru 0xcd77378 (0x8976 bytes) 2024-09-14T05:59:45.172 INFO:teuthology.orchestra.run.smithi006.stdout:2142 write 0x524d34a thru 0x5258311 (0xafc8 bytes) 2024-09-14T05:59:45.179 INFO:teuthology.orchestra.run.smithi006.stdout:2143 write 0x76b9893 thru 0x76bcb9b (0x3309 bytes) 2024-09-14T05:59:45.182 INFO:teuthology.orchestra.run.smithi006.stdout:2144 write 0x286d2b8 thru 0x2871407 (0x4150 bytes) 2024-09-14T05:59:45.185 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:45.181+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:45.194 INFO:teuthology.orchestra.run.smithi006.stdout:2145 trunc from 0xe88823c to 0xaaa15f2 2024-09-14T05:59:45.226 INFO:teuthology.orchestra.run.smithi006.stdout:2146 trunc from 0xaaa15f2 to 0x231926e 2024-09-14T05:59:45.227 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:45.227 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:45.227 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:45.227 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:45.227 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:45.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:59:45.256 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:45.274 INFO:teuthology.orchestra.run.smithi006.stdout:2148 write 0x784d787 thru 0x785b3c3 (0xdc3d bytes) 2024-09-14T05:59:45.284 INFO:teuthology.orchestra.run.smithi006.stdout:2152 punch from 0x6a118e7 to 0x6a20a93, (0xf1ac bytes) 2024-09-14T05:59:45.284 INFO:teuthology.orchestra.run.smithi006.stdout:2153 punch from 0x5460ace to 0x5464f1c, (0x444e bytes) 2024-09-14T05:59:45.286 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:45.281+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:45.306 INFO:teuthology.orchestra.run.smithi006.stdout:2154 write 0xed5b21e thru 0xed69ef1 (0xecd4 bytes) 2024-09-14T05:59:45.318 INFO:teuthology.orchestra.run.smithi006.stdout:2155 write 0xb7bb3d5 thru 0xb7be746 (0x3372 bytes) 2024-09-14T05:59:45.324 INFO:teuthology.orchestra.run.smithi006.stdout:2156 writesame 0x231f548 thru 0x2320417 data_size 0x6(0xed0 bytes) 2024-09-14T05:59:45.329 INFO:teuthology.orchestra.run.smithi006.stdout:2158 write 0x6ec532f thru 0x6ecd762 (0x8434 bytes) 2024-09-14T05:59:45.338 INFO:teuthology.orchestra.run.smithi006.stdout:2159 punch from 0x6acf27b to 0x6ad7c71, (0x89f6 bytes) 2024-09-14T05:59:45.338 INFO:teuthology.orchestra.run.smithi006.stdout:2160 punch from 0x3f4093b to 0x3f4a87e, (0x9f43 bytes) 2024-09-14T05:59:45.338 INFO:teuthology.orchestra.run.smithi006.stdout:2161 write 0xec4cc8f thru 0xec4dbd8 (0xf4a bytes) 2024-09-14T05:59:45.342 INFO:teuthology.orchestra.run.smithi006.stdout:2162 read 0x5877bda thru 0x5882cbd (0xb0e4 bytes) 2024-09-14T05:59:45.342 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:45.347 INFO:teuthology.orchestra.run.smithi006.stdout:2165 trunc from 0xed69ef2 to 0xbda4415 2024-09-14T05:59:45.369 INFO:teuthology.orchestra.run.smithi006.stdout:2166 read 0xb3a2caf thru 0xb3a7a74 (0x4dc6 bytes) 2024-09-14T05:59:45.369 INFO:teuthology.orchestra.run.smithi006.stdout:2167 read 0x5411249 thru 0x541ecc2 (0xda7a bytes) 2024-09-14T05:59:45.385 INFO:teuthology.orchestra.run.smithi006.stdout:2168 trunc from 0xbda4415 to 0xf7eb0b 2024-09-14T05:59:45.388 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:45.385+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:45.390 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:45.390 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:45.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:45.390 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:45.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.390 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12600 3.18 3:1e8e1704:::rbd_data.1127368d46aa.0000000000000000:a [read 1835008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.390 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.899978+0000", 2024-09-14T05:59:45.390 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.488591696, 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082577203000000002, 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12600 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.899978+0000", 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.899978+0000", 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.899980+0000", 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.26e-06 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.899986+0000", 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0499999999999997e-06 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900005+0000", 2024-09-14T05:59:45.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9162999999999999e-05 2024-09-14T05:59:45.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900019+0000", 2024-09-14T05:59:45.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3967e-05 2024-09-14T05:59:45.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982365+0000", 2024-09-14T05:59:45.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082346635000000001 2024-09-14T05:59:45.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982450+0000", 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4486000000000004e-05 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982556+0000", 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105642 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12601 3.18 3:1e8e1704:::rbd_data.1127368d46aa.0000000000000000:a [read 1900544~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.394 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900038+0000", 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.488531865999999, 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082708763000000005, 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12601 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900038+0000", 2024-09-14T05:59:45.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900038+0000", 2024-09-14T05:59:45.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900039+0000", 2024-09-14T05:59:45.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2300000000000001e-06 2024-09-14T05:59:45.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900061+0000", 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1999999999999999e-05 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900079+0000", 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7883000000000001e-05 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900094+0000", 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4363e-05 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982599+0000", 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082505455000000005 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982659+0000", 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9960999999999997e-05 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982747+0000", 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7870999999999999e-05 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.399 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12602 3.18 3:1e8e1704:::rbd_data.1127368d46aa.0000000000000000:a [read 1966080~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.399 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900115+0000", 2024-09-14T05:59:45.399 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.488455483999999, 2024-09-14T05:59:45.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082889114999999999, 2024-09-14T05:59:45.399 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.399 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.399 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.399 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.399 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.399 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.399 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12602 2024-09-14T05:59:45.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.399 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900115+0000", 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900115+0000", 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900116+0000", 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6640000000000001e-06 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900122+0000", 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6799999999999998e-06 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900139+0000", 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7309999999999999e-05 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900153+0000", 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.429e-05 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982795+0000", 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082641362999999995 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982891+0000", 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6271e-05 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983004+0000", 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000112537 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.402 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12603 3.18 3:1e8e1704:::rbd_data.1127368d46aa.0000000000000000:a [read 2031616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900172+0000", 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.488398437000001, 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083068960999999997, 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12603 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.403 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900172+0000", 2024-09-14T05:59:45.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900172+0000", 2024-09-14T05:59:45.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900173+0000", 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4699999999999999e-06 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900200+0000", 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7243e-05 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900220+0000", 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0196000000000001e-05 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900235+0000", 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.487e-05 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983044+0000", 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082808549999999995 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983097+0000", 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2865999999999998e-05 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983241+0000", 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014376600000000001 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12604 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1572864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900256+0000", 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.488313960999999, 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083449791999999995, 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.407 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12604 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900256+0000", 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900256+0000", 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900258+0000", 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900263+0000", 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8069999999999996e-06 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900280+0000", 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.717e-05 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900296+0000", 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5642999999999999e-05 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983293+0000", 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082997258000000004 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983483+0000", 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019005399999999999 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983706+0000", 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00022239699999999999 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12605 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1638400~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900320+0000", 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.488249671999998, 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083560593000000002, 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.411 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12605 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900320+0000", 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900320+0000", 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900322+0000", 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.226e-06 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900327+0000", 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4700000000000001e-06 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900345+0000", 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8297000000000001e-05 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900359+0000", 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3793e-05 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983732+0000", 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083372486999999995 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983786+0000", 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3906999999999997e-05 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983881+0000", 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5413000000000003e-05 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12606 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1703936~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900377+0000", 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.488192766000001, 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083968347999999998, 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.415 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12606 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900377+0000", 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900377+0000", 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900378+0000", 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0869999999999999e-06 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900383+0000", 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8269999999999997e-06 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900401+0000", 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7586000000000001e-05 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900414+0000", 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3616e-05 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983926+0000", 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083511964999999994 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984100+0000", 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000173647 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984346+0000", 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024562 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12607 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900435+0000", 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.488134652999999, 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084218643999999995, 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.419 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12607 2024-09-14T05:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900435+0000", 2024-09-14T05:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900435+0000", 2024-09-14T05:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900437+0000", 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.173e-06 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900442+0000", 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9569999999999999e-06 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900462+0000", 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9409999999999999e-05 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900476+0000", 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3842999999999999e-05 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984377+0000", 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083901341000000004 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984523+0000", 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014617800000000001 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984654+0000", 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013074199999999999 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12608 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1835008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900495+0000", 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.488075017, 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084429064999999998, 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.423 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.424 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.424 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.424 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.424 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12608 2024-09-14T05:59:45.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.424 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900495+0000", 2024-09-14T05:59:45.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900495+0000", 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900496+0000", 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3969999999999999e-06 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900502+0000", 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3369999999999999e-06 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900518+0000", 2024-09-14T05:59:45.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6215999999999999e-05 2024-09-14T05:59:45.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900546+0000", 2024-09-14T05:59:45.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8089000000000002e-05 2024-09-14T05:59:45.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984684+0000", 2024-09-14T05:59:45.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084137637000000001 2024-09-14T05:59:45.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984816+0000", 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013197799999999999 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984924+0000", 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108411 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12609 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1900544~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900568+0000", 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.488002137999999, 2024-09-14T05:59:45.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084572639000000005, 2024-09-14T05:59:45.428 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.428 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.428 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.428 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.428 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.428 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.428 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12609 2024-09-14T05:59:45.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.428 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900568+0000", 2024-09-14T05:59:45.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900568+0000", 2024-09-14T05:59:45.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900569+0000", 2024-09-14T05:59:45.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5540000000000001e-06 2024-09-14T05:59:45.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900586+0000", 2024-09-14T05:59:45.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6079999999999999e-05 2024-09-14T05:59:45.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900609+0000", 2024-09-14T05:59:45.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3580000000000001e-05 2024-09-14T05:59:45.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900624+0000", 2024-09-14T05:59:45.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5173e-05 2024-09-14T05:59:45.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984993+0000", 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084369059999999996 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985055+0000", 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1346000000000005e-05 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985141+0000", 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5846000000000004e-05 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.432 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12610 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1966080~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.432 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900645+0000", 2024-09-14T05:59:45.432 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.487924745000001, 2024-09-14T05:59:45.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084792891999999995, 2024-09-14T05:59:45.432 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.432 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.432 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.432 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.432 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.432 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.432 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12610 2024-09-14T05:59:45.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.432 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900645+0000", 2024-09-14T05:59:45.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900645+0000", 2024-09-14T05:59:45.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900647+0000", 2024-09-14T05:59:45.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6199999999999999e-06 2024-09-14T05:59:45.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900652+0000", 2024-09-14T05:59:45.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2100000000000001e-06 2024-09-14T05:59:45.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900669+0000", 2024-09-14T05:59:45.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7376000000000001e-05 2024-09-14T05:59:45.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900682+0000", 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2284e-05 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985177+0000", 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084495644999999994 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985322+0000", 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014503899999999999 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985438+0000", 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011571800000000001 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12611 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 2031616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900701+0000", 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.487868898999999, 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085063237999999999, 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.436 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12611 2024-09-14T05:59:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900701+0000", 2024-09-14T05:59:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900701+0000", 2024-09-14T05:59:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900702+0000", 2024-09-14T05:59:45.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.097e-06 2024-09-14T05:59:45.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900708+0000", 2024-09-14T05:59:45.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0599999999999996e-06 2024-09-14T05:59:45.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900729+0000", 2024-09-14T05:59:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1143000000000001e-05 2024-09-14T05:59:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900744+0000", 2024-09-14T05:59:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4953000000000001e-05 2024-09-14T05:59:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985502+0000", 2024-09-14T05:59:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084757543000000005 2024-09-14T05:59:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.440 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985620+0000", 2024-09-14T05:59:45.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000117644 2024-09-14T05:59:45.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.440 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.440 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985764+0000", 2024-09-14T05:59:45.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014479799999999999 2024-09-14T05:59:45.440 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.440 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.440 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.440 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12612 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1572864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.441 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900785+0000", 2024-09-14T05:59:45.441 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.487784822999998, 2024-09-14T05:59:45.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085273510999999996, 2024-09-14T05:59:45.441 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.441 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.441 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.441 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.441 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.441 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.441 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12612 2024-09-14T05:59:45.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.441 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900785+0000", 2024-09-14T05:59:45.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900785+0000", 2024-09-14T05:59:45.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900787+0000", 2024-09-14T05:59:45.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.327e-06 2024-09-14T05:59:45.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900805+0000", 2024-09-14T05:59:45.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8416000000000001e-05 2024-09-14T05:59:45.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900826+0000", 2024-09-14T05:59:45.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0579999999999999e-05 2024-09-14T05:59:45.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900839+0000", 2024-09-14T05:59:45.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.38e-05 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985790+0000", 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084950345999999996 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985918+0000", 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012817800000000001 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986059+0000", 2024-09-14T05:59:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014086400000000001 2024-09-14T05:59:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12613 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1638400~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900862+0000", 2024-09-14T05:59:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.487707780000001, 2024-09-14T05:59:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085363869999999994, 2024-09-14T05:59:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12613 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900862+0000", 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900862+0000", 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900864+0000", 2024-09-14T05:59:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3400000000000001e-06 2024-09-14T05:59:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900870+0000", 2024-09-14T05:59:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.246e-06 2024-09-14T05:59:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900889+0000", 2024-09-14T05:59:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.916e-05 2024-09-14T05:59:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900903+0000", 2024-09-14T05:59:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.448e-05 2024-09-14T05:59:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986080+0000", 2024-09-14T05:59:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085176475000000001 2024-09-14T05:59:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986129+0000", 2024-09-14T05:59:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9493000000000002e-05 2024-09-14T05:59:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986226+0000", 2024-09-14T05:59:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6675999999999994e-05 2024-09-14T05:59:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12614 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1703936~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900925+0000", 2024-09-14T05:59:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.487644744000001, 2024-09-14T05:59:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085610173999999997, 2024-09-14T05:59:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12614 2024-09-14T05:59:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900925+0000", 2024-09-14T05:59:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900925+0000", 2024-09-14T05:59:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900927+0000", 2024-09-14T05:59:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3769999999999999e-06 2024-09-14T05:59:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900933+0000", 2024-09-14T05:59:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1829999999999999e-06 2024-09-14T05:59:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900951+0000", 2024-09-14T05:59:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7810000000000001e-05 2024-09-14T05:59:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900966+0000", 2024-09-14T05:59:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5228999999999999e-05 2024-09-14T05:59:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986268+0000", 2024-09-14T05:59:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085302557000000001 2024-09-14T05:59:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986391+0000", 2024-09-14T05:59:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012244299999999999 2024-09-14T05:59:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986535+0000", 2024-09-14T05:59:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000144575 2024-09-14T05:59:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12615 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900988+0000", 2024-09-14T05:59:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.487582475, 2024-09-14T05:59:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085798447, 2024-09-14T05:59:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12615 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900988+0000", 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900988+0000", 2024-09-14T05:59:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900989+0000", 2024-09-14T05:59:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5200000000000001e-06 2024-09-14T05:59:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900995+0000", 2024-09-14T05:59:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3069999999999999e-06 2024-09-14T05:59:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901014+0000", 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.838e-05 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901028+0000", 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4752999999999999e-05 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986560+0000", 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085531441999999999 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986678+0000", 2024-09-14T05:59:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118034 2024-09-14T05:59:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986786+0000", 2024-09-14T05:59:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010801100000000001 2024-09-14T05:59:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12616 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1835008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.901049+0000", 2024-09-14T05:59:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.487521481999998, 2024-09-14T05:59:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085922076999999999, 2024-09-14T05:59:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12616 2024-09-14T05:59:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901049+0000", 2024-09-14T05:59:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901049+0000", 2024-09-14T05:59:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901050+0000", 2024-09-14T05:59:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5340000000000001e-06 2024-09-14T05:59:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901055+0000", 2024-09-14T05:59:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2730000000000002e-06 2024-09-14T05:59:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901075+0000", 2024-09-14T05:59:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9346000000000001e-05 2024-09-14T05:59:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901089+0000", 2024-09-14T05:59:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4392999999999999e-05 2024-09-14T05:59:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986819+0000", 2024-09-14T05:59:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085730161999999999 2024-09-14T05:59:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986885+0000", 2024-09-14T05:59:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6217999999999995e-05 2024-09-14T05:59:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986971+0000", 2024-09-14T05:59:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5150999999999998e-05 2024-09-14T05:59:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12617 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1900544~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.901113+0000", 2024-09-14T05:59:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.487457496000001, 2024-09-14T05:59:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086089867, 2024-09-14T05:59:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12617 2024-09-14T05:59:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901113+0000", 2024-09-14T05:59:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901113+0000", 2024-09-14T05:59:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901114+0000", 2024-09-14T05:59:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2130000000000001e-06 2024-09-14T05:59:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901119+0000", 2024-09-14T05:59:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5169999999999999e-06 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901137+0000", 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7819999999999999e-05 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901151+0000", 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3723000000000001e-05 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987010+0000", 2024-09-14T05:59:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085858773999999999 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987105+0000", 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5091000000000001e-05 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987202+0000", 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7728999999999999e-05 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12618 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1966080~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.901169+0000", 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.487400910000002, 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086197516000000002, 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12618 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901169+0000", 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901169+0000", 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901170+0000", 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.33e-06 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901176+0000", 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.22e-06 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901193+0000", 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7326999999999999e-05 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901206+0000", 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2979000000000001e-05 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987231+0000", 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086025015999999996 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987281+0000", 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9740000000000001e-05 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987367+0000", 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5903999999999996e-05 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12619 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 2031616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.901223+0000", 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.487346813999999, 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086375007000000004, 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12619 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901223+0000", 2024-09-14T05:59:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901223+0000", 2024-09-14T05:59:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901224+0000", 2024-09-14T05:59:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1000000000000001e-06 2024-09-14T05:59:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901229+0000", 2024-09-14T05:59:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8940000000000001e-06 2024-09-14T05:59:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901246+0000", 2024-09-14T05:59:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6863000000000001e-05 2024-09-14T05:59:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901259+0000", 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3207000000000001e-05 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987401+0000", 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086141599999999999 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987502+0000", 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000100654 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987598+0000", 2024-09-14T05:59:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6688999999999995e-05 2024-09-14T05:59:45.476 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.476 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.476 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.476 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:45.476 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:45.476 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:45.477 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:59:45.478 INFO:teuthology.orchestra.run.smithi006.stdout:2171 writesame 0x2ee59c thru 0x2f59de data_size 0x3(0x7443 bytes) 2024-09-14T05:59:45.478 INFO:teuthology.orchestra.run.smithi006.stdout:2172 punch from 0x580a36 to 0x580bef, (0x1b9 bytes) 2024-09-14T05:59:45.478 INFO:teuthology.orchestra.run.smithi006.stdout:2173 writesame 0x33cb043 thru 0x33d102a data_size 0x2(0x5fe8 bytes) 2024-09-14T05:59:45.478 INFO:teuthology.orchestra.run.smithi006.stdout:2175 write 0xb28c603 thru 0xb295b3c (0x953a bytes) 2024-09-14T05:59:45.478 INFO:teuthology.orchestra.run.smithi006.stdout:2176 read 0x9c84ac6 thru 0x9c8ac44 (0x617f bytes) 2024-09-14T05:59:45.478 INFO:teuthology.orchestra.run.smithi006.stdout:2177 read 0x8eb2967 thru 0x8ebff0a (0xd5a4 bytes) 2024-09-14T05:59:45.478 INFO:teuthology.orchestra.run.smithi006.stdout:2179 write 0x261507d thru 0x261a54d (0x54d1 bytes) 2024-09-14T05:59:45.483 INFO:teuthology.orchestra.run.smithi006.stdout:2180 trunc from 0xb295b3d to 0xcc31471 2024-09-14T05:59:45.509 INFO:teuthology.orchestra.run.smithi006.stdout:2181 trunc from 0xcc31471 to 0x571b407 2024-09-14T05:59:45.524 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:45.525+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:45.528 INFO:teuthology.orchestra.run.smithi006.stdout:2182 clone 13 order 22 su 524288 sc 3 2024-09-14T05:59:45.590 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:45.589+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:45.611 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:45.611 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:45.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:59:45.691 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:45.689+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:45.789 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T05:59:45.791 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:45.789+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:45.796 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:45.796 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:45.796 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:45.796 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:45.796 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:45.812 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:59:45.817 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-14T05:59:45.892 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:45.893+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:45.898 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone12 from 0x571b407 (overlap 0xf7eb0b) to 0xdf2056 2024-09-14T05:59:45.938 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:45.938 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:45.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:45.939 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:45.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.939 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23550 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 606208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:45.939 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948669+0000", 2024-09-14T05:59:45.939 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.990439359, 2024-09-14T05:59:45.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048793072999999999, 2024-09-14T05:59:45.939 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:45.939 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:45.939 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:45.939 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:45.939 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:45.939 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.939 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23550 2024-09-14T05:59:45.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.940 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:45.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:45.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T05:59:45.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:45.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T05:59:45.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:45.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T05:59:45.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:59:45.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:45.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948677+0000", 2024-09-14T05:59:45.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1949999999999997e-06 2024-09-14T05:59:45.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948687+0000", 2024-09-14T05:59:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0849000000000001e-05 2024-09-14T05:59:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948692+0000", 2024-09-14T05:59:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8670000000000002e-06 2024-09-14T05:59:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997290+0000", 2024-09-14T05:59:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048597596999999999 2024-09-14T05:59:45.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:45.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997367+0000", 2024-09-14T05:59:45.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7236000000000004e-05 2024-09-14T05:59:45.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:45.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997462+0000", 2024-09-14T05:59:45.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4951000000000006e-05 2024-09-14T05:59:45.943 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.943 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:45.943 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.944 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23551 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 620544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:45.944 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948700+0000", 2024-09-14T05:59:45.944 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.990408501999999, 2024-09-14T05:59:45.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048938838999999998, 2024-09-14T05:59:45.944 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:45.944 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:45.944 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:45.944 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:45.944 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:45.944 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.944 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23551 2024-09-14T05:59:45.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.944 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T05:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T05:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T05:59:45.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1e-07 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948701+0000", 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2950000000000001e-06 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948705+0000", 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948709+0000", 2024-09-14T05:59:45.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T05:59:45.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:45.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997535+0000", 2024-09-14T05:59:45.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048826181000000003 2024-09-14T05:59:45.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:45.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997580+0000", 2024-09-14T05:59:45.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5355000000000002e-05 2024-09-14T05:59:45.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:45.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997639+0000", 2024-09-14T05:59:45.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8479e-05 2024-09-14T05:59:45.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.948 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:45.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.948 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:45.948 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T05:59:45.948 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.990393024999999, 2024-09-14T05:59:45.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T05:59:45.948 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:45.948 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:45.948 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:45.948 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:45.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T05:59:45.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T05:59:45.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:45.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T05:59:45.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T05:59:45.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:45.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T05:59:45.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T05:59:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T05:59:45.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:45.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T05:59:45.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T05:59:45.952 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.952 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:45.952 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.952 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:45.952 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T05:59:45.953 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.99037375, 2024-09-14T05:59:45.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T05:59:45.953 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:45.953 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:45.953 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:45.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:45.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:45.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.953 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T05:59:45.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.953 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:45.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:45.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:45.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:45.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.957 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:45.957 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T05:59:45.957 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.990354174, 2024-09-14T05:59:45.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T05:59:45.957 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:45.957 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:45.957 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:45.957 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:45.957 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:45.957 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.957 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T05:59:45.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.957 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:45.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:45.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T05:59:45.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:45.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T05:59:45.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:45.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T05:59:45.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T05:59:45.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:45.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T05:59:45.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T05:59:45.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:45.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T05:59:45.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T05:59:45.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T05:59:45.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T05:59:45.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:45.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T05:59:45.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T05:59:45.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:45.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T05:59:45.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T05:59:45.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T05:59:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T05:59:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T05:59:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.990334717, 2024-09-14T05:59:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T05:59:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:45.961 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:45.962 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:45.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:45.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:45.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.962 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T05:59:45.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.962 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:45.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:45.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T05:59:45.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T05:59:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T05:59:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T05:59:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T05:59:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T05:59:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.990315666000001, 2024-09-14T05:59:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T05:59:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T05:59:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T05:59:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T05:59:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T05:59:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T05:59:45.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T05:59:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T05:59:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T05:59:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T05:59:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T05:59:45.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T05:59:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T05:59:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T05:59:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T05:59:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T05:59:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T05:59:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T05:59:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T05:59:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.990295984999999, 2024-09-14T05:59:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T05:59:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:45.970 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T05:59:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T05:59:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:45.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T05:59:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T05:59:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T05:59:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T05:59:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T05:59:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T05:59:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T05:59:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T05:59:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T05:59:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T05:59:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T05:59:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T05:59:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T05:59:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T05:59:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T05:59:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.974 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T05:59:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.990276034000001, 2024-09-14T05:59:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T05:59:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T05:59:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T05:59:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T05:59:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T05:59:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T05:59:45.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:45.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T05:59:45.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T05:59:45.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:45.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T05:59:45.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:59:45.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T05:59:45.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T05:59:45.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:45.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T05:59:45.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T05:59:45.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:45.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T05:59:45.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T05:59:45.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:45.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T05:59:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T05:59:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T05:59:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.990256722, 2024-09-14T05:59:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T05:59:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:45.980 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:45.980 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.980 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T05:59:45.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.980 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:45.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:45.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T05:59:45.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:45.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T05:59:45.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:45.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T05:59:45.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T05:59:45.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:45.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T05:59:45.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T05:59:45.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:45.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T05:59:45.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T05:59:45.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T05:59:45.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T05:59:45.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:45.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T05:59:45.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T05:59:45.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:45.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T05:59:45.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T05:59:45.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:45.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T05:59:45.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T05:59:45.983 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.983 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:45.983 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.984 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:45.984 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T05:59:45.984 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.990236961000001, 2024-09-14T05:59:45.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T05:59:45.984 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:45.984 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:45.984 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:45.984 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:45.984 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:45.984 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.984 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T05:59:45.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.984 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:45.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:45.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T05:59:45.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:45.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T05:59:45.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:45.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T05:59:45.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T05:59:45.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:45.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T05:59:45.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T05:59:45.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:45.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T05:59:45.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T05:59:45.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T05:59:45.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T05:59:45.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:45.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T05:59:45.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T05:59:45.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:45.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T05:59:45.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T05:59:45.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:45.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T05:59:45.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T05:59:45.988 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.988 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:45.988 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.988 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:45.988 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T05:59:45.988 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.99021604, 2024-09-14T05:59:45.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T05:59:45.988 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:45.988 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:45.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:45.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T05:59:45.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T05:59:45.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T05:59:45.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T05:59:45.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:45.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T05:59:45.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T05:59:45.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.989056706, 2024-09-14T05:59:45.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T05:59:45.993 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:45.993 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:45.993 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:45.993 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:45.993 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:45.993 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.993 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T05:59:45.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.993 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:45.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:45.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T05:59:45.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.988757924, 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T05:59:45.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T05:59:45.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T05:59:45.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:45.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T05:59:45.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T05:59:45.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:45.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T05:59:45.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T05:59:45.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:45.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:45.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:45.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.988607185999999, 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:46.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:46.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23582 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 911360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951427+0000", 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.987681799000001, 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048708939999999999, 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23582 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6300000000000005e-07 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:46.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951430+0000", 2024-09-14T05:59:46.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5179999999999999e-06 2024-09-14T05:59:46.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:46.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951437+0000", 2024-09-14T05:59:46.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0940000000000002e-06 2024-09-14T05:59:46.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:46.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951443+0000", 2024-09-14T05:59:46.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7910000000000001e-06 2024-09-14T05:59:46.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000047+0000", 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048604550000000003 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000095+0000", 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7735999999999998e-05 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000135+0000", 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0587999999999998e-05 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:46.008 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23588 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 722944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951451+0000", 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.987656934, 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048792653999999998, 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23588 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.009 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:46.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:46.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T05:59:46.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:46.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:46.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T05:59:46.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:46.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:46.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951665+0000", 2024-09-14T05:59:46.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021337600000000001 2024-09-14T05:59:46.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:46.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951669+0000", 2024-09-14T05:59:46.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3460000000000004e-06 2024-09-14T05:59:46.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:46.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951688+0000", 2024-09-14T05:59:46.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9042000000000002e-05 2024-09-14T05:59:46.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951696+0000", 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6660000000000008e-06 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000162+0000", 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048465824999999997 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000199+0000", 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7143e-05 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000244+0000", 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5256000000000002e-05 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23590 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 745472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951709+0000", 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.987399479, 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048677684999999998, 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:46.013 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:46.014 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:46.014 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:46.014 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23590 2024-09-14T05:59:46.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.014 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:46.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:46.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T05:59:46.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:46.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:46.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T05:59:46.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:46.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:46.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951850+0000", 2024-09-14T05:59:46.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014113 2024-09-14T05:59:46.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:46.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951855+0000", 2024-09-14T05:59:46.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6349999999999997e-06 2024-09-14T05:59:46.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:46.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951863+0000", 2024-09-14T05:59:46.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8189999999999998e-06 2024-09-14T05:59:46.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:46.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951871+0000", 2024-09-14T05:59:46.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2030000000000003e-06 2024-09-14T05:59:46.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:46.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000283+0000", 2024-09-14T05:59:46.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048412531000000002 2024-09-14T05:59:46.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000338+0000", 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4462000000000001e-05 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000387+0000", 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8905e-05 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.017 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.363305623, 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:46.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T05:59:46.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T05:59:46.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.022 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:46.022 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T05:59:46.022 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.840215684, 2024-09-14T05:59:46.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T05:59:46.022 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:46.022 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:46.022 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:46.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:46.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:46.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:46.022 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T05:59:46.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.022 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:46.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:46.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T05:59:46.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:46.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:46.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T05:59:46.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:46.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:46.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T05:59:46.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T05:59:46.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T05:59:46.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:46.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:46.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:46.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T05:59:46.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T05:59:46.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.027 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:46.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:46.027 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:46.027 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:46.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:59:46.028 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-14T05:59:46.029 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:59:46.030 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:46.029+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:46.097 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:46.097 INFO:teuthology.orchestra.run.smithi006.stdout:2184 writesame 0x2d5677c thru 0x2d64191 data_size 0xf(0xda16 bytes) 2024-09-14T05:59:46.116 INFO:teuthology.orchestra.run.smithi006.stdout:2185 read 0x1cf6f14 thru 0x1cffa0a (0x8af7 bytes) 2024-09-14T05:59:46.129 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:46.125+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:46.131 INFO:teuthology.orchestra.run.smithi006.stdout:2188 write 0x8816de4 thru 0x88181b6 (0x13d3 bytes) 2024-09-14T05:59:46.135 INFO:teuthology.orchestra.run.smithi006.stdout:2190 writesame 0x33279 thru 0x42938 data_size 0x6(0xf6c0 bytes) 2024-09-14T05:59:46.176 INFO:teuthology.orchestra.run.smithi006.stdout:2191 writesame 0xa69ee9 thru 0xa70ce1 data_size 0x1(0x6df9 bytes) 2024-09-14T05:59:46.178 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T05:59:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:59:46.199 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:46.199 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:46.215 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:46.216 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:46.230 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:46.230 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:46.230 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:46.230 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:46.230 INFO:teuthology.orchestra.run.smithi006.stdout:2192 read 0x546e73c thru 0x5473a88 (0x534d bytes) 2024-09-14T05:59:46.230 INFO:teuthology.orchestra.run.smithi006.stdout:2193 clone 14 order 18 su 32768 sc 7 2024-09-14T05:59:46.231 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:46.225+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:46.232 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:46.232 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:46.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:59:46.250 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:46.251 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:46.269 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:46.269 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:46.286 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:46.304 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:46.305 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:46.362 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:46.363 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:46.363 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:46.361+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:46.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:59:46.432 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:46.429+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:46.501 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:46.501 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:46.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T05:59:46.533 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:46.529+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:46.634 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:46.633+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:46.642 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:46.642 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:46.657 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T05:59:46.744 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:46.745+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:46.803 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.3 to 1 (10000) 2024-09-14T05:59:46.823 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:46.823 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:46.830 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T05:59:46.840 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T05:59:46.871 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:46.869+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:46.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:59:46.935 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone13 from 0x88181b7 (overlap 0x571b407) to 0x3cf979e 2024-09-14T05:59:46.935 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:46.933+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:47.015 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:47.016 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:47.031 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T05:59:47.036 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:47.033+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:47.096 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-14T05:59:47.131 INFO:teuthology.orchestra.run.smithi006.stdout:2195 write 0x3239bb5 thru 0x323b24e (0x169a bytes) 2024-09-14T05:59:47.137 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:47.137+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:47.141 INFO:teuthology.orchestra.run.smithi006.stdout:2196 write 0x76cf865 thru 0x76d7108 (0x78a4 bytes) 2024-09-14T05:59:47.147 INFO:teuthology.orchestra.run.smithi006.stdout:2198 punch from 0x4d7c845 to 0x4d7d8e2, (0x109d bytes) 2024-09-14T05:59:47.152 INFO:teuthology.orchestra.run.smithi006.stdout:2199 trunc from 0x88181b7 to 0x5137551 2024-09-14T05:59:47.195 INFO:teuthology.orchestra.run.smithi006.stdout:2200 write 0x9181ea5 thru 0x9189701 (0x785d bytes) 2024-09-14T05:59:47.203 INFO:teuthology.orchestra.run.smithi006.stdout:2201 write 0x64921e6 thru 0x6499674 (0x748f bytes) 2024-09-14T05:59:47.207 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:47.207 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:47.211 INFO:teuthology.orchestra.run.smithi006.stdout:2203 punch from 0x756fc30 to 0x7575728, (0x5af8 bytes) 2024-09-14T05:59:47.214 INFO:teuthology.orchestra.run.smithi006.stdout:2205 trunc from 0x9189702 to 0xafa1266 2024-09-14T05:59:47.222 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T05:59:47.224 INFO:teuthology.orchestra.run.smithi006.stdout:2206 read 0x8270a99 thru 0x8275a64 (0x4fcc bytes) 2024-09-14T05:59:47.224 INFO:teuthology.orchestra.run.smithi006.stdout:2207 writesame 0x1f3e032 thru 0x1f475db data_size 0x1(0x95aa bytes) 2024-09-14T05:59:47.238 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:47.237+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:47.264 INFO:teuthology.orchestra.run.smithi006.stdout:2208 write 0xce876dd thru 0xce8f68d (0x7fb1 bytes) 2024-09-14T05:59:47.270 INFO:teuthology.orchestra.run.smithi006.stdout:2211 read 0x19503d0 thru 0x195237a (0x1fab bytes) 2024-09-14T05:59:47.277 INFO:teuthology.orchestra.run.smithi006.stdout:2212 writesame 0xd0c0fa0 thru 0xd0ca999 data_size 0x1(0x99fa bytes) 2024-09-14T05:59:47.277 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:47.277 INFO:teuthology.orchestra.run.smithi006.stdout:2215 write 0x19ab5b1 thru 0x19b604b (0xaa9b bytes) 2024-09-14T05:59:47.285 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:47.285 INFO:teuthology.orchestra.run.smithi006.stdout:2217 read 0x9eca2b5 thru 0x9ed4fa8 (0xacf4 bytes) 2024-09-14T05:59:47.285 INFO:teuthology.orchestra.run.smithi006.stdout:2219 write 0xa0cc05d thru 0xa0d558b (0x952f bytes) 2024-09-14T05:59:47.312 INFO:teuthology.orchestra.run.smithi006.stdout:2220 trunc from 0xd0ca99a to 0x24bf8d 2024-09-14T05:59:47.339 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:47.337+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:47.349 INFO:teuthology.orchestra.run.smithi006.stdout:2221 read 0x3f8a5 thru 0x44783 (0x4edf bytes) 2024-09-14T05:59:47.350 INFO:teuthology.orchestra.run.smithi006.stdout:2222 read 0x174957 thru 0x17f2d8 (0xa982 bytes) 2024-09-14T05:59:47.374 INFO:teuthology.orchestra.run.smithi006.stdout:2223 write 0x7ce30f1 thru 0x7cf13d7 (0xe2e7 bytes) 2024-09-14T05:59:47.387 INFO:teuthology.orchestra.run.smithi006.stdout:2225 read 0x5653c87 thru 0x5657b56 (0x3ed0 bytes) 2024-09-14T05:59:47.394 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:47.394 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:47.394 INFO:teuthology.orchestra.run.smithi006.stdout:2226 trunc from 0x7cf13d8 to 0x48bdd5c 2024-09-14T05:59:47.409 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T05:59:47.417 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:47.440 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:47.437+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:47.442 INFO:teuthology.orchestra.run.smithi006.stdout:2228 writesame 0x8f707e7 thru 0x8f79cfb data_size 0x5(0x9515 bytes) 2024-09-14T05:59:47.444 INFO:teuthology.orchestra.run.smithi006.stdout:2230 trunc from 0x8f79cfc to 0x9758c35 2024-09-14T05:59:47.476 INFO:teuthology.orchestra.run.smithi006.stdout:2232 writesame 0xc474614 thru 0xc47776f data_size 0x34(0x315c bytes) 2024-09-14T05:59:47.476 INFO:teuthology.orchestra.run.smithi006.stdout:2233 writesame 0x6735cb4 thru 0x6741e93 data_size 0x8(0xc1e0 bytes) 2024-09-14T05:59:47.494 INFO:teuthology.orchestra.run.smithi006.stdout:2235 trunc from 0xc477770 to 0xa46ba53 2024-09-14T05:59:47.507 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:47.525 INFO:teuthology.orchestra.run.smithi006.stdout:2239 trunc from 0xa46ba53 to 0x37c52b1 2024-09-14T05:59:47.541 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:47.541+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:47.573 INFO:teuthology.orchestra.run.smithi006.stdout:2240 trunc from 0x37c52b1 to 0xb8dcca0 2024-09-14T05:59:47.583 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:47.583 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:47.588 INFO:teuthology.orchestra.run.smithi006.stdout:2241 write 0x52a16c3 thru 0x52a3a25 (0x2363 bytes) 2024-09-14T05:59:47.595 INFO:teuthology.orchestra.run.smithi006.stdout:2242 write 0x95e36a thru 0x960e3d (0x2ad4 bytes) 2024-09-14T05:59:47.598 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:59:47.603 INFO:teuthology.orchestra.run.smithi006.stdout:2244 write 0x6764e5b thru 0x676db77 (0x8d1d bytes) 2024-09-14T05:59:47.612 INFO:teuthology.orchestra.run.smithi006.stdout:2245 write 0x89d53a5 thru 0x89d7056 (0x1cb2 bytes) 2024-09-14T05:59:47.617 INFO:teuthology.orchestra.run.smithi006.stdout:2246 write 0x662f173 thru 0x663d77c (0xe60a bytes) 2024-09-14T05:59:47.637 INFO:teuthology.orchestra.run.smithi006.stdout:2247 write 0xdd021b8 thru 0xdd0b1fe (0x9047 bytes) 2024-09-14T05:59:47.643 INFO:teuthology.orchestra.run.smithi006.stdout:2248 clone 15 order 23 su 131072 sc 13 2024-09-14T05:59:47.644 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:47.645+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:47.733 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:47.733 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:47.742 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:47.737+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:47.747 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:59:47.812 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T05:59:47.812 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2024-09-14T05:59:47.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T05:59:47.844 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:47.845+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:47.922 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:47.922 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:47.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:59:47.963 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone14 from 0xdd0b1ff (overlap 0x24bf8d) to 0x19b949 2024-09-14T05:59:47.963 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:47.961+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:48.045 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:48.041+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:48.115 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:48.115 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:48.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:59:48.178 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-14T05:59:48.179 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:48.177+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:48.248 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:48.245+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:48.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:59:48.330 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:48.330 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:48.348 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:59:48.349 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:48.345+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:48.369 INFO:teuthology.orchestra.run.smithi006.stdout:2249 writesame 0xed0f152 thru 0xed17989 data_size 0xc(0x8838 bytes) 2024-09-14T05:59:48.375 INFO:teuthology.orchestra.run.smithi006.stdout:2250 writesame 0x4fb23b6 thru 0x4fc02d0 data_size 0x1(0xdf1b bytes) 2024-09-14T05:59:48.449 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:48.449+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:2251 punch from 0xdeaed0a to 0xdebb64a, (0xc940 bytes) 2024-09-14T05:59:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.456 INFO:teuthology.orchestra.run.smithi006.stdout:2255 writesame 0x5a3861 thru 0x5ae29a data_size 0x51(0xaa3a bytes) 2024-09-14T05:59:48.467 INFO:teuthology.orchestra.run.smithi006.stdout:2256 read 0xd8442d0 thru 0xd845a52 (0x1783 bytes) 2024-09-14T05:59:48.467 INFO:teuthology.orchestra.run.smithi006.stdout:2258 read 0xa6cefa6 thru 0xa6d59b4 (0x6a0f bytes) 2024-09-14T05:59:48.467 INFO:teuthology.orchestra.run.smithi006.stdout:2259 write 0x5dcfaad thru 0x5dd2f36 (0x348a bytes) 2024-09-14T05:59:48.483 INFO:teuthology.orchestra.run.smithi006.stdout:2260 trunc from 0xed1798a to 0x894a020 2024-09-14T05:59:48.484 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T05:59:48.484 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:59:48.495 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:48.495 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:48.505 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:48.505 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:48.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:59:48.525 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:48.525 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:48.535 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.535 INFO:teuthology.orchestra.run.smithi006.stdout:2263 punch from 0x15316f2 to 0x153f623, (0xdf31 bytes) 2024-09-14T05:59:48.535 INFO:teuthology.orchestra.run.smithi006.stdout:2265 punch from 0x5f7e9cb to 0x5f86eed, (0x8522 bytes) 2024-09-14T05:59:48.535 INFO:teuthology.orchestra.run.smithi006.stdout:2268 read 0x2a5563a thru 0x2a5feca (0xa891 bytes) 2024-09-14T05:59:48.536 INFO:teuthology.orchestra.run.smithi006.stdout:2269 punch from 0x65c4fc8 to 0x65c7fb4, (0x2fec bytes) 2024-09-14T05:59:48.536 INFO:teuthology.orchestra.run.smithi006.stdout:2271 read 0x395feec thru 0x3968244 (0x8359 bytes) 2024-09-14T05:59:48.536 INFO:teuthology.orchestra.run.smithi006.stdout:2272 write 0x396be6a thru 0x396f53f (0x36d6 bytes) 2024-09-14T05:59:48.544 INFO:teuthology.orchestra.run.smithi006.stdout:2273 read 0x4ba7b75 thru 0x4bb0aa1 (0x8f2d bytes) 2024-09-14T05:59:48.544 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.544 INFO:teuthology.orchestra.run.smithi006.stdout:2276 write 0x6913963 thru 0x691cfad (0x964b bytes) 2024-09-14T05:59:48.545 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:48.545 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:48.547 INFO:teuthology.orchestra.run.smithi006.stdout:2277 read 0x56cb65c thru 0x56d8a25 (0xd3ca bytes) 2024-09-14T05:59:48.547 INFO:teuthology.orchestra.run.smithi006.stdout:2278 punch from 0x15d724 to 0x163111, (0x59ed bytes) 2024-09-14T05:59:48.547 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.547 INFO:teuthology.orchestra.run.smithi006.stdout:2280 read 0x2b119d5 thru 0x2b13b43 (0x216f bytes) 2024-09-14T05:59:48.547 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.548 INFO:teuthology.orchestra.run.smithi006.stdout:2283 write 0x1f2bdcc thru 0x1f2c87f (0xab4 bytes) 2024-09-14T05:59:48.550 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:48.545+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:48.567 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:48.567 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:48.569 INFO:teuthology.orchestra.run.smithi006.stdout:2284 write 0xac52e2f thru 0xac59995 (0x6b67 bytes) 2024-09-14T05:59:48.572 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.573 INFO:teuthology.orchestra.run.smithi006.stdout:2286 read 0x857b1ad thru 0x85844f2 (0x9346 bytes) 2024-09-14T05:59:48.575 INFO:teuthology.orchestra.run.smithi006.stdout:2287 trunc from 0xac59996 to 0x99aedc9 2024-09-14T05:59:48.590 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:48.590 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:48.599 INFO:teuthology.orchestra.run.smithi006.stdout:2288 write 0xb3d1ae1 thru 0xb3d3d5c (0x227c bytes) 2024-09-14T05:59:48.613 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:48.613 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:48.615 INFO:teuthology.orchestra.run.smithi006.stdout:2289 trunc from 0xb3d3d5d to 0x34f983e 2024-09-14T05:59:48.643 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:48.651 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:48.649+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:48.667 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:48.680 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:48.680 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:48.680 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21567 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 993280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.760882569, 2024-09-14T05:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031237369000000001, 2024-09-14T05:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21567 2024-09-14T05:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918112+0000", 2024-09-14T05:59:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6000000000000004e-07 2024-09-14T05:59:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918113+0000", 2024-09-14T05:59:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:59:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918118+0000", 2024-09-14T05:59:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4789999999999998e-06 2024-09-14T05:59:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918122+0000", 2024-09-14T05:59:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7740000000000002e-06 2024-09-14T05:59:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949196+0000", 2024-09-14T05:59:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031074101 2024-09-14T05:59:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949239+0000", 2024-09-14T05:59:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3724999999999999e-05 2024-09-14T05:59:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949349+0000", 2024-09-14T05:59:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010916699999999999 2024-09-14T05:59:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21570 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1001472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.760849856, 2024-09-14T05:59:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031375860999999998, 2024-09-14T05:59:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21570 2024-09-14T05:59:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0499999999999999e-07 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918146+0000", 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1179999999999999e-06 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918153+0000", 2024-09-14T05:59:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0299999999999999e-06 2024-09-14T05:59:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918157+0000", 2024-09-14T05:59:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0589999999999996e-06 2024-09-14T05:59:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949386+0000", 2024-09-14T05:59:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031229455999999999 2024-09-14T05:59:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949448+0000", 2024-09-14T05:59:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2291000000000004e-05 2024-09-14T05:59:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949520+0000", 2024-09-14T05:59:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1501999999999994e-05 2024-09-14T05:59:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21574 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1024000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.760831114999998, 2024-09-14T05:59:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031511174000000003, 2024-09-14T05:59:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21574 2024-09-14T05:59:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8500000000000002e-07 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918165+0000", 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.674e-06 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918169+0000", 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5709999999999999e-06 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918175+0000", 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949555+0000", 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031380230000000002 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949606+0000", 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0300000000000003e-05 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949674+0000", 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8175000000000004e-05 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21576 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1032192~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.760807807999999, 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031677479000000001, 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21576 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918187+0000", 2024-09-14T05:59:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7100000000000001e-07 2024-09-14T05:59:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918189+0000", 2024-09-14T05:59:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.43e-06 2024-09-14T05:59:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918198+0000", 2024-09-14T05:59:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1859999999999998e-06 2024-09-14T05:59:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918206+0000", 2024-09-14T05:59:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4939999999999997e-06 2024-09-14T05:59:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949716+0000", 2024-09-14T05:59:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031510428 2024-09-14T05:59:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949789+0000", 2024-09-14T05:59:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3233999999999997e-05 2024-09-14T05:59:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949863+0000", 2024-09-14T05:59:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4035999999999994e-05 2024-09-14T05:59:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21577 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1046528~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.760776974999999, 2024-09-14T05:59:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031830166999999999, 2024-09-14T05:59:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21577 2024-09-14T05:59:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3499999999999996e-07 2024-09-14T05:59:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918221+0000", 2024-09-14T05:59:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3179999999999998e-06 2024-09-14T05:59:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918230+0000", 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9460000000000004e-06 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918240+0000", 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9580000000000002e-06 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949896+0000", 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031655839999999998 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949944+0000", 2024-09-14T05:59:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8658000000000001e-05 2024-09-14T05:59:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950047+0000", 2024-09-14T05:59:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102812 2024-09-14T05:59:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21615 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 995328~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.760565976999999, 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031807305000000001, 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21615 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6499999999999999e-07 2024-09-14T05:59:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918431+0000", 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.948e-06 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918440+0000", 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9390000000000003e-06 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918448+0000", 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.233e-06 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950088+0000", 2024-09-14T05:59:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031640922000000002 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950153+0000", 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4500999999999998e-05 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950235+0000", 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2196999999999999e-05 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21618 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1003520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.760534708000002, 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031945335999999998, 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21618 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918460+0000", 2024-09-14T05:59:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8400000000000002e-07 2024-09-14T05:59:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918464+0000", 2024-09-14T05:59:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4699999999999998e-06 2024-09-14T05:59:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918473+0000", 2024-09-14T05:59:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2159999999999995e-06 2024-09-14T05:59:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918480+0000", 2024-09-14T05:59:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2540000000000003e-06 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950268+0000", 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031787955 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950327+0000", 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9289000000000001e-05 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950404+0000", 2024-09-14T05:59:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7168000000000004e-05 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21620 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1026048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.760493358000002, 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032089751, 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21620 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918501+0000", 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.46e-07 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918503+0000", 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4940000000000002e-06 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918509+0000", 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0850000000000002e-06 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918514+0000", 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7219999999999999e-06 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950435+0000", 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031921161000000003 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950518+0000", 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2280999999999994e-05 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950590+0000", 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2562000000000001e-05 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21622 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1034240~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.760473093000002, 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032304393000000001, 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21622 2024-09-14T05:59:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8299999999999997e-07 2024-09-14T05:59:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918523+0000", 2024-09-14T05:59:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7370000000000001e-06 2024-09-14T05:59:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918528+0000", 2024-09-14T05:59:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.87e-06 2024-09-14T05:59:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918532+0000", 2024-09-14T05:59:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8999999999999999e-06 2024-09-14T05:59:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950656+0000", 2024-09-14T05:59:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032123800000000001 2024-09-14T05:59:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950745+0000", 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9044999999999999e-05 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950825+0000", 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0457999999999994e-05 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21668 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 983040~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.760350866, 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032333329000000001, 2024-09-14T05:59:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21668 2024-09-14T05:59:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9999999999999998e-07 2024-09-14T05:59:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918650+0000", 2024-09-14T05:59:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0779999999999998e-06 2024-09-14T05:59:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918656+0000", 2024-09-14T05:59:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.536e-06 2024-09-14T05:59:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918663+0000", 2024-09-14T05:59:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9480000000000002e-06 2024-09-14T05:59:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950856+0000", 2024-09-14T05:59:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032193580999999999 2024-09-14T05:59:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950908+0000", 2024-09-14T05:59:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1248999999999997e-05 2024-09-14T05:59:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950976+0000", 2024-09-14T05:59:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8536999999999998e-05 2024-09-14T05:59:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21671 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 997376~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.76032008, 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032470855999999999, 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21671 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:59:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918677+0000", 2024-09-14T05:59:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.565e-06 2024-09-14T05:59:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918686+0000", 2024-09-14T05:59:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3309999999999993e-06 2024-09-14T05:59:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918694+0000", 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6249999999999998e-06 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951003+0000", 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032308903 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951059+0000", 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951145+0000", 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.53e-05 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21673 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1005568~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.760288865, 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.03260818, 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21673 2024-09-14T05:59:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918706+0000", 2024-09-14T05:59:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4199999999999995e-07 2024-09-14T05:59:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918715+0000", 2024-09-14T05:59:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7459999999999995e-06 2024-09-14T05:59:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918725+0000", 2024-09-14T05:59:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0077e-05 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918733+0000", 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9610000000000005e-06 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951178+0000", 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032444711000000001 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951246+0000", 2024-09-14T05:59:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8256999999999994e-05 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951313+0000", 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6785999999999994e-05 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21674 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1028096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.760248737000001, 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032759020999999999, 2024-09-14T05:59:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21674 2024-09-14T05:59:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918746+0000", 2024-09-14T05:59:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6599999999999995e-07 2024-09-14T05:59:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918749+0000", 2024-09-14T05:59:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1489999999999998e-06 2024-09-14T05:59:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918758+0000", 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2779999999999999e-06 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918771+0000", 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2799999999999999e-05 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951346+0000", 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032574573000000002 2024-09-14T05:59:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951426+0000", 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0486000000000002e-05 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951504+0000", 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7968999999999998e-05 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21676 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1036288~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.760211178999999, 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032901069999999998, 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21676 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2600000000000002e-07 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918787+0000", 2024-09-14T05:59:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2430000000000001e-06 2024-09-14T05:59:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918796+0000", 2024-09-14T05:59:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5910000000000002e-06 2024-09-14T05:59:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918804+0000", 2024-09-14T05:59:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4050000000000003e-06 2024-09-14T05:59:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951539+0000", 2024-09-14T05:59:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032735383999999999 2024-09-14T05:59:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951611+0000", 2024-09-14T05:59:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1675999999999996e-05 2024-09-14T05:59:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951684+0000", 2024-09-14T05:59:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3045000000000003e-05 2024-09-14T05:59:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21723 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 985088~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.760009062000002, 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032913915000000002, 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21723 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0499999999999999e-07 2024-09-14T05:59:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918987+0000", 2024-09-14T05:59:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.883e-06 2024-09-14T05:59:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918992+0000", 2024-09-14T05:59:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8550000000000001e-06 2024-09-14T05:59:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918996+0000", 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8800000000000001e-06 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951712+0000", 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032715883000000001 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951784+0000", 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2484999999999995e-05 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951899+0000", 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000114524 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21725 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1007616~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.759991049, 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033063000000000002, 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21725 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3099999999999999e-07 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919013+0000", 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0222e-05 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919019+0000", 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5520000000000004e-06 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919023+0000", 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0779999999999997e-06 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951932+0000", 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032908958000000002 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952000+0000", 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8435000000000005e-05 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952066+0000", 2024-09-14T05:59:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5424000000000002e-05 2024-09-14T05:59:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21726 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1015808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.759964527000001, 2024-09-14T05:59:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033223673000000002, 2024-09-14T05:59:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21726 2024-09-14T05:59:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919030+0000", 2024-09-14T05:59:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9000000000000002e-07 2024-09-14T05:59:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919031+0000", 2024-09-14T05:59:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7060000000000001e-06 2024-09-14T05:59:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919036+0000", 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7439999999999998e-06 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919040+0000", 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9559999999999999e-06 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952093+0000", 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033053355 2024-09-14T05:59:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952151+0000", 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7352999999999998e-05 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952253+0000", 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102169 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21727 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1030144~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.759948526999999, 2024-09-14T05:59:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033447573000000001, 2024-09-14T05:59:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21727 2024-09-14T05:59:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919046+0000", 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.53e-07 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919049+0000", 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5130000000000001e-06 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919055+0000", 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3280000000000002e-06 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919059+0000", 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9820000000000002e-06 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952280+0000", 2024-09-14T05:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033220999000000001 2024-09-14T05:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952358+0000", 2024-09-14T05:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7941999999999993e-05 2024-09-14T05:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952493+0000", 2024-09-14T05:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000134456 2024-09-14T05:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21729 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1038336~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.759929002, 2024-09-14T05:59:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033604367000000003, 2024-09-14T05:59:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21729 2024-09-14T05:59:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1200000000000003e-07 2024-09-14T05:59:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919089+0000", 2024-09-14T05:59:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.332e-05 2024-09-14T05:59:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919096+0000", 2024-09-14T05:59:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5109999999999997e-06 2024-09-14T05:59:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919101+0000", 2024-09-14T05:59:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8239999999999999e-06 2024-09-14T05:59:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952524+0000", 2024-09-14T05:59:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033422466999999997 2024-09-14T05:59:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952599+0000", 2024-09-14T05:59:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5074999999999995e-05 2024-09-14T05:59:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952669+0000", 2024-09-14T05:59:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0557999999999998e-05 2024-09-14T05:59:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:28643 3.19 3:9c53e3bd:::rbd_data.11276864ec6c.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.059318154, 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033793691000000001, 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 28643 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619677+0000", 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.717e-06 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619683+0000", 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5300000000000004e-06 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619695+0000", 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2211e-05 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619701+0000", 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9429999999999997e-06 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619754+0000", 2024-09-14T05:59:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2899000000000003e-05 2024-09-14T05:59:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619809+0000", 2024-09-14T05:59:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4783e-05 2024-09-14T05:59:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 3", 2024-09-14T05:59:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.625771+0000", 2024-09-14T05:59:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0059617960000000001 2024-09-14T05:59:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653329+0000", 2024-09-14T05:59:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.027558068000000002 2024-09-14T05:59:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653351+0000", 2024-09-14T05:59:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2133e-05 2024-09-14T05:59:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653409+0000", 2024-09-14T05:59:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8687999999999998e-05 2024-09-14T05:59:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653469+0000", 2024-09-14T05:59:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9923000000000002e-05 2024-09-14T05:59:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:48.768 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:48.769 INFO:teuthology.orchestra.run.smithi006.stdout:2293 write 0xe0e0144 thru 0xe0ec97e (0xc83b bytes) 2024-09-14T05:59:48.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:59:48.771 INFO:teuthology.orchestra.run.smithi006.stdout:2294 write 0x2808bf9 thru 0x2812756 (0x9b5e bytes) 2024-09-14T05:59:48.771 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.771 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.771 INFO:teuthology.orchestra.run.smithi006.stdout:2298 punch from 0x608972a to 0x60901a5, (0x6a7b bytes) 2024-09-14T05:59:48.772 INFO:teuthology.orchestra.run.smithi006.stdout:2300 write 0x70e8d7f thru 0x70e98ee (0xb70 bytes) 2024-09-14T05:59:48.772 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.772 INFO:teuthology.orchestra.run.smithi006.stdout:2302 write 0xc7f971 thru 0xc85860 (0x5ef0 bytes) 2024-09-14T05:59:48.772 INFO:teuthology.orchestra.run.smithi006.stdout:2303 read 0x89c82a2 thru 0x89d8054 (0xfdb3 bytes) 2024-09-14T05:59:48.772 INFO:teuthology.orchestra.run.smithi006.stdout:2304 write 0x1cc9b37 thru 0x1cd0f60 (0x742a bytes) 2024-09-14T05:59:48.772 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.772 INFO:teuthology.orchestra.run.smithi006.stdout:2306 write 0xfeecb8 thru 0xffe2d4 (0xf61d bytes) 2024-09-14T05:59:48.772 INFO:teuthology.orchestra.run.smithi006.stdout:2308 trunc from 0xe0ec97f to 0x3265d6 2024-09-14T05:59:48.772 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:48.769+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:48.793 INFO:teuthology.orchestra.run.smithi006.stdout:2310 writesame 0xe3e7091 thru 0xe3ebcad data_size 0x3(0x4c1d bytes) 2024-09-14T05:59:48.793 INFO:teuthology.orchestra.run.smithi006.stdout:2311 writesame 0xc560c02 thru 0xc5620e4 data_size 0x1(0x14e3 bytes) 2024-09-14T05:59:48.799 INFO:teuthology.orchestra.run.smithi006.stdout:2313 read 0xd13bd96 thru 0xd1415b6 (0x5821 bytes) 2024-09-14T05:59:48.804 INFO:teuthology.orchestra.run.smithi006.stdout:2314 trunc from 0xe3ebcae to 0xb6b6c80 2024-09-14T05:59:48.815 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T05:59:48.819 INFO:teuthology.orchestra.run.smithi006.stdout:2315 punch from 0x65fbc28 to 0x65fd06b, (0x1443 bytes) 2024-09-14T05:59:48.819 INFO:teuthology.orchestra.run.smithi006.stdout:2316 writesame 0x666558a thru 0x6669480 data_size 0x3(0x3ef7 bytes) 2024-09-14T05:59:48.827 INFO:teuthology.orchestra.run.smithi006.stdout:2319 writesame 0x13b125 thru 0x14869e data_size 0x19(0xd57a bytes) 2024-09-14T05:59:48.833 INFO:teuthology.orchestra.run.smithi006.stdout:2320 read 0x6751403 thru 0x675ad39 (0x9937 bytes) 2024-09-14T05:59:48.837 INFO:teuthology.orchestra.run.smithi006.stdout:2321 writesame 0x4feaf94 thru 0x4ffa925 data_size 0x5(0xf992 bytes) 2024-09-14T05:59:48.850 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-14T05:59:48.858 INFO:teuthology.orchestra.run.smithi006.stdout:2322 read 0x67d91b2 thru 0x67e509c (0xbeeb bytes) 2024-09-14T05:59:48.859 INFO:teuthology.orchestra.run.smithi006.stdout:2323 write 0x439512d thru 0x439ca78 (0x794c bytes) 2024-09-14T05:59:48.862 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.862 INFO:teuthology.orchestra.run.smithi006.stdout:2326 writesame 0x9d00a91 thru 0x9d09d9e data_size 0x7(0x930e bytes) 2024-09-14T05:59:48.871 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:48.869+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:48.874 INFO:teuthology.orchestra.run.smithi006.stdout:2327 read 0x7ce83ad thru 0x7cf3dee (0xba42 bytes) 2024-09-14T05:59:48.874 INFO:teuthology.orchestra.run.smithi006.stdout:2328 punch from 0x4686afe to 0x4691b46, (0xb048 bytes) 2024-09-14T05:59:48.875 INFO:teuthology.orchestra.run.smithi006.stdout:2329 trunc from 0xb6b6c80 to 0xb3c8c0e 2024-09-14T05:59:48.886 INFO:teuthology.orchestra.run.smithi006.stdout:2331 write 0x8d714ff thru 0x8d75ad7 (0x45d9 bytes) 2024-09-14T05:59:48.894 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.894 INFO:teuthology.orchestra.run.smithi006.stdout:2336 punch from 0x9c0896d to 0x9c0b285, (0x2918 bytes) 2024-09-14T05:59:48.894 INFO:teuthology.orchestra.run.smithi006.stdout:2337 read 0x24db986 thru 0x24e6b67 (0xb1e2 bytes) 2024-09-14T05:59:48.894 INFO:teuthology.orchestra.run.smithi006.stdout:2338 writesame 0xa8887df thru 0xa8894d1 data_size 0x11(0xcf3 bytes) 2024-09-14T05:59:48.900 INFO:teuthology.orchestra.run.smithi006.stdout:2339 writesame 0x60d7d7 thru 0x61988f data_size 0x1(0xc0b9 bytes) 2024-09-14T05:59:48.930 INFO:teuthology.orchestra.run.smithi006.stdout:2340 read 0xa5d7449 thru 0xa5e52f8 (0xdeb0 bytes) 2024-09-14T05:59:48.934 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:48.934 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:48.934 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:48.935 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:48.942 INFO:teuthology.orchestra.run.smithi006.stdout:2341 write 0xd3a3f2e thru 0xd3a926f (0x5342 bytes) 2024-09-14T05:59:48.948 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.948 INFO:teuthology.orchestra.run.smithi006.stdout:2344 trunc from 0xd3a9270 to 0xd688772 2024-09-14T05:59:48.952 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:59:48.957 INFO:teuthology.orchestra.run.smithi006.stdout:2346 write 0x3c68af2 thru 0x3c746d7 (0xbbe6 bytes) 2024-09-14T05:59:48.960 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.960 INFO:teuthology.orchestra.run.smithi006.stdout:2349 read 0x434f267 thru 0x435c353 (0xd0ed bytes) 2024-09-14T05:59:48.961 INFO:teuthology.orchestra.run.smithi006.stdout:2350 read 0x7d3e1c4 thru 0x7d4e0b0 (0xfeed bytes) 2024-09-14T05:59:48.962 INFO:teuthology.orchestra.run.smithi006.stdout:2351 read 0x4e82267 thru 0x4e9158e (0xf328 bytes) 2024-09-14T05:59:48.962 INFO:teuthology.orchestra.run.smithi006.stdout:2352 write 0x5c7b732 thru 0x5c7cbea (0x14b9 bytes) 2024-09-14T05:59:48.965 INFO:teuthology.orchestra.run.smithi006.stdout:2353 read 0x6606360 thru 0x6615bd7 (0xf878 bytes) 2024-09-14T05:59:48.966 INFO:teuthology.orchestra.run.smithi006.stdout:2354 punch from 0x51bedf3 to 0x51c8478, (0x9685 bytes) 2024-09-14T05:59:48.966 INFO:teuthology.orchestra.run.smithi006.stdout:2356 read 0x63a642f thru 0x63a7d6d (0x193f bytes) 2024-09-14T05:59:48.966 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:48.968 INFO:teuthology.orchestra.run.smithi006.stdout:2359 trunc from 0xd688772 to 0xc1b6eff 2024-09-14T05:59:48.971 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:48.969+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:49.002 INFO:teuthology.orchestra.run.smithi006.stdout:2361 trunc from 0xc1b6eff to 0x42abe27 2024-09-14T05:59:49.028 INFO:teuthology.orchestra.run.smithi006.stdout:2362 writesame 0x2c2b755 thru 0x2c39ece data_size 0x1(0xe77a bytes) 2024-09-14T05:59:49.073 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:49.073+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:49.094 INFO:teuthology.orchestra.run.smithi006.stdout:2365 read 0x3f220a0 thru 0x3f3177a (0xf6db bytes) 2024-09-14T05:59:49.095 INFO:teuthology.orchestra.run.smithi006.stdout:2366 read 0x31e7862 thru 0x31f0f47 (0x96e6 bytes) 2024-09-14T05:59:49.095 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:49.096 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:49.096 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:49.096 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:49.096 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:49.096 INFO:teuthology.orchestra.run.smithi006.stdout:2367 read 0x10182d9 thru 0x1022375 (0xa09d bytes) 2024-09-14T05:59:49.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:59:49.121 INFO:teuthology.orchestra.run.smithi006.stdout:2369 writesame 0xe164e96 thru 0xe17189f data_size 0xb(0xca0a bytes) 2024-09-14T05:59:49.121 INFO:teuthology.orchestra.run.smithi006.stdout:2370 writesame 0x4b2602b thru 0x4b26f44 data_size 0x1(0xf1a bytes) 2024-09-14T05:59:49.128 INFO:teuthology.orchestra.run.smithi006.stdout:2372 trunc from 0xe1718a0 to 0xb2ce08e 2024-09-14T05:59:49.137 INFO:teuthology.orchestra.run.smithi006.stdout:2373 punch from 0x61856c7 to 0x6191ffe, (0xc937 bytes) 2024-09-14T05:59:49.137 INFO:teuthology.orchestra.run.smithi006.stdout:2374 read 0xecd4f1 thru 0xed5b4c (0x865c bytes) 2024-09-14T05:59:49.138 INFO:teuthology.orchestra.run.smithi006.stdout:2375 clone 16 order 21 su 8192 sc 7 2024-09-14T05:59:49.174 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:49.173+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:49.243 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:49.243 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:49.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:49.243 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:49.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.243 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3629 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'31, mlcod=31'25)", 2024-09-14T05:59:49.243 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:49.243 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 31.911467462000001, 2024-09-14T05:59:49.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048071900000000002, 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329483+0000", 2024-09-14T05:59:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-07 2024-09-14T05:59:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329488+0000", 2024-09-14T05:59:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000004e-06 2024-09-14T05:59:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329496+0000", 2024-09-14T05:59:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2209999999999997e-06 2024-09-14T05:59:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.246 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.246 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329501+0000", 2024-09-14T05:59:49.246 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8729999999999998e-06 2024-09-14T05:59:49.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.246 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.246 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329545+0000", 2024-09-14T05:59:49.246 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4382999999999998e-05 2024-09-14T05:59:49.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.246 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.246 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329564+0000", 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8947999999999999e-05 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334225+0000", 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004660923 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334289+0000", 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4041999999999994e-05 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.248 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3630 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'32, mlcod=31'25)", 2024-09-14T05:59:49.248 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:49.248 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 31.910719456999999, 2024-09-14T05:59:49.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0040991680000000003, 2024-09-14T05:59:49.248 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.248 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.248 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.248 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.248 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:49.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330231+0000", 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4099999999999998e-07 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330235+0000", 2024-09-14T05:59:49.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.391e-06 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330245+0000", 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330249+0000", 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330301+0000", 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1515999999999999e-05 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330312+0000", 2024-09-14T05:59:49.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1603000000000001e-05 2024-09-14T05:59:49.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334293+0000", 2024-09-14T05:59:49.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039809449999999996 2024-09-14T05:59:49.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334329+0000", 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5763000000000003e-05 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3632 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'34, mlcod=31'27)", 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 31.908345273999998, 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047983469999999997, 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332605+0000", 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5099999999999999e-07 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332611+0000", 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6999999999999996e-06 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332623+0000", 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2401e-05 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332629+0000", 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3720000000000001e-06 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332691+0000", 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1451000000000005e-05 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332711+0000", 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0285e-05 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337341+0000", 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046295900000000003 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337402+0000", 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1797000000000005e-05 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3633 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'35, mlcod=31'27)", 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 31.907483829, 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039783919999999999, 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.256 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:49.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1500000000000004e-07 2024-09-14T05:59:49.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.258 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.258 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333479+0000", 2024-09-14T05:59:49.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2918999999999999e-05 2024-09-14T05:59:49.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.258 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.258 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333489+0000", 2024-09-14T05:59:49.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0068000000000001e-05 2024-09-14T05:59:49.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333494+0000", 2024-09-14T05:59:49.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9309999999999999e-06 2024-09-14T05:59:49.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333543+0000", 2024-09-14T05:59:49.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9293999999999999e-05 2024-09-14T05:59:49.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333555+0000", 2024-09-14T05:59:49.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1467e-05 2024-09-14T05:59:49.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337408+0000", 2024-09-14T05:59:49.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038532549999999999 2024-09-14T05:59:49.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337444+0000", 2024-09-14T05:59:49.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5843000000000002e-05 2024-09-14T05:59:49.260 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.261 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.261 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.261 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3638 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'40, mlcod=31'32)", 2024-09-14T05:59:49.261 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:49.261 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 31.902203359000001, 2024-09-14T05:59:49.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004283345, 2024-09-14T05:59:49.261 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.261 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.261 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.261 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:49.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:49.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338747+0000", 2024-09-14T05:59:49.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0279999999999999e-06 2024-09-14T05:59:49.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338756+0000", 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5909999999999996e-06 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338774+0000", 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8073000000000001e-05 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338785+0000", 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1017e-05 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338844+0000", 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9292000000000001e-05 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338864+0000", 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9528999999999999e-05 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.342984+0000", 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041207809999999996 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.265 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.343029+0000", 2024-09-14T05:59:49.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5034000000000003e-05 2024-09-14T05:59:49.265 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.265 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.265 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.265 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:11218 3.9 e38/24 3:967d83c0:::rbd_data.1127ff8b71e0.0000000000000064:head v 38'37, mlcod=38'35)", 2024-09-14T05:59:49.265 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:49.265 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.996097246000001, 2024-09-14T05:59:49.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004035416, 2024-09-14T05:59:49.265 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.265 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244854+0000", 2024-09-14T05:59:49.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2350000000000002e-06 2024-09-14T05:59:49.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.267 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.267 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246114+0000", 2024-09-14T05:59:49.267 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012600980000000001 2024-09-14T05:59:49.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.267 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.267 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246158+0000", 2024-09-14T05:59:49.267 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3473000000000002e-05 2024-09-14T05:59:49.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.267 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.268 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246179+0000", 2024-09-14T05:59:49.268 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0738999999999999e-05 2024-09-14T05:59:49.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.268 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.268 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246306+0000", 2024-09-14T05:59:49.268 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000127238 2024-09-14T05:59:49.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.268 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.268 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246349+0000", 2024-09-14T05:59:49.268 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3211999999999999e-05 2024-09-14T05:59:49.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248780+0000", 2024-09-14T05:59:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0024304970000000002 2024-09-14T05:59:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248888+0000", 2024-09-14T05:59:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010792400000000001 2024-09-14T05:59:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:17596 3.4 e41/24 3:27f62511:::rbd_data.1127d65075f9.00000000000000ca:head v 41'97, mlcod=41'95)", 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.270450794999999, 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049456559999999997, 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970500+0000", 2024-09-14T05:59:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9600000000000008e-07 2024-09-14T05:59:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970614+0000", 2024-09-14T05:59:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000113956 2024-09-14T05:59:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.272 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.272 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970631+0000", 2024-09-14T05:59:49.272 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7150999999999999e-05 2024-09-14T05:59:49.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.272 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.272 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970643+0000", 2024-09-14T05:59:49.272 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1868999999999999e-05 2024-09-14T05:59:49.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.272 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.272 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970711+0000", 2024-09-14T05:59:49.273 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8952e-05 2024-09-14T05:59:49.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.273 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.273 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970738+0000", 2024-09-14T05:59:49.273 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6055999999999999e-05 2024-09-14T05:59:49.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.273 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.273 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975388+0000", 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046502499999999999 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975444+0000", 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6425999999999998e-05 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24289 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'57, mlcod=41'54)", 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.085158616000001, 2024-09-14T05:59:49.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.060867738999999997, 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.276 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.276 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155793+0000", 2024-09-14T05:59:49.276 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9470000000000002e-06 2024-09-14T05:59:49.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.276 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.276 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181776+0000", 2024-09-14T05:59:49.276 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.02598313 2024-09-14T05:59:49.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.276 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.276 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181817+0000", 2024-09-14T05:59:49.276 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1440000000000003e-05 2024-09-14T05:59:49.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.277 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.277 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181834+0000", 2024-09-14T05:59:49.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6979000000000001e-05 2024-09-14T05:59:49.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.277 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.277 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181931+0000", 2024-09-14T05:59:49.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7219999999999994e-05 2024-09-14T05:59:49.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.277 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.277 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181964+0000", 2024-09-14T05:59:49.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2094999999999997e-05 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216586+0000", 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034622503999999998 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216658+0000", 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24309 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'58, mlcod=41'56)", 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 16.985923510999999, 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044435519999999999, 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.280 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:49.280 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.280 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.280 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255027+0000", 2024-09-14T05:59:49.280 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T05:59:49.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.280 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.280 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255040+0000", 2024-09-14T05:59:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2773e-05 2024-09-14T05:59:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255066+0000", 2024-09-14T05:59:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5459000000000001e-05 2024-09-14T05:59:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255076+0000", 2024-09-14T05:59:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0372e-05 2024-09-14T05:59:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255151+0000", 2024-09-14T05:59:49.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5444999999999993e-05 2024-09-14T05:59:49.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255176+0000", 2024-09-14T05:59:49.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5089e-05 2024-09-14T05:59:49.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259379+0000", 2024-09-14T05:59:49.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042025439999999999 2024-09-14T05:59:49.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.283 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.283 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259469+0000", 2024-09-14T05:59:49.283 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0407000000000004e-05 2024-09-14T05:59:49.283 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.283 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.283 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.283 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37361 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'280, mlcod=50'278)", 2024-09-14T05:59:49.283 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.041186+0000", 2024-09-14T05:59:49.283 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1997632530000004, 2024-09-14T05:59:49.283 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075534590000000002, 2024-09-14T05:59:49.284 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.284 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.284 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.284 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.284 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T05:59:49.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.284 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.284 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T05:59:49.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041187+0000", 2024-09-14T05:59:49.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2160000000000001e-06 2024-09-14T05:59:49.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041208+0000", 2024-09-14T05:59:49.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0528999999999999e-05 2024-09-14T05:59:49.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041225+0000", 2024-09-14T05:59:49.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7255e-05 2024-09-14T05:59:49.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041235+0000", 2024-09-14T05:59:49.286 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4190000000000008e-06 2024-09-14T05:59:49.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041302+0000", 2024-09-14T05:59:49.286 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7774000000000005e-05 2024-09-14T05:59:49.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041330+0000", 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7382999999999999e-05 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048686+0000", 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073564570000000003 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048740+0000", 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3426e-05 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.287 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.288 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37362 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'281, mlcod=50'278)", 2024-09-14T05:59:49.288 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.046086+0000", 2024-09-14T05:59:49.288 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.1948628540000001, 2024-09-14T05:59:49.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047169380000000004, 2024-09-14T05:59:49.288 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.288 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.288 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.288 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.288 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T05:59:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T05:59:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046087+0000", 2024-09-14T05:59:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3600000000000003e-07 2024-09-14T05:59:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046093+0000", 2024-09-14T05:59:49.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7869999999999998e-06 2024-09-14T05:59:49.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.290 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046106+0000", 2024-09-14T05:59:49.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2636999999999999e-05 2024-09-14T05:59:49.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.290 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046113+0000", 2024-09-14T05:59:49.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0129999999999996e-06 2024-09-14T05:59:49.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046170+0000", 2024-09-14T05:59:49.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7819000000000003e-05 2024-09-14T05:59:49.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046194+0000", 2024-09-14T05:59:49.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3167999999999999e-05 2024-09-14T05:59:49.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050760+0000", 2024-09-14T05:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045665999999999997 2024-09-14T05:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050803+0000", 2024-09-14T05:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3177999999999999e-05 2024-09-14T05:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.292 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39545 3.0 e50/24 3:06bdaf45:::rbd_data.112781171282.0000000000000002:head v 50'347, mlcod=50'345)", 2024-09-14T05:59:49.293 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.578467+0000", 2024-09-14T05:59:49.293 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.662482572, 2024-09-14T05:59:49.293 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047008700000000002, 2024-09-14T05:59:49.293 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.293 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.293 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.293 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.293 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T05:59:49.293 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.293 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T05:59:49.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578468+0000", 2024-09-14T05:59:49.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1599999999999999e-06 2024-09-14T05:59:49.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579733+0000", 2024-09-14T05:59:49.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012647120000000001 2024-09-14T05:59:49.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579755+0000", 2024-09-14T05:59:49.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2637999999999999e-05 2024-09-14T05:59:49.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579766+0000", 2024-09-14T05:59:49.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0264e-05 2024-09-14T05:59:49.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579832+0000", 2024-09-14T05:59:49.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6531000000000004e-05 2024-09-14T05:59:49.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.296 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.296 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579859+0000", 2024-09-14T05:59:49.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6855999999999998e-05 2024-09-14T05:59:49.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.296 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.296 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583098+0000", 2024-09-14T05:59:49.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003238632 2024-09-14T05:59:49.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.297 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583168+0000", 2024-09-14T05:59:49.297 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0077e-05 2024-09-14T05:59:49.297 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.297 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.297 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.297 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39602 3.9 e50/24 3:909cb01b:::rbd_data.112781171282.000000000000006f:head v 50'86, mlcod=50'84)", 2024-09-14T05:59:49.297 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.746165+0000", 2024-09-14T05:59:49.298 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.4947846020000002, 2024-09-14T05:59:49.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041492480000000003, 2024-09-14T05:59:49.298 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.298 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.298 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.298 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746165+0000", 2024-09-14T05:59:49.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746165+0000", 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746166+0000", 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3600000000000002e-07 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746287+0000", 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000120927 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.299 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.300 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746297+0000", 2024-09-14T05:59:49.300 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0395e-05 2024-09-14T05:59:49.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.300 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.300 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746302+0000", 2024-09-14T05:59:49.300 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2379999999999997e-06 2024-09-14T05:59:49.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.300 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.300 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746362+0000", 2024-09-14T05:59:49.300 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9765999999999997e-05 2024-09-14T05:59:49.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.301 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.301 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746385+0000", 2024-09-14T05:59:49.301 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3357999999999999e-05 2024-09-14T05:59:49.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.301 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.301 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.750213+0000", 2024-09-14T05:59:49.301 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038276019999999998 2024-09-14T05:59:49.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.301 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.302 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.750314+0000", 2024-09-14T05:59:49.302 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010112599999999999 2024-09-14T05:59:49.302 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.302 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.302 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.302 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39765 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'410, mlcod=51'406)", 2024-09-14T05:59:49.302 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.004422+0000", 2024-09-14T05:59:49.302 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.2365277710000004, 2024-09-14T05:59:49.302 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044953839999999998, 2024-09-14T05:59:49.302 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.302 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.302 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004423+0000", 2024-09-14T05:59:49.303 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:59:49.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.304 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.304 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004432+0000", 2024-09-14T05:59:49.304 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2180000000000005e-06 2024-09-14T05:59:49.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.304 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.304 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004453+0000", 2024-09-14T05:59:49.304 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1182000000000001e-05 2024-09-14T05:59:49.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.304 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.304 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004464+0000", 2024-09-14T05:59:49.305 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1198e-05 2024-09-14T05:59:49.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.305 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.305 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004520+0000", 2024-09-14T05:59:49.305 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5835999999999999e-05 2024-09-14T05:59:49.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.305 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.305 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004547+0000", 2024-09-14T05:59:49.305 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6454000000000001e-05 2024-09-14T05:59:49.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.305 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.306 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008866+0000", 2024-09-14T05:59:49.306 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043194679999999999 2024-09-14T05:59:49.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.306 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.306 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008917+0000", 2024-09-14T05:59:49.306 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0837000000000001e-05 2024-09-14T05:59:49.306 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.306 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.306 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39847 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'431, mlcod=51'426)", 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.117705+0000", 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.123244422, 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046358010000000002, 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.307 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.308 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T05:59:49.308 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.308 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.308 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117706+0000", 2024-09-14T05:59:49.308 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4899999999999995e-07 2024-09-14T05:59:49.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.308 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.308 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117711+0000", 2024-09-14T05:59:49.308 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6890000000000001e-06 2024-09-14T05:59:49.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117724+0000", 2024-09-14T05:59:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3054000000000001e-05 2024-09-14T05:59:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117736+0000", 2024-09-14T05:59:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1654999999999999e-05 2024-09-14T05:59:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117788+0000", 2024-09-14T05:59:49.309 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2197000000000002e-05 2024-09-14T05:59:49.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.310 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117811+0000", 2024-09-14T05:59:49.310 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2472000000000001e-05 2024-09-14T05:59:49.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.310 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122292+0000", 2024-09-14T05:59:49.310 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004481596 2024-09-14T05:59:49.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.310 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122341+0000", 2024-09-14T05:59:49.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8489000000000003e-05 2024-09-14T05:59:49.311 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.311 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.311 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.311 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39865 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'438, mlcod=51'434)", 2024-09-14T05:59:49.311 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145039+0000", 2024-09-14T05:59:49.311 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.0959101240000004, 2024-09-14T05:59:49.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004519426, 2024-09-14T05:59:49.311 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.311 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.312 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.312 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.312 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T05:59:49.312 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.312 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.312 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T05:59:49.312 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.312 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.312 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145040+0000", 2024-09-14T05:59:49.313 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7899999999999998e-07 2024-09-14T05:59:49.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.313 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.313 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145044+0000", 2024-09-14T05:59:49.313 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3789999999999999e-06 2024-09-14T05:59:49.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.313 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.313 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145053+0000", 2024-09-14T05:59:49.313 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2650000000000002e-06 2024-09-14T05:59:49.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.313 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145058+0000", 2024-09-14T05:59:49.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8169999999999998e-06 2024-09-14T05:59:49.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145105+0000", 2024-09-14T05:59:49.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7176999999999999e-05 2024-09-14T05:59:49.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145119+0000", 2024-09-14T05:59:49.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3179e-05 2024-09-14T05:59:49.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.315 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.315 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149512+0000", 2024-09-14T05:59:49.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043934389999999999 2024-09-14T05:59:49.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.315 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.315 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149559+0000", 2024-09-14T05:59:49.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6591000000000002e-05 2024-09-14T05:59:49.315 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.315 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.315 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.316 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39866 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'439, mlcod=51'434)", 2024-09-14T05:59:49.316 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145610+0000", 2024-09-14T05:59:49.316 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.0953391850000003, 2024-09-14T05:59:49.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039787060000000003, 2024-09-14T05:59:49.316 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.316 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.316 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.316 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.316 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.316 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145610+0000", 2024-09-14T05:59:49.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145610+0000", 2024-09-14T05:59:49.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145611+0000", 2024-09-14T05:59:49.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7599999999999997e-07 2024-09-14T05:59:49.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145615+0000", 2024-09-14T05:59:49.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1309999999999999e-06 2024-09-14T05:59:49.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.318 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145624+0000", 2024-09-14T05:59:49.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8480000000000007e-06 2024-09-14T05:59:49.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.318 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145629+0000", 2024-09-14T05:59:49.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7840000000000003e-06 2024-09-14T05:59:49.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145679+0000", 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0206e-05 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145699+0000", 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149561+0000", 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038619969999999998 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149589+0000", 2024-09-14T05:59:49.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8147999999999999e-05 2024-09-14T05:59:49.320 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.320 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.320 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.320 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40245 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'513, mlcod=52'509)", 2024-09-14T05:59:49.321 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.923591+0000", 2024-09-14T05:59:49.321 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.317358096, 2024-09-14T05:59:49.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053460410000000002, 2024-09-14T05:59:49.321 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.321 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.321 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.321 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.321 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T05:59:49.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T05:59:49.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923592+0000", 2024-09-14T05:59:49.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6599999999999996e-07 2024-09-14T05:59:49.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923598+0000", 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.083e-06 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923609+0000", 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1137e-05 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923617+0000", 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.401e-06 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924037+0000", 2024-09-14T05:59:49.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042046 2024-09-14T05:59:49.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924082+0000", 2024-09-14T05:59:49.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4617000000000003e-05 2024-09-14T05:59:49.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928882+0000", 2024-09-14T05:59:49.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048000889999999996 2024-09-14T05:59:49.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928937+0000", 2024-09-14T05:59:49.325 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5587999999999997e-05 2024-09-14T05:59:49.325 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.325 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.325 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.325 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40246 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'514, mlcod=52'509)", 2024-09-14T05:59:49.325 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.924626+0000", 2024-09-14T05:59:49.325 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.3163235809999998, 2024-09-14T05:59:49.325 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043609649999999996, 2024-09-14T05:59:49.325 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.325 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.325 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T05:59:49.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T05:59:49.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2099999999999996e-07 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924631+0000", 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8450000000000002e-06 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924641+0000", 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0057e-05 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924649+0000", 2024-09-14T05:59:49.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5669999999999997e-06 2024-09-14T05:59:49.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925127+0000", 2024-09-14T05:59:49.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00047783800000000001 2024-09-14T05:59:49.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925171+0000", 2024-09-14T05:59:49.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4017000000000002e-05 2024-09-14T05:59:49.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928942+0000", 2024-09-14T05:59:49.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037716809999999998 2024-09-14T05:59:49.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928987+0000", 2024-09-14T05:59:49.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4338999999999997e-05 2024-09-14T05:59:49.329 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.330 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.330 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.330 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40249 3.0 e52/24 3:06bdaf45:::rbd_data.112781171282.0000000000000002:head v 52'516, mlcod=52'510)", 2024-09-14T05:59:49.330 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.925532+0000", 2024-09-14T05:59:49.330 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.3154176319999999, 2024-09-14T05:59:49.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038249949999999999, 2024-09-14T05:59:49.330 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.330 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.330 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:49.330 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925532+0000", 2024-09-14T05:59:49.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925532+0000", 2024-09-14T05:59:49.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925532+0000", 2024-09-14T05:59:49.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8899999999999999e-07 2024-09-14T05:59:49.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925537+0000", 2024-09-14T05:59:49.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0499999999999999e-06 2024-09-14T05:59:49.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925547+0000", 2024-09-14T05:59:49.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1540000000000008e-06 2024-09-14T05:59:49.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925552+0000", 2024-09-14T05:59:49.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2209999999999996e-06 2024-09-14T05:59:49.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.926202+0000", 2024-09-14T05:59:49.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00065016399999999995 2024-09-14T05:59:49.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.926245+0000", 2024-09-14T05:59:49.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2787999999999998e-05 2024-09-14T05:59:49.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:49.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.929309+0000", 2024-09-14T05:59:49.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003064209 2024-09-14T05:59:49.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.334 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.929357+0000", 2024-09-14T05:59:49.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.782e-05 2024-09-14T05:59:49.334 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.334 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.334 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.334 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.334 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.334 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:49.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:59:49.336 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:49.333+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:49.436 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:49.433+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:49.510 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:49.510 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:49.510 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:49.510 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:49.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:59:49.537 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:49.537+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:49.638 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:49.637+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:49.692 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:49.692 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:49.692 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:49.692 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:49.692 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:49.706 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:59:49.751 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:49.749+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:49.835 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.6 to 1 (10000) 2024-09-14T05:59:49.838 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:49.837+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:49.839 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:49.840 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:49.840 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:49.840 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:49.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.840 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12600 3.18 3:1e8e1704:::rbd_data.1127368d46aa.0000000000000000:a [read 1835008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.840 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.899978+0000", 2024-09-14T05:59:49.840 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.937645017000001, 2024-09-14T05:59:49.840 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082577203000000002, 2024-09-14T05:59:49.840 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.840 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.840 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.840 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.840 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.840 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.841 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12600 2024-09-14T05:59:49.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.841 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.841 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.841 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.899978+0000", 2024-09-14T05:59:49.841 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.841 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.841 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.899978+0000", 2024-09-14T05:59:49.841 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.899980+0000", 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.26e-06 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.899986+0000", 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0499999999999997e-06 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900005+0000", 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9162999999999999e-05 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.842 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900019+0000", 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3967e-05 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982365+0000", 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082346635000000001 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982450+0000", 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4486000000000004e-05 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.843 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.844 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982556+0000", 2024-09-14T05:59:49.844 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105642 2024-09-14T05:59:49.844 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.844 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.844 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.844 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12601 3.18 3:1e8e1704:::rbd_data.1127368d46aa.0000000000000000:a [read 1900544~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.844 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900038+0000", 2024-09-14T05:59:49.844 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.937585187, 2024-09-14T05:59:49.844 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082708763000000005, 2024-09-14T05:59:49.845 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.845 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.845 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.845 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.845 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.845 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.845 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12601 2024-09-14T05:59:49.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.845 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.845 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.845 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.845 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900038+0000", 2024-09-14T05:59:49.845 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900038+0000", 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900039+0000", 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2300000000000001e-06 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900061+0000", 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1999999999999999e-05 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900079+0000", 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7883000000000001e-05 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900094+0000", 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4363e-05 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982599+0000", 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082505455000000005 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.847 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.848 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982659+0000", 2024-09-14T05:59:49.848 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9960999999999997e-05 2024-09-14T05:59:49.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.848 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.848 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982747+0000", 2024-09-14T05:59:49.848 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7870999999999999e-05 2024-09-14T05:59:49.848 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.848 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.848 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.848 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12602 3.18 3:1e8e1704:::rbd_data.1127368d46aa.0000000000000000:a [read 1966080~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.848 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900115+0000", 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.937508805, 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082889114999999999, 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12602 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900115+0000", 2024-09-14T05:59:49.849 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900115+0000", 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900116+0000", 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6640000000000001e-06 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900122+0000", 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6799999999999998e-06 2024-09-14T05:59:49.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900139+0000", 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7309999999999999e-05 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900153+0000", 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.429e-05 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982795+0000", 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082641362999999995 2024-09-14T05:59:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.982891+0000", 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6271e-05 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983004+0000", 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000112537 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12603 3.18 3:1e8e1704:::rbd_data.1127368d46aa.0000000000000000:a [read 2031616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900172+0000", 2024-09-14T05:59:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.937451758000002, 2024-09-14T05:59:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083068960999999997, 2024-09-14T05:59:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12603 2024-09-14T05:59:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.854 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900172+0000", 2024-09-14T05:59:49.854 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.854 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.854 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900172+0000", 2024-09-14T05:59:49.854 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.854 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.854 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900173+0000", 2024-09-14T05:59:49.854 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4699999999999999e-06 2024-09-14T05:59:49.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900200+0000", 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7243e-05 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900220+0000", 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0196000000000001e-05 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900235+0000", 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.487e-05 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983044+0000", 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082808549999999995 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983097+0000", 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2865999999999998e-05 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983241+0000", 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014376600000000001 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.856 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.857 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.857 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12604 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1572864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.857 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900256+0000", 2024-09-14T05:59:49.857 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.937367282, 2024-09-14T05:59:49.857 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083449791999999995, 2024-09-14T05:59:49.857 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.857 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.857 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.857 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.857 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.857 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.857 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12604 2024-09-14T05:59:49.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.858 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.858 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.858 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900256+0000", 2024-09-14T05:59:49.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.858 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.858 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900256+0000", 2024-09-14T05:59:49.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900258+0000", 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900263+0000", 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8069999999999996e-06 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900280+0000", 2024-09-14T05:59:49.859 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.717e-05 2024-09-14T05:59:49.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900296+0000", 2024-09-14T05:59:49.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5642999999999999e-05 2024-09-14T05:59:49.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983293+0000", 2024-09-14T05:59:49.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082997258000000004 2024-09-14T05:59:49.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.861 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983483+0000", 2024-09-14T05:59:49.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019005399999999999 2024-09-14T05:59:49.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.861 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983706+0000", 2024-09-14T05:59:49.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00022239699999999999 2024-09-14T05:59:49.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.861 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.862 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12605 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1638400~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.862 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900320+0000", 2024-09-14T05:59:49.862 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.937302992999999, 2024-09-14T05:59:49.862 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083560593000000002, 2024-09-14T05:59:49.862 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.862 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.862 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.862 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.862 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.862 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12605 2024-09-14T05:59:49.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900320+0000", 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900320+0000", 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900322+0000", 2024-09-14T05:59:49.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.226e-06 2024-09-14T05:59:49.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.864 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900327+0000", 2024-09-14T05:59:49.864 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4700000000000001e-06 2024-09-14T05:59:49.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.864 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900345+0000", 2024-09-14T05:59:49.864 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8297000000000001e-05 2024-09-14T05:59:49.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.864 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900359+0000", 2024-09-14T05:59:49.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3793e-05 2024-09-14T05:59:49.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.865 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983732+0000", 2024-09-14T05:59:49.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083372486999999995 2024-09-14T05:59:49.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.865 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983786+0000", 2024-09-14T05:59:49.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3906999999999997e-05 2024-09-14T05:59:49.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983881+0000", 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5413000000000003e-05 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12606 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1703936~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900377+0000", 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.937246086999998, 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083968347999999998, 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.866 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12606 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900377+0000", 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900377+0000", 2024-09-14T05:59:49.868 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.868 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.868 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900378+0000", 2024-09-14T05:59:49.868 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0869999999999999e-06 2024-09-14T05:59:49.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.868 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.868 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900383+0000", 2024-09-14T05:59:49.868 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8269999999999997e-06 2024-09-14T05:59:49.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.869 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900401+0000", 2024-09-14T05:59:49.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7586000000000001e-05 2024-09-14T05:59:49.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.869 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900414+0000", 2024-09-14T05:59:49.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3616e-05 2024-09-14T05:59:49.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.869 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.983926+0000", 2024-09-14T05:59:49.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083511964999999994 2024-09-14T05:59:49.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984100+0000", 2024-09-14T05:59:49.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000173647 2024-09-14T05:59:49.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984346+0000", 2024-09-14T05:59:49.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024562 2024-09-14T05:59:49.870 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.870 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.871 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.871 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12607 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.871 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900435+0000", 2024-09-14T05:59:49.871 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.937187974, 2024-09-14T05:59:49.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084218643999999995, 2024-09-14T05:59:49.871 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.871 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.871 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.871 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.871 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.871 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.872 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12607 2024-09-14T05:59:49.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.872 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900435+0000", 2024-09-14T05:59:49.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900435+0000", 2024-09-14T05:59:49.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.873 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.873 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900437+0000", 2024-09-14T05:59:49.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.173e-06 2024-09-14T05:59:49.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.873 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.873 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900442+0000", 2024-09-14T05:59:49.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9569999999999999e-06 2024-09-14T05:59:49.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.873 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.873 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900462+0000", 2024-09-14T05:59:49.874 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9409999999999999e-05 2024-09-14T05:59:49.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.874 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.874 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900476+0000", 2024-09-14T05:59:49.874 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3842999999999999e-05 2024-09-14T05:59:49.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.874 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.874 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984377+0000", 2024-09-14T05:59:49.874 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083901341000000004 2024-09-14T05:59:49.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984523+0000", 2024-09-14T05:59:49.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014617800000000001 2024-09-14T05:59:49.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984654+0000", 2024-09-14T05:59:49.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013074199999999999 2024-09-14T05:59:49.875 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.875 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.875 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.876 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12608 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1835008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.876 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900495+0000", 2024-09-14T05:59:49.876 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.937128338000001, 2024-09-14T05:59:49.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084429064999999998, 2024-09-14T05:59:49.876 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.876 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.876 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.876 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.876 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.876 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.876 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12608 2024-09-14T05:59:49.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.876 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900495+0000", 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900495+0000", 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900496+0000", 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3969999999999999e-06 2024-09-14T05:59:49.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900502+0000", 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3369999999999999e-06 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900518+0000", 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6215999999999999e-05 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900546+0000", 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8089000000000002e-05 2024-09-14T05:59:49.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984684+0000", 2024-09-14T05:59:49.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084137637000000001 2024-09-14T05:59:49.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984816+0000", 2024-09-14T05:59:49.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013197799999999999 2024-09-14T05:59:49.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984924+0000", 2024-09-14T05:59:49.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108411 2024-09-14T05:59:49.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.880 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.880 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12609 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1900544~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.880 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900568+0000", 2024-09-14T05:59:49.880 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.937055459, 2024-09-14T05:59:49.880 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084572639000000005, 2024-09-14T05:59:49.880 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.880 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.880 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.880 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.880 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12609 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900568+0000", 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900568+0000", 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900569+0000", 2024-09-14T05:59:49.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5540000000000001e-06 2024-09-14T05:59:49.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900586+0000", 2024-09-14T05:59:49.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6079999999999999e-05 2024-09-14T05:59:49.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900609+0000", 2024-09-14T05:59:49.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3580000000000001e-05 2024-09-14T05:59:49.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.883 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.883 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900624+0000", 2024-09-14T05:59:49.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5173e-05 2024-09-14T05:59:49.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.883 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.883 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.984993+0000", 2024-09-14T05:59:49.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084369059999999996 2024-09-14T05:59:49.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985055+0000", 2024-09-14T05:59:49.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1346000000000005e-05 2024-09-14T05:59:49.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985141+0000", 2024-09-14T05:59:49.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5846000000000004e-05 2024-09-14T05:59:49.884 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.884 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.884 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.885 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12610 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 1966080~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.885 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900645+0000", 2024-09-14T05:59:49.885 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.936978066000002, 2024-09-14T05:59:49.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084792891999999995, 2024-09-14T05:59:49.885 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.885 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.885 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.885 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.885 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.885 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.885 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12610 2024-09-14T05:59:49.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.885 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900645+0000", 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900645+0000", 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900647+0000", 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6199999999999999e-06 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900652+0000", 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2100000000000001e-06 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900669+0000", 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7376000000000001e-05 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900682+0000", 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2284e-05 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985177+0000", 2024-09-14T05:59:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084495644999999994 2024-09-14T05:59:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985322+0000", 2024-09-14T05:59:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014503899999999999 2024-09-14T05:59:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985438+0000", 2024-09-14T05:59:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011571800000000001 2024-09-14T05:59:49.888 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12611 3.18 3:19fcc36c:::rbd_data.1127368d46aa.0000000000000001:a [read 2031616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900701+0000", 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.93692222, 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085063237999999999, 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.889 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12611 2024-09-14T05:59:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900701+0000", 2024-09-14T05:59:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900701+0000", 2024-09-14T05:59:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900702+0000", 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.097e-06 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900708+0000", 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0599999999999996e-06 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900729+0000", 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1143000000000001e-05 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900744+0000", 2024-09-14T05:59:49.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4953000000000001e-05 2024-09-14T05:59:49.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985502+0000", 2024-09-14T05:59:49.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084757543000000005 2024-09-14T05:59:49.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985620+0000", 2024-09-14T05:59:49.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000117644 2024-09-14T05:59:49.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.893 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.893 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985764+0000", 2024-09-14T05:59:49.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014479799999999999 2024-09-14T05:59:49.893 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.893 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.893 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.893 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12612 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1572864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.893 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900785+0000", 2024-09-14T05:59:49.893 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.936838143999999, 2024-09-14T05:59:49.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085273510999999996, 2024-09-14T05:59:49.893 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.894 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.894 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.894 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.894 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.894 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12612 2024-09-14T05:59:49.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.894 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900785+0000", 2024-09-14T05:59:49.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900785+0000", 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900787+0000", 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.327e-06 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900805+0000", 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8416000000000001e-05 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900826+0000", 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0579999999999999e-05 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900839+0000", 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.38e-05 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985790+0000", 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084950345999999996 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.985918+0000", 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012817800000000001 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986059+0000", 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014086400000000001 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12613 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1638400~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900862+0000", 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.936761100999998, 2024-09-14T05:59:49.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085363869999999994, 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12613 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900862+0000", 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.898 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900862+0000", 2024-09-14T05:59:49.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900864+0000", 2024-09-14T05:59:49.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3400000000000001e-06 2024-09-14T05:59:49.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900870+0000", 2024-09-14T05:59:49.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.246e-06 2024-09-14T05:59:49.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900889+0000", 2024-09-14T05:59:49.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.916e-05 2024-09-14T05:59:49.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900903+0000", 2024-09-14T05:59:49.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.448e-05 2024-09-14T05:59:49.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986080+0000", 2024-09-14T05:59:49.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085176475000000001 2024-09-14T05:59:49.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986129+0000", 2024-09-14T05:59:49.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9493000000000002e-05 2024-09-14T05:59:49.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986226+0000", 2024-09-14T05:59:49.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6675999999999994e-05 2024-09-14T05:59:49.902 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.902 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.902 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.902 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12614 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1703936~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.902 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900925+0000", 2024-09-14T05:59:49.902 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.936698065000002, 2024-09-14T05:59:49.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085610173999999997, 2024-09-14T05:59:49.902 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.902 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.902 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.902 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12614 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900925+0000", 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900925+0000", 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900927+0000", 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3769999999999999e-06 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900933+0000", 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1829999999999999e-06 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900951+0000", 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7810000000000001e-05 2024-09-14T05:59:49.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900966+0000", 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5228999999999999e-05 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986268+0000", 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085302557000000001 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986391+0000", 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012244299999999999 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.906 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.906 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986535+0000", 2024-09-14T05:59:49.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000144575 2024-09-14T05:59:49.906 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.906 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.906 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.906 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12615 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1769472~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.906 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.900988+0000", 2024-09-14T05:59:49.906 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.936635796000001, 2024-09-14T05:59:49.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085798447, 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12615 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900988+0000", 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900988+0000", 2024-09-14T05:59:49.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900989+0000", 2024-09-14T05:59:49.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5200000000000001e-06 2024-09-14T05:59:49.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.900995+0000", 2024-09-14T05:59:49.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3069999999999999e-06 2024-09-14T05:59:49.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901014+0000", 2024-09-14T05:59:49.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.838e-05 2024-09-14T05:59:49.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901028+0000", 2024-09-14T05:59:49.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4752999999999999e-05 2024-09-14T05:59:49.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986560+0000", 2024-09-14T05:59:49.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085531441999999999 2024-09-14T05:59:49.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986678+0000", 2024-09-14T05:59:49.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118034 2024-09-14T05:59:49.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986786+0000", 2024-09-14T05:59:49.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010801100000000001 2024-09-14T05:59:49.910 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.910 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.911 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.911 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12616 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1835008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.911 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.901049+0000", 2024-09-14T05:59:49.911 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.936574802999999, 2024-09-14T05:59:49.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085922076999999999, 2024-09-14T05:59:49.911 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.911 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.911 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.911 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.911 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.911 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.911 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12616 2024-09-14T05:59:49.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.912 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901049+0000", 2024-09-14T05:59:49.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901049+0000", 2024-09-14T05:59:49.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901050+0000", 2024-09-14T05:59:49.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5340000000000001e-06 2024-09-14T05:59:49.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901055+0000", 2024-09-14T05:59:49.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2730000000000002e-06 2024-09-14T05:59:49.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901075+0000", 2024-09-14T05:59:49.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9346000000000001e-05 2024-09-14T05:59:49.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901089+0000", 2024-09-14T05:59:49.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4392999999999999e-05 2024-09-14T05:59:49.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986819+0000", 2024-09-14T05:59:49.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085730161999999999 2024-09-14T05:59:49.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986885+0000", 2024-09-14T05:59:49.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6217999999999995e-05 2024-09-14T05:59:49.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.986971+0000", 2024-09-14T05:59:49.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5150999999999998e-05 2024-09-14T05:59:49.915 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.915 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.915 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12617 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1900544~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.901113+0000", 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.936510816999998, 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086089867, 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12617 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901113+0000", 2024-09-14T05:59:49.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901113+0000", 2024-09-14T05:59:49.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901114+0000", 2024-09-14T05:59:49.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2130000000000001e-06 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901119+0000", 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5169999999999999e-06 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901137+0000", 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7819999999999999e-05 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901151+0000", 2024-09-14T05:59:49.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3723000000000001e-05 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987010+0000", 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085858773999999999 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987105+0000", 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5091000000000001e-05 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987202+0000", 2024-09-14T05:59:49.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7728999999999999e-05 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12618 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 1966080~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.901169+0000", 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.936454230999999, 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086197516000000002, 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.920 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12618 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901169+0000", 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901169+0000", 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901170+0000", 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.33e-06 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901176+0000", 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.22e-06 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901193+0000", 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7326999999999999e-05 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901206+0000", 2024-09-14T05:59:49.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2979000000000001e-05 2024-09-14T05:59:49.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987231+0000", 2024-09-14T05:59:49.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086025015999999996 2024-09-14T05:59:49.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987281+0000", 2024-09-14T05:59:49.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9740000000000001e-05 2024-09-14T05:59:49.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987367+0000", 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5903999999999996e-05 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:12619 3.18 3:192e4509:::rbd_data.1127368d46aa.0000000000000002:a [read 2031616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.901223+0000", 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.936400135, 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086375007000000004, 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:49.924 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 12619 2024-09-14T05:59:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901223+0000", 2024-09-14T05:59:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901223+0000", 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901224+0000", 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1000000000000001e-06 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901229+0000", 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8940000000000001e-06 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:49.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901246+0000", 2024-09-14T05:59:49.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6863000000000001e-05 2024-09-14T05:59:49.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:49.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.901259+0000", 2024-09-14T05:59:49.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3207000000000001e-05 2024-09-14T05:59:49.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:49.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987401+0000", 2024-09-14T05:59:49.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086141599999999999 2024-09-14T05:59:49.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:49.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987502+0000", 2024-09-14T05:59:49.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000100654 2024-09-14T05:59:49.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:49.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:49.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:49.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.987598+0000", 2024-09-14T05:59:49.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6688999999999995e-05 2024-09-14T05:59:49.928 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.928 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.928 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.928 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:49.928 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:49.928 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:49.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:59:49.930 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:59:49.931 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-14T05:59:49.972 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:49.969+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:49.996 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone15 from 0xb2ce08e (overlap 0x3265d6) to 0x0 2024-09-14T05:59:50.040 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:50.037+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:50.071 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:50.071 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:50.086 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:59:50.141 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:50.141+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:50.151 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-14T05:59:50.159 INFO:teuthology.orchestra.run.smithi006.stdout:2376 read 0xaf80b48 thru 0xaf840f1 (0x35aa bytes) 2024-09-14T05:59:50.160 INFO:teuthology.orchestra.run.smithi006.stdout:2377 read 0x2f47863 thru 0x2f533aa (0xbb48 bytes) 2024-09-14T05:59:50.163 INFO:teuthology.orchestra.run.smithi006.stdout:2378 read 0x2910b07 thru 0x291336a (0x2864 bytes) 2024-09-14T05:59:50.164 INFO:teuthology.orchestra.run.smithi006.stdout:2379 read 0x62bf432 thru 0x62c4cfa (0x58c9 bytes) 2024-09-14T05:59:50.165 INFO:teuthology.orchestra.run.smithi006.stdout:2380 read 0x4f5296e thru 0x4f5716a (0x47fd bytes) 2024-09-14T05:59:50.166 INFO:teuthology.orchestra.run.smithi006.stdout:2381 write 0x5088e8 thru 0x51534a (0xca63 bytes) 2024-09-14T05:59:50.241 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:50.241+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:50.242 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:50.243 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:50.243 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:50.243 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:50.243 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:50.266 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:59:50.302 INFO:teuthology.orchestra.run.smithi006.stdout:2382 trunc from 0xb2ce08e to 0x8d9a941 2024-09-14T05:59:50.321 INFO:teuthology.orchestra.run.smithi006.stdout:2383 read 0xc5f940 thru 0xc659af (0x6070 bytes) 2024-09-14T05:59:50.322 INFO:teuthology.orchestra.run.smithi006.stdout:2384 punch from 0x23ae687 to 0x23b5bba, (0x7533 bytes) 2024-09-14T05:59:50.322 INFO:teuthology.orchestra.run.smithi006.stdout:2385 punch from 0x50dbc9e to 0x50e72ab, (0xb60d bytes) 2024-09-14T05:59:50.322 INFO:teuthology.orchestra.run.smithi006.stdout:2386 read 0xcc0a6c thru 0xcc648a (0x5a1f bytes) 2024-09-14T05:59:50.323 INFO:teuthology.orchestra.run.smithi006.stdout:2387 read 0x38409fa thru 0x384119c (0x7a3 bytes) 2024-09-14T05:59:50.334 INFO:teuthology.orchestra.run.smithi006.stdout:2388 trunc from 0x8d9a941 to 0x364d815 2024-09-14T05:59:50.342 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:50.341+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:50.443 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:50.441+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:50.484 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:50.484 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T05:59:50.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T05:59:50.484 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:50.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.484 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23550 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 606208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.485 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948669+0000", 2024-09-14T05:59:50.485 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.535984068000001, 2024-09-14T05:59:50.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048793072999999999, 2024-09-14T05:59:50.485 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.485 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.485 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.485 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.485 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.485 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.485 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23550 2024-09-14T05:59:50.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.485 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948677+0000", 2024-09-14T05:59:50.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1949999999999997e-06 2024-09-14T05:59:50.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948687+0000", 2024-09-14T05:59:50.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0849000000000001e-05 2024-09-14T05:59:50.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948692+0000", 2024-09-14T05:59:50.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8670000000000002e-06 2024-09-14T05:59:50.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997290+0000", 2024-09-14T05:59:50.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048597596999999999 2024-09-14T05:59:50.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997367+0000", 2024-09-14T05:59:50.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7236000000000004e-05 2024-09-14T05:59:50.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997462+0000", 2024-09-14T05:59:50.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4951000000000006e-05 2024-09-14T05:59:50.489 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.489 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.489 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.489 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23551 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 620544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.489 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948700+0000", 2024-09-14T05:59:50.489 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.535953210999999, 2024-09-14T05:59:50.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048938838999999998, 2024-09-14T05:59:50.489 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.489 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23551 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T05:59:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T05:59:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1e-07 2024-09-14T05:59:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948701+0000", 2024-09-14T05:59:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2950000000000001e-06 2024-09-14T05:59:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948705+0000", 2024-09-14T05:59:50.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:59:50.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948709+0000", 2024-09-14T05:59:50.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T05:59:50.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997535+0000", 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048826181000000003 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997580+0000", 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5355000000000002e-05 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997639+0000", 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8479e-05 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.535937734000001, 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T05:59:50.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T05:59:50.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T05:59:50.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T05:59:50.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T05:59:50.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T05:59:50.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T05:59:50.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T05:59:50.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T05:59:50.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T05:59:50.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.535918459000001, 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.498 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T05:59:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T05:59:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T05:59:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T05:59:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T05:59:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T05:59:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T05:59:50.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T05:59:50.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T05:59:50.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T05:59:50.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T05:59:50.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T05:59:50.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T05:59:50.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T05:59:50.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.502 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.502 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.502 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T05:59:50.502 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.535898883000002, 2024-09-14T05:59:50.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T05:59:50.502 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.502 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.503 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.503 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T05:59:50.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.503 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T05:59:50.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T05:59:50.506 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.535879426000001, 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T05:59:50.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T05:59:50.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T05:59:50.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T05:59:50.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T05:59:50.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T05:59:50.510 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.510 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.510 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.535860374999999, 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.514 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.535840694000001, 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T05:59:50.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T05:59:50.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T05:59:50.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T05:59:50.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T05:59:50.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T05:59:50.518 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.535820742999999, 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T05:59:50.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.520 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T05:59:50.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T05:59:50.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T05:59:50.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T05:59:50.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T05:59:50.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T05:59:50.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T05:59:50.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T05:59:50.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T05:59:50.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T05:59:50.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.523 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.523 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.523 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T05:59:50.523 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.535801430999999, 2024-09-14T05:59:50.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T05:59:50.523 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.523 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.523 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.524 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.524 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.524 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.524 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T05:59:50.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.524 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T05:59:50.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T05:59:50.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T05:59:50.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T05:59:50.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T05:59:50.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T05:59:50.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T05:59:50.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T05:59:50.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T05:59:50.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T05:59:50.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T05:59:50.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T05:59:50.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.527 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.535781669999999, 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T05:59:50.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T05:59:50.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T05:59:50.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T05:59:50.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T05:59:50.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T05:59:50.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T05:59:50.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.531 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.532 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.532 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T05:59:50.532 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.535760749000001, 2024-09-14T05:59:50.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T05:59:50.532 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.532 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.532 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.532 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T05:59:50.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.533 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T05:59:50.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T05:59:50.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T05:59:50.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T05:59:50.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T05:59:50.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T05:59:50.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T05:59:50.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T05:59:50.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T05:59:50.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T05:59:50.536 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.536 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.536 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.536 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.536 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T05:59:50.536 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.534601415000001, 2024-09-14T05:59:50.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T05:59:50.536 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.536 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.536 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T05:59:50.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T05:59:50.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T05:59:50.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T05:59:50.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T05:59:50.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T05:59:50.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T05:59:50.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T05:59:50.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T05:59:50.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T05:59:50.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T05:59:50.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T05:59:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T05:59:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T05:59:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T05:59:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.534302632999999, 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.534151895000001, 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T05:59:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T05:59:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T05:59:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T05:59:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T05:59:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T05:59:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T05:59:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T05:59:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23582 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 911360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951427+0000", 2024-09-14T05:59:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.533226507999998, 2024-09-14T05:59:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048708939999999999, 2024-09-14T05:59:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23582 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6300000000000005e-07 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951430+0000", 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5179999999999999e-06 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951437+0000", 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0940000000000002e-06 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951443+0000", 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7910000000000001e-06 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000047+0000", 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048604550000000003 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000095+0000", 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7735999999999998e-05 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000135+0000", 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0587999999999998e-05 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23588 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 722944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951451+0000", 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.533201642999998, 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048792653999999998, 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23588 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951665+0000", 2024-09-14T05:59:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021337600000000001 2024-09-14T05:59:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951669+0000", 2024-09-14T05:59:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3460000000000004e-06 2024-09-14T05:59:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951688+0000", 2024-09-14T05:59:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9042000000000002e-05 2024-09-14T05:59:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951696+0000", 2024-09-14T05:59:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6660000000000008e-06 2024-09-14T05:59:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000162+0000", 2024-09-14T05:59:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048465824999999997 2024-09-14T05:59:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000199+0000", 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7143e-05 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000244+0000", 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5256000000000002e-05 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23590 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 745472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951709+0000", 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.532944187999998, 2024-09-14T05:59:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048677684999999998, 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23590 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951850+0000", 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014113 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951855+0000", 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6349999999999997e-06 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951863+0000", 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8189999999999998e-06 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951871+0000", 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2030000000000003e-06 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000283+0000", 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048412531000000002 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000338+0000", 2024-09-14T05:59:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4462000000000001e-05 2024-09-14T05:59:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000387+0000", 2024-09-14T05:59:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8905e-05 2024-09-14T05:59:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.908850332, 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T05:59:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T05:59:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T05:59:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T05:59:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T05:59:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T05:59:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T05:59:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T05:59:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T05:59:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T05:59:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T05:59:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T05:59:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T05:59:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T05:59:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T05:59:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T05:59:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T05:59:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T05:59:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.385760392999998, 2024-09-14T05:59:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T05:59:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T05:59:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T05:59:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T05:59:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T05:59:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T05:59:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T05:59:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T05:59:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T05:59:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T05:59:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T05:59:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T05:59:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T05:59:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T05:59:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T05:59:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T05:59:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T05:59:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.572 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:50.573 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:59:50.574 INFO:teuthology.orchestra.run.smithi006.stdout:2389 punch from 0x270075 to 0x273699, (0x3624 bytes) 2024-09-14T05:59:50.574 INFO:teuthology.orchestra.run.smithi006.stdout:2391 trunc from 0x364d815 to 0x9cc9fef 2024-09-14T05:59:50.574 INFO:teuthology.orchestra.run.smithi006.stdout:2392 write 0x8b2947c thru 0x8b36262 (0xcde7 bytes) 2024-09-14T05:59:50.574 INFO:teuthology.orchestra.run.smithi006.stdout:2393 writesame 0xda3fb3a thru 0xda4cb49 data_size 0x8(0xd010 bytes) 2024-09-14T05:59:50.574 INFO:teuthology.orchestra.run.smithi006.stdout:2394 write 0x8546aba thru 0x854cdb0 (0x62f7 bytes) 2024-09-14T05:59:50.574 INFO:teuthology.orchestra.run.smithi006.stdout:2395 write 0x62ab734 thru 0x62b1456 (0x5d23 bytes) 2024-09-14T05:59:50.574 INFO:teuthology.orchestra.run.smithi006.stdout:2397 write 0x19d8462 thru 0x19e2cb5 (0xa854 bytes) 2024-09-14T05:59:50.575 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:50.569+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:50.650 INFO:teuthology.orchestra.run.smithi006.stdout:2398 writesame 0xce4a372 thru 0xce50174 data_size 0x1(0x5e03 bytes) 2024-09-14T05:59:50.663 INFO:teuthology.orchestra.run.smithi006.stdout:2401 punch from 0x6530cb6 to 0x653b3e8, (0xa732 bytes) 2024-09-14T05:59:50.663 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:50.666 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:59:50.674 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:50.673+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:50.675 INFO:teuthology.orchestra.run.smithi006.stdout:2404 trunc from 0xda4cb4a to 0x62a4993 2024-09-14T05:59:50.698 INFO:teuthology.orchestra.run.smithi006.stdout:2407 write 0x70cc8de thru 0x70d7c0d (0xb330 bytes) 2024-09-14T05:59:50.709 INFO:teuthology.orchestra.run.smithi006.stdout:2410 writesame 0x1eaf1fd thru 0x1eb92af data_size 0x15(0xa0b3 bytes) 2024-09-14T05:59:50.724 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:50.724 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T05:59:50.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.724 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48547 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.725 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719058+0000", 2024-09-14T05:59:50.725 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.004870409, 2024-09-14T05:59:50.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048890920000000003, 2024-09-14T05:59:50.725 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.725 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.725 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.725 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.725 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.725 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.725 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48547 2024-09-14T05:59:50.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.725 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719058+0000", 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719058+0000", 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719058+0000", 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5299999999999999e-07 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719060+0000", 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2220000000000001e-06 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719066+0000", 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7379999999999999e-06 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719071+0000", 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6280000000000004e-06 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.727 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48799 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719788+0000", 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0041402879999999998, 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041948979999999999, 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48799 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.728 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719788+0000", 2024-09-14T05:59:50.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719788+0000", 2024-09-14T05:59:50.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719788+0000", 2024-09-14T05:59:50.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4499999999999998e-07 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719799+0000", 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0959e-05 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719807+0000", 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6620000000000005e-06 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719813+0000", 2024-09-14T05:59:50.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6679999999999998e-06 2024-09-14T05:59:50.731 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.731 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.731 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.731 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48548 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.731 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719079+0000", 2024-09-14T05:59:50.731 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0048490499999999997, 2024-09-14T05:59:50.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0049450800000000001, 2024-09-14T05:59:50.731 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.731 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.731 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.731 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.732 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.732 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.732 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48548 2024-09-14T05:59:50.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.732 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719079+0000", 2024-09-14T05:59:50.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719079+0000", 2024-09-14T05:59:50.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719080+0000", 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4400000000000001e-07 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719082+0000", 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1749999999999999e-06 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719089+0000", 2024-09-14T05:59:50.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0509999999999999e-06 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719094+0000", 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8620000000000002e-06 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48800 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719821+0000", 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.004107032, 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004245136, 2024-09-14T05:59:50.734 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48800 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719821+0000", 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719821+0000", 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719822+0000", 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7300000000000001e-07 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719824+0000", 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3460000000000001e-06 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719831+0000", 2024-09-14T05:59:50.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7000000000000002e-06 2024-09-14T05:59:50.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719836+0000", 2024-09-14T05:59:50.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0350000000000001e-06 2024-09-14T05:59:50.737 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.737 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.737 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.737 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48549 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.737 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719101+0000", 2024-09-14T05:59:50.737 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0048273500000000002, 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050133269999999997, 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48549 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719101+0000", 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719101+0000", 2024-09-14T05:59:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719101+0000", 2024-09-14T05:59:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9700000000000002e-07 2024-09-14T05:59:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719104+0000", 2024-09-14T05:59:50.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4540000000000001e-06 2024-09-14T05:59:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719110+0000", 2024-09-14T05:59:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7769999999999999e-06 2024-09-14T05:59:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719114+0000", 2024-09-14T05:59:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9239999999999998e-06 2024-09-14T05:59:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48801 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719843+0000", 2024-09-14T05:59:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0040853599999999997, 2024-09-14T05:59:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043237379999999997, 2024-09-14T05:59:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48801 2024-09-14T05:59:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719843+0000", 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719843+0000", 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719843+0000", 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.46e-07 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719845+0000", 2024-09-14T05:59:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.052e-06 2024-09-14T05:59:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719852+0000", 2024-09-14T05:59:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3339999999999998e-06 2024-09-14T05:59:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719857+0000", 2024-09-14T05:59:50.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1109999999999999e-06 2024-09-14T05:59:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48605 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719122+0000", 2024-09-14T05:59:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0048064300000000004, 2024-09-14T05:59:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050973119999999997, 2024-09-14T05:59:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.744 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48605 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719122+0000", 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719122+0000", 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719122+0000", 2024-09-14T05:59:50.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.32e-07 2024-09-14T05:59:50.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719124+0000", 2024-09-14T05:59:50.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2120000000000002e-06 2024-09-14T05:59:50.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719131+0000", 2024-09-14T05:59:50.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2879999999999998e-06 2024-09-14T05:59:50.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719135+0000", 2024-09-14T05:59:50.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5059999999999997e-06 2024-09-14T05:59:50.747 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.747 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.747 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.747 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48802 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.747 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719864+0000", 2024-09-14T05:59:50.747 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0040644660000000001, 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044053139999999996, 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48802 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719864+0000", 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719864+0000", 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719864+0000", 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0499999999999999e-07 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719866+0000", 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1320000000000001e-06 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719873+0000", 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3300000000000004e-06 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719878+0000", 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8930000000000004e-06 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48606 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.750 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719142+0000", 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.004786116, 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051771819999999998, 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48606 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719142+0000", 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719142+0000", 2024-09-14T05:59:50.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719143+0000", 2024-09-14T05:59:50.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4000000000000002e-07 2024-09-14T05:59:50.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719145+0000", 2024-09-14T05:59:50.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0370000000000001e-06 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719150+0000", 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7150000000000003e-06 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719155+0000", 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4769999999999997e-06 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48803 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719885+0000", 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0040432949999999997, 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044879849999999999, 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48803 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719885+0000", 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719885+0000", 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719885+0000", 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6600000000000002e-07 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719887+0000", 2024-09-14T05:59:50.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0020000000000001e-06 2024-09-14T05:59:50.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719894+0000", 2024-09-14T05:59:50.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5339999999999996e-06 2024-09-14T05:59:50.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719899+0000", 2024-09-14T05:59:50.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.887e-06 2024-09-14T05:59:50.756 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.756 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.756 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.757 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48607 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.757 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719163+0000", 2024-09-14T05:59:50.757 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0047655420000000002, 2024-09-14T05:59:50.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052612830000000003, 2024-09-14T05:59:50.757 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.757 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.757 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.757 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.757 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.757 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.757 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48607 2024-09-14T05:59:50.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.758 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719163+0000", 2024-09-14T05:59:50.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719163+0000", 2024-09-14T05:59:50.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719163+0000", 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4000000000000002e-07 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719165+0000", 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2790000000000001e-06 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719172+0000", 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3670000000000002e-06 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719176+0000", 2024-09-14T05:59:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7260000000000002e-06 2024-09-14T05:59:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48804 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719906+0000", 2024-09-14T05:59:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0040221240000000002, 2024-09-14T05:59:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045678059999999998, 2024-09-14T05:59:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.760 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.761 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.761 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.761 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48804 2024-09-14T05:59:50.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.761 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719906+0000", 2024-09-14T05:59:50.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719906+0000", 2024-09-14T05:59:50.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719907+0000", 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.03e-07 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719909+0000", 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0269999999999998e-06 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719914+0000", 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9070000000000004e-06 2024-09-14T05:59:50.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719921+0000", 2024-09-14T05:59:50.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7730000000000002e-06 2024-09-14T05:59:50.763 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.763 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.763 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.763 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48608 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.763 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719184+0000", 2024-09-14T05:59:50.763 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0047440609999999999, 2024-09-14T05:59:50.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053393410000000001, 2024-09-14T05:59:50.763 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.764 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.764 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.764 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.764 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.764 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.764 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48608 2024-09-14T05:59:50.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.764 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719184+0000", 2024-09-14T05:59:50.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719184+0000", 2024-09-14T05:59:50.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719185+0000", 2024-09-14T05:59:50.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.75e-07 2024-09-14T05:59:50.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719187+0000", 2024-09-14T05:59:50.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.092e-06 2024-09-14T05:59:50.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719193+0000", 2024-09-14T05:59:50.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.37e-06 2024-09-14T05:59:50.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719198+0000", 2024-09-14T05:59:50.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5120000000000002e-06 2024-09-14T05:59:50.766 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.766 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.766 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48805 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719928+0000", 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0039998400000000002, 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046449459999999996, 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48805 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719928+0000", 2024-09-14T05:59:50.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719928+0000", 2024-09-14T05:59:50.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719929+0000", 2024-09-14T05:59:50.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3300000000000003e-07 2024-09-14T05:59:50.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719931+0000", 2024-09-14T05:59:50.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639999999999999e-06 2024-09-14T05:59:50.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719937+0000", 2024-09-14T05:59:50.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2480000000000001e-06 2024-09-14T05:59:50.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719942+0000", 2024-09-14T05:59:50.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.853e-06 2024-09-14T05:59:50.770 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.770 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.770 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.770 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48609 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.770 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719205+0000", 2024-09-14T05:59:50.770 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0047231060000000004, 2024-09-14T05:59:50.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054179559999999998, 2024-09-14T05:59:50.770 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.770 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.770 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.770 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48609 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719205+0000", 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719205+0000", 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719206+0000", 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8500000000000002e-07 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719208+0000", 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4269999999999998e-06 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719214+0000", 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9320000000000001e-06 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719219+0000", 2024-09-14T05:59:50.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9339999999999997e-06 2024-09-14T05:59:50.773 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.773 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.773 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.773 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48610 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.773 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719226+0000", 2024-09-14T05:59:50.773 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0047020229999999996, 2024-09-14T05:59:50.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054459749999999996, 2024-09-14T05:59:50.774 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.774 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.774 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.774 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.774 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.774 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.774 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48610 2024-09-14T05:59:50.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.774 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719226+0000", 2024-09-14T05:59:50.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719226+0000", 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719227+0000", 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9200000000000001e-07 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719229+0000", 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.091e-06 2024-09-14T05:59:50.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719237+0000", 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4770000000000003e-06 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719242+0000", 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6290000000000001e-06 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.776 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48611 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719250+0000", 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0046782350000000002, 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054720610000000003, 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48611 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719250+0000", 2024-09-14T05:59:50.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719250+0000", 2024-09-14T05:59:50.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719250+0000", 2024-09-14T05:59:50.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:59:50.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719253+0000", 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.79e-06 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719262+0000", 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4190000000000002e-06 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719266+0000", 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6890000000000003e-06 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.779 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.780 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48612 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.780 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719273+0000", 2024-09-14T05:59:50.780 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0046550539999999996, 2024-09-14T05:59:50.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055028009999999999, 2024-09-14T05:59:50.780 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.780 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.780 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.780 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.780 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.780 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.780 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48612 2024-09-14T05:59:50.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719273+0000", 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719273+0000", 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719274+0000", 2024-09-14T05:59:50.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.51e-07 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719276+0000", 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1560000000000002e-06 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719284+0000", 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3629999999999994e-06 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719289+0000", 2024-09-14T05:59:50.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1789999999999999e-06 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48613 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719297+0000", 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0046315649999999998, 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055308049999999997, 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.783 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48613 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719297+0000", 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719297+0000", 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719297+0000", 2024-09-14T05:59:50.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T05:59:50.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719305+0000", 2024-09-14T05:59:50.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4340000000000003e-06 2024-09-14T05:59:50.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719312+0000", 2024-09-14T05:59:50.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7079999999999997e-06 2024-09-14T05:59:50.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719317+0000", 2024-09-14T05:59:50.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.955e-06 2024-09-14T05:59:50.786 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.786 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.786 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.786 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48614 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.786 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719324+0000", 2024-09-14T05:59:50.786 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0046040860000000003, 2024-09-14T05:59:50.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055550520000000004, 2024-09-14T05:59:50.786 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.786 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48614 2024-09-14T05:59:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719324+0000", 2024-09-14T05:59:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719324+0000", 2024-09-14T05:59:50.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719325+0000", 2024-09-14T05:59:50.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1100000000000001e-07 2024-09-14T05:59:50.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719327+0000", 2024-09-14T05:59:50.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.962e-06 2024-09-14T05:59:50.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719333+0000", 2024-09-14T05:59:50.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1229999999999997e-06 2024-09-14T05:59:50.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719337+0000", 2024-09-14T05:59:50.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6260000000000003e-06 2024-09-14T05:59:50.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.789 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.790 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48615 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.790 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719345+0000", 2024-09-14T05:59:50.790 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0045827510000000004, 2024-09-14T05:59:50.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055891839999999996, 2024-09-14T05:59:50.790 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.790 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.790 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.790 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48615 2024-09-14T05:59:50.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.790 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719345+0000", 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719345+0000", 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719346+0000", 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3099999999999998e-07 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719348+0000", 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1689999999999999e-06 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719356+0000", 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5089999999999996e-06 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719360+0000", 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7570000000000004e-06 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.792 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.793 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48616 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.793 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719367+0000", 2024-09-14T05:59:50.793 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0045612150000000004, 2024-09-14T05:59:50.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055937850000000004, 2024-09-14T05:59:50.793 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.793 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.793 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.793 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.793 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.793 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.793 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48616 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719367+0000", 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719367+0000", 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719367+0000", 2024-09-14T05:59:50.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2e-07 2024-09-14T05:59:50.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719369+0000", 2024-09-14T05:59:50.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8640000000000001e-06 2024-09-14T05:59:50.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719377+0000", 2024-09-14T05:59:50.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6279999999999996e-06 2024-09-14T05:59:50.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719382+0000", 2024-09-14T05:59:50.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7099999999999998e-06 2024-09-14T05:59:50.796 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.796 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.796 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.796 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48617 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.796 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719388+0000", 2024-09-14T05:59:50.796 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0045397620000000001, 2024-09-14T05:59:50.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055971959999999996, 2024-09-14T05:59:50.796 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.796 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.796 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.797 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.797 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.797 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.797 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48617 2024-09-14T05:59:50.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.797 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719388+0000", 2024-09-14T05:59:50.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719388+0000", 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719389+0000", 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2599999999999998e-07 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719391+0000", 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.153e-06 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719399+0000", 2024-09-14T05:59:50.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2069999999999995e-06 2024-09-14T05:59:50.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719404+0000", 2024-09-14T05:59:50.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8770000000000001e-06 2024-09-14T05:59:50.799 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.799 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.799 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.799 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48618 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.800 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719411+0000", 2024-09-14T05:59:50.800 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0045170619999999996, 2024-09-14T05:59:50.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055992100000000003, 2024-09-14T05:59:50.800 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.800 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.800 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.800 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.800 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.800 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.800 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48618 2024-09-14T05:59:50.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.800 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719411+0000", 2024-09-14T05:59:50.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719411+0000", 2024-09-14T05:59:50.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719412+0000", 2024-09-14T05:59:50.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.58e-07 2024-09-14T05:59:50.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719414+0000", 2024-09-14T05:59:50.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1239999999999999e-06 2024-09-14T05:59:50.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719422+0000", 2024-09-14T05:59:50.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9680000000000006e-06 2024-09-14T05:59:50.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719426+0000", 2024-09-14T05:59:50.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7149999999999997e-06 2024-09-14T05:59:50.803 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.803 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.803 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.803 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48619 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.803 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719434+0000", 2024-09-14T05:59:50.803 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0044940199999999996, 2024-09-14T05:59:50.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056011139999999999, 2024-09-14T05:59:50.803 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.803 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.803 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.804 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.804 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.804 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.804 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48619 2024-09-14T05:59:50.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.804 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719434+0000", 2024-09-14T05:59:50.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719434+0000", 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719435+0000", 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2100000000000002e-07 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719437+0000", 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0430000000000002e-06 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719445+0000", 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.123e-06 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719450+0000", 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1309999999999997e-06 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48620 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719458+0000", 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0044698730000000001, 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056015190000000001, 2024-09-14T05:59:50.806 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48620 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719458+0000", 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719458+0000", 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719459+0000", 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8299999999999997e-07 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719461+0000", 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2110000000000001e-06 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719469+0000", 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6380000000000004e-06 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719473+0000", 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.656e-06 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48621 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719481+0000", 2024-09-14T05:59:50.809 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0044474029999999999, 2024-09-14T05:59:50.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056104149999999997, 2024-09-14T05:59:50.810 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.810 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.810 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.810 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.810 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.810 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.810 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48621 2024-09-14T05:59:50.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.810 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719481+0000", 2024-09-14T05:59:50.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719481+0000", 2024-09-14T05:59:50.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719481+0000", 2024-09-14T05:59:50.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0600000000000001e-07 2024-09-14T05:59:50.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719484+0000", 2024-09-14T05:59:50.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3199999999999998e-06 2024-09-14T05:59:50.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719492+0000", 2024-09-14T05:59:50.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8510000000000005e-06 2024-09-14T05:59:50.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719498+0000", 2024-09-14T05:59:50.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.75e-06 2024-09-14T05:59:50.812 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.812 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.813 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.813 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48622 3.c 3.8748d74c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.813 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719506+0000", 2024-09-14T05:59:50.813 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.004422105, 2024-09-14T05:59:50.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005634081, 2024-09-14T05:59:50.813 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.813 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.813 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.813 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.813 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.813 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.813 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48622 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719506+0000", 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719506+0000", 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719507+0000", 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9800000000000004e-07 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719509+0000", 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3429999999999998e-06 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719517+0000", 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8210000000000002e-06 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719522+0000", 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7609999999999998e-06 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48788 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719541+0000", 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0043876519999999997, 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056563100000000003, 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.816 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.817 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.817 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48788 2024-09-14T05:59:50.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.817 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719541+0000", 2024-09-14T05:59:50.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719541+0000", 2024-09-14T05:59:50.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719541+0000", 2024-09-14T05:59:50.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8500000000000002e-07 2024-09-14T05:59:50.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719544+0000", 2024-09-14T05:59:50.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7930000000000002e-06 2024-09-14T05:59:50.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719553+0000", 2024-09-14T05:59:50.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2180000000000005e-06 2024-09-14T05:59:50.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719559+0000", 2024-09-14T05:59:50.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.434e-06 2024-09-14T05:59:50.819 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.819 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.819 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.819 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48789 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.819 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719567+0000", 2024-09-14T05:59:50.819 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.004361518, 2024-09-14T05:59:50.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056799169999999996, 2024-09-14T05:59:50.820 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.820 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.820 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.820 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.820 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.820 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.820 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48789 2024-09-14T05:59:50.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.820 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719567+0000", 2024-09-14T05:59:50.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719567+0000", 2024-09-14T05:59:50.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719567+0000", 2024-09-14T05:59:50.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7599999999999997e-07 2024-09-14T05:59:50.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719570+0000", 2024-09-14T05:59:50.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4530000000000001e-06 2024-09-14T05:59:50.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719577+0000", 2024-09-14T05:59:50.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7470000000000005e-06 2024-09-14T05:59:50.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719582+0000", 2024-09-14T05:59:50.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0980000000000001e-06 2024-09-14T05:59:50.822 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.823 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.823 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.823 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48790 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.823 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719590+0000", 2024-09-14T05:59:50.823 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0043383199999999997, 2024-09-14T05:59:50.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057094509999999999, 2024-09-14T05:59:50.823 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.823 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.823 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.823 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.823 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.824 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.824 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48790 2024-09-14T05:59:50.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.824 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719590+0000", 2024-09-14T05:59:50.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719590+0000", 2024-09-14T05:59:50.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719590+0000", 2024-09-14T05:59:50.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2399999999999999e-07 2024-09-14T05:59:50.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719592+0000", 2024-09-14T05:59:50.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.114e-06 2024-09-14T05:59:50.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719600+0000", 2024-09-14T05:59:50.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9650000000000008e-06 2024-09-14T05:59:50.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719605+0000", 2024-09-14T05:59:50.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0209999999999999e-06 2024-09-14T05:59:50.826 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.826 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.826 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.826 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48791 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.826 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719612+0000", 2024-09-14T05:59:50.827 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0043157819999999998, 2024-09-14T05:59:50.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057138060000000001, 2024-09-14T05:59:50.827 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.827 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.827 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.827 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.827 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.827 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.827 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48791 2024-09-14T05:59:50.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.827 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719612+0000", 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719612+0000", 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719613+0000", 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719615+0000", 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4660000000000002e-06 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719623+0000", 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9610000000000005e-06 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719628+0000", 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48792 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719636+0000", 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0042922050000000003, 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057173980000000003, 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48792 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719636+0000", 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719636+0000", 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719636+0000", 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1100000000000001e-07 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719639+0000", 2024-09-14T05:59:50.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1689999999999999e-06 2024-09-14T05:59:50.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719647+0000", 2024-09-14T05:59:50.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0190000000000006e-06 2024-09-14T05:59:50.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719651+0000", 2024-09-14T05:59:50.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6419999999999998e-06 2024-09-14T05:59:50.832 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.832 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48793 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719659+0000", 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0042696449999999999, 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057196840000000001, 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48793 2024-09-14T05:59:50.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719659+0000", 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719659+0000", 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719659+0000", 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0399999999999996e-07 2024-09-14T05:59:50.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719661+0000", 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0509999999999999e-06 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719669+0000", 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2309999999999996e-06 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719674+0000", 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.904e-06 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.835 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.836 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.836 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48794 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.836 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719682+0000", 2024-09-14T05:59:50.836 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0042459200000000002, 2024-09-14T05:59:50.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057296880000000001, 2024-09-14T05:59:50.836 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.836 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.836 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.836 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.836 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.836 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.836 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48794 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719682+0000", 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719682+0000", 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719683+0000", 2024-09-14T05:59:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.08e-07 2024-09-14T05:59:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719685+0000", 2024-09-14T05:59:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2910000000000002e-06 2024-09-14T05:59:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719694+0000", 2024-09-14T05:59:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.799e-06 2024-09-14T05:59:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719699+0000", 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8319999999999996e-06 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48795 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719706+0000", 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0042218510000000004, 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057308710000000002, 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48795 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719706+0000", 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719706+0000", 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719707+0000", 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3799999999999998e-07 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719709+0000", 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2139999999999999e-06 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719716+0000", 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7989999999999996e-06 2024-09-14T05:59:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719721+0000", 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.887e-06 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48796 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719728+0000", 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0042000709999999997, 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005734393, 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.842 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48796 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719728+0000", 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719728+0000", 2024-09-14T05:59:50.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719729+0000", 2024-09-14T05:59:50.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2300000000000002e-07 2024-09-14T05:59:50.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719731+0000", 2024-09-14T05:59:50.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2050000000000001e-06 2024-09-14T05:59:50.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719737+0000", 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3670000000000002e-06 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719742+0000", 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8280000000000002e-06 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48797 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719749+0000", 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.004179248, 2024-09-14T05:59:50.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057383369999999996, 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48797 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719749+0000", 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719749+0000", 2024-09-14T05:59:50.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719749+0000", 2024-09-14T05:59:50.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2399999999999999e-07 2024-09-14T05:59:50.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719752+0000", 2024-09-14T05:59:50.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0990000000000001e-06 2024-09-14T05:59:50.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719757+0000", 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9399999999999999e-06 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719762+0000", 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6779999999999999e-06 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.848 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:48798 3.1c 3.4765be1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-14T05:59:50.849 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:50.719769+0000", 2024-09-14T05:59:50.849 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0041595210000000002, 2024-09-14T05:59:50.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057618529999999999, 2024-09-14T05:59:50.849 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T05:59:50.849 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T05:59:50.849 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:50.849 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T05:59:50.849 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T05:59:50.849 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:50.849 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 48798 2024-09-14T05:59:50.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.849 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T05:59:50.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719769+0000", 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719769+0000", 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719769+0000", 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.39e-07 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T05:59:50.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719771+0000", 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9230000000000001e-06 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719777+0000", 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0270000000000001e-06 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:50.719782+0000", 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6099999999999999e-06 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T05:59:50.851 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-09-14T05:59:50.852 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 39 2024-09-14T05:59:50.852 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:50.853 INFO:teuthology.orchestra.run.smithi006.stdout:2411 trunc from 0x70d7c0e to 0xa6f53f5 2024-09-14T05:59:50.853 INFO:teuthology.orchestra.run.smithi006.stdout:2412 read 0x9f9b79 thru 0x9fbb05 (0x1f8d bytes) 2024-09-14T05:59:50.853 INFO:teuthology.orchestra.run.smithi006.stdout:2413 writesame 0xecdaed3 thru 0xece493a data_size 0x1b(0x9a68 bytes) 2024-09-14T05:59:50.854 INFO:teuthology.orchestra.run.smithi006.stdout:2414 read 0x487291a thru 0x4880b65 (0xe24c bytes) 2024-09-14T05:59:50.854 INFO:teuthology.orchestra.run.smithi006.stdout:2415 read 0x7ba3deb thru 0x7ba55c9 (0x17df bytes) 2024-09-14T05:59:50.854 INFO:teuthology.orchestra.run.smithi006.stdout:2416 writesame 0x1b9fac1 thru 0x1bacb7c data_size 0xc(0xd0bc bytes) 2024-09-14T05:59:50.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:59:50.854 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:50.853+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:50.855 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.7 to 1 (10000) 2024-09-14T05:59:50.855 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2024-09-14T05:59:50.855 INFO:teuthology.orchestra.run.smithi006.stdout:2418 trunc from 0xece493b to 0x95d9edc 2024-09-14T05:59:50.856 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T05:59:50.856 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:59:50.868 INFO:teuthology.orchestra.run.smithi006.stdout:2419 writesame 0xa38144f thru 0xa38fb69 data_size 0xd(0xe71b bytes) 2024-09-14T05:59:50.868 INFO:teuthology.orchestra.run.smithi006.stdout:2420 punch from 0x5da2b84 to 0x5dacc74, (0xa0f0 bytes) 2024-09-14T05:59:50.868 INFO:teuthology.orchestra.run.smithi006.stdout:2421 punch from 0x24f343 to 0x25735d, (0x801a bytes) 2024-09-14T05:59:50.869 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T05:59:50.869 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:59:50.869 INFO:teuthology.orchestra.run.smithi006.stdout:2423 trunc from 0xa38fb6a to 0x982785d 2024-09-14T05:59:50.876 INFO:teuthology.orchestra.run.smithi006.stdout:2424 punch from 0x29a1595 to 0x29a4e3a, (0x38a5 bytes) 2024-09-14T05:59:50.877 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:50.877 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:50.887 INFO:teuthology.orchestra.run.smithi006.stdout:2427 write 0xc6eb093 thru 0xc6f4ad6 (0x9a44 bytes) 2024-09-14T05:59:50.896 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:50.897 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:50.898 INFO:teuthology.orchestra.run.smithi006.stdout:2429 trunc from 0xc6f4ad7 to 0xd675467 2024-09-14T05:59:50.904 INFO:teuthology.orchestra.run.smithi006.stdout:2430 read 0xae16d21 thru 0xae1f0ae (0x838e bytes) 2024-09-14T05:59:50.916 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:50.916 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:50.926 INFO:teuthology.orchestra.run.smithi006.stdout:2432 trunc from 0xd675467 to 0x109f756 2024-09-14T05:59:50.939 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:50.939 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:50.953 INFO:teuthology.orchestra.run.smithi006.stdout:2433 read 0x8138f2 thru 0x81c996 (0x90a5 bytes) 2024-09-14T05:59:50.954 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:50.953+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:50.954 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:50.954 INFO:teuthology.orchestra.run.smithi006.stdout:2435 punch from 0xb5fb2f to 0xb69e86, (0xa357 bytes) 2024-09-14T05:59:50.954 INFO:teuthology.orchestra.run.smithi006.stdout:2437 read 0x65e897 thru 0x65edfe (0x568 bytes) 2024-09-14T05:59:50.955 INFO:teuthology.orchestra.run.smithi006.stdout:2439 punch from 0x817c27 to 0x820d71, (0x914a bytes) 2024-09-14T05:59:50.955 INFO:teuthology.orchestra.run.smithi006.stdout:2440 read 0x19009d thru 0x19592b (0x588f bytes) 2024-09-14T05:59:50.959 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:50.965 INFO:teuthology.orchestra.run.smithi006.stdout:2441 write 0x2caba2b thru 0x2cb7563 (0xbb39 bytes) 2024-09-14T05:59:50.979 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:50.993 INFO:teuthology.orchestra.run.smithi006.stdout:2443 trunc from 0x2cb7564 to 0xd05ab6f 2024-09-14T05:59:50.997 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:50.997 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:50.999 INFO:teuthology.orchestra.run.smithi006.stdout:2444 write 0x528b27d thru 0x528d935 (0x26b9 bytes) 2024-09-14T05:59:51.004 INFO:teuthology.orchestra.run.smithi006.stdout:2445 punch from 0x5756a1c to 0x576214c, (0xb730 bytes) 2024-09-14T05:59:51.004 INFO:teuthology.orchestra.run.smithi006.stdout:2446 read 0x4da3e14 thru 0x4dacd98 (0x8f85 bytes) 2024-09-14T05:59:51.004 INFO:teuthology.orchestra.run.smithi006.stdout:2448 punch from 0x95700b3 to 0x9572bad, (0x2afa bytes) 2024-09-14T05:59:51.004 INFO:teuthology.orchestra.run.smithi006.stdout:2449 write 0x163d04 thru 0x171ff3 (0xe2f0 bytes) 2024-09-14T05:59:51.008 INFO:teuthology.orchestra.run.smithi006.stdout:2450 write 0x1907abd thru 0x1912eee (0xb432 bytes) 2024-09-14T05:59:51.028 INFO:teuthology.orchestra.run.smithi006.stdout:2451 trunc from 0xd05ab6f to 0x109da03 2024-09-14T05:59:51.037 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:51.037 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:51.043 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:51.043 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:51.043 INFO:teuthology.orchestra.run.smithi006.stdout:2456 punch from 0xc1e997 to 0xc1fa4c, (0x10b5 bytes) 2024-09-14T05:59:51.051 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:59:51.061 INFO:teuthology.orchestra.run.smithi006.stdout:2457 write 0x92a589a thru 0x92ac812 (0x6f79 bytes) 2024-09-14T05:59:51.069 INFO:teuthology.orchestra.run.smithi006.stdout:2458 punch from 0x7c54469 to 0x7c5e363, (0x9efa bytes) 2024-09-14T05:59:51.069 INFO:teuthology.orchestra.run.smithi006.stdout:2459 punch from 0x4583b3d to 0x458aa1a, (0x6edd bytes) 2024-09-14T05:59:51.069 INFO:teuthology.orchestra.run.smithi006.stdout:2461 read 0x26c21c2 thru 0x26d02c2 (0xe101 bytes) 2024-09-14T05:59:51.069 INFO:teuthology.orchestra.run.smithi006.stdout:2462 writesame 0x7b86701 thru 0x7b9004d data_size 0x2f(0x994d bytes) 2024-09-14T05:59:51.092 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:51.093+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:51.093 INFO:teuthology.orchestra.run.smithi006.stdout:2464 writesame 0xcb9114c thru 0xcb9be5b data_size 0x68(0xad10 bytes) 2024-09-14T05:59:51.098 INFO:teuthology.orchestra.run.smithi006.stdout:2465 trunc from 0xcb9be5c to 0x9235b00 2024-09-14T05:59:51.115 INFO:teuthology.orchestra.run.smithi006.stdout:2466 trunc from 0x9235b00 to 0x570dcb9 2024-09-14T05:59:51.130 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:51.130 INFO:teuthology.orchestra.run.smithi006.stdout:2471 read 0x3f739f6 thru 0x3f74c99 (0x12a4 bytes) 2024-09-14T05:59:51.131 INFO:teuthology.orchestra.run.smithi006.stdout:2474 write 0x7e007e thru 0x7e3df9 (0x3d7c bytes) 2024-09-14T05:59:51.133 INFO:teuthology.orchestra.run.smithi006.stdout:2476 read 0x1f041d6 thru 0x1f09cfd (0x5b28 bytes) 2024-09-14T05:59:51.133 INFO:teuthology.orchestra.run.smithi006.stdout:2480 writesame 0x1d8011f thru 0x1d8bd23 data_size 0x1(0xbc05 bytes) 2024-09-14T05:59:51.155 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:51.153+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:51.165 INFO:teuthology.orchestra.run.smithi006.stdout:2482 trunc from 0x570dcb9 to 0xd056375 2024-09-14T05:59:51.184 INFO:teuthology.orchestra.run.smithi006.stdout:2483 write 0xdeffcff thru 0xdf07b7e (0x7e80 bytes) 2024-09-14T05:59:51.198 INFO:teuthology.orchestra.run.smithi006.stdout:2484 write 0x84b49e8 thru 0x84bfc4d (0xb266 bytes) 2024-09-14T05:59:51.215 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:51.215 INFO:teuthology.orchestra.run.smithi006.stdout:2486 punch from 0x33e5cf9 to 0x33e7327, (0x162e bytes) 2024-09-14T05:59:51.215 INFO:teuthology.orchestra.run.smithi006.stdout:2487 write 0xc951e02 thru 0xc9606f6 (0xe8f5 bytes) 2024-09-14T05:59:51.225 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:51.225 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:51.235 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:59:51.235 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T05:59:51.240 INFO:teuthology.orchestra.run.smithi006.stdout:2491 trunc from 0xdf07b7f to 0x7a82f74 2024-09-14T05:59:51.241 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T05:59:51.258 INFO:teuthology.orchestra.run.smithi006.stdout:2492 punch from 0x3008883 to 0x3010946, (0x80c3 bytes) 2024-09-14T05:59:51.258 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-14T05:59:50.842818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":418811016,"num_objects":616,"num_object_clones":114,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":616,"num_whiteouts":253,"num_read":53951,"num_read_kb":175149,"num_write":6676,"num_write_kb":152288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":5610454,"num_keys_recovered":69,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5158,"ondisk_log_size":5158,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":339468,"kb_used_data":80616,"kb_used_omap":15,"kb_used_meta":258608,"kb_avail":754635252,"statfs":{"total":773094113280,"available":772746498048,"internally_reserved":0,"allocated":82550784,"data_stored":104218765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":264815388},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5695200,"num_objects":13,"num_object_clones":4,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":5,"num_read":1170,"num_read_kb":10043,"num_write":177,"num_write_kb":5990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.041360"},"pg_stats":[{"pgid":"3.1f","version":"53'141","reported_seq":1136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T05:59:47.815955+0000","last_change":"2024-09-14T05:59:43.763150+0000","last_active":"2024-09-14T05:59:47.815955+0000","last_peered":"2024-09-14T05:59:47.815955+0000","last_clean":"2024-09-14T05:59:47.815955+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T05:59:47.815955+0000","last_undegraded":"2024-09-14T05:59:47.815955+0000","last_fullsized":"2024-09-14T05:59:47.815955+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:21.136889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001224482,"stat_sum":{"num_bytes":31200042,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":9,"num_read":1583,"num_read_kb":10219,"num_write":139,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"51'247","reported_seq":407,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.799459+0000","last_change":"2024-09-14T05:59:08.299658+0000","last_active":"2024-09-14T05:59:45.799459+0000","last_peered":"2024-09-14T05:59:45.799459+0000","last_clean":"2024-09-14T05:59:45.799459+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T05:59:45.799459+0000","last_undegraded":"2024-09-14T05:59:45.799459+0000","last_fullsized":"2024-09-14T05:59:45.799459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:18.826471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882171,"stat_sum":{"num_bytes":1922653,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":1062,"num_read_kb":974,"num_write":395,"num_write_kb":3340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"52'79","reported_seq":3276,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.156083+0000","last_change":"2024-09-14T05:59:08.293155+0000","last_active":"2024-09-14T05:59:46.156083+0000","last_peered":"2024-09-14T05:59:46.156083+0000","last_clean":"2024-09-14T05:59:46.156083+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T05:59:46.156083+0000","last_undegraded":"2024-09-14T05:59:46.156083+0000","last_fullsized":"2024-09-14T05:59:46.156083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:49.750350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000618802,"stat_sum":{"num_bytes":10139706,"num_objects":13,"num_object_clones":2,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":4,"num_read":3168,"num_read_kb":11542,"num_write":107,"num_write_kb":18834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"52'85","reported_seq":1622,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.001179+0000","last_change":"2024-09-14T05:59:08.294498+0000","last_active":"2024-09-14T05:59:46.001179+0000","last_peered":"2024-09-14T05:59:46.001179+0000","last_clean":"2024-09-14T05:59:46.001179+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T05:59:46.001179+0000","last_undegraded":"2024-09-14T05:59:46.001179+0000","last_fullsized":"2024-09-14T05:59:46.001179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:29.933017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014905350000000001,"stat_sum":{"num_bytes":2976523,"num_objects":17,"num_object_clones":1,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":8,"num_read":1504,"num_read_kb":2865,"num_write":78,"num_write_kb":2016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"54'160","reported_seq":419,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T05:59:48.761877+0000","last_change":"2024-09-14T05:59:40.834308+0000","last_active":"2024-09-14T05:59:48.761877+0000","last_peered":"2024-09-14T05:59:48.761877+0000","last_clean":"2024-09-14T05:59:48.761877+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T05:59:48.761877+0000","last_undegraded":"2024-09-14T05:59:48.761877+0000","last_fullsized":"2024-09-14T05:59:48.761877+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:24.791672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2064433,"num_objects":23,"num_object_clones":6,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":12,"num_read":759,"num_read_kb":1943,"num_write":148,"num_write_kb":2171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"52'181","reported_seq":1243,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.186068+0000","last_change":"2024-09-14T05:59:08.282710+0000","last_active":"2024-09-14T05:59:46.186068+0000","last_peered":"2024-09-14T05:59:46.186068+0000","last_clean":"2024-09-14T05:59:46.186068+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T05:59:46.186068+0000","last_undegraded":"2024-09-14T05:59:46.186068+0000","last_fullsized":"2024-09-14T05:59:46.186068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:19.733635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078735700000000003,"stat_sum":{"num_bytes":3174477,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":5,"num_read":1827,"num_read_kb":3114,"num_write":222,"num_write_kb":3633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"51'104","reported_seq":358,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.794386+0000","last_change":"2024-09-14T05:59:08.283122+0000","last_active":"2024-09-14T05:59:45.794386+0000","last_peered":"2024-09-14T05:59:45.794386+0000","last_clean":"2024-09-14T05:59:45.794386+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T05:59:45.794386+0000","last_undegraded":"2024-09-14T05:59:45.794386+0000","last_fullsized":"2024-09-14T05:59:45.794386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:27.924971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020244989999999999,"stat_sum":{"num_bytes":18182764,"num_objects":14,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":7,"num_read":204,"num_read_kb":2389,"num_write":108,"num_write_kb":3416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"51'227","reported_seq":2588,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.024869+0000","last_change":"2024-09-14T05:59:43.761389+0000","last_active":"2024-09-14T05:59:46.024869+0000","last_peered":"2024-09-14T05:59:46.024869+0000","last_clean":"2024-09-14T05:59:46.024869+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T05:59:46.024869+0000","last_undegraded":"2024-09-14T05:59:46.024869+0000","last_fullsized":"2024-09-14T05:59:46.024869+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:51.529862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090099400000000001,"stat_sum":{"num_bytes":38158038,"num_objects":28,"num_object_clones":6,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":12,"num_read":3742,"num_read_kb":20740,"num_write":217,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"54'87","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T05:59:48.639660+0000","last_change":"2024-09-14T05:59:40.929839+0000","last_active":"2024-09-14T05:59:48.639660+0000","last_peered":"2024-09-14T05:59:48.639660+0000","last_clean":"2024-09-14T05:59:48.639660+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T05:59:48.639660+0000","last_undegraded":"2024-09-14T05:59:48.639660+0000","last_fullsized":"2024-09-14T05:59:48.639660+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:11.228013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3899892,"num_objects":16,"num_object_clones":4,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":5,"num_read":586,"num_read_kb":1706,"num_write":80,"num_write_kb":1171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"51'97","reported_seq":393,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.791805+0000","last_change":"2024-09-14T05:59:08.293088+0000","last_active":"2024-09-14T05:59:45.791805+0000","last_peered":"2024-09-14T05:59:45.791805+0000","last_clean":"2024-09-14T05:59:45.791805+0000","last_became_active":"2024-09-14T05:59:06.296607+0000","last_became_peered":"2024-09-14T05:59:06.296607+0000","last_unstale":"2024-09-14T05:59:45.791805+0000","last_undegraded":"2024-09-14T05:59:45.791805+0000","last_fullsized":"2024-09-14T05:59:45.791805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:52:23.473672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056627299999999995,"stat_sum":{"num_bytes":20733952,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":3,"num_read":246,"num_read_kb":2549,"num_write":114,"num_write_kb":8106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"52'202","reported_seq":576,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.186764+0000","last_change":"2024-09-14T05:59:08.370304+0000","last_active":"2024-09-14T05:59:46.186764+0000","last_peered":"2024-09-14T05:59:46.186764+0000","last_clean":"2024-09-14T05:59:46.186764+0000","last_became_active":"2024-09-14T05:59:06.295335+0000","last_became_peered":"2024-09-14T05:59:06.295335+0000","last_unstale":"2024-09-14T05:59:46.186764+0000","last_undegraded":"2024-09-14T05:59:46.186764+0000","last_fullsized":"2024-09-14T05:59:46.186764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:10.852265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001779487,"stat_sum":{"num_bytes":29202710,"num_objects":30,"num_object_clones":7,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":14,"num_read":849,"num_read_kb":3267,"num_write":312,"num_write_kb":4654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"51'85","reported_seq":2393,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.790258+0000","last_change":"2024-09-14T05:59:08.282513+0000","last_active":"2024-09-14T05:59:45.790258+0000","last_peered":"2024-09-14T05:59:45.790258+0000","last_clean":"2024-09-14T05:59:45.790258+0000","last_became_active":"2024-09-14T05:59:06.307548+0000","last_became_peered":"2024-09-14T05:59:06.307548+0000","last_unstale":"2024-09-14T05:59:45.790258+0000","last_undegraded":"2024-09-14T05:59:45.790258+0000","last_fullsized":"2024-09-14T05:59:45.790258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:06.861860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061538200000000004,"stat_sum":{"num_bytes":4600172,"num_objects":19,"num_object_clones":4,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":8,"num_read":2454,"num_read_kb":4122,"num_write":112,"num_write_kb":1701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.836022+0000","last_change":"2024-09-14T05:58:56.312544+0000","last_active":"2024-09-14T05:59:45.836022+0000","last_peered":"2024-09-14T05:59:45.836022+0000","last_clean":"2024-09-14T05:59:45.836022+0000","last_became_active":"2024-09-14T05:58:54.103612+0000","last_became_peered":"2024-09-14T05:58:54.103612+0000","last_unstale":"2024-09-14T05:59:45.836022+0000","last_undegraded":"2024-09-14T05:59:45.836022+0000","last_fullsized":"2024-09-14T05:59:45.836022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:08.678742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"53'238","reported_seq":1912,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T05:59:48.237006+0000","last_change":"2024-09-14T05:59:43.762927+0000","last_active":"2024-09-14T05:59:48.237006+0000","last_peered":"2024-09-14T05:59:48.237006+0000","last_clean":"2024-09-14T05:59:48.237006+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T05:59:48.237006+0000","last_undegraded":"2024-09-14T05:59:48.237006+0000","last_fullsized":"2024-09-14T05:59:48.237006+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:29.584493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11667866,"num_objects":25,"num_object_clones":5,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":10,"num_read":2379,"num_read_kb":8066,"num_write":338,"num_write_kb":3564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.794389+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T05:59:45.794389+0000","last_peered":"2024-09-14T05:59:45.794389+0000","last_clean":"2024-09-14T05:59:45.794389+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T05:59:45.794389+0000","last_undegraded":"2024-09-14T05:59:45.794389+0000","last_fullsized":"2024-09-14T05:59:45.794389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"52'138","reported_seq":2114,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.183193+0000","last_change":"2024-09-14T05:59:08.299312+0000","last_active":"2024-09-14T05:59:46.183193+0000","last_peered":"2024-09-14T05:59:46.183193+0000","last_clean":"2024-09-14T05:59:46.183193+0000","last_became_active":"2024-09-14T05:59:06.302779+0000","last_became_peered":"2024-09-14T05:59:06.302779+0000","last_unstale":"2024-09-14T05:59:46.183193+0000","last_undegraded":"2024-09-14T05:59:46.183193+0000","last_fullsized":"2024-09-14T05:59:46.183193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:51:22.554923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001533155,"stat_sum":{"num_bytes":42012006,"num_objects":24,"num_object_clones":3,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":10,"num_read":1936,"num_read_kb":10402,"num_write":162,"num_write_kb":10794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":89,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.855251+0000","last_change":"2024-09-14T05:59:40.765463+0000","last_active":"2024-09-14T05:59:45.855251+0000","last_peered":"2024-09-14T05:59:45.855251+0000","last_clean":"2024-09-14T05:59:45.855251+0000","last_became_active":"2024-09-14T05:59:40.764785+0000","last_became_peered":"2024-09-14T05:59:40.764785+0000","last_unstale":"2024-09-14T05:59:45.855251+0000","last_undegraded":"2024-09-14T05:59:45.855251+0000","last_fullsized":"2024-09-14T05:59:45.855251+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:47.547246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"51'112","reported_seq":1242,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.794586+0000","last_change":"2024-09-14T05:59:08.282105+0000","last_active":"2024-09-14T05:59:45.794586+0000","last_peered":"2024-09-14T05:59:45.794586+0000","last_clean":"2024-09-14T05:59:45.794586+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T05:59:45.794586+0000","last_undegraded":"2024-09-14T05:59:45.794586+0000","last_fullsized":"2024-09-14T05:59:45.794586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:04.044967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010945919999999999,"stat_sum":{"num_bytes":1417352,"num_objects":13,"num_object_clones":1,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":9,"num_read":1308,"num_read_kb":2061,"num_write":162,"num_write_kb":1709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.794319+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T05:59:45.794319+0000","last_peered":"2024-09-14T05:59:45.794319+0000","last_clean":"2024-09-14T05:59:45.794319+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T05:59:45.794319+0000","last_undegraded":"2024-09-14T05:59:45.794319+0000","last_fullsized":"2024-09-14T05:59:45.794319+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"51'184","reported_seq":2527,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.791831+0000","last_change":"2024-09-14T05:59:08.293368+0000","last_active":"2024-09-14T05:59:45.791831+0000","last_peered":"2024-09-14T05:59:45.791831+0000","last_clean":"2024-09-14T05:59:45.791831+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T05:59:45.791831+0000","last_undegraded":"2024-09-14T05:59:45.791831+0000","last_fullsized":"2024-09-14T05:59:45.791831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:35.057614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072033799999999995,"stat_sum":{"num_bytes":7946280,"num_objects":23,"num_object_clones":5,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":9,"num_read":3677,"num_read_kb":10532,"num_write":170,"num_write_kb":1621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"52'108","reported_seq":863,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.186916+0000","last_change":"2024-09-14T05:59:40.846399+0000","last_active":"2024-09-14T05:59:46.186916+0000","last_peered":"2024-09-14T05:59:46.186916+0000","last_clean":"2024-09-14T05:59:46.186916+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T05:59:46.186916+0000","last_undegraded":"2024-09-14T05:59:46.186916+0000","last_fullsized":"2024-09-14T05:59:46.186916+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:31.252055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047912600000000002,"stat_sum":{"num_bytes":29889576,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":6,"num_read":653,"num_read_kb":7890,"num_write":108,"num_write_kb":3257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":82,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.791412+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T05:59:45.791412+0000","last_peered":"2024-09-14T05:59:45.791412+0000","last_clean":"2024-09-14T05:59:45.791412+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T05:59:45.791412+0000","last_undegraded":"2024-09-14T05:59:45.791412+0000","last_fullsized":"2024-09-14T05:59:45.791412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"52'520","reported_seq":860,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.186843+0000","last_change":"2024-09-14T05:59:08.281926+0000","last_active":"2024-09-14T05:59:46.186843+0000","last_peered":"2024-09-14T05:59:46.186843+0000","last_clean":"2024-09-14T05:59:46.186843+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T05:59:46.186843+0000","last_undegraded":"2024-09-14T05:59:46.186843+0000","last_fullsized":"2024-09-14T05:59:46.186843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:02.993620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096925799999999997,"stat_sum":{"num_bytes":6530882,"num_objects":20,"num_object_clones":3,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":7,"num_read":2747,"num_read_kb":5422,"num_write":902,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-14T05:59:47.141140+0000","last_change":"2024-09-14T05:58:56.096637+0000","last_active":"2024-09-14T05:59:47.141140+0000","last_peered":"2024-09-14T05:59:47.141140+0000","last_clean":"2024-09-14T05:59:47.141140+0000","last_became_active":"2024-09-14T05:58:54.356560+0000","last_became_peered":"2024-09-14T05:58:54.356560+0000","last_unstale":"2024-09-14T05:59:47.141140+0000","last_undegraded":"2024-09-14T05:59:47.141140+0000","last_fullsized":"2024-09-14T05:59:47.141140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:10.136136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012156140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"54'124","reported_seq":268,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T05:59:48.625440+0000","last_change":"2024-09-14T05:59:40.894081+0000","last_active":"2024-09-14T05:59:48.625440+0000","last_peered":"2024-09-14T05:59:48.625440+0000","last_clean":"2024-09-14T05:59:48.625440+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T05:59:48.625440+0000","last_undegraded":"2024-09-14T05:59:48.625440+0000","last_fullsized":"2024-09-14T05:59:48.625440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:11.874120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5805554,"num_objects":22,"num_object_clones":5,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":11,"num_read":324,"num_read_kb":5781,"num_write":138,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.854779+0000","last_change":"2024-09-14T05:58:56.593338+0000","last_active":"2024-09-14T05:59:45.854779+0000","last_peered":"2024-09-14T05:59:45.854779+0000","last_clean":"2024-09-14T05:59:45.854779+0000","last_became_active":"2024-09-14T05:58:54.099699+0000","last_became_peered":"2024-09-14T05:58:54.099699+0000","last_unstale":"2024-09-14T05:59:45.854779+0000","last_undegraded":"2024-09-14T05:59:45.854779+0000","last_fullsized":"2024-09-14T05:59:45.854779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:40.481832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"51'58","reported_seq":701,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.799317+0000","last_change":"2024-09-14T05:59:08.298483+0000","last_active":"2024-09-14T05:59:45.799317+0000","last_peered":"2024-09-14T05:59:45.799317+0000","last_clean":"2024-09-14T05:59:45.799317+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T05:59:45.799317+0000","last_undegraded":"2024-09-14T05:59:45.799317+0000","last_fullsized":"2024-09-14T05:59:45.799317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:43.658765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011244670000000001,"stat_sum":{"num_bytes":6781080,"num_objects":15,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":5,"num_read":630,"num_read_kb":7206,"num_write":90,"num_write_kb":2462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":81,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.791443+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T05:59:45.791443+0000","last_peered":"2024-09-14T05:59:45.791443+0000","last_clean":"2024-09-14T05:59:45.791443+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T05:59:45.791443+0000","last_undegraded":"2024-09-14T05:59:45.791443+0000","last_fullsized":"2024-09-14T05:59:45.791443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":180,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.854789+0000","last_change":"2024-09-14T05:59:40.766729+0000","last_active":"2024-09-14T05:59:45.854789+0000","last_peered":"2024-09-14T05:59:45.854789+0000","last_clean":"2024-09-14T05:59:45.854789+0000","last_became_active":"2024-09-14T05:59:40.765914+0000","last_became_peered":"2024-09-14T05:59:40.765914+0000","last_unstale":"2024-09-14T05:59:45.854789+0000","last_undegraded":"2024-09-14T05:59:45.854789+0000","last_fullsized":"2024-09-14T05:59:45.854789+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:02.407639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"52'324","reported_seq":594,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.179586+0000","last_change":"2024-09-14T05:59:08.298535+0000","last_active":"2024-09-14T05:59:46.179586+0000","last_peered":"2024-09-14T05:59:46.179586+0000","last_clean":"2024-09-14T05:59:46.179586+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T05:59:46.179586+0000","last_undegraded":"2024-09-14T05:59:46.179586+0000","last_fullsized":"2024-09-14T05:59:46.179586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:43.648310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085964400000000001,"stat_sum":{"num_bytes":15879803,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":3,"num_read":1464,"num_read_kb":2495,"num_write":494,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"51'99","reported_seq":1206,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.789909+0000","last_change":"2024-09-14T05:59:08.282238+0000","last_active":"2024-09-14T05:59:45.789909+0000","last_peered":"2024-09-14T05:59:45.789909+0000","last_clean":"2024-09-14T05:59:45.789909+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T05:59:45.789909+0000","last_undegraded":"2024-09-14T05:59:45.789909+0000","last_fullsized":"2024-09-14T05:59:45.789909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:49.239550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052576800000000003,"stat_sum":{"num_bytes":21329018,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":5,"num_read":1044,"num_read_kb":1865,"num_write":113,"num_write_kb":16982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"52'86","reported_seq":261,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.962381+0000","last_change":"2024-09-14T05:59:08.303592+0000","last_active":"2024-09-14T05:59:45.962381+0000","last_peered":"2024-09-14T05:59:45.962381+0000","last_clean":"2024-09-14T05:59:45.962381+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T05:59:45.962381+0000","last_undegraded":"2024-09-14T05:59:45.962381+0000","last_fullsized":"2024-09-14T05:59:45.962381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:08.231443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035228000000000001,"stat_sum":{"num_bytes":1076879,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":8,"num_read":137,"num_read_kb":701,"num_write":79,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"52'65","reported_seq":364,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.854167+0000","last_change":"2024-09-14T05:59:40.885530+0000","last_active":"2024-09-14T05:59:45.854167+0000","last_peered":"2024-09-14T05:59:45.854167+0000","last_clean":"2024-09-14T05:59:45.854167+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T05:59:45.854167+0000","last_undegraded":"2024-09-14T05:59:45.854167+0000","last_fullsized":"2024-09-14T05:59:45.854167+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:03.072888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083256200000000002,"stat_sum":{"num_bytes":800845,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":462,"num_read_kb":762,"num_write":78,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"52'89","reported_seq":1836,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.793118+0000","last_change":"2024-09-14T05:59:08.294210+0000","last_active":"2024-09-14T05:59:45.793118+0000","last_peered":"2024-09-14T05:59:45.793118+0000","last_clean":"2024-09-14T05:59:45.793118+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T05:59:45.793118+0000","last_undegraded":"2024-09-14T05:59:45.793118+0000","last_fullsized":"2024-09-14T05:59:45.793118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:01.883060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013095159999999999,"stat_sum":{"num_bytes":23616339,"num_objects":16,"num_object_clones":1,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":10,"num_read":1689,"num_read_kb":2567,"num_write":84,"num_write_kb":4748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"51'119","reported_seq":786,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.855146+0000","last_change":"2024-09-14T05:59:08.371003+0000","last_active":"2024-09-14T05:59:45.855146+0000","last_peered":"2024-09-14T05:59:45.855146+0000","last_clean":"2024-09-14T05:59:45.855146+0000","last_became_active":"2024-09-14T05:59:06.300360+0000","last_became_peered":"2024-09-14T05:59:06.300360+0000","last_unstale":"2024-09-14T05:59:45.855146+0000","last_undegraded":"2024-09-14T05:59:45.855146+0000","last_fullsized":"2024-09-14T05:59:45.855146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:35.490569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022610920000000001,"stat_sum":{"num_bytes":7475751,"num_objects":18,"num_object_clones":5,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":9,"num_read":1443,"num_read_kb":1901,"num_write":130,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"51'124","reported_seq":700,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.855622+0000","last_change":"2024-09-14T05:59:08.370421+0000","last_active":"2024-09-14T05:59:45.855622+0000","last_peered":"2024-09-14T05:59:45.855622+0000","last_clean":"2024-09-14T05:59:45.855622+0000","last_became_active":"2024-09-14T05:59:06.308504+0000","last_became_peered":"2024-09-14T05:59:06.308504+0000","last_unstale":"2024-09-14T05:59:45.855622+0000","last_undegraded":"2024-09-14T05:59:45.855622+0000","last_fullsized":"2024-09-14T05:59:45.855622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:05.976186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001798163,"stat_sum":{"num_bytes":5044335,"num_objects":24,"num_object_clones":3,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":10,"num_read":1090,"num_read_kb":1750,"num_write":138,"num_write_kb":2129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"51'96","reported_seq":3490,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.855370+0000","last_change":"2024-09-14T05:59:08.370940+0000","last_active":"2024-09-14T05:59:45.855370+0000","last_peered":"2024-09-14T05:59:45.855370+0000","last_clean":"2024-09-14T05:59:45.855370+0000","last_became_active":"2024-09-14T05:59:06.302019+0000","last_became_peered":"2024-09-14T05:59:06.302019+0000","last_unstale":"2024-09-14T05:59:45.855370+0000","last_undegraded":"2024-09-14T05:59:45.855370+0000","last_fullsized":"2024-09-14T05:59:45.855370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:26.407136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022861499999999998,"stat_sum":{"num_bytes":7530989,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":5,"num_read":3712,"num_read_kb":5003,"num_write":92,"num_write_kb":1455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"52'455","reported_seq":1663,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.233452+0000","last_change":"2024-09-14T05:59:43.767147+0000","last_active":"2024-09-14T05:59:46.233452+0000","last_peered":"2024-09-14T05:59:46.233452+0000","last_clean":"2024-09-14T05:59:46.233452+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T05:59:46.233452+0000","last_undegraded":"2024-09-14T05:59:46.233452+0000","last_fullsized":"2024-09-14T05:59:46.233452+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:39.428221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047002699999999998,"stat_sum":{"num_bytes":3662341,"num_objects":21,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":9,"num_read":3300,"num_read_kb":5224,"num_write":719,"num_write_kb":4179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"52'126","reported_seq":3247,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.044191+0000","last_change":"2024-09-14T05:59:08.369705+0000","last_active":"2024-09-14T05:59:46.044191+0000","last_peered":"2024-09-14T05:59:46.044191+0000","last_clean":"2024-09-14T05:59:46.044191+0000","last_became_active":"2024-09-14T05:59:06.311716+0000","last_became_peered":"2024-09-14T05:59:06.311716+0000","last_unstale":"2024-09-14T05:59:46.044191+0000","last_undegraded":"2024-09-14T05:59:46.044191+0000","last_fullsized":"2024-09-14T05:59:46.044191+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:26:16.766222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001347256,"stat_sum":{"num_bytes":30972980,"num_objects":23,"num_object_clones":3,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":10,"num_read":3088,"num_read_kb":11950,"num_write":148,"num_write_kb":24089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"54'223","reported_seq":1920,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T05:59:48.710701+0000","last_change":"2024-09-14T05:59:43.765786+0000","last_active":"2024-09-14T05:59:48.710701+0000","last_peered":"2024-09-14T05:59:48.710701+0000","last_clean":"2024-09-14T05:59:48.710701+0000","last_became_active":"2024-09-14T05:59:43.763983+0000","last_became_peered":"2024-09-14T05:59:43.763983+0000","last_unstale":"2024-09-14T05:59:48.710701+0000","last_undegraded":"2024-09-14T05:59:48.710701+0000","last_fullsized":"2024-09-14T05:59:48.710701+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:13.740441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8285599,"num_objects":28,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":17,"num_read":2095,"num_read_kb":4319,"num_write":276,"num_write_kb":2330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":767927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"52'100","reported_seq":2872,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.183082+0000","last_change":"2024-09-14T05:59:08.369685+0000","last_active":"2024-09-14T05:59:46.183082+0000","last_peered":"2024-09-14T05:59:46.183082+0000","last_clean":"2024-09-14T05:59:46.183082+0000","last_became_active":"2024-09-14T05:59:06.302125+0000","last_became_peered":"2024-09-14T05:59:06.302125+0000","last_unstale":"2024-09-14T05:59:46.183082+0000","last_undegraded":"2024-09-14T05:59:46.183082+0000","last_fullsized":"2024-09-14T05:59:46.183082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:26.153327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012750369999999999,"stat_sum":{"num_bytes":14239792,"num_objects":23,"num_object_clones":6,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":6,"num_read":2723,"num_read_kb":13767,"num_write":120,"num_write_kb":3565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":418220629,"num_objects":612,"num_object_clones":114,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":612,"num_whiteouts":253,"num_read":53885,"num_read_kb":175094,"num_write":6573,"num_write_kb":150658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":5610454,"num_keys_recovered":69,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":85176320,"data_stored":113503742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5083,"ondisk_log_size":5083,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":5068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":5189632,"data_stored":7390699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495619,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41604,"kb_used_data":13616,"kb_used_omap":4,"kb_used_meta":27963,"kb_avail":94330236,"statfs":{"total":96636764160,"available":96594161664,"internally_reserved":0,"allocated":13942784,"data_stored":20712908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":28634800},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44188,"kb_used_data":13000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327652,"statfs":{"total":96636764160,"available":96591515648,"internally_reserved":0,"allocated":13312000,"data_stored":16175979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33876,"kb_used_data":2684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337964,"statfs":{"total":96636764160,"available":96602075136,"internally_reserved":0,"allocated":2748416,"data_stored":3977238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42360,"kb_used_data":11168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329480,"statfs":{"total":96636764160,"available":96593387520,"internally_reserved":0,"allocated":11436032,"data_stored":11918790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47356,"kb_used_data":12008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94324484,"statfs":{"total":96636764160,"available":96588271616,"internally_reserved":0,"allocated":12296192,"data_stored":12442411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49136,"kb_used_data":13780,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322704,"statfs":{"total":96636764160,"available":96586448896,"internally_reserved":0,"allocated":14110720,"data_stored":16923215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44636,"kb_used_data":9292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327204,"statfs":{"total":96636764160,"available":96591056896,"internally_reserved":0,"allocated":9515008,"data_stored":14677525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12861440,"data_stored":19982955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8921088,"data_stored":14419808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4603904,"data_stored":7139591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13520896,"data_stored":16665517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15933440,"data_stored":20387966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10842112,"data_stored":11661073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2158592,"data_stored":3719540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16334848,"data_stored":19527292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:59:51.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:59:51.268 INFO:teuthology.orchestra.run.smithi006.stdout:2493 write 0x9a288f4 thru 0x9a342a7 (0xb9b4 bytes) 2024-09-14T05:59:51.284 INFO:teuthology.orchestra.run.smithi006.stdout:2495 trunc from 0x9a342a8 to 0x7766461 2024-09-14T05:59:51.284 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:51.285+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:51.297 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:51.302 INFO:teuthology.orchestra.run.smithi006.stdout:2498 trunc from 0x7766461 to 0xa6b49f7 2024-09-14T05:59:51.308 INFO:teuthology.orchestra.run.smithi006.stdout:2499 read 0x882dcb4 thru 0x883a45c (0xc7a9 bytes) 2024-09-14T05:59:51.308 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:51.324 INFO:teuthology.orchestra.run.smithi006.stdout:2503 trunc from 0xa6b49f7 to 0x5be5e2 2024-09-14T05:59:51.350 INFO:teuthology.orchestra.run.smithi006.stdout:2505 write 0x1270438 thru 0x1278012 (0x7bdb bytes) 2024-09-14T05:59:51.357 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:51.353+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:51.376 INFO:teuthology.orchestra.run.smithi006.stdout:2506 write 0x79d571b thru 0x79e2f58 (0xd83e bytes) 2024-09-14T05:59:51.389 INFO:teuthology.orchestra.run.smithi006.stdout:2507 write 0x3c557c8 thru 0x3c61713 (0xbf4c bytes) 2024-09-14T05:59:51.403 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:51.403 INFO:teuthology.orchestra.run.smithi006.stdout:2509 read 0x6cbdb34 thru 0x6cc1618 (0x3ae5 bytes) 2024-09-14T05:59:51.403 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:51.403 INFO:teuthology.orchestra.run.smithi006.stdout:2511 write 0xc9fa48 thru 0xca523c (0x57f5 bytes) 2024-09-14T05:59:51.419 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:51.420 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:51.422 INFO:teuthology.orchestra.run.smithi006.stdout:2512 write 0xe98a7d3 thru 0xe997512 (0xcd40 bytes) 2024-09-14T05:59:51.438 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T05:59:51.438 INFO:teuthology.orchestra.run.smithi006.stdout:2513 write 0xe0ad181 thru 0xe0afd99 (0x2c19 bytes) 2024-09-14T05:59:51.440 INFO:teuthology.orchestra.run.smithi006.stdout:2514 writesame 0x93d25ff thru 0x93d941a data_size 0x57(0x6e1c bytes) 2024-09-14T05:59:51.451 INFO:teuthology.orchestra.run.smithi006.stdout:2516 write 0xa303202 thru 0xa310b09 (0xd908 bytes) 2024-09-14T05:59:51.462 INFO:teuthology.orchestra.run.smithi006.stdout:2517 read 0x548d8b1 thru 0x549add9 (0xd529 bytes) 2024-09-14T05:59:51.462 INFO:teuthology.orchestra.run.smithi006.stdout:2518 clone 17 order 19 su 2048 sc 9 2024-09-14T05:59:51.484 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:51.485+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:51.555 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:51.555 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:51.558 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:51.557+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:51.569 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T05:59:51.607 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T05:59:51.607 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T05:59:51.626 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-14T05:59:51.481020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":418811016,"num_objects":616,"num_object_clones":114,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":616,"num_whiteouts":253,"num_read":53951,"num_read_kb":175149,"num_write":6676,"num_write_kb":152288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":5610454,"num_keys_recovered":69,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5158,"ondisk_log_size":5158,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":339468,"kb_used_data":80616,"kb_used_omap":15,"kb_used_meta":258608,"kb_avail":754635252,"statfs":{"total":773094113280,"available":772746498048,"internally_reserved":0,"allocated":82550784,"data_stored":104218765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":264815388},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5695200,"num_objects":13,"num_object_clones":4,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":5,"num_read":1170,"num_read_kb":10043,"num_write":177,"num_write_kb":5990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000961"},"pg_stats":[{"pgid":"3.1f","version":"53'141","reported_seq":1136,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T05:59:47.815955+0000","last_change":"2024-09-14T05:59:43.763150+0000","last_active":"2024-09-14T05:59:47.815955+0000","last_peered":"2024-09-14T05:59:47.815955+0000","last_clean":"2024-09-14T05:59:47.815955+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T05:59:47.815955+0000","last_undegraded":"2024-09-14T05:59:47.815955+0000","last_fullsized":"2024-09-14T05:59:47.815955+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:21.136889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001224482,"stat_sum":{"num_bytes":31200042,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":9,"num_read":1583,"num_read_kb":10219,"num_write":139,"num_write_kb":1925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"51'247","reported_seq":407,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.799459+0000","last_change":"2024-09-14T05:59:08.299658+0000","last_active":"2024-09-14T05:59:45.799459+0000","last_peered":"2024-09-14T05:59:45.799459+0000","last_clean":"2024-09-14T05:59:45.799459+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T05:59:45.799459+0000","last_undegraded":"2024-09-14T05:59:45.799459+0000","last_fullsized":"2024-09-14T05:59:45.799459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:18.826471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882171,"stat_sum":{"num_bytes":1922653,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":1062,"num_read_kb":974,"num_write":395,"num_write_kb":3340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"52'79","reported_seq":3276,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.156083+0000","last_change":"2024-09-14T05:59:08.293155+0000","last_active":"2024-09-14T05:59:46.156083+0000","last_peered":"2024-09-14T05:59:46.156083+0000","last_clean":"2024-09-14T05:59:46.156083+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T05:59:46.156083+0000","last_undegraded":"2024-09-14T05:59:46.156083+0000","last_fullsized":"2024-09-14T05:59:46.156083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:49.750350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000618802,"stat_sum":{"num_bytes":10139706,"num_objects":13,"num_object_clones":2,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":4,"num_read":3168,"num_read_kb":11542,"num_write":107,"num_write_kb":18834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"52'85","reported_seq":1622,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.001179+0000","last_change":"2024-09-14T05:59:08.294498+0000","last_active":"2024-09-14T05:59:46.001179+0000","last_peered":"2024-09-14T05:59:46.001179+0000","last_clean":"2024-09-14T05:59:46.001179+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T05:59:46.001179+0000","last_undegraded":"2024-09-14T05:59:46.001179+0000","last_fullsized":"2024-09-14T05:59:46.001179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:29.933017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014905350000000001,"stat_sum":{"num_bytes":2976523,"num_objects":17,"num_object_clones":1,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":8,"num_read":1504,"num_read_kb":2865,"num_write":78,"num_write_kb":2016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"54'160","reported_seq":419,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T05:59:48.761877+0000","last_change":"2024-09-14T05:59:40.834308+0000","last_active":"2024-09-14T05:59:48.761877+0000","last_peered":"2024-09-14T05:59:48.761877+0000","last_clean":"2024-09-14T05:59:48.761877+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T05:59:48.761877+0000","last_undegraded":"2024-09-14T05:59:48.761877+0000","last_fullsized":"2024-09-14T05:59:48.761877+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:24.791672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2064433,"num_objects":23,"num_object_clones":6,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":12,"num_read":759,"num_read_kb":1943,"num_write":148,"num_write_kb":2171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"52'181","reported_seq":1243,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.186068+0000","last_change":"2024-09-14T05:59:08.282710+0000","last_active":"2024-09-14T05:59:46.186068+0000","last_peered":"2024-09-14T05:59:46.186068+0000","last_clean":"2024-09-14T05:59:46.186068+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T05:59:46.186068+0000","last_undegraded":"2024-09-14T05:59:46.186068+0000","last_fullsized":"2024-09-14T05:59:46.186068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:19.733635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078735700000000003,"stat_sum":{"num_bytes":3174477,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":5,"num_read":1827,"num_read_kb":3114,"num_write":222,"num_write_kb":3633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"51'104","reported_seq":358,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.794386+0000","last_change":"2024-09-14T05:59:08.283122+0000","last_active":"2024-09-14T05:59:45.794386+0000","last_peered":"2024-09-14T05:59:45.794386+0000","last_clean":"2024-09-14T05:59:45.794386+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T05:59:45.794386+0000","last_undegraded":"2024-09-14T05:59:45.794386+0000","last_fullsized":"2024-09-14T05:59:45.794386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:27.924971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020244989999999999,"stat_sum":{"num_bytes":18182764,"num_objects":14,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":7,"num_read":204,"num_read_kb":2389,"num_write":108,"num_write_kb":3416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"51'227","reported_seq":2588,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.024869+0000","last_change":"2024-09-14T05:59:43.761389+0000","last_active":"2024-09-14T05:59:46.024869+0000","last_peered":"2024-09-14T05:59:46.024869+0000","last_clean":"2024-09-14T05:59:46.024869+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T05:59:46.024869+0000","last_undegraded":"2024-09-14T05:59:46.024869+0000","last_fullsized":"2024-09-14T05:59:46.024869+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:51.529862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090099400000000001,"stat_sum":{"num_bytes":38158038,"num_objects":28,"num_object_clones":6,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":12,"num_read":3742,"num_read_kb":20740,"num_write":217,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"54'87","reported_seq":189,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T05:59:48.639660+0000","last_change":"2024-09-14T05:59:40.929839+0000","last_active":"2024-09-14T05:59:48.639660+0000","last_peered":"2024-09-14T05:59:48.639660+0000","last_clean":"2024-09-14T05:59:48.639660+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T05:59:48.639660+0000","last_undegraded":"2024-09-14T05:59:48.639660+0000","last_fullsized":"2024-09-14T05:59:48.639660+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:11.228013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3899892,"num_objects":16,"num_object_clones":4,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":5,"num_read":586,"num_read_kb":1706,"num_write":80,"num_write_kb":1171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"51'97","reported_seq":393,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.791805+0000","last_change":"2024-09-14T05:59:08.293088+0000","last_active":"2024-09-14T05:59:45.791805+0000","last_peered":"2024-09-14T05:59:45.791805+0000","last_clean":"2024-09-14T05:59:45.791805+0000","last_became_active":"2024-09-14T05:59:06.296607+0000","last_became_peered":"2024-09-14T05:59:06.296607+0000","last_unstale":"2024-09-14T05:59:45.791805+0000","last_undegraded":"2024-09-14T05:59:45.791805+0000","last_fullsized":"2024-09-14T05:59:45.791805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:52:23.473672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056627299999999995,"stat_sum":{"num_bytes":20733952,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":3,"num_read":246,"num_read_kb":2549,"num_write":114,"num_write_kb":8106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"52'202","reported_seq":576,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.186764+0000","last_change":"2024-09-14T05:59:08.370304+0000","last_active":"2024-09-14T05:59:46.186764+0000","last_peered":"2024-09-14T05:59:46.186764+0000","last_clean":"2024-09-14T05:59:46.186764+0000","last_became_active":"2024-09-14T05:59:06.295335+0000","last_became_peered":"2024-09-14T05:59:06.295335+0000","last_unstale":"2024-09-14T05:59:46.186764+0000","last_undegraded":"2024-09-14T05:59:46.186764+0000","last_fullsized":"2024-09-14T05:59:46.186764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:10.852265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001779487,"stat_sum":{"num_bytes":29202710,"num_objects":30,"num_object_clones":7,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":14,"num_read":849,"num_read_kb":3267,"num_write":312,"num_write_kb":4654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"51'85","reported_seq":2393,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.790258+0000","last_change":"2024-09-14T05:59:08.282513+0000","last_active":"2024-09-14T05:59:45.790258+0000","last_peered":"2024-09-14T05:59:45.790258+0000","last_clean":"2024-09-14T05:59:45.790258+0000","last_became_active":"2024-09-14T05:59:06.307548+0000","last_became_peered":"2024-09-14T05:59:06.307548+0000","last_unstale":"2024-09-14T05:59:45.790258+0000","last_undegraded":"2024-09-14T05:59:45.790258+0000","last_fullsized":"2024-09-14T05:59:45.790258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:06.861860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061538200000000004,"stat_sum":{"num_bytes":4600172,"num_objects":19,"num_object_clones":4,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":8,"num_read":2454,"num_read_kb":4122,"num_write":112,"num_write_kb":1701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.836022+0000","last_change":"2024-09-14T05:58:56.312544+0000","last_active":"2024-09-14T05:59:45.836022+0000","last_peered":"2024-09-14T05:59:45.836022+0000","last_clean":"2024-09-14T05:59:45.836022+0000","last_became_active":"2024-09-14T05:58:54.103612+0000","last_became_peered":"2024-09-14T05:58:54.103612+0000","last_unstale":"2024-09-14T05:59:45.836022+0000","last_undegraded":"2024-09-14T05:59:45.836022+0000","last_fullsized":"2024-09-14T05:59:45.836022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:08.678742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"53'238","reported_seq":1912,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T05:59:48.237006+0000","last_change":"2024-09-14T05:59:43.762927+0000","last_active":"2024-09-14T05:59:48.237006+0000","last_peered":"2024-09-14T05:59:48.237006+0000","last_clean":"2024-09-14T05:59:48.237006+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T05:59:48.237006+0000","last_undegraded":"2024-09-14T05:59:48.237006+0000","last_fullsized":"2024-09-14T05:59:48.237006+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:29.584493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11667866,"num_objects":25,"num_object_clones":5,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":10,"num_read":2379,"num_read_kb":8066,"num_write":338,"num_write_kb":3564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.794389+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T05:59:45.794389+0000","last_peered":"2024-09-14T05:59:45.794389+0000","last_clean":"2024-09-14T05:59:45.794389+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T05:59:45.794389+0000","last_undegraded":"2024-09-14T05:59:45.794389+0000","last_fullsized":"2024-09-14T05:59:45.794389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"52'138","reported_seq":2114,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.183193+0000","last_change":"2024-09-14T05:59:08.299312+0000","last_active":"2024-09-14T05:59:46.183193+0000","last_peered":"2024-09-14T05:59:46.183193+0000","last_clean":"2024-09-14T05:59:46.183193+0000","last_became_active":"2024-09-14T05:59:06.302779+0000","last_became_peered":"2024-09-14T05:59:06.302779+0000","last_unstale":"2024-09-14T05:59:46.183193+0000","last_undegraded":"2024-09-14T05:59:46.183193+0000","last_fullsized":"2024-09-14T05:59:46.183193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:51:22.554923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001533155,"stat_sum":{"num_bytes":42012006,"num_objects":24,"num_object_clones":3,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":10,"num_read":1936,"num_read_kb":10402,"num_write":162,"num_write_kb":10794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":89,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.855251+0000","last_change":"2024-09-14T05:59:40.765463+0000","last_active":"2024-09-14T05:59:45.855251+0000","last_peered":"2024-09-14T05:59:45.855251+0000","last_clean":"2024-09-14T05:59:45.855251+0000","last_became_active":"2024-09-14T05:59:40.764785+0000","last_became_peered":"2024-09-14T05:59:40.764785+0000","last_unstale":"2024-09-14T05:59:45.855251+0000","last_undegraded":"2024-09-14T05:59:45.855251+0000","last_fullsized":"2024-09-14T05:59:45.855251+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:47.547246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"51'112","reported_seq":1242,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.794586+0000","last_change":"2024-09-14T05:59:08.282105+0000","last_active":"2024-09-14T05:59:45.794586+0000","last_peered":"2024-09-14T05:59:45.794586+0000","last_clean":"2024-09-14T05:59:45.794586+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T05:59:45.794586+0000","last_undegraded":"2024-09-14T05:59:45.794586+0000","last_fullsized":"2024-09-14T05:59:45.794586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:04.044967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010945919999999999,"stat_sum":{"num_bytes":1417352,"num_objects":13,"num_object_clones":1,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":9,"num_read":1308,"num_read_kb":2061,"num_write":162,"num_write_kb":1709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":89,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.794319+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T05:59:45.794319+0000","last_peered":"2024-09-14T05:59:45.794319+0000","last_clean":"2024-09-14T05:59:45.794319+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T05:59:45.794319+0000","last_undegraded":"2024-09-14T05:59:45.794319+0000","last_fullsized":"2024-09-14T05:59:45.794319+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"51'184","reported_seq":2527,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.791831+0000","last_change":"2024-09-14T05:59:08.293368+0000","last_active":"2024-09-14T05:59:45.791831+0000","last_peered":"2024-09-14T05:59:45.791831+0000","last_clean":"2024-09-14T05:59:45.791831+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T05:59:45.791831+0000","last_undegraded":"2024-09-14T05:59:45.791831+0000","last_fullsized":"2024-09-14T05:59:45.791831+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:35.057614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072033799999999995,"stat_sum":{"num_bytes":7946280,"num_objects":23,"num_object_clones":5,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":9,"num_read":3677,"num_read_kb":10532,"num_write":170,"num_write_kb":1621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"52'108","reported_seq":863,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.186916+0000","last_change":"2024-09-14T05:59:40.846399+0000","last_active":"2024-09-14T05:59:46.186916+0000","last_peered":"2024-09-14T05:59:46.186916+0000","last_clean":"2024-09-14T05:59:46.186916+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T05:59:46.186916+0000","last_undegraded":"2024-09-14T05:59:46.186916+0000","last_fullsized":"2024-09-14T05:59:46.186916+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:31.252055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047912600000000002,"stat_sum":{"num_bytes":29889576,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":6,"num_read":653,"num_read_kb":7890,"num_write":108,"num_write_kb":3257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":82,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.791412+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T05:59:45.791412+0000","last_peered":"2024-09-14T05:59:45.791412+0000","last_clean":"2024-09-14T05:59:45.791412+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T05:59:45.791412+0000","last_undegraded":"2024-09-14T05:59:45.791412+0000","last_fullsized":"2024-09-14T05:59:45.791412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"52'520","reported_seq":860,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.186843+0000","last_change":"2024-09-14T05:59:08.281926+0000","last_active":"2024-09-14T05:59:46.186843+0000","last_peered":"2024-09-14T05:59:46.186843+0000","last_clean":"2024-09-14T05:59:46.186843+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T05:59:46.186843+0000","last_undegraded":"2024-09-14T05:59:46.186843+0000","last_fullsized":"2024-09-14T05:59:46.186843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:02.993620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096925799999999997,"stat_sum":{"num_bytes":6530882,"num_objects":20,"num_object_clones":3,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":7,"num_read":2747,"num_read_kb":5422,"num_write":902,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-14T05:59:47.141140+0000","last_change":"2024-09-14T05:58:56.096637+0000","last_active":"2024-09-14T05:59:47.141140+0000","last_peered":"2024-09-14T05:59:47.141140+0000","last_clean":"2024-09-14T05:59:47.141140+0000","last_became_active":"2024-09-14T05:58:54.356560+0000","last_became_peered":"2024-09-14T05:58:54.356560+0000","last_unstale":"2024-09-14T05:59:47.141140+0000","last_undegraded":"2024-09-14T05:59:47.141140+0000","last_fullsized":"2024-09-14T05:59:47.141140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:10.136136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012156140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"54'124","reported_seq":268,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T05:59:48.625440+0000","last_change":"2024-09-14T05:59:40.894081+0000","last_active":"2024-09-14T05:59:48.625440+0000","last_peered":"2024-09-14T05:59:48.625440+0000","last_clean":"2024-09-14T05:59:48.625440+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T05:59:48.625440+0000","last_undegraded":"2024-09-14T05:59:48.625440+0000","last_fullsized":"2024-09-14T05:59:48.625440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:11.874120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5805554,"num_objects":22,"num_object_clones":5,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":11,"num_read":324,"num_read_kb":5781,"num_write":138,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.854779+0000","last_change":"2024-09-14T05:58:56.593338+0000","last_active":"2024-09-14T05:59:45.854779+0000","last_peered":"2024-09-14T05:59:45.854779+0000","last_clean":"2024-09-14T05:59:45.854779+0000","last_became_active":"2024-09-14T05:58:54.099699+0000","last_became_peered":"2024-09-14T05:58:54.099699+0000","last_unstale":"2024-09-14T05:59:45.854779+0000","last_undegraded":"2024-09-14T05:59:45.854779+0000","last_fullsized":"2024-09-14T05:59:45.854779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:40.481832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"51'58","reported_seq":701,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.799317+0000","last_change":"2024-09-14T05:59:08.298483+0000","last_active":"2024-09-14T05:59:45.799317+0000","last_peered":"2024-09-14T05:59:45.799317+0000","last_clean":"2024-09-14T05:59:45.799317+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T05:59:45.799317+0000","last_undegraded":"2024-09-14T05:59:45.799317+0000","last_fullsized":"2024-09-14T05:59:45.799317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:43.658765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011244670000000001,"stat_sum":{"num_bytes":6781080,"num_objects":15,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":5,"num_read":630,"num_read_kb":7206,"num_write":90,"num_write_kb":2462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":81,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.791443+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T05:59:45.791443+0000","last_peered":"2024-09-14T05:59:45.791443+0000","last_clean":"2024-09-14T05:59:45.791443+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T05:59:45.791443+0000","last_undegraded":"2024-09-14T05:59:45.791443+0000","last_fullsized":"2024-09-14T05:59:45.791443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":180,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.854789+0000","last_change":"2024-09-14T05:59:40.766729+0000","last_active":"2024-09-14T05:59:45.854789+0000","last_peered":"2024-09-14T05:59:45.854789+0000","last_clean":"2024-09-14T05:59:45.854789+0000","last_became_active":"2024-09-14T05:59:40.765914+0000","last_became_peered":"2024-09-14T05:59:40.765914+0000","last_unstale":"2024-09-14T05:59:45.854789+0000","last_undegraded":"2024-09-14T05:59:45.854789+0000","last_fullsized":"2024-09-14T05:59:45.854789+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:02.407639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"52'324","reported_seq":594,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.179586+0000","last_change":"2024-09-14T05:59:08.298535+0000","last_active":"2024-09-14T05:59:46.179586+0000","last_peered":"2024-09-14T05:59:46.179586+0000","last_clean":"2024-09-14T05:59:46.179586+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T05:59:46.179586+0000","last_undegraded":"2024-09-14T05:59:46.179586+0000","last_fullsized":"2024-09-14T05:59:46.179586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:43.648310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085964400000000001,"stat_sum":{"num_bytes":15879803,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":3,"num_read":1464,"num_read_kb":2495,"num_write":494,"num_write_kb":974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"51'99","reported_seq":1206,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.789909+0000","last_change":"2024-09-14T05:59:08.282238+0000","last_active":"2024-09-14T05:59:45.789909+0000","last_peered":"2024-09-14T05:59:45.789909+0000","last_clean":"2024-09-14T05:59:45.789909+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T05:59:45.789909+0000","last_undegraded":"2024-09-14T05:59:45.789909+0000","last_fullsized":"2024-09-14T05:59:45.789909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:49.239550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052576800000000003,"stat_sum":{"num_bytes":21329018,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":5,"num_read":1044,"num_read_kb":1865,"num_write":113,"num_write_kb":16982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"52'86","reported_seq":261,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.962381+0000","last_change":"2024-09-14T05:59:08.303592+0000","last_active":"2024-09-14T05:59:45.962381+0000","last_peered":"2024-09-14T05:59:45.962381+0000","last_clean":"2024-09-14T05:59:45.962381+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T05:59:45.962381+0000","last_undegraded":"2024-09-14T05:59:45.962381+0000","last_fullsized":"2024-09-14T05:59:45.962381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:08.231443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035228000000000001,"stat_sum":{"num_bytes":1076879,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":8,"num_read":137,"num_read_kb":701,"num_write":79,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"52'65","reported_seq":364,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.854167+0000","last_change":"2024-09-14T05:59:40.885530+0000","last_active":"2024-09-14T05:59:45.854167+0000","last_peered":"2024-09-14T05:59:45.854167+0000","last_clean":"2024-09-14T05:59:45.854167+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T05:59:45.854167+0000","last_undegraded":"2024-09-14T05:59:45.854167+0000","last_fullsized":"2024-09-14T05:59:45.854167+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:03.072888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083256200000000002,"stat_sum":{"num_bytes":800845,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":462,"num_read_kb":762,"num_write":78,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"52'89","reported_seq":1836,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.793118+0000","last_change":"2024-09-14T05:59:08.294210+0000","last_active":"2024-09-14T05:59:45.793118+0000","last_peered":"2024-09-14T05:59:45.793118+0000","last_clean":"2024-09-14T05:59:45.793118+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T05:59:45.793118+0000","last_undegraded":"2024-09-14T05:59:45.793118+0000","last_fullsized":"2024-09-14T05:59:45.793118+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:01.883060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013095159999999999,"stat_sum":{"num_bytes":23616339,"num_objects":16,"num_object_clones":1,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":10,"num_read":1689,"num_read_kb":2567,"num_write":84,"num_write_kb":4748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"51'119","reported_seq":786,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.855146+0000","last_change":"2024-09-14T05:59:08.371003+0000","last_active":"2024-09-14T05:59:45.855146+0000","last_peered":"2024-09-14T05:59:45.855146+0000","last_clean":"2024-09-14T05:59:45.855146+0000","last_became_active":"2024-09-14T05:59:06.300360+0000","last_became_peered":"2024-09-14T05:59:06.300360+0000","last_unstale":"2024-09-14T05:59:45.855146+0000","last_undegraded":"2024-09-14T05:59:45.855146+0000","last_fullsized":"2024-09-14T05:59:45.855146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:35.490569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022610920000000001,"stat_sum":{"num_bytes":7475751,"num_objects":18,"num_object_clones":5,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":9,"num_read":1443,"num_read_kb":1901,"num_write":130,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"51'124","reported_seq":700,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.855622+0000","last_change":"2024-09-14T05:59:08.370421+0000","last_active":"2024-09-14T05:59:45.855622+0000","last_peered":"2024-09-14T05:59:45.855622+0000","last_clean":"2024-09-14T05:59:45.855622+0000","last_became_active":"2024-09-14T05:59:06.308504+0000","last_became_peered":"2024-09-14T05:59:06.308504+0000","last_unstale":"2024-09-14T05:59:45.855622+0000","last_undegraded":"2024-09-14T05:59:45.855622+0000","last_fullsized":"2024-09-14T05:59:45.855622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:05.976186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001798163,"stat_sum":{"num_bytes":5044335,"num_objects":24,"num_object_clones":3,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":10,"num_read":1090,"num_read_kb":1750,"num_write":138,"num_write_kb":2129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"51'96","reported_seq":3490,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:45.855370+0000","last_change":"2024-09-14T05:59:08.370940+0000","last_active":"2024-09-14T05:59:45.855370+0000","last_peered":"2024-09-14T05:59:45.855370+0000","last_clean":"2024-09-14T05:59:45.855370+0000","last_became_active":"2024-09-14T05:59:06.302019+0000","last_became_peered":"2024-09-14T05:59:06.302019+0000","last_unstale":"2024-09-14T05:59:45.855370+0000","last_undegraded":"2024-09-14T05:59:45.855370+0000","last_fullsized":"2024-09-14T05:59:45.855370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:26.407136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022861499999999998,"stat_sum":{"num_bytes":7530989,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":5,"num_read":3712,"num_read_kb":5003,"num_write":92,"num_write_kb":1455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"52'455","reported_seq":1663,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.233452+0000","last_change":"2024-09-14T05:59:43.767147+0000","last_active":"2024-09-14T05:59:46.233452+0000","last_peered":"2024-09-14T05:59:46.233452+0000","last_clean":"2024-09-14T05:59:46.233452+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T05:59:46.233452+0000","last_undegraded":"2024-09-14T05:59:46.233452+0000","last_fullsized":"2024-09-14T05:59:46.233452+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:39.428221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047002699999999998,"stat_sum":{"num_bytes":3662341,"num_objects":21,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":9,"num_read":3300,"num_read_kb":5224,"num_write":719,"num_write_kb":4179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"52'126","reported_seq":3247,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.044191+0000","last_change":"2024-09-14T05:59:08.369705+0000","last_active":"2024-09-14T05:59:46.044191+0000","last_peered":"2024-09-14T05:59:46.044191+0000","last_clean":"2024-09-14T05:59:46.044191+0000","last_became_active":"2024-09-14T05:59:06.311716+0000","last_became_peered":"2024-09-14T05:59:06.311716+0000","last_unstale":"2024-09-14T05:59:46.044191+0000","last_undegraded":"2024-09-14T05:59:46.044191+0000","last_fullsized":"2024-09-14T05:59:46.044191+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:26:16.766222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001347256,"stat_sum":{"num_bytes":30972980,"num_objects":23,"num_object_clones":3,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":10,"num_read":3088,"num_read_kb":11950,"num_write":148,"num_write_kb":24089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"54'223","reported_seq":1920,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-14T05:59:48.710701+0000","last_change":"2024-09-14T05:59:43.765786+0000","last_active":"2024-09-14T05:59:48.710701+0000","last_peered":"2024-09-14T05:59:48.710701+0000","last_clean":"2024-09-14T05:59:48.710701+0000","last_became_active":"2024-09-14T05:59:43.763983+0000","last_became_peered":"2024-09-14T05:59:43.763983+0000","last_unstale":"2024-09-14T05:59:48.710701+0000","last_undegraded":"2024-09-14T05:59:48.710701+0000","last_fullsized":"2024-09-14T05:59:48.710701+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:13.740441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8285599,"num_objects":28,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":17,"num_read":2095,"num_read_kb":4319,"num_write":276,"num_write_kb":2330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":767927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"52'100","reported_seq":2872,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-14T05:59:46.183082+0000","last_change":"2024-09-14T05:59:08.369685+0000","last_active":"2024-09-14T05:59:46.183082+0000","last_peered":"2024-09-14T05:59:46.183082+0000","last_clean":"2024-09-14T05:59:46.183082+0000","last_became_active":"2024-09-14T05:59:06.302125+0000","last_became_peered":"2024-09-14T05:59:06.302125+0000","last_unstale":"2024-09-14T05:59:46.183082+0000","last_undegraded":"2024-09-14T05:59:46.183082+0000","last_fullsized":"2024-09-14T05:59:46.183082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:26.153327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012750369999999999,"stat_sum":{"num_bytes":14239792,"num_objects":23,"num_object_clones":6,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":6,"num_read":2723,"num_read_kb":13767,"num_write":120,"num_write_kb":3565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":418220629,"num_objects":612,"num_object_clones":114,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":612,"num_whiteouts":253,"num_read":53885,"num_read_kb":175094,"num_write":6573,"num_write_kb":150658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":5610454,"num_keys_recovered":69,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":85176320,"data_stored":113503742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5083,"ondisk_log_size":5083,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":5068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":5189632,"data_stored":7390699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495619,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41604,"kb_used_data":13616,"kb_used_omap":4,"kb_used_meta":27963,"kb_avail":94330236,"statfs":{"total":96636764160,"available":96594161664,"internally_reserved":0,"allocated":13942784,"data_stored":20712908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":28634800},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44188,"kb_used_data":13000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327652,"statfs":{"total":96636764160,"available":96591515648,"internally_reserved":0,"allocated":13312000,"data_stored":16175979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33876,"kb_used_data":2684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337964,"statfs":{"total":96636764160,"available":96602075136,"internally_reserved":0,"allocated":2748416,"data_stored":3977238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42360,"kb_used_data":11168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329480,"statfs":{"total":96636764160,"available":96593387520,"internally_reserved":0,"allocated":11436032,"data_stored":11918790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47356,"kb_used_data":12008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94324484,"statfs":{"total":96636764160,"available":96588271616,"internally_reserved":0,"allocated":12296192,"data_stored":12442411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49136,"kb_used_data":13780,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322704,"statfs":{"total":96636764160,"available":96586448896,"internally_reserved":0,"allocated":14110720,"data_stored":16923215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44636,"kb_used_data":9292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327204,"statfs":{"total":96636764160,"available":96591056896,"internally_reserved":0,"allocated":9515008,"data_stored":14677525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12861440,"data_stored":19982955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8921088,"data_stored":14419808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4603904,"data_stored":7139591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13520896,"data_stored":16665517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15933440,"data_stored":20387966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10842112,"data_stored":11661073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2158592,"data_stored":3719540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16334848,"data_stored":19527292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:59:51.628 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T05:59:51.629 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:59:51.629 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-14T05:59:51.629 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T05:59:51.629 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T05:59:51.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-14T05:59:51.704 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:51.705+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:51.737 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:51.737 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:51.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T05:59:51.760 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:51.757+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:51.784 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:51.784 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T05:59:51.784 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:51.861 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:51.861+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:51.917 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:51.917 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:51.931 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T05:59:51.962 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:51.961+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:52.063 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:52.061+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:52.084 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone16 from 0xe997513 (overlap 0x5be5e2) to 0x1b91c3 2024-09-14T05:59:52.105 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:52.105 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:52.124 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T05:59:52.164 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:52.161+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:52.248 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:52.248 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:52.263 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:59:52.264 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:52.261+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:52.316 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-14T05:59:52.347 INFO:teuthology.orchestra.run.smithi006.stdout:2519 trunc from 0xe997513 to 0x6a10e0 2024-09-14T05:59:52.365 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:52.361+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:52.434 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:52.434 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:52.456 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:59:52.499 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:52.497+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:52.552 INFO:teuthology.orchestra.run.smithi006.stdout:2520 write 0x218ea7e thru 0x219ce96 (0xe419 bytes) 2024-09-14T05:59:52.566 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:52.561+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:52.569 INFO:teuthology.orchestra.run.smithi006.stdout:2523 read 0x1407d11 thru 0x1413591 (0xb881 bytes) 2024-09-14T05:59:52.569 INFO:teuthology.orchestra.run.smithi006.stdout:2524 punch from 0x1f3bbe1 to 0x1f4260e, (0x6a2d bytes) 2024-09-14T05:59:52.569 INFO:teuthology.orchestra.run.smithi006.stdout:2525 read 0x1e07a21 thru 0x1e0c66b (0x4c4b bytes) 2024-09-14T05:59:52.569 INFO:teuthology.orchestra.run.smithi006.stdout:2526 punch from 0x1ef2d24 to 0x1f01168, (0xe444 bytes) 2024-09-14T05:59:52.586 INFO:teuthology.orchestra.run.smithi006.stdout:2528 trunc from 0x219ce97 to 0xeaf4fe8 2024-09-14T05:59:52.593 INFO:teuthology.orchestra.run.smithi006.stdout:2532 punch from 0x645c279 to 0x646488f, (0x8616 bytes) 2024-09-14T05:59:52.593 INFO:teuthology.orchestra.run.smithi006.stdout:2535 writesame 0x85984a0 thru 0x85a6d7f data_size 0xb8(0xe8e0 bytes) 2024-09-14T05:59:52.624 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:52.624 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:52.636 INFO:teuthology.orchestra.run.smithi006.stdout:2536 trunc from 0xeaf4fe8 to 0x12b6864 2024-09-14T05:59:52.646 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:59:52.663 INFO:teuthology.orchestra.run.smithi006.stdout:2538 read 0x40b02e thru 0x4196a8 (0xe67b bytes) 2024-09-14T05:59:52.667 INFO:teuthology.orchestra.run.smithi006.stdout:2539 read 0x92fc96 thru 0x93b596 (0xb901 bytes) 2024-09-14T05:59:52.668 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:52.665+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:52.681 INFO:teuthology.orchestra.run.smithi006.stdout:2540 write 0x2165b33 thru 0x2165d61 (0x22f bytes) 2024-09-14T05:59:52.686 INFO:teuthology.orchestra.run.smithi006.stdout:2541 read 0x10518ad thru 0x105bc68 (0xa3bc bytes) 2024-09-14T05:59:52.686 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:52.686 INFO:teuthology.orchestra.run.smithi006.stdout:2543 write 0x1e7192e thru 0x1e7b844 (0x9f17 bytes) 2024-09-14T05:59:52.743 INFO:teuthology.orchestra.run.smithi006.stdout:2544 write 0xce37bae thru 0xce3c5a7 (0x49fa bytes) 2024-09-14T05:59:52.768 INFO:teuthology.orchestra.run.smithi006.stdout:2545 writesame 0x9c5df7f thru 0x9c6aa7f data_size 0x11(0xcb01 bytes) 2024-09-14T05:59:52.768 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:52.768+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:52.790 INFO:teuthology.orchestra.run.smithi006.stdout:2548 read 0x69180da thru 0x691ebea (0x6b11 bytes) 2024-09-14T05:59:52.791 INFO:teuthology.orchestra.run.smithi006.stdout:2549 punch from 0x49d01f7 to 0x49dc5d1, (0xc3da bytes) 2024-09-14T05:59:52.791 INFO:teuthology.orchestra.run.smithi006.stdout:2550 trunc from 0xce3c5a8 to 0xcbc04cd 2024-09-14T05:59:52.800 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:52.800 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:52.805 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:52.805 INFO:teuthology.orchestra.run.smithi006.stdout:2553 write 0x7747049 thru 0x774770a (0x6c2 bytes) 2024-09-14T05:59:52.811 INFO:teuthology.orchestra.run.smithi006.stdout:2555 punch from 0x3005a25 to 0x300a35d, (0x4938 bytes) 2024-09-14T05:59:52.811 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:52.811 INFO:teuthology.orchestra.run.smithi006.stdout:2557 read 0xaec667 thru 0xaecfef (0x989 bytes) 2024-09-14T05:59:52.811 INFO:teuthology.orchestra.run.smithi006.stdout:2558 read 0x52fe039 thru 0x530a2fb (0xc2c3 bytes) 2024-09-14T05:59:52.811 INFO:teuthology.orchestra.run.smithi006.stdout:2560 read 0xa290641 thru 0xa29c9a9 (0xc369 bytes) 2024-09-14T05:59:52.811 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:52.812 INFO:teuthology.orchestra.run.smithi006.stdout:2562 writesame 0x3088ed4 thru 0x3095b0a data_size 0x1(0xcc37 bytes) 2024-09-14T05:59:52.816 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:59:52.841 INFO:teuthology.orchestra.run.smithi006.stdout:2564 read 0x49bde03 thru 0x49bdf29 (0x127 bytes) 2024-09-14T05:59:52.841 INFO:teuthology.orchestra.run.smithi006.stdout:2565 punch from 0x14c1896 to 0x14c33bc, (0x1b26 bytes) 2024-09-14T05:59:52.841 INFO:teuthology.orchestra.run.smithi006.stdout:2567 write 0xc3ada42 thru 0xc3b7e67 (0xa426 bytes) 2024-09-14T05:59:52.858 INFO:teuthology.orchestra.run.smithi006.stdout:2569 read 0x65fe42c thru 0x6608c76 (0xa84b bytes) 2024-09-14T05:59:52.858 INFO:teuthology.orchestra.run.smithi006.stdout:2570 clone 18 order 19 su 16384 sc 9 2024-09-14T05:59:52.869 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:52.865+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:52.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:59:52.967 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:52.968 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:52.970 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:52.968+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:52.983 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:59:53.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:59:53.075 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:53.073+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:53.102 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:53.102 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:53.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:59:53.169 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T05:59:53.170 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:59:53.172 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:53.172+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:53.186 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:53.187 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:53.204 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:53.204 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:53.221 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:53.221 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:53.242 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:53.242 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:53.263 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:53.263 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:53.273 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:53.269+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:53.277 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:53.277 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:53.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:53.277 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:53.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.278 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21567 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 993280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.278 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:53.278 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.357261570999999, 2024-09-14T05:59:53.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031237369000000001, 2024-09-14T05:59:53.278 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.278 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.278 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.278 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.278 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.278 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.278 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21567 2024-09-14T05:59:53.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918111+0000", 2024-09-14T05:59:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918112+0000", 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6000000000000004e-07 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918113+0000", 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918118+0000", 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4789999999999998e-06 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.280 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918122+0000", 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7740000000000002e-06 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949196+0000", 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031074101 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949239+0000", 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3724999999999999e-05 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949349+0000", 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010916699999999999 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21570 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1001472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.357228857999999, 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031375860999999998, 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.282 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.283 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.283 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21570 2024-09-14T05:59:53.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.283 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.283 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.283 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:53.283 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.284 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.284 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:53.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.284 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.284 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918144+0000", 2024-09-14T05:59:53.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0499999999999999e-07 2024-09-14T05:59:53.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.284 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.284 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918146+0000", 2024-09-14T05:59:53.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1179999999999999e-06 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918153+0000", 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0299999999999999e-06 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918157+0000", 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0589999999999996e-06 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949386+0000", 2024-09-14T05:59:53.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031229455999999999 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949448+0000", 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2291000000000004e-05 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949520+0000", 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1501999999999994e-05 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.286 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21574 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1024000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.357210117000001, 2024-09-14T05:59:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031511174000000003, 2024-09-14T05:59:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21574 2024-09-14T05:59:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918163+0000", 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8500000000000002e-07 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.288 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918165+0000", 2024-09-14T05:59:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.674e-06 2024-09-14T05:59:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918169+0000", 2024-09-14T05:59:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5709999999999999e-06 2024-09-14T05:59:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918175+0000", 2024-09-14T05:59:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:59:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949555+0000", 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031380230000000002 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949606+0000", 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0300000000000003e-05 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949674+0000", 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8175000000000004e-05 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.290 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21576 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1032192~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.357186810000002, 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031677479000000001, 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21576 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.291 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918186+0000", 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918187+0000", 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7100000000000001e-07 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.293 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.293 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918189+0000", 2024-09-14T05:59:53.293 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.43e-06 2024-09-14T05:59:53.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.293 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.293 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918198+0000", 2024-09-14T05:59:53.293 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1859999999999998e-06 2024-09-14T05:59:53.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.293 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.293 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918206+0000", 2024-09-14T05:59:53.293 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4939999999999997e-06 2024-09-14T05:59:53.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949716+0000", 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031510428 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949789+0000", 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3233999999999997e-05 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949863+0000", 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4035999999999994e-05 2024-09-14T05:59:53.294 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.295 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.295 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.295 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21577 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1046528~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.295 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:53.295 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.357155977000001, 2024-09-14T05:59:53.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031830166999999999, 2024-09-14T05:59:53.295 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.295 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.295 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.295 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.295 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.295 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.296 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21577 2024-09-14T05:59:53.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.296 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.296 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.296 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:53.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.296 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.296 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:53.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.297 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918217+0000", 2024-09-14T05:59:53.297 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3499999999999996e-07 2024-09-14T05:59:53.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.297 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918221+0000", 2024-09-14T05:59:53.297 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3179999999999998e-06 2024-09-14T05:59:53.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.297 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918230+0000", 2024-09-14T05:59:53.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9460000000000004e-06 2024-09-14T05:59:53.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.298 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918240+0000", 2024-09-14T05:59:53.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9580000000000002e-06 2024-09-14T05:59:53.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.298 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949896+0000", 2024-09-14T05:59:53.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031655839999999998 2024-09-14T05:59:53.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.299 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.949944+0000", 2024-09-14T05:59:53.299 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8658000000000001e-05 2024-09-14T05:59:53.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.299 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.299 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950047+0000", 2024-09-14T05:59:53.299 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102812 2024-09-14T05:59:53.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.299 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.300 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.300 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21615 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 995328~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.300 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:53.300 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.356944979000001, 2024-09-14T05:59:53.300 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031807305000000001, 2024-09-14T05:59:53.300 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.300 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.300 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21615 2024-09-14T05:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.301 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:53.302 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.302 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.302 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918428+0000", 2024-09-14T05:59:53.302 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6499999999999999e-07 2024-09-14T05:59:53.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.302 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.302 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918431+0000", 2024-09-14T05:59:53.302 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.948e-06 2024-09-14T05:59:53.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.302 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918440+0000", 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9390000000000003e-06 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918448+0000", 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.233e-06 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950088+0000", 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031640922000000002 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.303 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950153+0000", 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4500999999999998e-05 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950235+0000", 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2196999999999999e-05 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21618 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1003520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.356913710000001, 2024-09-14T05:59:53.304 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031945335999999998, 2024-09-14T05:59:53.305 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.305 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.305 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.305 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.305 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.305 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21618 2024-09-14T05:59:53.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.305 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.305 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.305 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918459+0000", 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918460+0000", 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8400000000000002e-07 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.306 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918464+0000", 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4699999999999998e-06 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918473+0000", 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2159999999999995e-06 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918480+0000", 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2540000000000003e-06 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.307 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950268+0000", 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031787955 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950327+0000", 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9289000000000001e-05 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950404+0000", 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7168000000000004e-05 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21620 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1026048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.356872360000001, 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032089751, 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21620 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.310 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:53.310 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.310 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918500+0000", 2024-09-14T05:59:53.310 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.311 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.311 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918501+0000", 2024-09-14T05:59:53.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.46e-07 2024-09-14T05:59:53.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.311 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.311 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918503+0000", 2024-09-14T05:59:53.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4940000000000002e-06 2024-09-14T05:59:53.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.311 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.311 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918509+0000", 2024-09-14T05:59:53.312 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0850000000000002e-06 2024-09-14T05:59:53.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.312 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.312 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918514+0000", 2024-09-14T05:59:53.312 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7219999999999999e-06 2024-09-14T05:59:53.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.312 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.312 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950435+0000", 2024-09-14T05:59:53.313 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031921161000000003 2024-09-14T05:59:53.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.313 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.313 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950518+0000", 2024-09-14T05:59:53.313 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2280999999999994e-05 2024-09-14T05:59:53.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.313 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.313 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950590+0000", 2024-09-14T05:59:53.313 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2562000000000001e-05 2024-09-14T05:59:53.313 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.313 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.313 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21622 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1034240~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.356852095000001, 2024-09-14T05:59:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032304393000000001, 2024-09-14T05:59:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21622 2024-09-14T05:59:53.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.315 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.315 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.315 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:53.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.315 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.315 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:53.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.315 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.316 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918521+0000", 2024-09-14T05:59:53.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8299999999999997e-07 2024-09-14T05:59:53.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.316 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.316 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918523+0000", 2024-09-14T05:59:53.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7370000000000001e-06 2024-09-14T05:59:53.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.316 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.316 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918528+0000", 2024-09-14T05:59:53.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.87e-06 2024-09-14T05:59:53.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918532+0000", 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8999999999999999e-06 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950656+0000", 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032123800000000001 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950745+0000", 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9044999999999999e-05 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950825+0000", 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0457999999999994e-05 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21668 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 983040~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.356729867999999, 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032333329000000001, 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.318 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.319 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.319 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.319 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.319 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21668 2024-09-14T05:59:53.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.319 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:53.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918643+0000", 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9999999999999998e-07 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918650+0000", 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0779999999999998e-06 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918656+0000", 2024-09-14T05:59:53.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.536e-06 2024-09-14T05:59:53.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.321 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.321 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918663+0000", 2024-09-14T05:59:53.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9480000000000002e-06 2024-09-14T05:59:53.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.321 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.321 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950856+0000", 2024-09-14T05:59:53.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032193580999999999 2024-09-14T05:59:53.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.321 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950908+0000", 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1248999999999997e-05 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.950976+0000", 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8536999999999998e-05 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21671 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 997376~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:53.322 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.356699081999999, 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032470855999999999, 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21671 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918674+0000", 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918677+0000", 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.565e-06 2024-09-14T05:59:53.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918686+0000", 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3309999999999993e-06 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918694+0000", 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6249999999999998e-06 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951003+0000", 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032308903 2024-09-14T05:59:53.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951059+0000", 2024-09-14T05:59:53.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:59:53.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951145+0000", 2024-09-14T05:59:53.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.53e-05 2024-09-14T05:59:53.326 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.326 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.326 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.327 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21673 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1005568~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.327 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:53.327 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.356667866999999, 2024-09-14T05:59:53.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.03260818, 2024-09-14T05:59:53.327 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.327 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.327 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.327 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.327 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.327 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.327 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21673 2024-09-14T05:59:53.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.328 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:53.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918705+0000", 2024-09-14T05:59:53.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918706+0000", 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4199999999999995e-07 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918715+0000", 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7459999999999995e-06 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918725+0000", 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0077e-05 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918733+0000", 2024-09-14T05:59:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9610000000000005e-06 2024-09-14T05:59:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951178+0000", 2024-09-14T05:59:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032444711000000001 2024-09-14T05:59:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951246+0000", 2024-09-14T05:59:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8256999999999994e-05 2024-09-14T05:59:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951313+0000", 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6785999999999994e-05 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21674 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1028096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.356627739, 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032759020999999999, 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.331 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.332 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.332 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.332 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.332 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21674 2024-09-14T05:59:53.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.332 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:53.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918745+0000", 2024-09-14T05:59:53.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918746+0000", 2024-09-14T05:59:53.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6599999999999995e-07 2024-09-14T05:59:53.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918749+0000", 2024-09-14T05:59:53.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1489999999999998e-06 2024-09-14T05:59:53.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918758+0000", 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2779999999999999e-06 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918771+0000", 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2799999999999999e-05 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951346+0000", 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032574573000000002 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951426+0000", 2024-09-14T05:59:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0486000000000002e-05 2024-09-14T05:59:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951504+0000", 2024-09-14T05:59:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7968999999999998e-05 2024-09-14T05:59:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.335 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21676 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1036288~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.336 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:53.336 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.356590181000001, 2024-09-14T05:59:53.336 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032901069999999998, 2024-09-14T05:59:53.336 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.336 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.336 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.336 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.336 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.336 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.336 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21676 2024-09-14T05:59:53.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.336 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:53.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:53.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918783+0000", 2024-09-14T05:59:53.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2600000000000002e-07 2024-09-14T05:59:53.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918787+0000", 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2430000000000001e-06 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918796+0000", 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5910000000000002e-06 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918804+0000", 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4050000000000003e-06 2024-09-14T05:59:53.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951539+0000", 2024-09-14T05:59:53.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032735383999999999 2024-09-14T05:59:53.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951611+0000", 2024-09-14T05:59:53.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1675999999999996e-05 2024-09-14T05:59:53.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951684+0000", 2024-09-14T05:59:53.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3045000000000003e-05 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21723 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 985088~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.356388064000001, 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032913915000000002, 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.340 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.341 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21723 2024-09-14T05:59:53.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.341 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:53.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:53.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918985+0000", 2024-09-14T05:59:53.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0499999999999999e-07 2024-09-14T05:59:53.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918987+0000", 2024-09-14T05:59:53.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.883e-06 2024-09-14T05:59:53.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918992+0000", 2024-09-14T05:59:53.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8550000000000001e-06 2024-09-14T05:59:53.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.918996+0000", 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8800000000000001e-06 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951712+0000", 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032715883000000001 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951784+0000", 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2484999999999995e-05 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951899+0000", 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000114524 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21725 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1007616~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.356370050999999, 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033063000000000002, 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.344 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21725 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919003+0000", 2024-09-14T05:59:53.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3099999999999999e-07 2024-09-14T05:59:53.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919013+0000", 2024-09-14T05:59:53.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0222e-05 2024-09-14T05:59:53.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919019+0000", 2024-09-14T05:59:53.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5520000000000004e-06 2024-09-14T05:59:53.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919023+0000", 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0779999999999997e-06 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.951932+0000", 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032908958000000002 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952000+0000", 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8435000000000005e-05 2024-09-14T05:59:53.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.348 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952066+0000", 2024-09-14T05:59:53.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5424000000000002e-05 2024-09-14T05:59:53.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.348 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.348 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21726 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1015808~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.348 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:53.348 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.356343529, 2024-09-14T05:59:53.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033223673000000002, 2024-09-14T05:59:53.348 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.349 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.349 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.349 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.349 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.349 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21726 2024-09-14T05:59:53.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.349 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.349 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.349 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:53.349 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919029+0000", 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919030+0000", 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9000000000000002e-07 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919031+0000", 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7060000000000001e-06 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919036+0000", 2024-09-14T05:59:53.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7439999999999998e-06 2024-09-14T05:59:53.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919040+0000", 2024-09-14T05:59:53.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9559999999999999e-06 2024-09-14T05:59:53.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952093+0000", 2024-09-14T05:59:53.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033053355 2024-09-14T05:59:53.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952151+0000", 2024-09-14T05:59:53.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7352999999999998e-05 2024-09-14T05:59:53.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952253+0000", 2024-09-14T05:59:53.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102169 2024-09-14T05:59:53.352 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.352 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.352 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21727 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1030144~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.356327529000001, 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033447573000000001, 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21727 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919045+0000", 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919046+0000", 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.53e-07 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919049+0000", 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5130000000000001e-06 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919055+0000", 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3280000000000002e-06 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919059+0000", 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9820000000000002e-06 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952280+0000", 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033220999000000001 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952358+0000", 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7941999999999993e-05 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952493+0000", 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000134456 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.357 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:21729 3.6 3:6500150b:::rbd_data.1127ff8b71e0.0000000000000003:b [read 1038336~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T05:59:53.357 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:53.357 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.356308003999999, 2024-09-14T05:59:53.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033604367000000003, 2024-09-14T05:59:53.357 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.357 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.357 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:53.357 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.357 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.357 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.357 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 21729 2024-09-14T05:59:53.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.357 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919065+0000", 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1200000000000003e-07 2024-09-14T05:59:53.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919089+0000", 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.332e-05 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919096+0000", 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5109999999999997e-06 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.919101+0000", 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8239999999999999e-06 2024-09-14T05:59:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952524+0000", 2024-09-14T05:59:53.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033422466999999997 2024-09-14T05:59:53.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952599+0000", 2024-09-14T05:59:53.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5074999999999995e-05 2024-09-14T05:59:53.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:30.952669+0000", 2024-09-14T05:59:53.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0557999999999998e-05 2024-09-14T05:59:53.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.361 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.361 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:28643 3.19 3:9c53e3bd:::rbd_data.11276864ec6c.0000000000000005:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-09-14T05:59:53.361 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:53.361 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.655697155999999, 2024-09-14T05:59:53.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033793691000000001, 2024-09-14T05:59:53.361 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.361 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.361 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.361 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:53.361 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:53.362 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:53.362 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 28643 2024-09-14T05:59:53.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.362 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:53.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619676+0000", 2024-09-14T05:59:53.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619677+0000", 2024-09-14T05:59:53.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.717e-06 2024-09-14T05:59:53.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619683+0000", 2024-09-14T05:59:53.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5300000000000004e-06 2024-09-14T05:59:53.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619695+0000", 2024-09-14T05:59:53.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2211e-05 2024-09-14T05:59:53.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619701+0000", 2024-09-14T05:59:53.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9429999999999997e-06 2024-09-14T05:59:53.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619754+0000", 2024-09-14T05:59:53.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2899000000000003e-05 2024-09-14T05:59:53.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.619809+0000", 2024-09-14T05:59:53.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4783e-05 2024-09-14T05:59:53.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 3", 2024-09-14T05:59:53.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.625771+0000", 2024-09-14T05:59:53.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0059617960000000001 2024-09-14T05:59:53.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:59:53.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653329+0000", 2024-09-14T05:59:53.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.027558068000000002 2024-09-14T05:59:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T05:59:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653351+0000", 2024-09-14T05:59:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2133e-05 2024-09-14T05:59:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653409+0000", 2024-09-14T05:59:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8687999999999998e-05 2024-09-14T05:59:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:34.653469+0000", 2024-09-14T05:59:53.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9923000000000002e-05 2024-09-14T05:59:53.367 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.367 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.367 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.367 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.367 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.367 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:53.368 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:53.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:59:53.369 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:53.370 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:53.374 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:53.372+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:53.474 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:53.469+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:53.538 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:53.538 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:53.538 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:53.538 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:53.553 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:59:53.575 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:53.572+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:53.676 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:53.673+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:53.720 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:53.720 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:53.720 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:53.720 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:53.720 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:53.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:59:53.777 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:53.773+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:53.871 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2024-09-14T05:59:53.877 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:53.876+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:53.911 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:53.911 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:53.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:53.911 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:53.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.911 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3629 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'31, mlcod=31'25)", 2024-09-14T05:59:53.911 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.579969931999997, 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048071900000000002, 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:53.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329483+0000", 2024-09-14T05:59:53.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-07 2024-09-14T05:59:53.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329488+0000", 2024-09-14T05:59:53.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000004e-06 2024-09-14T05:59:53.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329496+0000", 2024-09-14T05:59:53.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2209999999999997e-06 2024-09-14T05:59:53.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329501+0000", 2024-09-14T05:59:53.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8729999999999998e-06 2024-09-14T05:59:53.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329545+0000", 2024-09-14T05:59:53.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4382999999999998e-05 2024-09-14T05:59:53.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329564+0000", 2024-09-14T05:59:53.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8947999999999999e-05 2024-09-14T05:59:53.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334225+0000", 2024-09-14T05:59:53.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004660923 2024-09-14T05:59:53.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334289+0000", 2024-09-14T05:59:53.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4041999999999994e-05 2024-09-14T05:59:53.915 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.916 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.916 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3630 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'32, mlcod=31'25)", 2024-09-14T05:59:53.916 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:53.916 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.579221926999999, 2024-09-14T05:59:53.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0040991680000000003, 2024-09-14T05:59:53.916 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.916 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.916 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.916 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:53.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:53.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330231+0000", 2024-09-14T05:59:53.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4099999999999998e-07 2024-09-14T05:59:53.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330235+0000", 2024-09-14T05:59:53.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.391e-06 2024-09-14T05:59:53.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330245+0000", 2024-09-14T05:59:53.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:59:53.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330249+0000", 2024-09-14T05:59:53.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T05:59:53.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330301+0000", 2024-09-14T05:59:53.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1515999999999999e-05 2024-09-14T05:59:53.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330312+0000", 2024-09-14T05:59:53.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1603000000000001e-05 2024-09-14T05:59:53.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334293+0000", 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039809449999999996 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334329+0000", 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5763000000000003e-05 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.920 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3632 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'34, mlcod=31'27)", 2024-09-14T05:59:53.921 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:53.921 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.576847743999998, 2024-09-14T05:59:53.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047983469999999997, 2024-09-14T05:59:53.921 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.921 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.921 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.921 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:53.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332605+0000", 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5099999999999999e-07 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332611+0000", 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6999999999999996e-06 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332623+0000", 2024-09-14T05:59:53.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2401e-05 2024-09-14T05:59:53.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332629+0000", 2024-09-14T05:59:53.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3720000000000001e-06 2024-09-14T05:59:53.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332691+0000", 2024-09-14T05:59:53.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1451000000000005e-05 2024-09-14T05:59:53.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332711+0000", 2024-09-14T05:59:53.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0285e-05 2024-09-14T05:59:53.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337341+0000", 2024-09-14T05:59:53.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046295900000000003 2024-09-14T05:59:53.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337402+0000", 2024-09-14T05:59:53.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1797000000000005e-05 2024-09-14T05:59:53.924 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.925 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.925 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3633 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'35, mlcod=31'27)", 2024-09-14T05:59:53.925 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:53.925 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.575986299, 2024-09-14T05:59:53.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039783919999999999, 2024-09-14T05:59:53.925 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.925 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.925 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.925 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1500000000000004e-07 2024-09-14T05:59:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333479+0000", 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2918999999999999e-05 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333489+0000", 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0068000000000001e-05 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333494+0000", 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9309999999999999e-06 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333543+0000", 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9293999999999999e-05 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333555+0000", 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1467e-05 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337408+0000", 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038532549999999999 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337444+0000", 2024-09-14T05:59:53.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5843000000000002e-05 2024-09-14T05:59:53.929 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.929 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.929 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.929 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3638 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'40, mlcod=31'32)", 2024-09-14T05:59:53.929 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:53.929 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.570705828999998, 2024-09-14T05:59:53.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004283345, 2024-09-14T05:59:53.929 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.930 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.930 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.930 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:53.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:53.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338747+0000", 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0279999999999999e-06 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338756+0000", 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5909999999999996e-06 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338774+0000", 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8073000000000001e-05 2024-09-14T05:59:53.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338785+0000", 2024-09-14T05:59:53.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1017e-05 2024-09-14T05:59:53.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338844+0000", 2024-09-14T05:59:53.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9292000000000001e-05 2024-09-14T05:59:53.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338864+0000", 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9528999999999999e-05 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.342984+0000", 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041207809999999996 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.343029+0000", 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5034000000000003e-05 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.934 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:11218 3.9 e38/24 3:967d83c0:::rbd_data.1127ff8b71e0.0000000000000064:head v 38'37, mlcod=38'35)", 2024-09-14T05:59:53.934 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:53.934 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.664599716000001, 2024-09-14T05:59:53.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004035416, 2024-09-14T05:59:53.934 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.934 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.934 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.934 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:53.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244854+0000", 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2350000000000002e-06 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246114+0000", 2024-09-14T05:59:53.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012600980000000001 2024-09-14T05:59:53.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.936 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246158+0000", 2024-09-14T05:59:53.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3473000000000002e-05 2024-09-14T05:59:53.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.936 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246179+0000", 2024-09-14T05:59:53.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0738999999999999e-05 2024-09-14T05:59:53.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.936 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246306+0000", 2024-09-14T05:59:53.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000127238 2024-09-14T05:59:53.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246349+0000", 2024-09-14T05:59:53.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3211999999999999e-05 2024-09-14T05:59:53.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248780+0000", 2024-09-14T05:59:53.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0024304970000000002 2024-09-14T05:59:53.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248888+0000", 2024-09-14T05:59:53.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010792400000000001 2024-09-14T05:59:53.938 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.938 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.938 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.938 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:17596 3.4 e41/24 3:27f62511:::rbd_data.1127d65075f9.00000000000000ca:head v 41'97, mlcod=41'95)", 2024-09-14T05:59:53.938 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:53.938 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.938953264999999, 2024-09-14T05:59:53.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049456559999999997, 2024-09-14T05:59:53.938 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.938 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.938 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970500+0000", 2024-09-14T05:59:53.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9600000000000008e-07 2024-09-14T05:59:53.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970614+0000", 2024-09-14T05:59:53.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000113956 2024-09-14T05:59:53.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970631+0000", 2024-09-14T05:59:53.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7150999999999999e-05 2024-09-14T05:59:53.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970643+0000", 2024-09-14T05:59:53.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1868999999999999e-05 2024-09-14T05:59:53.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970711+0000", 2024-09-14T05:59:53.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8952e-05 2024-09-14T05:59:53.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970738+0000", 2024-09-14T05:59:53.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6055999999999999e-05 2024-09-14T05:59:53.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975388+0000", 2024-09-14T05:59:53.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046502499999999999 2024-09-14T05:59:53.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975444+0000", 2024-09-14T05:59:53.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6425999999999998e-05 2024-09-14T05:59:53.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.942 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24289 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'57, mlcod=41'54)", 2024-09-14T05:59:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.753661086000001, 2024-09-14T05:59:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.060867738999999997, 2024-09-14T05:59:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155793+0000", 2024-09-14T05:59:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9470000000000002e-06 2024-09-14T05:59:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181776+0000", 2024-09-14T05:59:53.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.02598313 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181817+0000", 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1440000000000003e-05 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181834+0000", 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6979000000000001e-05 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181931+0000", 2024-09-14T05:59:53.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7219999999999994e-05 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181964+0000", 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2094999999999997e-05 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216586+0000", 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034622503999999998 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216658+0000", 2024-09-14T05:59:53.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:59:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24309 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'58, mlcod=41'56)", 2024-09-14T05:59:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.654425980999999, 2024-09-14T05:59:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044435519999999999, 2024-09-14T05:59:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.947 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255027+0000", 2024-09-14T05:59:53.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T05:59:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255040+0000", 2024-09-14T05:59:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2773e-05 2024-09-14T05:59:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255066+0000", 2024-09-14T05:59:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5459000000000001e-05 2024-09-14T05:59:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255076+0000", 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0372e-05 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255151+0000", 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5444999999999993e-05 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255176+0000", 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5089e-05 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259379+0000", 2024-09-14T05:59:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042025439999999999 2024-09-14T05:59:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259469+0000", 2024-09-14T05:59:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0407000000000004e-05 2024-09-14T05:59:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37361 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'280, mlcod=50'278)", 2024-09-14T05:59:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.041186+0000", 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.8682657230000004, 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075534590000000002, 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T05:59:53.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041187+0000", 2024-09-14T05:59:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2160000000000001e-06 2024-09-14T05:59:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041208+0000", 2024-09-14T05:59:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0528999999999999e-05 2024-09-14T05:59:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041225+0000", 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7255e-05 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041235+0000", 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4190000000000008e-06 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041302+0000", 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7774000000000005e-05 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041330+0000", 2024-09-14T05:59:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7382999999999999e-05 2024-09-14T05:59:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048686+0000", 2024-09-14T05:59:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073564570000000003 2024-09-14T05:59:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048740+0000", 2024-09-14T05:59:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3426e-05 2024-09-14T05:59:53.955 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37362 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'281, mlcod=50'278)", 2024-09-14T05:59:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.046086+0000", 2024-09-14T05:59:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.8633653240000001, 2024-09-14T05:59:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047169380000000004, 2024-09-14T05:59:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T05:59:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T05:59:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046087+0000", 2024-09-14T05:59:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3600000000000003e-07 2024-09-14T05:59:53.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046093+0000", 2024-09-14T05:59:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7869999999999998e-06 2024-09-14T05:59:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046106+0000", 2024-09-14T05:59:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2636999999999999e-05 2024-09-14T05:59:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046113+0000", 2024-09-14T05:59:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0129999999999996e-06 2024-09-14T05:59:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046170+0000", 2024-09-14T05:59:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7819000000000003e-05 2024-09-14T05:59:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046194+0000", 2024-09-14T05:59:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3167999999999999e-05 2024-09-14T05:59:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050760+0000", 2024-09-14T05:59:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045665999999999997 2024-09-14T05:59:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050803+0000", 2024-09-14T05:59:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3177999999999999e-05 2024-09-14T05:59:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39545 3.0 e50/24 3:06bdaf45:::rbd_data.112781171282.0000000000000002:head v 50'347, mlcod=50'345)", 2024-09-14T05:59:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.578467+0000", 2024-09-14T05:59:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.330985042, 2024-09-14T05:59:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047008700000000002, 2024-09-14T05:59:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T05:59:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578468+0000", 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1599999999999999e-06 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579733+0000", 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012647120000000001 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579755+0000", 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2637999999999999e-05 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579766+0000", 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0264e-05 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579832+0000", 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6531000000000004e-05 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579859+0000", 2024-09-14T05:59:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6855999999999998e-05 2024-09-14T05:59:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583098+0000", 2024-09-14T05:59:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003238632 2024-09-14T05:59:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583168+0000", 2024-09-14T05:59:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0077e-05 2024-09-14T05:59:53.964 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39602 3.9 e50/24 3:909cb01b:::rbd_data.112781171282.000000000000006f:head v 50'86, mlcod=50'84)", 2024-09-14T05:59:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.746165+0000", 2024-09-14T05:59:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.1632870719999993, 2024-09-14T05:59:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041492480000000003, 2024-09-14T05:59:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746165+0000", 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746165+0000", 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746166+0000", 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3600000000000002e-07 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746287+0000", 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000120927 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746297+0000", 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0395e-05 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746302+0000", 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2379999999999997e-06 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746362+0000", 2024-09-14T05:59:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9765999999999997e-05 2024-09-14T05:59:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746385+0000", 2024-09-14T05:59:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3357999999999999e-05 2024-09-14T05:59:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.750213+0000", 2024-09-14T05:59:53.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038276019999999998 2024-09-14T05:59:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.750314+0000", 2024-09-14T05:59:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010112599999999999 2024-09-14T05:59:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39765 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'410, mlcod=51'406)", 2024-09-14T05:59:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.004422+0000", 2024-09-14T05:59:53.969 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9050302410000004, 2024-09-14T05:59:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044953839999999998, 2024-09-14T05:59:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T05:59:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T05:59:53.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004423+0000", 2024-09-14T05:59:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:59:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004432+0000", 2024-09-14T05:59:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2180000000000005e-06 2024-09-14T05:59:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004453+0000", 2024-09-14T05:59:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1182000000000001e-05 2024-09-14T05:59:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004464+0000", 2024-09-14T05:59:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1198e-05 2024-09-14T05:59:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004520+0000", 2024-09-14T05:59:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5835999999999999e-05 2024-09-14T05:59:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004547+0000", 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6454000000000001e-05 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008866+0000", 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043194679999999999 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008917+0000", 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0837000000000001e-05 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.973 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39847 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'431, mlcod=51'426)", 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.117705+0000", 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.7917468920000008, 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046358010000000002, 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T05:59:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117706+0000", 2024-09-14T05:59:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4899999999999995e-07 2024-09-14T05:59:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117711+0000", 2024-09-14T05:59:53.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6890000000000001e-06 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117724+0000", 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3054000000000001e-05 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117736+0000", 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1654999999999999e-05 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117788+0000", 2024-09-14T05:59:53.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2197000000000002e-05 2024-09-14T05:59:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117811+0000", 2024-09-14T05:59:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2472000000000001e-05 2024-09-14T05:59:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122292+0000", 2024-09-14T05:59:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004481596 2024-09-14T05:59:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122341+0000", 2024-09-14T05:59:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8489000000000003e-05 2024-09-14T05:59:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39865 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'438, mlcod=51'434)", 2024-09-14T05:59:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145039+0000", 2024-09-14T05:59:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.7644125939999995, 2024-09-14T05:59:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004519426, 2024-09-14T05:59:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.978 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145040+0000", 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7899999999999998e-07 2024-09-14T05:59:53.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145044+0000", 2024-09-14T05:59:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3789999999999999e-06 2024-09-14T05:59:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145053+0000", 2024-09-14T05:59:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2650000000000002e-06 2024-09-14T05:59:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145058+0000", 2024-09-14T05:59:53.980 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8169999999999998e-06 2024-09-14T05:59:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145105+0000", 2024-09-14T05:59:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7176999999999999e-05 2024-09-14T05:59:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145119+0000", 2024-09-14T05:59:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3179e-05 2024-09-14T05:59:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149512+0000", 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043934389999999999 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149559+0000", 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6591000000000002e-05 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39866 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'439, mlcod=51'434)", 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145610+0000", 2024-09-14T05:59:53.982 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.7638416550000002, 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039787060000000003, 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145610+0000", 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145610+0000", 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145611+0000", 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7599999999999997e-07 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145615+0000", 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1309999999999999e-06 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145624+0000", 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8480000000000007e-06 2024-09-14T05:59:53.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145629+0000", 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7840000000000003e-06 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145679+0000", 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0206e-05 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145699+0000", 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:59:53.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149561+0000", 2024-09-14T05:59:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038619969999999998 2024-09-14T05:59:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149589+0000", 2024-09-14T05:59:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8147999999999999e-05 2024-09-14T05:59:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40245 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'513, mlcod=52'509)", 2024-09-14T05:59:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.923591+0000", 2024-09-14T05:59:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9858605660000004, 2024-09-14T05:59:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053460410000000002, 2024-09-14T05:59:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T05:59:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T05:59:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923592+0000", 2024-09-14T05:59:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6599999999999996e-07 2024-09-14T05:59:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923598+0000", 2024-09-14T05:59:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.083e-06 2024-09-14T05:59:53.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923609+0000", 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1137e-05 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923617+0000", 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.401e-06 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924037+0000", 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042046 2024-09-14T05:59:53.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924082+0000", 2024-09-14T05:59:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4617000000000003e-05 2024-09-14T05:59:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928882+0000", 2024-09-14T05:59:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048000889999999996 2024-09-14T05:59:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928937+0000", 2024-09-14T05:59:53.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5587999999999997e-05 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40246 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'514, mlcod=52'509)", 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.924626+0000", 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9848260509999998, 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043609649999999996, 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T05:59:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T05:59:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T05:59:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2099999999999996e-07 2024-09-14T05:59:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.992 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924631+0000", 2024-09-14T05:59:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8450000000000002e-06 2024-09-14T05:59:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924641+0000", 2024-09-14T05:59:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0057e-05 2024-09-14T05:59:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924649+0000", 2024-09-14T05:59:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5669999999999997e-06 2024-09-14T05:59:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925127+0000", 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00047783800000000001 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925171+0000", 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4017000000000002e-05 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928942+0000", 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037716809999999998 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928987+0000", 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4338999999999997e-05 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:46646 3.0 e56/24 3:01acbe3d:::rbd_data.1127f2f8ff9b.0000000000000015:head v 56'541, mlcod=55'538)", 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:50.461412+0000", 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.4480397809999999, 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064775850000000001, 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:53.995 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461415+0000", 2024-09-14T05:59:53.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.666e-06 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463456+0000", 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00204177 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463488+0000", 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1503e-05 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463508+0000", 2024-09-14T05:59:53.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9788000000000001e-05 2024-09-14T05:59:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463697+0000", 2024-09-14T05:59:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018873499999999999 2024-09-14T05:59:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463741+0000", 2024-09-14T05:59:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4333999999999999e-05 2024-09-14T05:59:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467845+0000", 2024-09-14T05:59:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041041430000000002 2024-09-14T05:59:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467890+0000", 2024-09-14T05:59:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4645999999999999e-05 2024-09-14T05:59:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:53.999 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:53.999 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:54.001 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:59:54.001 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:53.997+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:54.100 INFO:teuthology.orchestra.run.smithi006.stdout:flattening image image_client.0-clone17 2024-09-14T05:59:54.101 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:54.097+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:54.202 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:54.197+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:54.237 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54621 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.138481+0000", 2024-09-14T05:59:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079911693000000006, 2024-09-14T05:59:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.079934926000000003, 2024-09-14T05:59:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.237 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54621 2024-09-14T05:59:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138481+0000", 2024-09-14T05:59:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.238 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138481+0000", 2024-09-14T05:59:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138482+0000", 2024-09-14T05:59:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T05:59:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138485+0000", 2024-09-14T05:59:54.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6469999999999998e-06 2024-09-14T05:59:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138491+0000", 2024-09-14T05:59:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.737e-06 2024-09-14T05:59:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138497+0000", 2024-09-14T05:59:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2689999999999999e-06 2024-09-14T05:59:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54653 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139499+0000", 2024-09-14T05:59:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078894134000000005, 2024-09-14T05:59:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.078952986000000003, 2024-09-14T05:59:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.241 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54653 2024-09-14T05:59:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139499+0000", 2024-09-14T05:59:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139499+0000", 2024-09-14T05:59:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139500+0000", 2024-09-14T05:59:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2799999999999996e-07 2024-09-14T05:59:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139502+0000", 2024-09-14T05:59:54.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6309999999999999e-06 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139509+0000", 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1640000000000004e-06 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139515+0000", 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2750000000000003e-06 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54868 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148350+0000", 2024-09-14T05:59:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070043026999999994, 2024-09-14T05:59:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.070142624000000001, 2024-09-14T05:59:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54868 2024-09-14T05:59:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T05:59:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T05:59:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148351+0000", 2024-09-14T05:59:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:59:54.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148353+0000", 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2299999999999998e-06 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148362+0000", 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9800000000000004e-06 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148367+0000", 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.327e-06 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.248 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54900 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163842+0000", 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054550929999999997, 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054702492999999998, 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54900 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.249 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163842+0000", 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163842+0000", 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163843+0000", 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5299999999999999e-07 2024-09-14T05:59:54.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163844+0000", 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.64e-06 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163849+0000", 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4209999999999997e-06 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163854+0000", 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0019999999999997e-06 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.251 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55114 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.172016+0000", 2024-09-14T05:59:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.046377003999999999, 2024-09-14T05:59:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046582048000000001, 2024-09-14T05:59:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.252 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55114 2024-09-14T05:59:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172016+0000", 2024-09-14T05:59:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172016+0000", 2024-09-14T05:59:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172254+0000", 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000237569 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172259+0000", 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8679999999999998e-06 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172270+0000", 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1155000000000001e-05 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.254 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172277+0000", 2024-09-14T05:59:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7640000000000005e-06 2024-09-14T05:59:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55146 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187800+0000", 2024-09-14T05:59:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030592714999999999, 2024-09-14T05:59:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.030851440000000001, 2024-09-14T05:59:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.255 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55146 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187800+0000", 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187800+0000", 2024-09-14T05:59:54.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187801+0000", 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1300000000000001e-07 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187803+0000", 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5179999999999999e-06 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187810+0000", 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9129999999999997e-06 2024-09-14T05:59:54.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187816+0000", 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2820000000000004e-06 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55362 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.195594+0000", 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.022799023000000002, 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.023126962000000001, 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.258 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55362 2024-09-14T05:59:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195594+0000", 2024-09-14T05:59:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195594+0000", 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195594+0000", 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5499999999999999e-07 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195602+0000", 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.289e-06 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195606+0000", 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9659999999999998e-06 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195609+0000", 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.021e-06 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55394 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.206851+0000", 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.011542273, 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.011987306, 2024-09-14T05:59:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55394 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.206851+0000", 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.206851+0000", 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207085+0000", 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023367 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207089+0000", 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9629999999999997e-06 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207102+0000", 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2361000000000001e-05 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207109+0000", 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.345e-06 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54622 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.138506+0000", 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079887388000000004, 2024-09-14T05:59:54.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.080390818000000003, 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54622 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138506+0000", 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138506+0000", 2024-09-14T05:59:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138506+0000", 2024-09-14T05:59:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1800000000000001e-07 2024-09-14T05:59:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138508+0000", 2024-09-14T05:59:54.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.278e-06 2024-09-14T05:59:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138515+0000", 2024-09-14T05:59:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5780000000000004e-06 2024-09-14T05:59:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138537+0000", 2024-09-14T05:59:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1525000000000001e-05 2024-09-14T05:59:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.267 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54654 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139524+0000", 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078869580999999994, 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.079429595000000006, 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54654 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.268 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139524+0000", 2024-09-14T05:59:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139524+0000", 2024-09-14T05:59:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139524+0000", 2024-09-14T05:59:54.269 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7700000000000005e-07 2024-09-14T05:59:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139526+0000", 2024-09-14T05:59:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1739999999999999e-06 2024-09-14T05:59:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139533+0000", 2024-09-14T05:59:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5899999999999996e-06 2024-09-14T05:59:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139558+0000", 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5443999999999999e-05 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54869 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148376+0000", 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070017128999999997, 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.070628412000000002, 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.271 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54869 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.272 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148377+0000", 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148379+0000", 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.429e-06 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148389+0000", 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9029999999999999e-06 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.273 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148395+0000", 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5080000000000002e-06 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54901 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163861+0000", 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054531938000000002, 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.055194992999999998, 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.274 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54901 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163861+0000", 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163861+0000", 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163862+0000", 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163869+0000", 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2760000000000003e-06 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163877+0000", 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7340000000000008e-06 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.276 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163883+0000", 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.088e-06 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55115 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.172291+0000", 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.04610177, 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046817431, 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.277 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55115 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172291+0000", 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172291+0000", 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172656+0000", 2024-09-14T05:59:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00036497500000000002 2024-09-14T05:59:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172661+0000", 2024-09-14T05:59:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.544e-06 2024-09-14T05:59:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172673+0000", 2024-09-14T05:59:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2140000000000001e-05 2024-09-14T05:59:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172681+0000", 2024-09-14T05:59:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0129999999999993e-06 2024-09-14T05:59:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55147 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187823+0000", 2024-09-14T05:59:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030570327000000001, 2024-09-14T05:59:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031337279000000003, 2024-09-14T05:59:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55147 2024-09-14T05:59:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187823+0000", 2024-09-14T05:59:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187823+0000", 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187823+0000", 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8599999999999998e-07 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187826+0000", 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2630000000000002e-06 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187832+0000", 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3169999999999998e-06 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187837+0000", 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3739999999999997e-06 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55363 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.195613+0000", 2024-09-14T05:59:54.283 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.022780245000000001, 2024-09-14T05:59:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.023599109, 2024-09-14T05:59:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55363 2024-09-14T05:59:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195613+0000", 2024-09-14T05:59:54.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195613+0000", 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203642+0000", 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.008029029 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203648+0000", 2024-09-14T05:59:54.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0750000000000003e-06 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203662+0000", 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3543000000000001e-05 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203669+0000", 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7719999999999994e-06 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.286 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55395 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.207124+0000", 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.011269408999999999, 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.01211601, 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55395 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.287 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207124+0000", 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207124+0000", 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207489+0000", 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00036508100000000001 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207494+0000", 2024-09-14T05:59:54.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3839999999999996e-06 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207505+0000", 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1112e-05 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207517+0000", 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1669e-05 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54623 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.138548+0000", 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079845450999999998, 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.080717294999999994, 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54623 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138548+0000", 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138548+0000", 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138548+0000", 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4499999999999997e-07 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138572+0000", 2024-09-14T05:59:54.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4142999999999999e-05 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138585+0000", 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2289e-05 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138592+0000", 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9840000000000004e-06 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54655 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139569+0000", 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078823893000000006, 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.079725003000000003, 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54655 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.293 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139569+0000", 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139569+0000", 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139570+0000", 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2900000000000004e-07 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139573+0000", 2024-09-14T05:59:54.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8959999999999999e-06 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139580+0000", 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3429999999999998e-06 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139586+0000", 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7169999999999996e-06 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.295 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54870 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148405+0000", 2024-09-14T05:59:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.069987800000000003, 2024-09-14T05:59:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.070913816000000005, 2024-09-14T05:59:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54870 2024-09-14T05:59:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.296 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T05:59:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T05:59:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148406+0000", 2024-09-14T05:59:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T05:59:54.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148409+0000", 2024-09-14T05:59:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T05:59:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148418+0000", 2024-09-14T05:59:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7329999999999998e-06 2024-09-14T05:59:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148425+0000", 2024-09-14T05:59:54.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2079999999999997e-06 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54902 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163891+0000", 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054501675999999999, 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.055452184000000002, 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54902 2024-09-14T05:59:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163891+0000", 2024-09-14T05:59:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163891+0000", 2024-09-14T05:59:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163892+0000", 2024-09-14T05:59:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000002e-07 2024-09-14T05:59:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163895+0000", 2024-09-14T05:59:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.977e-06 2024-09-14T05:59:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163902+0000", 2024-09-14T05:59:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8519999999999998e-06 2024-09-14T05:59:54.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163907+0000", 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9030000000000003e-06 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55116 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.172695+0000", 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.045698192999999998, 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046695328000000001, 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.302 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55116 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172695+0000", 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172695+0000", 2024-09-14T05:59:54.303 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173250+0000", 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00055500099999999995 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173256+0000", 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5860000000000004e-06 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173270+0000", 2024-09-14T05:59:54.304 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.449e-05 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173279+0000", 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0869999999999996e-06 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55148 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187879+0000", 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030513757999999998, 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031583381000000001, 2024-09-14T05:59:54.305 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55148 2024-09-14T05:59:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187879+0000", 2024-09-14T05:59:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187879+0000", 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187880+0000", 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2900000000000004e-07 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187883+0000", 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0970000000000002e-06 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187892+0000", 2024-09-14T05:59:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7600000000000008e-06 2024-09-14T05:59:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187898+0000", 2024-09-14T05:59:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2439999999999998e-06 2024-09-14T05:59:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.308 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55364 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203689+0000", 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014703691, 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.015821768999999999, 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55364 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.309 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203689+0000", 2024-09-14T05:59:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203689+0000", 2024-09-14T05:59:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203690+0000", 2024-09-14T05:59:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.68e-07 2024-09-14T05:59:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203694+0000", 2024-09-14T05:59:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4199999999999999e-06 2024-09-14T05:59:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203699+0000", 2024-09-14T05:59:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.728e-06 2024-09-14T05:59:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203703+0000", 2024-09-14T05:59:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7969999999999998e-06 2024-09-14T05:59:54.311 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55396 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.207534+0000", 2024-09-14T05:59:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.010858734, 2024-09-14T05:59:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.012027219, 2024-09-14T05:59:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.312 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55396 2024-09-14T05:59:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207534+0000", 2024-09-14T05:59:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207534+0000", 2024-09-14T05:59:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207922+0000", 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00038718699999999999 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207927+0000", 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7570000000000001e-06 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207938+0000", 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0764000000000001e-05 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207945+0000", 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.255e-06 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54624 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.138604+0000", 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079789603000000001, 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.080997499000000001, 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54624 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138604+0000", 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138604+0000", 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138604+0000", 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8999999999999996e-07 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138607+0000", 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0019999999999998e-06 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138617+0000", 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9799999999999993e-06 2024-09-14T05:59:54.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138623+0000", 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3040000000000001e-06 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54656 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139631+0000", 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078762126000000002, 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.079996650000000002, 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.318 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54656 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139631+0000", 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139631+0000", 2024-09-14T05:59:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139632+0000", 2024-09-14T05:59:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9800000000000003e-07 2024-09-14T05:59:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139634+0000", 2024-09-14T05:59:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8210000000000002e-06 2024-09-14T05:59:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139643+0000", 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1329999999999999e-06 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139648+0000", 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6749999999999999e-06 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54871 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.321 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148435+0000", 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.069957839999999993, 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.071217432999999997, 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54871 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T05:59:54.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148436+0000", 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148439+0000", 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8090000000000001e-06 2024-09-14T05:59:54.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148449+0000", 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0115000000000001e-05 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148466+0000", 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6761000000000001e-05 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.324 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54903 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163915+0000", 2024-09-14T05:59:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054478022000000001, 2024-09-14T05:59:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.055766436000000003, 2024-09-14T05:59:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54903 2024-09-14T05:59:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.325 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163915+0000", 2024-09-14T05:59:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163915+0000", 2024-09-14T05:59:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163916+0000", 2024-09-14T05:59:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6499999999999999e-07 2024-09-14T05:59:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163918+0000", 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5110000000000002e-06 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163925+0000", 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.204e-06 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163931+0000", 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2320000000000001e-06 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.327 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55117 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.173294+0000", 2024-09-14T05:59:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.045099591000000001, 2024-09-14T05:59:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046423541999999998, 2024-09-14T05:59:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55117 2024-09-14T05:59:54.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173294+0000", 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173294+0000", 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173536+0000", 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000242721 2024-09-14T05:59:54.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173541+0000", 2024-09-14T05:59:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0479999999999998e-06 2024-09-14T05:59:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173554+0000", 2024-09-14T05:59:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2712e-05 2024-09-14T05:59:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173566+0000", 2024-09-14T05:59:54.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1866e-05 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55149 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187908+0000", 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030484833999999999, 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.031834321999999998, 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.331 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55149 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187908+0000", 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187908+0000", 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187909+0000", 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4899999999999995e-07 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187911+0000", 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5500000000000001e-06 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187918+0000", 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7379999999999997e-06 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187924+0000", 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5180000000000004e-06 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55365 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203709+0000", 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014683631000000001, 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016065195000000001, 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.334 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55365 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203709+0000", 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203709+0000", 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.335 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203710+0000", 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0600000000000001e-07 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203712+0000", 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2180000000000002e-06 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203720+0000", 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6299999999999998e-06 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.336 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203726+0000", 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.156e-06 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55397 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.207959+0000", 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.010434148000000001, 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.011848874000000001, 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.337 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55397 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207959+0000", 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.207959+0000", 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.208365+0000", 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00040606699999999997 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.208371+0000", 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0639999999999999e-06 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.208386+0000", 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5031999999999999e-05 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.208394+0000", 2024-09-14T05:59:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1440000000000003e-06 2024-09-14T05:59:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54625 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.138634+0000", 2024-09-14T05:59:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079758923999999995, 2024-09-14T05:59:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.081233370999999999, 2024-09-14T05:59:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.340 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54625 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138634+0000", 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138634+0000", 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138635+0000", 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138638+0000", 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9079999999999999e-06 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138646+0000", 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5469999999999997e-06 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138664+0000", 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7575e-05 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54657 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139657+0000", 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078735842, 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.080264241, 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54657 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139657+0000", 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139657+0000", 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139658+0000", 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8800000000000002e-07 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139660+0000", 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1840000000000002e-06 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139667+0000", 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4930000000000003e-06 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139672+0000", 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1479999999999997e-06 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54872 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148476+0000", 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.069916642000000001, 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.071538884999999997, 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.346 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54872 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155484+0000", 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070072429999999998 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155490+0000", 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6379999999999998e-06 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155504+0000", 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4065e-05 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155513+0000", 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6799999999999999e-06 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54904 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163938+0000", 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054455139999999999, 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.056119401999999999, 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54904 2024-09-14T05:59:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163938+0000", 2024-09-14T05:59:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163938+0000", 2024-09-14T05:59:54.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163938+0000", 2024-09-14T05:59:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5999999999999999e-07 2024-09-14T05:59:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163941+0000", 2024-09-14T05:59:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1629999999999999e-06 2024-09-14T05:59:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163951+0000", 2024-09-14T05:59:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0577999999999999e-05 2024-09-14T05:59:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163956+0000", 2024-09-14T05:59:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3850000000000001e-06 2024-09-14T05:59:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55118 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.352 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.173581+0000", 2024-09-14T05:59:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.044812537999999999, 2024-09-14T05:59:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046528372999999998, 2024-09-14T05:59:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55118 2024-09-14T05:59:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.353 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173581+0000", 2024-09-14T05:59:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173581+0000", 2024-09-14T05:59:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173949+0000", 2024-09-14T05:59:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00036819499999999998 2024-09-14T05:59:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173954+0000", 2024-09-14T05:59:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.741e-06 2024-09-14T05:59:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173962+0000", 2024-09-14T05:59:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6400000000000003e-06 2024-09-14T05:59:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173968+0000", 2024-09-14T05:59:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.575e-06 2024-09-14T05:59:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.355 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55150 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187932+0000", 2024-09-14T05:59:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030461489000000001, 2024-09-14T05:59:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032228231000000003, 2024-09-14T05:59:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.356 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55150 2024-09-14T05:59:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187932+0000", 2024-09-14T05:59:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187932+0000", 2024-09-14T05:59:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187932+0000", 2024-09-14T05:59:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.39e-07 2024-09-14T05:59:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187934+0000", 2024-09-14T05:59:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0320000000000002e-06 2024-09-14T05:59:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187942+0000", 2024-09-14T05:59:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2279999999999998e-06 2024-09-14T05:59:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187947+0000", 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0590000000000002e-06 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55366 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203735+0000", 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014658406000000001, 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016457987, 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.359 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55366 2024-09-14T05:59:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203735+0000", 2024-09-14T05:59:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203735+0000", 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203735+0000", 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8100000000000003e-07 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203738+0000", 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7089999999999998e-06 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203747+0000", 2024-09-14T05:59:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6519999999999995e-06 2024-09-14T05:59:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203750+0000", 2024-09-14T05:59:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4309999999999998e-06 2024-09-14T05:59:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.362 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55398 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.208409+0000", 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0099838300000000008, 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.011826856, 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55398 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.208409+0000", 2024-09-14T05:59:54.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.208409+0000", 2024-09-14T05:59:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.208679+0000", 2024-09-14T05:59:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026921999999999997 2024-09-14T05:59:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.208703+0000", 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4258000000000001e-05 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.208723+0000", 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0506999999999999e-05 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.208732+0000", 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6330000000000002e-06 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54626 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.138676+0000", 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079716809, 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.081604429000000006, 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54626 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138676+0000", 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138676+0000", 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138677+0000", 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2399999999999998e-07 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138687+0000", 2024-09-14T05:59:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.747e-06 2024-09-14T05:59:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138695+0000", 2024-09-14T05:59:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3550000000000005e-06 2024-09-14T05:59:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138701+0000", 2024-09-14T05:59:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7219999999999996e-06 2024-09-14T05:59:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.368 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54658 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139679+0000", 2024-09-14T05:59:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078714135000000005, 2024-09-14T05:59:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.080657384999999998, 2024-09-14T05:59:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.369 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54658 2024-09-14T05:59:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T05:59:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T05:59:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4700000000000002e-07 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139687+0000", 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7170000000000008e-06 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139694+0000", 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.063e-06 2024-09-14T05:59:54.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139709+0000", 2024-09-14T05:59:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4324999999999999e-05 2024-09-14T05:59:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54873 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155528+0000", 2024-09-14T05:59:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062865008, 2024-09-14T05:59:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.064861327999999996, 2024-09-14T05:59:54.372 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54873 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155528+0000", 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155528+0000", 2024-09-14T05:59:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155529+0000", 2024-09-14T05:59:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T05:59:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155531+0000", 2024-09-14T05:59:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1579999999999999e-06 2024-09-14T05:59:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155536+0000", 2024-09-14T05:59:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9289999999999997e-06 2024-09-14T05:59:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155539+0000", 2024-09-14T05:59:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6219999999999998e-06 2024-09-14T05:59:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.375 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54905 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163965+0000", 2024-09-14T05:59:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054427936000000003, 2024-09-14T05:59:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.056480336999999999, 2024-09-14T05:59:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54905 2024-09-14T05:59:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163965+0000", 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163965+0000", 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163966+0000", 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1200000000000003e-07 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163968+0000", 2024-09-14T05:59:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.509e-06 2024-09-14T05:59:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163975+0000", 2024-09-14T05:59:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.657e-06 2024-09-14T05:59:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163978+0000", 2024-09-14T05:59:54.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5410000000000001e-06 2024-09-14T05:59:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55119 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.173978+0000", 2024-09-14T05:59:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.044414792000000002, 2024-09-14T05:59:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046516441999999998, 2024-09-14T05:59:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.379 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55119 2024-09-14T05:59:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173978+0000", 2024-09-14T05:59:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.173978+0000", 2024-09-14T05:59:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.174303+0000", 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000324863 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.174312+0000", 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4719999999999995e-06 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.174321+0000", 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8589999999999994e-06 2024-09-14T05:59:54.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.174339+0000", 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.84e-05 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55151 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187955+0000", 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030438221000000001, 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032592062999999998, 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.382 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55151 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187955+0000", 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187955+0000", 2024-09-14T05:59:54.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187955+0000", 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187958+0000", 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5229999999999998e-06 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187964+0000", 2024-09-14T05:59:54.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4620000000000001e-06 2024-09-14T05:59:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187970+0000", 2024-09-14T05:59:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3349999999999997e-06 2024-09-14T05:59:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55367 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203755+0000", 2024-09-14T05:59:54.385 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014637654999999999, 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.016843633, 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55367 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203755+0000", 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203755+0000", 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203756+0000", 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2099999999999998e-07 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203757+0000", 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5659999999999999e-06 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203761+0000", 2024-09-14T05:59:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5329999999999999e-06 2024-09-14T05:59:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203764+0000", 2024-09-14T05:59:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8289999999999999e-06 2024-09-14T05:59:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55399 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.208746+0000", 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0096467489999999996, 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.011905793, 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55399 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.208746+0000", 2024-09-14T05:59:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.208746+0000", 2024-09-14T05:59:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.209036+0000", 2024-09-14T05:59:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028931600000000002 2024-09-14T05:59:54.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.209041+0000", 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9540000000000003e-06 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.209051+0000", 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0855e-05 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.209059+0000", 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5630000000000003e-06 2024-09-14T05:59:54.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54627 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.138710+0000", 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079683008999999999, 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.081976831, 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.392 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54627 2024-09-14T05:59:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138710+0000", 2024-09-14T05:59:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138710+0000", 2024-09-14T05:59:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138711+0000", 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4300000000000003e-07 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138713+0000", 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5859999999999999e-06 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138720+0000", 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6490000000000002e-06 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138725+0000", 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1950000000000002e-06 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54659 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139717+0000", 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078675787999999997, 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.081007071, 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.395 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54659 2024-09-14T05:59:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T05:59:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T05:59:54.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139718+0000", 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9699999999999996e-07 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139731+0000", 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2993000000000001e-05 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139738+0000", 2024-09-14T05:59:54.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4610000000000002e-06 2024-09-14T05:59:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139744+0000", 2024-09-14T05:59:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6389999999999997e-06 2024-09-14T05:59:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54874 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155545+0000", 2024-09-14T05:59:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062848382999999994, 2024-09-14T05:59:54.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.065231123000000002, 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54874 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155545+0000", 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155545+0000", 2024-09-14T05:59:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155545+0000", 2024-09-14T05:59:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0100000000000001e-07 2024-09-14T05:59:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155547+0000", 2024-09-14T05:59:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5400000000000001e-06 2024-09-14T05:59:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155551+0000", 2024-09-14T05:59:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0319999999999997e-06 2024-09-14T05:59:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155554+0000", 2024-09-14T05:59:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2200000000000001e-06 2024-09-14T05:59:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54906 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163983+0000", 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054409964999999998, 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.056851194000000001, 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54906 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163983+0000", 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163983+0000", 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163983+0000", 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2599999999999998e-07 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163985+0000", 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6610000000000001e-06 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163991+0000", 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3010000000000003e-06 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163996+0000", 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6630000000000001e-06 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55120 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.174354+0000", 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.044038699000000001, 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046531061999999998, 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55120 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.174354+0000", 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.174354+0000", 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179461+0000", 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0051070350000000002 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179469+0000", 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6620000000000005e-06 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179490+0000", 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0432999999999999e-05 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179498+0000", 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9449999999999999e-06 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55152 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187977+0000", 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030416116, 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032938942999999998, 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55152 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187977+0000", 2024-09-14T05:59:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187977+0000", 2024-09-14T05:59:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187977+0000", 2024-09-14T05:59:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T05:59:54.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187980+0000", 2024-09-14T05:59:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.131e-06 2024-09-14T05:59:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187987+0000", 2024-09-14T05:59:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.272e-06 2024-09-14T05:59:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187992+0000", 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9810000000000003e-06 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55368 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203767+0000", 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014625694, 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017202640000000002, 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.411 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55368 2024-09-14T05:59:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203767+0000", 2024-09-14T05:59:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203767+0000", 2024-09-14T05:59:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203768+0000", 2024-09-14T05:59:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5600000000000002e-07 2024-09-14T05:59:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203769+0000", 2024-09-14T05:59:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2079999999999999e-06 2024-09-14T05:59:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203772+0000", 2024-09-14T05:59:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.095e-06 2024-09-14T05:59:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203775+0000", 2024-09-14T05:59:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7630000000000001e-06 2024-09-14T05:59:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55400 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.414 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.209081+0000", 2024-09-14T05:59:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0093117129999999992, 2024-09-14T05:59:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.011939969999999999, 2024-09-14T05:59:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55400 2024-09-14T05:59:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.209081+0000", 2024-09-14T05:59:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.209081+0000", 2024-09-14T05:59:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211524+0000", 2024-09-14T05:59:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0024430089999999999 2024-09-14T05:59:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211529+0000", 2024-09-14T05:59:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5739999999999997e-06 2024-09-14T05:59:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211539+0000", 2024-09-14T05:59:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9599999999999995e-06 2024-09-14T05:59:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211548+0000", 2024-09-14T05:59:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9279999999999999e-06 2024-09-14T05:59:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.417 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54628 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 32768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.138735+0000", 2024-09-14T05:59:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079658599999999996, 2024-09-14T05:59:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082355391, 2024-09-14T05:59:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T05:59:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.418 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54628 2024-09-14T05:59:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138735+0000", 2024-09-14T05:59:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138735+0000", 2024-09-14T05:59:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138735+0000", 2024-09-14T05:59:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8999999999999996e-07 2024-09-14T05:59:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138737+0000", 2024-09-14T05:59:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2639999999999998e-06 2024-09-14T05:59:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138744+0000", 2024-09-14T05:59:54.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4200000000000004e-06 2024-09-14T05:59:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138749+0000", 2024-09-14T05:59:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0849999999999996e-06 2024-09-14T05:59:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.221043+0000", 2024-09-14T05:59:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082293585000000002 2024-09-14T05:59:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.221099+0000", 2024-09-14T05:59:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6054999999999998e-05 2024-09-14T05:59:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54660 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139753+0000", 2024-09-14T05:59:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078640453999999999, 2024-09-14T05:59:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.081400400999999997, 2024-09-14T05:59:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.422 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54660 2024-09-14T05:59:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T05:59:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T05:59:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T05:59:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T05:59:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139755+0000", 2024-09-14T05:59:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T05:59:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139762+0000", 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6719999999999998e-06 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139767+0000", 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9819999999999999e-06 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54875 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155559+0000", 2024-09-14T05:59:54.425 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062833942000000004, 2024-09-14T05:59:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.065639765000000003, 2024-09-14T05:59:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54875 2024-09-14T05:59:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155559+0000", 2024-09-14T05:59:54.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155559+0000", 2024-09-14T05:59:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155560+0000", 2024-09-14T05:59:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.39e-07 2024-09-14T05:59:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155569+0000", 2024-09-14T05:59:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4360000000000008e-06 2024-09-14T05:59:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155576+0000", 2024-09-14T05:59:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0679999999999999e-06 2024-09-14T05:59:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155580+0000", 2024-09-14T05:59:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5300000000000001e-06 2024-09-14T05:59:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.428 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54907 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.164004+0000", 2024-09-14T05:59:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054388710999999999, 2024-09-14T05:59:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057235466999999998, 2024-09-14T05:59:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.429 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54907 2024-09-14T05:59:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164004+0000", 2024-09-14T05:59:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164004+0000", 2024-09-14T05:59:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164005+0000", 2024-09-14T05:59:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5600000000000001e-07 2024-09-14T05:59:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164007+0000", 2024-09-14T05:59:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5160000000000001e-06 2024-09-14T05:59:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164020+0000", 2024-09-14T05:59:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2672e-05 2024-09-14T05:59:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164042+0000", 2024-09-14T05:59:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1906e-05 2024-09-14T05:59:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55121 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179515+0000", 2024-09-14T05:59:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038877630000000003, 2024-09-14T05:59:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.041772913000000002, 2024-09-14T05:59:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.433 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55121 2024-09-14T05:59:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179515+0000", 2024-09-14T05:59:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179515+0000", 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179517+0000", 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.017e-06 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179520+0000", 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3799999999999998e-06 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179529+0000", 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2990000000000002e-06 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179535+0000", 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0419999999999999e-06 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55153 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.188000+0000", 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030393595999999998, 2024-09-14T05:59:54.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033315382999999997, 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55153 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188000+0000", 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188000+0000", 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188000+0000", 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2100000000000002e-07 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188002+0000", 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3360000000000002e-06 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188013+0000", 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0314e-05 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188019+0000", 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2169999999999999e-06 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55369 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.439 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203778+0000", 2024-09-14T05:59:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014614892000000001, 2024-09-14T05:59:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017572502, 2024-09-14T05:59:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55369 2024-09-14T05:59:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.440 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203778+0000", 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203778+0000", 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203778+0000", 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.65e-07 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203780+0000", 2024-09-14T05:59:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.201e-06 2024-09-14T05:59:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203783+0000", 2024-09-14T05:59:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0299999999999998e-06 2024-09-14T05:59:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203785+0000", 2024-09-14T05:59:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7020000000000001e-06 2024-09-14T05:59:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.442 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55401 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.211562+0000", 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0068314420000000001, 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.009814906, 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55401 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.443 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211562+0000", 2024-09-14T05:59:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211562+0000", 2024-09-14T05:59:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211562+0000", 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211564+0000", 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.846e-06 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211572+0000", 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9619999999999993e-06 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211578+0000", 2024-09-14T05:59:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7540000000000003e-06 2024-09-14T05:59:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54629 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 88064~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.138770+0000", 2024-09-14T05:59:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079623137999999996, 2024-09-14T05:59:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082641459, 2024-09-14T05:59:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:54.446 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54629 2024-09-14T05:59:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138770+0000", 2024-09-14T05:59:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138770+0000", 2024-09-14T05:59:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138770+0000", 2024-09-14T05:59:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9999999999999998e-07 2024-09-14T05:59:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138773+0000", 2024-09-14T05:59:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4820000000000001e-06 2024-09-14T05:59:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138781+0000", 2024-09-14T05:59:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.712e-06 2024-09-14T05:59:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138786+0000", 2024-09-14T05:59:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7270000000000004e-06 2024-09-14T05:59:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.221304+0000", 2024-09-14T05:59:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082517325000000002 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.221366+0000", 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1838e-05 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54844 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139774+0000", 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078618963, 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.081667607000000003, 2024-09-14T05:59:54.450 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54844 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139775+0000", 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3500000000000002e-07 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139777+0000", 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.979e-06 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139787+0000", 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0779e-05 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139799+0000", 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1719000000000001e-05 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54876 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155585+0000", 2024-09-14T05:59:54.453 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062807901999999999, 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.065883706, 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54876 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155585+0000", 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155585+0000", 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155586+0000", 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4700000000000002e-07 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155587+0000", 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7540000000000001e-06 2024-09-14T05:59:54.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155592+0000", 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4780000000000002e-06 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155595+0000", 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4410000000000002e-06 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.456 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54908 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.164052+0000", 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054341264, 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057447123000000003, 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54908 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.457 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164052+0000", 2024-09-14T05:59:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164052+0000", 2024-09-14T05:59:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164053+0000", 2024-09-14T05:59:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6599999999999995e-07 2024-09-14T05:59:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164062+0000", 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.329e-06 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164070+0000", 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1009999999999992e-06 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164077+0000", 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-06 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55122 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179545+0000", 2024-09-14T05:59:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038847688999999998, 2024-09-14T05:59:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.042070072, 2024-09-14T05:59:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55122 2024-09-14T05:59:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.460 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179545+0000", 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179545+0000", 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179546+0000", 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2300000000000001e-07 2024-09-14T05:59:54.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179549+0000", 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.824e-06 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179572+0000", 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2892e-05 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179578+0000", 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1990000000000003e-06 2024-09-14T05:59:54.462 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55154 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.188027+0000", 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030365626, 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033622935999999999, 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.463 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55154 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188027+0000", 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188027+0000", 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188028+0000", 2024-09-14T05:59:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9800000000000003e-07 2024-09-14T05:59:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188035+0000", 2024-09-14T05:59:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5610000000000004e-06 2024-09-14T05:59:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188042+0000", 2024-09-14T05:59:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8549999999999996e-06 2024-09-14T05:59:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188047+0000", 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4890000000000003e-06 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55370 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203789+0000", 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014604169, 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.017889958000000001, 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.466 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55370 2024-09-14T05:59:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203789+0000", 2024-09-14T05:59:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203789+0000", 2024-09-14T05:59:54.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203789+0000", 2024-09-14T05:59:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.65e-07 2024-09-14T05:59:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203790+0000", 2024-09-14T05:59:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.212e-06 2024-09-14T05:59:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203794+0000", 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1580000000000001e-06 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203796+0000", 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6290000000000002e-06 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55402 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.211587+0000", 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.006805775, 2024-09-14T05:59:54.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.010116740000000001, 2024-09-14T05:59:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55402 2024-09-14T05:59:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211587+0000", 2024-09-14T05:59:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211587+0000", 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211588+0000", 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.75e-07 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211591+0000", 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211597+0000", 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6869999999999997e-06 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211603+0000", 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6690000000000003e-06 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54630 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 94208~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.472 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.138796+0000", 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079597421000000002, 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082946087000000002, 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54630 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138796+0000", 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138796+0000", 2024-09-14T05:59:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138796+0000", 2024-09-14T05:59:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6199999999999998e-07 2024-09-14T05:59:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138798+0000", 2024-09-14T05:59:54.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1449999999999998e-06 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138805+0000", 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.392e-06 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138810+0000", 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1699999999999996e-06 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.221600+0000", 2024-09-14T05:59:54.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082789960999999995 2024-09-14T05:59:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.221646+0000", 2024-09-14T05:59:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5658000000000002e-05 2024-09-14T05:59:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54845 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139808+0000", 2024-09-14T05:59:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078585292000000001, 2024-09-14T05:59:54.476 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.081975274000000001, 2024-09-14T05:59:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54845 2024-09-14T05:59:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T05:59:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T05:59:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T05:59:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4899999999999995e-07 2024-09-14T05:59:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139811+0000", 2024-09-14T05:59:54.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000001e-06 2024-09-14T05:59:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139821+0000", 2024-09-14T05:59:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0168e-05 2024-09-14T05:59:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139826+0000", 2024-09-14T05:59:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2780000000000001e-06 2024-09-14T05:59:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54877 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155602+0000", 2024-09-14T05:59:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062790997000000001, 2024-09-14T05:59:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.066235441000000006, 2024-09-14T05:59:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54877 2024-09-14T05:59:54.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155602+0000", 2024-09-14T05:59:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155602+0000", 2024-09-14T05:59:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.481 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155603+0000", 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155610+0000", 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8469999999999996e-06 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155618+0000", 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.644e-06 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.482 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155632+0000", 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4034e-05 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54909 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.164088+0000", 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054305027999999998, 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057787770000000002, 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.483 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54909 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164088+0000", 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164088+0000", 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.484 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164089+0000", 2024-09-14T05:59:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4600000000000005e-07 2024-09-14T05:59:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164091+0000", 2024-09-14T05:59:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4770000000000002e-06 2024-09-14T05:59:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164099+0000", 2024-09-14T05:59:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9540000000000004e-06 2024-09-14T05:59:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.485 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164105+0000", 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55123 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179588+0000", 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038804896999999998, 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.042319092000000003, 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.486 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55123 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179588+0000", 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179588+0000", 2024-09-14T05:59:54.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179589+0000", 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8299999999999997e-07 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179592+0000", 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.892e-06 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179599+0000", 2024-09-14T05:59:54.488 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3239999999999997e-06 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179604+0000", 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3059999999999997e-06 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55155 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.188056+0000", 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030337385000000001, 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033901740999999999, 2024-09-14T05:59:54.489 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55155 2024-09-14T05:59:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188056+0000", 2024-09-14T05:59:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188056+0000", 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188056+0000", 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9699999999999996e-07 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188059+0000", 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6419999999999999e-06 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188066+0000", 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3669999999999999e-06 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188071+0000", 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1240000000000004e-06 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55371 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203800+0000", 2024-09-14T05:59:54.492 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014593467000000001, 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.018216178, 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55371 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203800+0000", 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203800+0000", 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203800+0000", 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5699999999999999e-07 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203801+0000", 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.186e-06 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.494 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203806+0000", 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3349999999999997e-06 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203809+0000", 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8040000000000002e-06 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55403 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.211637+0000", 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0067561499999999998, 2024-09-14T05:59:54.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.010418128, 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55403 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211637+0000", 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.496 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211637+0000", 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211637+0000", 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4799999999999999e-07 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211640+0000", 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5890000000000001e-06 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211645+0000", 2024-09-14T05:59:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1240000000000004e-06 2024-09-14T05:59:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211651+0000", 2024-09-14T05:59:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7729999999999996e-06 2024-09-14T05:59:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54631 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 100352~2048 out=2048b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.138817+0000", 2024-09-14T05:59:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079575815999999994, 2024-09-14T05:59:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083301, 2024-09-14T05:59:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54631 2024-09-14T05:59:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138817+0000", 2024-09-14T05:59:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138817+0000", 2024-09-14T05:59:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138818+0000", 2024-09-14T05:59:54.500 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2599999999999998e-07 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138820+0000", 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.091e-06 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138827+0000", 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8199999999999999e-06 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138832+0000", 2024-09-14T05:59:54.501 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.242e-06 2024-09-14T05:59:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.221880+0000", 2024-09-14T05:59:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083047714999999994 2024-09-14T05:59:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.221934+0000", 2024-09-14T05:59:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4184000000000002e-05 2024-09-14T05:59:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54846 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139834+0000", 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078558984999999998, 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082335153999999994, 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54846 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.503 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T05:59:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T05:59:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139835+0000", 2024-09-14T05:59:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T05:59:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139837+0000", 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1059999999999998e-06 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139845+0000", 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4300000000000006e-06 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139851+0000", 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.505 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54878 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155643+0000", 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062749904999999995, 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.066555934999999997, 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54878 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.506 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155643+0000", 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155643+0000", 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155644+0000", 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0800000000000004e-07 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155647+0000", 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.971e-06 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155655+0000", 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5790000000000004e-06 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155661+0000", 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.942e-06 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.508 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54910 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.164113+0000", 2024-09-14T05:59:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054279797999999997, 2024-09-14T05:59:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.058124527000000002, 2024-09-14T05:59:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.509 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54910 2024-09-14T05:59:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164113+0000", 2024-09-14T05:59:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.164113+0000", 2024-09-14T05:59:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166783+0000", 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0026695519999999999 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166789+0000", 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0769999999999996e-06 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166803+0000", 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3740999999999999e-05 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166811+0000", 2024-09-14T05:59:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.619e-06 2024-09-14T05:59:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55124 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179613+0000", 2024-09-14T05:59:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038780011000000003, 2024-09-14T05:59:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.042679966, 2024-09-14T05:59:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.512 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55124 2024-09-14T05:59:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179613+0000", 2024-09-14T05:59:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179613+0000", 2024-09-14T05:59:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179624+0000", 2024-09-14T05:59:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0597e-05 2024-09-14T05:59:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179627+0000", 2024-09-14T05:59:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0029999999999999e-06 2024-09-14T05:59:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179635+0000", 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3340000000000002e-06 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179641+0000", 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8069999999999996e-06 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55156 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.188079+0000", 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030313629000000002, 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034266366999999999, 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55156 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.516 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188079+0000", 2024-09-14T05:59:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188079+0000", 2024-09-14T05:59:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188080+0000", 2024-09-14T05:59:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6699999999999999e-07 2024-09-14T05:59:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188083+0000", 2024-09-14T05:59:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5790000000000002e-06 2024-09-14T05:59:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188090+0000", 2024-09-14T05:59:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.99e-06 2024-09-14T05:59:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188096+0000", 2024-09-14T05:59:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2190000000000001e-06 2024-09-14T05:59:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.518 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55372 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203813+0000", 2024-09-14T05:59:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014580179, 2024-09-14T05:59:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.018585550999999999, 2024-09-14T05:59:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.519 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55372 2024-09-14T05:59:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203813+0000", 2024-09-14T05:59:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203813+0000", 2024-09-14T05:59:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203813+0000", 2024-09-14T05:59:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6800000000000002e-07 2024-09-14T05:59:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203814+0000", 2024-09-14T05:59:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2580000000000001e-06 2024-09-14T05:59:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203818+0000", 2024-09-14T05:59:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9960000000000004e-06 2024-09-14T05:59:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203821+0000", 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6469999999999998e-06 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55404 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.211659+0000", 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0067344040000000003, 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.01079345, 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.522 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55404 2024-09-14T05:59:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211659+0000", 2024-09-14T05:59:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.523 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211659+0000", 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211659+0000", 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7399999999999998e-07 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211662+0000", 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9000000000000002e-06 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211671+0000", 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5860000000000005e-06 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211677+0000", 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4520000000000002e-06 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54847 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139860+0000", 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078533269000000003, 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082648053999999999, 2024-09-14T05:59:54.525 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54847 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.526 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139862+0000", 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0200000000000001e-06 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139870+0000", 2024-09-14T05:59:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0520000000000002e-06 2024-09-14T05:59:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139875+0000", 2024-09-14T05:59:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T05:59:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54879 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.528 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155672+0000", 2024-09-14T05:59:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062721526999999999, 2024-09-14T05:59:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.066880011000000003, 2024-09-14T05:59:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54879 2024-09-14T05:59:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.529 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155672+0000", 2024-09-14T05:59:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155672+0000", 2024-09-14T05:59:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155672+0000", 2024-09-14T05:59:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3e-07 2024-09-14T05:59:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155675+0000", 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6599999999999999e-06 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155683+0000", 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8129999999999996e-06 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155691+0000", 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9880000000000004e-06 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.531 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54911 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.166828+0000", 2024-09-14T05:59:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.051565336000000003, 2024-09-14T05:59:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.055755921, 2024-09-14T05:59:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.532 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54911 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166828+0000", 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166828+0000", 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166828+0000", 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6100000000000001e-07 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166832+0000", 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.326e-06 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166840+0000", 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4689999999999997e-06 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166847+0000", 2024-09-14T05:59:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.46e-06 2024-09-14T05:59:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55125 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179650+0000", 2024-09-14T05:59:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038742884999999998, 2024-09-14T05:59:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.042961643000000001, 2024-09-14T05:59:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.535 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55125 2024-09-14T05:59:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179650+0000", 2024-09-14T05:59:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179650+0000", 2024-09-14T05:59:54.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179651+0000", 2024-09-14T05:59:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.27e-07 2024-09-14T05:59:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179653+0000", 2024-09-14T05:59:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.48e-06 2024-09-14T05:59:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179666+0000", 2024-09-14T05:59:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2366e-05 2024-09-14T05:59:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179671+0000", 2024-09-14T05:59:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3399999999999997e-06 2024-09-14T05:59:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55157 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.188104+0000", 2024-09-14T05:59:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030289120999999999, 2024-09-14T05:59:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034541813999999997, 2024-09-14T05:59:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55157 2024-09-14T05:59:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188104+0000", 2024-09-14T05:59:54.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188104+0000", 2024-09-14T05:59:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188104+0000", 2024-09-14T05:59:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.01e-07 2024-09-14T05:59:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188107+0000", 2024-09-14T05:59:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2589999999999999e-06 2024-09-14T05:59:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188113+0000", 2024-09-14T05:59:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8090000000000004e-06 2024-09-14T05:59:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188118+0000", 2024-09-14T05:59:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9810000000000003e-06 2024-09-14T05:59:54.541 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55373 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203825+0000", 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014568516, 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.018871083, 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.542 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55373 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203825+0000", 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203825+0000", 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203825+0000", 2024-09-14T05:59:54.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5400000000000002e-07 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203826+0000", 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.26e-06 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203830+0000", 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2939999999999999e-06 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203833+0000", 2024-09-14T05:59:54.544 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7410000000000001e-06 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55405 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.211688+0000", 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0067051130000000004, 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.01105622, 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.545 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55405 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211688+0000", 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211688+0000", 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211688+0000", 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3999999999999997e-07 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211690+0000", 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.818e-06 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211696+0000", 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6500000000000001e-06 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211699+0000", 2024-09-14T05:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.016e-06 2024-09-14T05:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54848 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139883+0000", 2024-09-14T05:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078510173000000003, 2024-09-14T05:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.082920115000000003, 2024-09-14T05:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54848 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139885+0000", 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9929999999999998e-06 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139893+0000", 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9759999999999995e-06 2024-09-14T05:59:54.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139898+0000", 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6059999999999996e-06 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54880 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155700+0000", 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062692805000000004, 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.067156214000000006, 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.551 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54880 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155700+0000", 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155700+0000", 2024-09-14T05:59:54.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155701+0000", 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0500000000000003e-07 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155704+0000", 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6400000000000001e-06 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155711+0000", 2024-09-14T05:59:54.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9009999999999994e-06 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155729+0000", 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7190999999999999e-05 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54912 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.166863+0000", 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.051530225999999998, 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.056052506000000002, 2024-09-14T05:59:54.554 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54912 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166863+0000", 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166863+0000", 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166864+0000", 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4000000000000001e-07 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166866+0000", 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6850000000000001e-06 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166877+0000", 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0589e-05 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166883+0000", 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.579e-06 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55126 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179679+0000", 2024-09-14T05:59:54.557 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038714159999999997, 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.043284808000000001, 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55126 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179679+0000", 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179679+0000", 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179679+0000", 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9100000000000004e-07 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179682+0000", 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7209999999999999e-06 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179691+0000", 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4910000000000005e-06 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179696+0000", 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1930000000000001e-06 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55158 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.560 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.188126+0000", 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030267507999999999, 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034892322000000003, 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55158 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188126+0000", 2024-09-14T05:59:54.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188126+0000", 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188637+0000", 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00051182799999999998 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188644+0000", 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.212e-06 2024-09-14T05:59:54.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188655+0000", 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1683e-05 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188670+0000", 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4593000000000001e-05 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.563 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55374 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203837+0000", 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014556611000000001, 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.019223951999999999, 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55374 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203837+0000", 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203837+0000", 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203837+0000", 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4499999999999998e-07 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203842+0000", 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7039999999999999e-06 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203846+0000", 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.709e-06 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203849+0000", 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8159999999999998e-06 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55406 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.211703+0000", 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0066898950000000004, 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.011386438, 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55406 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211703+0000", 2024-09-14T05:59:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211703+0000", 2024-09-14T05:59:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211704+0000", 2024-09-14T05:59:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:59:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211705+0000", 2024-09-14T05:59:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2950000000000001e-06 2024-09-14T05:59:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211708+0000", 2024-09-14T05:59:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.095e-06 2024-09-14T05:59:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211711+0000", 2024-09-14T05:59:54.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7039999999999999e-06 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54849 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139906+0000", 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078486716999999998, 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083238156999999993, 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.570 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54849 2024-09-14T05:59:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T05:59:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T05:59:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139907+0000", 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139909+0000", 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139916+0000", 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139921+0000", 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54881 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155742+0000", 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062651001999999997, 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.067453244999999995, 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54881 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155742+0000", 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155742+0000", 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155743+0000", 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3300000000000002e-07 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155746+0000", 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2200000000000001e-06 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155756+0000", 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6679999999999996e-06 2024-09-14T05:59:54.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155762+0000", 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1029999999999998e-06 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54913 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.166903+0000", 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.051490503999999999, 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.056324082999999997, 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.576 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54913 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166903+0000", 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166903+0000", 2024-09-14T05:59:54.577 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166903+0000", 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2799999999999996e-07 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166911+0000", 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6510000000000001e-06 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166921+0000", 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0254e-05 2024-09-14T05:59:54.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166928+0000", 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8469999999999998e-06 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55127 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179705+0000", 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038687633999999999, 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.043546043, 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.579 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55127 2024-09-14T05:59:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179705+0000", 2024-09-14T05:59:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179705+0000", 2024-09-14T05:59:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179706+0000", 2024-09-14T05:59:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7199999999999999e-07 2024-09-14T05:59:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179708+0000", 2024-09-14T05:59:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3360000000000002e-06 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179717+0000", 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3040000000000005e-06 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179723+0000", 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8850000000000001e-06 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55159 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.188685+0000", 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.029707972999999999, 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034593125000000002, 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55159 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188685+0000", 2024-09-14T05:59:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188685+0000", 2024-09-14T05:59:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188686+0000", 2024-09-14T05:59:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9800000000000003e-07 2024-09-14T05:59:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188689+0000", 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.004e-06 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188698+0000", 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5440000000000004e-06 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188705+0000", 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4300000000000003e-06 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55375 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203853+0000", 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014540119000000001, 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.019450154000000001, 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55375 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203853+0000", 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203853+0000", 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203853+0000", 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0499999999999999e-07 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203855+0000", 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.325e-06 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203860+0000", 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.852e-06 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203866+0000", 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4310000000000002e-06 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55407 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.211715+0000", 2024-09-14T05:59:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0066785560000000004, 2024-09-14T05:59:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.011614474, 2024-09-14T05:59:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55407 2024-09-14T05:59:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211715+0000", 2024-09-14T05:59:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.211715+0000", 2024-09-14T05:59:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.590 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219522+0000", 2024-09-14T05:59:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0078073250000000004 2024-09-14T05:59:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219529+0000", 2024-09-14T05:59:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0260000000000002e-06 2024-09-14T05:59:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219542+0000", 2024-09-14T05:59:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3501e-05 2024-09-14T05:59:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219551+0000", 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2679999999999994e-06 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54635 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 174080~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.138919+0000", 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079474330999999995, 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084451802000000006, 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.592 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54635 2024-09-14T05:59:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138919+0000", 2024-09-14T05:59:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138919+0000", 2024-09-14T05:59:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138919+0000", 2024-09-14T05:59:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T05:59:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138928+0000", 2024-09-14T05:59:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2900000000000002e-06 2024-09-14T05:59:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138937+0000", 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1179999999999998e-06 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138943+0000", 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8830000000000003e-06 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.223144+0000", 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084201684999999998 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:54.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.223214+0000", 2024-09-14T05:59:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9352999999999998e-05 2024-09-14T05:59:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54850 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139928+0000", 2024-09-14T05:59:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078465009000000002, 2024-09-14T05:59:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083518215000000007, 2024-09-14T05:59:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54850 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139929+0000", 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139931+0000", 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.024e-06 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139937+0000", 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3770000000000001e-06 2024-09-14T05:59:54.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139942+0000", 2024-09-14T05:59:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0289999999999996e-06 2024-09-14T05:59:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54882 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155772+0000", 2024-09-14T05:59:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062620863999999998, 2024-09-14T05:59:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.067715541000000004, 2024-09-14T05:59:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54882 2024-09-14T05:59:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155772+0000", 2024-09-14T05:59:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155772+0000", 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155773+0000", 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4099999999999999e-07 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155775+0000", 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6000000000000001e-06 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155786+0000", 2024-09-14T05:59:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0992000000000001e-05 2024-09-14T05:59:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155793+0000", 2024-09-14T05:59:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9700000000000002e-06 2024-09-14T05:59:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.602 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54914 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.166938+0000", 2024-09-14T05:59:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.051454812000000003, 2024-09-14T05:59:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.056582486000000001, 2024-09-14T05:59:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54914 2024-09-14T05:59:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.603 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166938+0000", 2024-09-14T05:59:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166938+0000", 2024-09-14T05:59:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166939+0000", 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8599999999999998e-07 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166942+0000", 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6740000000000001e-06 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166956+0000", 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4489e-05 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166963+0000", 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4470000000000003e-06 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55128 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179733+0000", 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038659724999999999, 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.043815451999999998, 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.606 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55128 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179733+0000", 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179733+0000", 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179734+0000", 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7800000000000002e-07 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179736+0000", 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.418e-06 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179744+0000", 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8140000000000001e-06 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179749+0000", 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2920000000000003e-06 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55160 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.188720+0000", 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.029672883000000001, 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034858465999999998, 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.609 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55160 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188720+0000", 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188720+0000", 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.188997+0000", 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000276586 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189001+0000", 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9580000000000001e-06 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189011+0000", 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0062e-05 2024-09-14T05:59:54.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189016+0000", 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8919999999999999e-06 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55376 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203873+0000", 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014519861, 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.019732385000000002, 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.612 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55376 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203873+0000", 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203873+0000", 2024-09-14T05:59:54.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203874+0000", 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.39e-07 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203876+0000", 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3070000000000001e-06 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203881+0000", 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3890000000000004e-06 2024-09-14T05:59:54.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203884+0000", 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8660000000000002e-06 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55408 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219566+0000", 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.998827, 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0040676669999999996, 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.615 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55408 2024-09-14T05:59:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219566+0000", 2024-09-14T05:59:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219566+0000", 2024-09-14T05:59:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219567+0000", 2024-09-14T05:59:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0900000000000001e-07 2024-09-14T05:59:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219569+0000", 2024-09-14T05:59:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.729e-06 2024-09-14T05:59:54.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219576+0000", 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3790000000000003e-06 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219581+0000", 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9690000000000002e-06 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.618 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54636 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 180224~2048 out=2048b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.138951+0000", 2024-09-14T05:59:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079441962000000005, 2024-09-14T05:59:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084720868000000005, 2024-09-14T05:59:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54636 2024-09-14T05:59:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138951+0000", 2024-09-14T05:59:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138951+0000", 2024-09-14T05:59:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138952+0000", 2024-09-14T05:59:54.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3499999999999996e-07 2024-09-14T05:59:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138954+0000", 2024-09-14T05:59:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.418e-06 2024-09-14T05:59:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138961+0000", 2024-09-14T05:59:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4779999999999996e-06 2024-09-14T05:59:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138966+0000", 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1089999999999997e-06 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.223495+0000", 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084529293000000005 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.223553+0000", 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7701000000000002e-05 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54851 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139950+0000", 2024-09-14T05:59:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078443296999999995, 2024-09-14T05:59:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.083776093999999995, 2024-09-14T05:59:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54851 2024-09-14T05:59:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.623 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T05:59:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T05:59:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T05:59:54.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T05:59:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139952+0000", 2024-09-14T05:59:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0600000000000002e-06 2024-09-14T05:59:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139959+0000", 2024-09-14T05:59:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.584e-06 2024-09-14T05:59:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139964+0000", 2024-09-14T05:59:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8890000000000001e-06 2024-09-14T05:59:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54883 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155803+0000", 2024-09-14T05:59:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062589663000000004, 2024-09-14T05:59:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.067974032000000004, 2024-09-14T05:59:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.626 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54883 2024-09-14T05:59:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155803+0000", 2024-09-14T05:59:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155803+0000", 2024-09-14T05:59:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155804+0000", 2024-09-14T05:59:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7100000000000002e-07 2024-09-14T05:59:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155807+0000", 2024-09-14T05:59:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7829999999999999e-06 2024-09-14T05:59:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155815+0000", 2024-09-14T05:59:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1680000000000004e-06 2024-09-14T05:59:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155821+0000", 2024-09-14T05:59:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6509999999999998e-06 2024-09-14T05:59:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54915 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.166972+0000", 2024-09-14T05:59:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.051421100999999997, 2024-09-14T05:59:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.056862592000000003, 2024-09-14T05:59:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54915 2024-09-14T05:59:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.630 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166972+0000", 2024-09-14T05:59:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166972+0000", 2024-09-14T05:59:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166973+0000", 2024-09-14T05:59:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9900000000000001e-07 2024-09-14T05:59:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166975+0000", 2024-09-14T05:59:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8219999999999998e-06 2024-09-14T05:59:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166983+0000", 2024-09-14T05:59:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3409999999999997e-06 2024-09-14T05:59:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.166988+0000", 2024-09-14T05:59:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3499999999999996e-06 2024-09-14T05:59:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55129 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179759+0000", 2024-09-14T05:59:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038634234000000003, 2024-09-14T05:59:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.044126158999999998, 2024-09-14T05:59:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.633 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55129 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179759+0000", 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179759+0000", 2024-09-14T05:59:54.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179759+0000", 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4499999999999997e-07 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179762+0000", 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3e-06 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179770+0000", 2024-09-14T05:59:54.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9670000000000001e-06 2024-09-14T05:59:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179775+0000", 2024-09-14T05:59:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3410000000000002e-06 2024-09-14T05:59:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55161 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.189030+0000", 2024-09-14T05:59:54.636 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.029362890999999999, 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034886001999999999, 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55161 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189030+0000", 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189030+0000", 2024-09-14T05:59:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189346+0000", 2024-09-14T05:59:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00031567599999999998 2024-09-14T05:59:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189350+0000", 2024-09-14T05:59:54.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5449999999999997e-06 2024-09-14T05:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189360+0000", 2024-09-14T05:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0003000000000001e-05 2024-09-14T05:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189369+0000", 2024-09-14T05:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3100000000000001e-06 2024-09-14T05:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55377 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203889+0000", 2024-09-14T05:59:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014504344000000001, 2024-09-14T05:59:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.020057234, 2024-09-14T05:59:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55377 2024-09-14T05:59:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.640 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203889+0000", 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203889+0000", 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203889+0000", 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9700000000000003e-07 2024-09-14T05:59:54.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203890+0000", 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2929999999999999e-06 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203895+0000", 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1980000000000003e-06 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203897+0000", 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7329999999999999e-06 2024-09-14T05:59:54.642 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55409 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219588+0000", 2024-09-14T05:59:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.998805, 2024-09-14T05:59:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044058159999999999, 2024-09-14T05:59:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.643 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55409 2024-09-14T05:59:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219588+0000", 2024-09-14T05:59:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219588+0000", 2024-09-14T05:59:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219589+0000", 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1300000000000001e-07 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219591+0000", 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1119999999999999e-06 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219597+0000", 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8040000000000004e-06 2024-09-14T05:59:54.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219603+0000", 2024-09-14T05:59:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1290000000000004e-06 2024-09-14T05:59:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54637 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 235520~2048 out=2048b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.138973+0000", 2024-09-14T05:59:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079419851999999999, 2024-09-14T05:59:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085072066000000002, 2024-09-14T05:59:54.646 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54637 2024-09-14T05:59:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138973+0000", 2024-09-14T05:59:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138973+0000", 2024-09-14T05:59:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138974+0000", 2024-09-14T05:59:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6599999999999996e-07 2024-09-14T05:59:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138983+0000", 2024-09-14T05:59:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5860000000000005e-06 2024-09-14T05:59:54.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138989+0000", 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9569999999999996e-06 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.138995+0000", 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4879999999999998e-06 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.223722+0000", 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084727123000000001 2024-09-14T05:59:54.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.223812+0000", 2024-09-14T05:59:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0249999999999998e-05 2024-09-14T05:59:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.224045+0000", 2024-09-14T05:59:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023299599999999999 2024-09-14T05:59:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54852 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139971+0000", 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078422169, 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084137271, 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54852 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140125+0000", 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154332 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140130+0000", 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.284e-06 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140140+0000", 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0789e-05 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140147+0000", 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9879999999999998e-06 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54884 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155830+0000", 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062562777, 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.068324958000000005, 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54884 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.654 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155830+0000", 2024-09-14T05:59:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155830+0000", 2024-09-14T05:59:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155831+0000", 2024-09-14T05:59:54.655 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0800000000000004e-07 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155834+0000", 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4609999999999998e-06 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155841+0000", 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6680000000000001e-06 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155849+0000", 2024-09-14T05:59:54.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6190000000000002e-06 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54916 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.167003+0000", 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.051390544000000003, 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057214862999999998, 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.657 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54916 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167003+0000", 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167003+0000", 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167003+0000", 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.34e-07 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167006+0000", 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.525e-06 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167014+0000", 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5809999999999997e-06 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.659 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167020+0000", 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9329999999999998e-06 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55130 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179783+0000", 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038609989999999997, 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.044483364999999997, 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.660 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55130 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179783+0000", 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179783+0000", 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179784+0000", 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4400000000000001e-07 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179786+0000", 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3360000000000002e-06 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179793+0000", 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6329999999999999e-06 2024-09-14T05:59:54.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179798+0000", 2024-09-14T05:59:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5249999999999996e-06 2024-09-14T05:59:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55162 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.189382+0000", 2024-09-14T05:59:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.029010940999999998, 2024-09-14T05:59:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034918531000000003, 2024-09-14T05:59:54.663 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55162 2024-09-14T05:59:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189382+0000", 2024-09-14T05:59:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189382+0000", 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189662+0000", 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028004100000000002 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189668+0000", 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6500000000000001e-06 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189676+0000", 2024-09-14T05:59:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2470000000000008e-06 2024-09-14T05:59:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189681+0000", 2024-09-14T05:59:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0459999999999996e-06 2024-09-14T05:59:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.666 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55378 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203901+0000", 2024-09-14T05:59:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014492245000000001, 2024-09-14T05:59:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.020436498000000001, 2024-09-14T05:59:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55378 2024-09-14T05:59:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203901+0000", 2024-09-14T05:59:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203901+0000", 2024-09-14T05:59:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203901+0000", 2024-09-14T05:59:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3799999999999999e-07 2024-09-14T05:59:54.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203902+0000", 2024-09-14T05:59:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.161e-06 2024-09-14T05:59:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203905+0000", 2024-09-14T05:59:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1879999999999998e-06 2024-09-14T05:59:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203908+0000", 2024-09-14T05:59:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9110000000000002e-06 2024-09-14T05:59:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55410 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219610+0000", 2024-09-14T05:59:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9987836, 2024-09-14T05:59:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004781268, 2024-09-14T05:59:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.670 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55410 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219610+0000", 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219610+0000", 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219610+0000", 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4999999999999998e-07 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219619+0000", 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6090000000000001e-06 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219623+0000", 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4329999999999997e-06 2024-09-14T05:59:54.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219627+0000", 2024-09-14T05:59:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5020000000000001e-06 2024-09-14T05:59:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54853 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.140160+0000", 2024-09-14T05:59:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078233346999999995, 2024-09-14T05:59:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084290718000000001, 2024-09-14T05:59:54.673 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54853 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.674 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147748+0000", 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075884910000000002 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147798+0000", 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0152999999999999e-05 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.675 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147814+0000", 2024-09-14T05:59:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5866e-05 2024-09-14T05:59:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147831+0000", 2024-09-14T05:59:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6991999999999999e-05 2024-09-14T05:59:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54885 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155860+0000", 2024-09-14T05:59:54.676 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062533297000000002, 2024-09-14T05:59:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.068645395999999997, 2024-09-14T05:59:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54885 2024-09-14T05:59:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155860+0000", 2024-09-14T05:59:54.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155860+0000", 2024-09-14T05:59:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155860+0000", 2024-09-14T05:59:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7899999999999999e-07 2024-09-14T05:59:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155863+0000", 2024-09-14T05:59:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7750000000000001e-06 2024-09-14T05:59:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155873+0000", 2024-09-14T05:59:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4450000000000002e-06 2024-09-14T05:59:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155879+0000", 2024-09-14T05:59:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3570000000000003e-06 2024-09-14T05:59:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.679 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55099 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.167029+0000", 2024-09-14T05:59:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.051364118, 2024-09-14T05:59:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057675213000000003, 2024-09-14T05:59:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55099 2024-09-14T05:59:54.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167029+0000", 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167029+0000", 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167030+0000", 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9900000000000001e-07 2024-09-14T05:59:54.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167032+0000", 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7709999999999998e-06 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167039+0000", 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8560000000000001e-06 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167044+0000", 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2059999999999998e-06 2024-09-14T05:59:54.682 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55131 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179806+0000", 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038586782999999999, 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.044937803999999998, 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55131 2024-09-14T05:59:54.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179806+0000", 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179806+0000", 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179807+0000", 2024-09-14T05:59:54.684 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179817+0000", 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0397000000000001e-05 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179825+0000", 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4660000000000002e-06 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179830+0000", 2024-09-14T05:59:54.685 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4040000000000003e-06 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55163 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.189691+0000", 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.028701752000000001, 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.035111321000000001, 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.686 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55163 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189691+0000", 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.189691+0000", 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190047+0000", 2024-09-14T05:59:54.687 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00035598900000000002 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190053+0000", 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.536e-06 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190065+0000", 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2534999999999999e-05 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190076+0000", 2024-09-14T05:59:54.688 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0407e-05 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55379 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203913+0000", 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014480537999999999, 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.020931096999999999, 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.689 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55379 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203913+0000", 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203913+0000", 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.690 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203913+0000", 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7500000000000001e-07 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203914+0000", 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.251e-06 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203917+0000", 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.151e-06 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203920+0000", 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5569999999999998e-06 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55411 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219632+0000", 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9987612, 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0052677430000000001, 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.692 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55411 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219632+0000", 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219632+0000", 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.693 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219632+0000", 2024-09-14T05:59:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2500000000000001e-07 2024-09-14T05:59:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219633+0000", 2024-09-14T05:59:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.381e-06 2024-09-14T05:59:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219637+0000", 2024-09-14T05:59:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4350000000000001e-06 2024-09-14T05:59:54.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219640+0000", 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7860000000000001e-06 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54854 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.147855+0000", 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070538339000000005, 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.077078346000000006, 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.695 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54854 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147855+0000", 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.696 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147855+0000", 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147856+0000", 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2099999999999996e-07 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147860+0000", 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3880000000000002e-06 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.697 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147870+0000", 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6220000000000004e-06 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147877+0000", 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5979999999999999e-06 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54886 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155886+0000", 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062506718000000003, 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.069096129000000006, 2024-09-14T05:59:54.698 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54886 2024-09-14T05:59:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155886+0000", 2024-09-14T05:59:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.699 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155886+0000", 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155887+0000", 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3099999999999999e-07 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155895+0000", 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3809999999999999e-06 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155900+0000", 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8230000000000002e-06 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155903+0000", 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3569999999999998e-06 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55100 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.701 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.167053+0000", 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.051340548999999999, 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057984418000000003, 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55100 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167053+0000", 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167053+0000", 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167319+0000", 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000266877 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167324+0000", 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5120000000000002e-06 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167336+0000", 2024-09-14T05:59:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2028000000000001e-05 2024-09-14T05:59:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167344+0000", 2024-09-14T05:59:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8820000000000001e-06 2024-09-14T05:59:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.704 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55132 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179839+0000", 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038553998999999999, 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045259114000000003, 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55132 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.705 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179839+0000", 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179839+0000", 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179840+0000", 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.63e-07 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179842+0000", 2024-09-14T05:59:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4870000000000001e-06 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179849+0000", 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.793e-06 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179854+0000", 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.305e-06 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.707 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55164 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.190090+0000", 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.028303411000000001, 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.035053204999999997, 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55164 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190090+0000", 2024-09-14T05:59:54.708 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190090+0000", 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190441+0000", 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00035122300000000001 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190446+0000", 2024-09-14T05:59:54.709 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2159999999999997e-06 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190454+0000", 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1869999999999997e-06 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190460+0000", 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55380 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203923+0000", 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014469965, 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.021274194, 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55380 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.711 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203923+0000", 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203923+0000", 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203923+0000", 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6e-07 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.712 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203925+0000", 2024-09-14T05:59:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.15e-06 2024-09-14T05:59:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203928+0000", 2024-09-14T05:59:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0170000000000001e-06 2024-09-14T05:59:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203930+0000", 2024-09-14T05:59:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.621e-06 2024-09-14T05:59:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.713 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55412 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219644+0000", 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9987497, 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.005586199, 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55412 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219644+0000", 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219644+0000", 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219644+0000", 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3200000000000001e-07 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.715 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219645+0000", 2024-09-14T05:59:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2330000000000001e-06 2024-09-14T05:59:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219648+0000", 2024-09-14T05:59:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.039e-06 2024-09-14T05:59:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219651+0000", 2024-09-14T05:59:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6709999999999999e-06 2024-09-14T05:59:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.716 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54855 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.147888+0000", 2024-09-14T05:59:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070504768999999995, 2024-09-14T05:59:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.077370006000000005, 2024-09-14T05:59:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.717 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54855 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147888+0000", 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147888+0000", 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.718 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147889+0000", 2024-09-14T05:59:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7100000000000002e-07 2024-09-14T05:59:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147891+0000", 2024-09-14T05:59:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5339999999999998e-06 2024-09-14T05:59:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147900+0000", 2024-09-14T05:59:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2330000000000006e-06 2024-09-14T05:59:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.719 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147906+0000", 2024-09-14T05:59:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1670000000000004e-06 2024-09-14T05:59:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54887 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155908+0000", 2024-09-14T05:59:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062484812000000001, 2024-09-14T05:59:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.069402857999999998, 2024-09-14T05:59:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.720 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54887 2024-09-14T05:59:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155908+0000", 2024-09-14T05:59:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155908+0000", 2024-09-14T05:59:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155909+0000", 2024-09-14T05:59:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6199999999999999e-07 2024-09-14T05:59:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155910+0000", 2024-09-14T05:59:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5039999999999999e-06 2024-09-14T05:59:54.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155914+0000", 2024-09-14T05:59:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:59:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155917+0000", 2024-09-14T05:59:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.954e-06 2024-09-14T05:59:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55101 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.167357+0000", 2024-09-14T05:59:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.051035670999999998, 2024-09-14T05:59:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.058004284000000003, 2024-09-14T05:59:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55101 2024-09-14T05:59:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167357+0000", 2024-09-14T05:59:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167357+0000", 2024-09-14T05:59:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167766+0000", 2024-09-14T05:59:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00040830700000000001 2024-09-14T05:59:54.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167771+0000", 2024-09-14T05:59:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.699e-06 2024-09-14T05:59:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167786+0000", 2024-09-14T05:59:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4146e-05 2024-09-14T05:59:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167795+0000", 2024-09-14T05:59:54.726 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4490000000000005e-06 2024-09-14T05:59:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55133 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179863+0000", 2024-09-14T05:59:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038529902999999997, 2024-09-14T05:59:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045558153999999997, 2024-09-14T05:59:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.727 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55133 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179863+0000", 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179863+0000", 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.728 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179864+0000", 2024-09-14T05:59:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9200000000000001e-07 2024-09-14T05:59:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179867+0000", 2024-09-14T05:59:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7080000000000002e-06 2024-09-14T05:59:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179873+0000", 2024-09-14T05:59:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9759999999999998e-06 2024-09-14T05:59:54.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179879+0000", 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4049999999999999e-06 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55165 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.190470+0000", 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.027923, 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034997779, 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.730 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55165 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190470+0000", 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190470+0000", 2024-09-14T05:59:54.731 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190774+0000", 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030437999999999998 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190780+0000", 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1959999999999999e-06 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190792+0000", 2024-09-14T05:59:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1967000000000001e-05 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190803+0000", 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0869e-05 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55381 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203936+0000", 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014457194, 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.021589183000000001, 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55381 2024-09-14T05:59:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203936+0000", 2024-09-14T05:59:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203936+0000", 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203936+0000", 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2300000000000002e-07 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203939+0000", 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3439999999999999e-06 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203946+0000", 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8050000000000007e-06 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203951+0000", 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.865e-06 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55413 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219655+0000", 2024-09-14T05:59:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9987383, 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0059248340000000004, 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55413 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219655+0000", 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219655+0000", 2024-09-14T05:59:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219655+0000", 2024-09-14T05:59:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.41e-07 2024-09-14T05:59:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219656+0000", 2024-09-14T05:59:54.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4750000000000001e-06 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219659+0000", 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1410000000000001e-06 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219662+0000", 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.571e-06 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54856 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.147915+0000", 2024-09-14T05:59:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070478078, 2024-09-14T05:59:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.077720673000000004, 2024-09-14T05:59:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54856 2024-09-14T05:59:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147915+0000", 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147915+0000", 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147916+0000", 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9800000000000004e-07 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147918+0000", 2024-09-14T05:59:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3740000000000001e-06 2024-09-14T05:59:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147927+0000", 2024-09-14T05:59:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0869999999999996e-06 2024-09-14T05:59:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147933+0000", 2024-09-14T05:59:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8340000000000004e-06 2024-09-14T05:59:54.742 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54888 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155921+0000", 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062472160999999998, 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.069752843999999994, 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.743 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54888 2024-09-14T05:59:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T05:59:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T05:59:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T05:59:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8299999999999998e-07 2024-09-14T05:59:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155923+0000", 2024-09-14T05:59:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4720000000000001e-06 2024-09-14T05:59:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155926+0000", 2024-09-14T05:59:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.444e-06 2024-09-14T05:59:54.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155929+0000", 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7970000000000001e-06 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55102 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.167809+0000", 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.050583755000000001, 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057893884999999999, 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.746 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55102 2024-09-14T05:59:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167809+0000", 2024-09-14T05:59:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.167809+0000", 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168094+0000", 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028504700000000002 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168098+0000", 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0269999999999997e-06 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168107+0000", 2024-09-14T05:59:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5730000000000008e-06 2024-09-14T05:59:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168112+0000", 2024-09-14T05:59:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9679999999999997e-06 2024-09-14T05:59:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.749 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55134 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179902+0000", 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038491216000000002, 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045835460000000001, 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55134 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179902+0000", 2024-09-14T05:59:54.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179902+0000", 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179902+0000", 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5899999999999996e-07 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179906+0000", 2024-09-14T05:59:54.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2219999999999998e-06 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179915+0000", 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1290000000000002e-06 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179921+0000", 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8030000000000002e-06 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55166 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.190820+0000", 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.02757341, 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034948044999999997, 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55166 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.753 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190820+0000", 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.190820+0000", 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191110+0000", 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029058000000000003 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.754 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191120+0000", 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0195e-05 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191130+0000", 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3270000000000007e-06 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191137+0000", 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2579999999999998e-06 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55382 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203959+0000", 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014433708, 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.021833734, 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55382 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203959+0000", 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203959+0000", 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203960+0000", 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0699999999999997e-07 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203963+0000", 2024-09-14T05:59:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6390000000000001e-06 2024-09-14T05:59:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203971+0000", 2024-09-14T05:59:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5369999999999997e-06 2024-09-14T05:59:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203976+0000", 2024-09-14T05:59:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1590000000000001e-06 2024-09-14T05:59:54.758 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55414 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219667+0000", 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9987259, 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0061530789999999997, 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55414 2024-09-14T05:59:54.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219667+0000", 2024-09-14T05:59:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219667+0000", 2024-09-14T05:59:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219668+0000", 2024-09-14T05:59:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8099999999999998e-07 2024-09-14T05:59:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219670+0000", 2024-09-14T05:59:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4789999999999999e-06 2024-09-14T05:59:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219677+0000", 2024-09-14T05:59:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3199999999999996e-06 2024-09-14T05:59:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219682+0000", 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.916e-06 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54857 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.147942+0000", 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070451569000000006, 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.077914606999999997, 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.762 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54857 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147942+0000", 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147942+0000", 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147942+0000", 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5600000000000001e-07 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147944+0000", 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.385e-06 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147984+0000", 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9533000000000002e-05 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147991+0000", 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3220000000000004e-06 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54889 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155934+0000", 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.062459560999999997, 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.069965286000000002, 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.765 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54889 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163444+0000", 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00751033 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163454+0000", 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0579e-05 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163468+0000", 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3794999999999999e-05 2024-09-14T05:59:54.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163487+0000", 2024-09-14T05:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8907999999999999e-05 2024-09-14T05:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55103 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.168122+0000", 2024-09-14T05:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.050271044000000001, 2024-09-14T05:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057803826000000003, 2024-09-14T05:59:54.768 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55103 2024-09-14T05:59:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168122+0000", 2024-09-14T05:59:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168122+0000", 2024-09-14T05:59:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168467+0000", 2024-09-14T05:59:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00034480999999999997 2024-09-14T05:59:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168472+0000", 2024-09-14T05:59:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.49e-06 2024-09-14T05:59:54.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168487+0000", 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.504e-05 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168503+0000", 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5167999999999999e-05 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55135 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.771 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179931+0000", 2024-09-14T05:59:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038462517000000002, 2024-09-14T05:59:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046022689999999998, 2024-09-14T05:59:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55135 2024-09-14T05:59:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.772 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179931+0000", 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179931+0000", 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179931+0000", 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2500000000000005e-07 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179934+0000", 2024-09-14T05:59:54.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6139999999999999e-06 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179941+0000", 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0369999999999997e-06 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179946+0000", 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9350000000000002e-06 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.774 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55167 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.191151+0000", 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.027241812000000001, 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034845699000000001, 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55167 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.775 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191151+0000", 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191151+0000", 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191401+0000", 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024951999999999998 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.776 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191406+0000", 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.775e-06 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191423+0000", 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7113e-05 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191429+0000", 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6579999999999996e-06 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55383 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.203985+0000", 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014408607, 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022057070000000002, 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55383 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203985+0000", 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203985+0000", 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203985+0000", 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3799999999999998e-07 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.779 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203986+0000", 2024-09-14T05:59:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.593e-06 2024-09-14T05:59:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203991+0000", 2024-09-14T05:59:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.758e-06 2024-09-14T05:59:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.203995+0000", 2024-09-14T05:59:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2339999999999996e-06 2024-09-14T05:59:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.780 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55415 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219690+0000", 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.998703, 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0063913060000000002, 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55415 2024-09-14T05:59:54.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219690+0000", 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219690+0000", 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219690+0000", 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8599999999999998e-07 2024-09-14T05:59:54.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219693+0000", 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4269999999999998e-06 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219699+0000", 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5470000000000002e-06 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219704+0000", 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1429999999999997e-06 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.783 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54643 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 321536~2048 out=2048b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139155+0000", 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079237661000000001, 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086973523999999997, 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54643 2024-09-14T05:59:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139155+0000", 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139155+0000", 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139156+0000", 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9100000000000004e-07 2024-09-14T05:59:54.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139158+0000", 2024-09-14T05:59:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.261e-06 2024-09-14T05:59:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139164+0000", 2024-09-14T05:59:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9880000000000001e-06 2024-09-14T05:59:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139197+0000", 2024-09-14T05:59:54.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3037000000000002e-05 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.225894+0000", 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.086696589000000004 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.225958+0000", 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4142999999999999e-05 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.226130+0000", 2024-09-14T05:59:54.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000172289 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54858 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148006+0000", 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070386900000000002, 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.078193386000000004, 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.788 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54858 2024-09-14T05:59:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148006+0000", 2024-09-14T05:59:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148006+0000", 2024-09-14T05:59:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148007+0000", 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7899999999999997e-07 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148010+0000", 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2930000000000001e-06 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148018+0000", 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3869999999999997e-06 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.790 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148024+0000", 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0020000000000003e-06 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54890 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163504+0000", 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054889074000000003, 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.062748984999999993, 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.791 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54890 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163504+0000", 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163504+0000", 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163505+0000", 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1699999999999998e-07 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163508+0000", 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0539999999999999e-06 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163516+0000", 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0860000000000002e-06 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163538+0000", 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1909e-05 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55104 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.168524+0000", 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.049868711000000003, 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057785773999999998, 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.794 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55104 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168524+0000", 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168524+0000", 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168746+0000", 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000221776 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168751+0000", 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0490000000000003e-06 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168762+0000", 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0607e-05 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168770+0000", 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1780000000000003e-06 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55136 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.179958+0000", 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.038434672000000003, 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046387177000000002, 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.797 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55136 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179958+0000", 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.179958+0000", 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187496+0000", 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075376050000000002 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187503+0000", 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4849999999999997e-06 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187523+0000", 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0509999999999998e-05 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187533+0000", 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5249999999999994e-06 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55168 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.191443+0000", 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.026950239000000001, 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034949573999999997, 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55168 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191443+0000", 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191443+0000", 2024-09-14T05:59:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191813+0000", 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00036991999999999998 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191818+0000", 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5740000000000003e-06 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191830+0000", 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1904e-05 2024-09-14T05:59:54.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191838+0000", 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3130000000000001e-06 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55384 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.204002+0000", 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014390966, 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022440925, 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.803 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55384 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204002+0000", 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204002+0000", 2024-09-14T05:59:54.804 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204002+0000", 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1100000000000002e-07 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204005+0000", 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204011+0000", 2024-09-14T05:59:54.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9800000000000003e-06 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204015+0000", 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8040000000000001e-06 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55416 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219713+0000", 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9986806, 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0067895899999999999, 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.806 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55416 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219713+0000", 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219713+0000", 2024-09-14T05:59:54.807 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219713+0000", 2024-09-14T05:59:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.34e-07 2024-09-14T05:59:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219715+0000", 2024-09-14T05:59:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7269999999999999e-06 2024-09-14T05:59:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.808 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219718+0000", 2024-09-14T05:59:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8750000000000002e-06 2024-09-14T05:59:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219721+0000", 2024-09-14T05:59:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8870000000000001e-06 2024-09-14T05:59:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54859 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148033+0000", 2024-09-14T05:59:54.809 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070359631000000006, 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.078519153999999994, 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54859 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148033+0000", 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148033+0000", 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148034+0000", 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1500000000000004e-07 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148037+0000", 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.615e-06 2024-09-14T05:59:54.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148047+0000", 2024-09-14T05:59:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0634e-05 2024-09-14T05:59:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148064+0000", 2024-09-14T05:59:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6104e-05 2024-09-14T05:59:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54891 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163555+0000", 2024-09-14T05:59:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054837986999999998, 2024-09-14T05:59:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.063032803999999998, 2024-09-14T05:59:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54891 2024-09-14T05:59:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.813 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163555+0000", 2024-09-14T05:59:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163555+0000", 2024-09-14T05:59:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163556+0000", 2024-09-14T05:59:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0699999999999997e-07 2024-09-14T05:59:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163559+0000", 2024-09-14T05:59:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6689999999999999e-06 2024-09-14T05:59:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163569+0000", 2024-09-14T05:59:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0012e-05 2024-09-14T05:59:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.815 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163576+0000", 2024-09-14T05:59:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9179999999999997e-06 2024-09-14T05:59:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55105 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.168785+0000", 2024-09-14T05:59:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.049607970000000001, 2024-09-14T05:59:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057835306000000003, 2024-09-14T05:59:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.816 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55105 2024-09-14T05:59:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168785+0000", 2024-09-14T05:59:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.817 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.168785+0000", 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169064+0000", 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027857199999999999 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169070+0000", 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0480000000000004e-06 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169082+0000", 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.269e-05 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169090+0000", 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9589999999999995e-06 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55137 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187551+0000", 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030842130999999998, 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.039126401999999998, 2024-09-14T05:59:54.819 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55137 2024-09-14T05:59:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187551+0000", 2024-09-14T05:59:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187551+0000", 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187552+0000", 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7599999999999996e-07 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187555+0000", 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5540000000000002e-06 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187564+0000", 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6000000000000007e-06 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187570+0000", 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7470000000000002e-06 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55169 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.191848+0000", 2024-09-14T05:59:54.822 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.026545029000000001, 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034885442000000003, 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55169 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191848+0000", 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.191848+0000", 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192239+0000", 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00039053299999999998 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192244+0000", 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3619999999999997e-06 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192256+0000", 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2397e-05 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192265+0000", 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3129999999999999e-06 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55385 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.825 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.204024+0000", 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.014369543, 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022763288, 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55385 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204024+0000", 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204024+0000", 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204932+0000", 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00090847900000000001 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204937+0000", 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9899999999999997e-06 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204954+0000", 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.677e-05 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204962+0000", 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3729999999999993e-06 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55417 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.828 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219726+0000", 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9986677, 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070958820000000004, 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55417 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219726+0000", 2024-09-14T05:59:54.829 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219726+0000", 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219726+0000", 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4900000000000002e-07 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219727+0000", 2024-09-14T05:59:54.830 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2300000000000001e-06 2024-09-14T05:59:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219730+0000", 2024-09-14T05:59:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9280000000000002e-06 2024-09-14T05:59:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219733+0000", 2024-09-14T05:59:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.734e-06 2024-09-14T05:59:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54860 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148075+0000", 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070318088000000001, 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.078776709, 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54860 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.832 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148075+0000", 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148075+0000", 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148076+0000", 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9699999999999996e-07 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148079+0000", 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2480000000000001e-06 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148100+0000", 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0795999999999999e-05 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148107+0000", 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0890000000000002e-06 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.834 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54892 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163586+0000", 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054806739, 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.063293286000000004, 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54892 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.835 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163586+0000", 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163586+0000", 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163587+0000", 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7800000000000001e-07 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.836 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163590+0000", 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7719999999999999e-06 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163600+0000", 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8190000000000003e-06 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163606+0000", 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2740000000000004e-06 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55106 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.169106+0000", 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.04928751, 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057824990999999999, 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55106 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.838 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169106+0000", 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169106+0000", 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169471+0000", 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00036573399999999999 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.839 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169477+0000", 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5470000000000004e-06 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169488+0000", 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1591e-05 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169496+0000", 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8669999999999994e-06 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.840 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55138 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187581+0000", 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030812550000000001, 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.039401107999999997, 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55138 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.841 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187581+0000", 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187581+0000", 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187581+0000", 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3799999999999997e-07 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187584+0000", 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6800000000000002e-06 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187591+0000", 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.481e-06 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187610+0000", 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8805e-05 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.843 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55170 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.192280+0000", 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.026112782000000001, 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034757722999999997, 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55170 2024-09-14T05:59:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192280+0000", 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192280+0000", 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192570+0000", 2024-09-14T05:59:54.845 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028972299999999998 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192575+0000", 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0050000000000004e-06 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192585+0000", 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0199e-05 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192593+0000", 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6709999999999999e-06 2024-09-14T05:59:54.846 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55386 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.204977+0000", 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.01341621, 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022122523000000002, 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55386 2024-09-14T05:59:54.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204977+0000", 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204977+0000", 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204978+0000", 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.75e-07 2024-09-14T05:59:54.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204989+0000", 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1868000000000001e-05 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.204998+0000", 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2179999999999999e-06 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205003+0000", 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6810000000000003e-06 2024-09-14T05:59:54.849 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55418 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219736+0000", 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9986567, 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0074027290000000003, 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.850 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55418 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219736+0000", 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219736+0000", 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219737+0000", 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.41e-07 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219738+0000", 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.234e-06 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219743+0000", 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0490000000000003e-06 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.852 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219747+0000", 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6909999999999999e-06 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54646 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 389120~2048 out=2048b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139276+0000", 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079117353000000001, 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087892094000000004, 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.853 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54646 2024-09-14T05:59:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139276+0000", 2024-09-14T05:59:54.854 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139276+0000", 2024-09-14T05:59:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139276+0000", 2024-09-14T05:59:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1799999999999995e-07 2024-09-14T05:59:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139279+0000", 2024-09-14T05:59:54.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2620000000000001e-06 2024-09-14T05:59:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139288+0000", 2024-09-14T05:59:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0589999999999992e-06 2024-09-14T05:59:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139293+0000", 2024-09-14T05:59:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9490000000000004e-06 2024-09-14T05:59:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:54.857 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.226826+0000", 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087533841000000001 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.226922+0000", 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5937e-05 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.227168+0000", 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024552800000000001 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54861 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148125+0000", 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070267662999999994, 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.079081101000000001, 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54861 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148125+0000", 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148125+0000", 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148126+0000", 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2399999999999998e-07 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148129+0000", 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.965e-06 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148137+0000", 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2530000000000004e-06 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148143+0000", 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1829999999999999e-06 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54893 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163618+0000", 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054774817000000003, 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.063625973000000002, 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54893 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163618+0000", 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163618+0000", 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163619+0000", 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.863 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163622+0000", 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0730000000000001e-06 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163630+0000", 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3410000000000003e-06 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163636+0000", 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8449999999999999e-06 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55107 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.169511+0000", 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.048882495999999998, 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057790152999999997, 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55107 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169511+0000", 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169511+0000", 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169896+0000", 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00038552699999999998 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169906+0000", 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6099999999999995e-06 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169917+0000", 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1592e-05 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169923+0000", 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2220000000000001e-06 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55139 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187621+0000", 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.03077179, 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.039737148, 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55139 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187621+0000", 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187621+0000", 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187622+0000", 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8400000000000004e-07 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187625+0000", 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0960000000000001e-06 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187633+0000", 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2770000000000005e-06 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187639+0000", 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0599999999999996e-06 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.870 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55171 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.192607+0000", 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.025786301000000001, 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034794419, 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55171 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192607+0000", 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192607+0000", 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192926+0000", 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000318845 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192931+0000", 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5029999999999997e-06 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192943+0000", 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2129e-05 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192951+0000", 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1729999999999995e-06 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.873 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55387 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.205015+0000", 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.013377716, 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022438720999999998, 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55387 2024-09-14T05:59:54.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205015+0000", 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205015+0000", 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205016+0000", 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5199999999999997e-07 2024-09-14T05:59:54.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205018+0000", 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4420000000000001e-06 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205025+0000", 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8859999999999998e-06 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205031+0000", 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.412e-06 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.876 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55419 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219751+0000", 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.998642, 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0077305910000000002, 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55419 2024-09-14T05:59:54.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219751+0000", 2024-09-14T05:59:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219751+0000", 2024-09-14T05:59:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.878 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219751+0000", 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5199999999999998e-07 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219753+0000", 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4589999999999999e-06 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219756+0000", 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.54e-06 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219759+0000", 2024-09-14T05:59:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7970000000000001e-06 2024-09-14T05:59:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54862 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148151+0000", 2024-09-14T05:59:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070241787999999999, 2024-09-14T05:59:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.079360722999999994, 2024-09-14T05:59:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.880 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54862 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148151+0000", 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148151+0000", 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148152+0000", 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9299999999999999e-07 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148154+0000", 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2500000000000001e-06 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148162+0000", 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3920000000000003e-06 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148176+0000", 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3930999999999999e-05 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54894 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163644+0000", 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054749036000000001, 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.063900870999999998, 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.883 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54894 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163644+0000", 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163644+0000", 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163645+0000", 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4799999999999999e-07 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163646+0000", 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9549999999999999e-06 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163653+0000", 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2140000000000001e-06 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163658+0000", 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.536e-06 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55108 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.169936+0000", 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.048457005999999997, 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057637651999999998, 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.886 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55108 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169936+0000", 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.169936+0000", 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170086+0000", 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014963699999999999 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170091+0000", 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9799999999999998e-06 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170100+0000", 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1840000000000005e-06 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170106+0000", 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.246e-06 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55140 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187648+0000", 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030745539999999998, 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.039952567000000001, 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.889 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55140 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187648+0000", 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187648+0000", 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187648+0000", 2024-09-14T05:59:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.75e-07 2024-09-14T05:59:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187650+0000", 2024-09-14T05:59:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3740000000000001e-06 2024-09-14T05:59:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187659+0000", 2024-09-14T05:59:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2889999999999998e-06 2024-09-14T05:59:54.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187664+0000", 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.592e-06 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55172 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.192976+0000", 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.025417329999999998, 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034669014999999997, 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55172 2024-09-14T05:59:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192976+0000", 2024-09-14T05:59:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.893 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.192976+0000", 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.193300+0000", 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032436500000000002 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.193305+0000", 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9660000000000004e-06 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.193319+0000", 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4042999999999999e-05 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.193327+0000", 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1219999999999995e-06 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55388 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.205057+0000", 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.013335733000000001, 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022641773, 2024-09-14T05:59:54.895 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55388 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205057+0000", 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205057+0000", 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205058+0000", 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8299999999999998e-07 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205060+0000", 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1019999999999999e-06 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205068+0000", 2024-09-14T05:59:54.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7209999999999994e-06 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205071+0000", 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8340000000000001e-06 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55420 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219763+0000", 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9986305, 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0079825269999999997, 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.898 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55420 2024-09-14T05:59:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219763+0000", 2024-09-14T05:59:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219763+0000", 2024-09-14T05:59:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219763+0000", 2024-09-14T05:59:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.53e-07 2024-09-14T05:59:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219764+0000", 2024-09-14T05:59:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2860000000000001e-06 2024-09-14T05:59:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219767+0000", 2024-09-14T05:59:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.066e-06 2024-09-14T05:59:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219770+0000", 2024-09-14T05:59:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7310000000000002e-06 2024-09-14T05:59:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.901 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54648 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 401408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139339+0000", 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079054495000000002, 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.088468106000000005, 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54648 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139339+0000", 2024-09-14T05:59:54.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139339+0000", 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139339+0000", 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9900000000000001e-07 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139350+0000", 2024-09-14T05:59:54.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0445000000000001e-05 2024-09-14T05:59:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139357+0000", 2024-09-14T05:59:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9109999999999993e-06 2024-09-14T05:59:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139363+0000", 2024-09-14T05:59:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.604e-06 2024-09-14T05:59:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:54.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.227522+0000", 2024-09-14T05:59:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.088159008999999997 2024-09-14T05:59:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.227575+0000", 2024-09-14T05:59:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2416000000000001e-05 2024-09-14T05:59:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54863 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.905 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148186+0000", 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070207100999999994, 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.079691051999999998, 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54863 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148186+0000", 2024-09-14T05:59:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148186+0000", 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148187+0000", 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5499999999999997e-07 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148190+0000", 2024-09-14T05:59:54.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7410000000000001e-06 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148197+0000", 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6459999999999993e-06 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148203+0000", 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9150000000000001e-06 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54895 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163668+0000", 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054724663999999999, 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.064259265999999995, 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54895 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163668+0000", 2024-09-14T05:59:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163668+0000", 2024-09-14T05:59:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163669+0000", 2024-09-14T05:59:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6300000000000005e-07 2024-09-14T05:59:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163671+0000", 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4650000000000001e-06 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163680+0000", 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9369999999999993e-06 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163697+0000", 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6288999999999999e-05 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.911 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55109 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.170118+0000", 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.048275047000000001, 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057841199000000003, 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55109 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170118+0000", 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170118+0000", 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170745+0000", 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00062696200000000001 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170751+0000", 2024-09-14T05:59:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.536e-06 2024-09-14T05:59:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170763+0000", 2024-09-14T05:59:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2632e-05 2024-09-14T05:59:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170771+0000", 2024-09-14T05:59:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9650000000000008e-06 2024-09-14T05:59:54.914 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55141 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187673+0000", 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030720263000000001, 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.040329243000000001, 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.915 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55141 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187673+0000", 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187673+0000", 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187673+0000", 2024-09-14T05:59:54.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9800000000000004e-07 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187676+0000", 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5119999999999998e-06 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187685+0000", 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7180000000000002e-06 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187690+0000", 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5690000000000004e-06 2024-09-14T05:59:54.917 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55357 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.193343+0000", 2024-09-14T05:59:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.025050394, 2024-09-14T05:59:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034695207999999998, 2024-09-14T05:59:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.918 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55357 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.193343+0000", 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.193343+0000", 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195482+0000", 2024-09-14T05:59:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0021388430000000001 2024-09-14T05:59:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195487+0000", 2024-09-14T05:59:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5949999999999998e-06 2024-09-14T05:59:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195498+0000", 2024-09-14T05:59:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0511e-05 2024-09-14T05:59:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195505+0000", 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2339999999999997e-06 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55389 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.205078+0000", 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.013315280000000001, 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022997079, 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.921 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55389 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205078+0000", 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205078+0000", 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205459+0000", 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00038084000000000002 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205465+0000", 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8839999999999999e-06 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205481+0000", 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6684000000000002e-05 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205490+0000", 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2849999999999995e-06 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55421 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219773+0000", 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9986196, 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0083448540000000005, 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.924 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55421 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219773+0000", 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219773+0000", 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219774+0000", 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000002e-07 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219775+0000", 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.254e-06 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219778+0000", 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.994e-06 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219781+0000", 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7030000000000002e-06 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54649 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 456704~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139378+0000", 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.079015330999999994, 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.088785024000000004, 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.927 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54649 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139378+0000", 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139378+0000", 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139378+0000", 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2699999999999999e-07 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139381+0000", 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4389999999999999e-06 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139388+0000", 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0400000000000004e-06 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139393+0000", 2024-09-14T05:59:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3789999999999997e-06 2024-09-14T05:59:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.228067+0000", 2024-09-14T05:59:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.088673907999999996 2024-09-14T05:59:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54864 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.930 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148213+0000", 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.07017967, 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.079987664, 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54864 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148213+0000", 2024-09-14T05:59:54.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148213+0000", 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148214+0000", 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.46e-07 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148224+0000", 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0285000000000001e-05 2024-09-14T05:59:54.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148232+0000", 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.559e-06 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148238+0000", 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2199999999999997e-06 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.933 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54896 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163706+0000", 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054687337000000003, 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.064522668000000005, 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54896 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163706+0000", 2024-09-14T05:59:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163706+0000", 2024-09-14T05:59:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163706+0000", 2024-09-14T05:59:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4700000000000001e-07 2024-09-14T05:59:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163709+0000", 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7360000000000001e-06 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163717+0000", 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.96e-06 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163723+0000", 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.908e-06 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.936 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55110 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.170806+0000", 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.047586951000000002, 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057447605999999998, 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55110 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170806+0000", 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170806+0000", 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170807+0000", 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2799999999999995e-07 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170811+0000", 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7620000000000001e-06 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170822+0000", 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1579e-05 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170829+0000", 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7530000000000004e-06 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55142 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187699+0000", 2024-09-14T05:59:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030694373, 2024-09-14T05:59:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.040581649999999997, 2024-09-14T05:59:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55142 2024-09-14T05:59:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.940 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187699+0000", 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187699+0000", 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187699+0000", 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5600000000000001e-07 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187702+0000", 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6240000000000002e-06 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187709+0000", 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.99e-06 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187714+0000", 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4190000000000001e-06 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55358 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.195531+0000", 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.022861985000000001, 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.032779234999999997, 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55358 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195531+0000", 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195531+0000", 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195532+0000", 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7899999999999999e-07 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195534+0000", 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.328e-06 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195540+0000", 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9349999999999999e-06 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195545+0000", 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4870000000000002e-06 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.945 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55390 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.205504+0000", 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.012889398999999999, 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022841578000000001, 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55390 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205504+0000", 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205504+0000", 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205739+0000", 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023498099999999999 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205744+0000", 2024-09-14T05:59:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8860000000000003e-06 2024-09-14T05:59:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205755+0000", 2024-09-14T05:59:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1878e-05 2024-09-14T05:59:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205765+0000", 2024-09-14T05:59:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7999999999999993e-06 2024-09-14T05:59:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.948 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55422 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219784+0000", 2024-09-14T05:59:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9986091, 2024-09-14T05:59:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0085875150000000004, 2024-09-14T05:59:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.949 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55422 2024-09-14T05:59:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219784+0000", 2024-09-14T05:59:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219784+0000", 2024-09-14T05:59:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219784+0000", 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4400000000000001e-07 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219792+0000", 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1099999999999997e-06 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219795+0000", 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.777e-06 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219798+0000", 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.881e-06 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54650 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139401+0000", 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078992168000000001, 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.088997636000000005, 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.952 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54650 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139401+0000", 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139401+0000", 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139401+0000", 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139404+0000", 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1229999999999998e-06 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139422+0000", 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8711000000000001e-05 2024-09-14T05:59:54.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139428+0000", 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8880000000000002e-06 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54865 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148248+0000", 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070145089999999993, 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.080188161999999993, 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.955 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54865 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148248+0000", 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148248+0000", 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148249+0000", 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1900000000000003e-07 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148271+0000", 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2765999999999999e-05 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148281+0000", 2024-09-14T05:59:54.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6090000000000007e-06 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148289+0000", 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4090000000000003e-06 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54897 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163732+0000", 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054661464, 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.064760358000000004, 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.958 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54897 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163732+0000", 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163732+0000", 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163732+0000", 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6000000000000004e-07 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163742+0000", 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5559999999999996e-06 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163750+0000", 2024-09-14T05:59:54.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2050000000000002e-06 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163756+0000", 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.874e-06 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55111 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.170875+0000", 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.047518315999999998, 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057667980000000001, 2024-09-14T05:59:54.961 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55111 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170875+0000", 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.170875+0000", 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171256+0000", 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000381231 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171272+0000", 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5539000000000001e-05 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171287+0000", 2024-09-14T05:59:54.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4969e-05 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171296+0000", 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4579999999999999e-06 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55143 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187727+0000", 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030666094000000001, 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.040845171999999999, 2024-09-14T05:59:54.964 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55143 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187727+0000", 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187727+0000", 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187728+0000", 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3000000000000001e-07 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187730+0000", 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7719999999999999e-06 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187736+0000", 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0680000000000002e-06 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187742+0000", 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6590000000000004e-06 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55359 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.195555+0000", 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.022838420000000002, 2024-09-14T05:59:54.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033042251000000002, 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55359 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195555+0000", 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195555+0000", 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195555+0000", 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1600000000000001e-07 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195557+0000", 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7600000000000001e-06 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195561+0000", 2024-09-14T05:59:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1080000000000003e-06 2024-09-14T05:59:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195564+0000", 2024-09-14T05:59:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2030000000000001e-06 2024-09-14T05:59:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55391 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.970 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.205780+0000", 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.012613601, 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022845932999999999, 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55391 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205780+0000", 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205780+0000", 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205973+0000", 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019346500000000001 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205978+0000", 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8339999999999998e-06 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205990+0000", 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2007e-05 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.205995+0000", 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4419999999999997e-06 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55423 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.973 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219803+0000", 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9985905, 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0088482590000000007, 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55423 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219803+0000", 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219803+0000", 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219803+0000", 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4099999999999999e-07 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219805+0000", 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.353e-06 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219807+0000", 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.977e-06 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219810+0000", 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6410000000000002e-06 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54651 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139438+0000", 2024-09-14T05:59:54.976 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078955079999999997, 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.089240449999999999, 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54651 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139438+0000", 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139438+0000", 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139439+0000", 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6400000000000002e-07 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139442+0000", 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.96e-06 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139449+0000", 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4880000000000001e-06 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139454+0000", 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2909999999999998e-06 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54866 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148301+0000", 2024-09-14T05:59:54.979 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070092435999999994, 2024-09-14T05:59:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.080410138000000006, 2024-09-14T05:59:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54866 2024-09-14T05:59:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148301+0000", 2024-09-14T05:59:54.980 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148301+0000", 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148301+0000", 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4700000000000001e-07 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148304+0000", 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4959999999999999e-06 2024-09-14T05:59:54.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148312+0000", 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6909999999999997e-06 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148318+0000", 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0889999999999996e-06 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54898 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.982 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163765+0000", 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054627706999999998, 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.064978668000000003, 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54898 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163765+0000", 2024-09-14T05:59:54.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163765+0000", 2024-09-14T05:59:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163766+0000", 2024-09-14T05:59:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3000000000000001e-07 2024-09-14T05:59:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.984 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163768+0000", 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2850000000000001e-06 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163775+0000", 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7909999999999999e-06 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163787+0000", 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1691999999999999e-05 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55112 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.171312+0000", 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.047080904999999999, 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057461574000000001, 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55112 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171312+0000", 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171312+0000", 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171600+0000", 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028760999999999999 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171605+0000", 2024-09-14T05:59:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.288e-06 2024-09-14T05:59:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171616+0000", 2024-09-14T05:59:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1192999999999999e-05 2024-09-14T05:59:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171624+0000", 2024-09-14T05:59:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8429999999999993e-06 2024-09-14T05:59:54.988 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55144 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187751+0000", 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030642316999999999, 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.04107152, 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.989 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55144 2024-09-14T05:59:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187751+0000", 2024-09-14T05:59:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187751+0000", 2024-09-14T05:59:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187751+0000", 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7199999999999999e-07 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187754+0000", 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5890000000000001e-06 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187760+0000", 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3239999999999999e-06 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187766+0000", 2024-09-14T05:59:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2419999999999997e-06 2024-09-14T05:59:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55360 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.195569+0000", 2024-09-14T05:59:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.022824585000000001, 2024-09-14T05:59:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033294478000000002, 2024-09-14T05:59:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.992 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55360 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195569+0000", 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195569+0000", 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195569+0000", 2024-09-14T05:59:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7300000000000002e-07 2024-09-14T05:59:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195570+0000", 2024-09-14T05:59:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.274e-06 2024-09-14T05:59:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195574+0000", 2024-09-14T05:59:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4369999999999999e-06 2024-09-14T05:59:54.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195578+0000", 2024-09-14T05:59:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4429999999999996e-06 2024-09-14T05:59:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55392 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.206006+0000", 2024-09-14T05:59:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.012387284, 2024-09-14T05:59:54.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022883475, 2024-09-14T05:59:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55392 2024-09-14T05:59:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.206006+0000", 2024-09-14T05:59:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.206006+0000", 2024-09-14T05:59:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.206266+0000", 2024-09-14T05:59:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025994499999999998 2024-09-14T05:59:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.206270+0000", 2024-09-14T05:59:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4360000000000004e-06 2024-09-14T05:59:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.206280+0000", 2024-09-14T05:59:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4050000000000006e-06 2024-09-14T05:59:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.206287+0000", 2024-09-14T05:59:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8499999999999994e-06 2024-09-14T05:59:54.998 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55424 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219826+0000", 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9985676, 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0090914570000000007, 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:54.999 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55424 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219826+0000", 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219826+0000", 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.000 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219826+0000", 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9200000000000002e-07 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219828+0000", 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6589999999999999e-06 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219832+0000", 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8180000000000003e-06 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.001 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219836+0000", 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1140000000000002e-06 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54652 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139462+0000", 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.078931385000000007, 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.089480950000000004, 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.002 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54652 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139462+0000", 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139462+0000", 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139462+0000", 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2399999999999999e-07 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139464+0000", 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0810000000000001e-06 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139471+0000", 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7070000000000003e-06 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.004 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139490+0000", 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8612000000000001e-05 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54867 3.1e 3.c481d53e (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148326+0000", 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.070066809999999993, 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.080643610000000004, 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.005 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54867 2024-09-14T05:59:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148326+0000", 2024-09-14T05:59:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148326+0000", 2024-09-14T05:59:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148327+0000", 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148329+0000", 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.509e-06 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148337+0000", 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2060000000000001e-06 2024-09-14T05:59:55.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148342+0000", 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.57e-06 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54899 3.1e 3.d5073cbe (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.163819+0000", 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.054574136000000002, 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.065176233, 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.008 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54899 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163819+0000", 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163819+0000", 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163820+0000", 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.06e-07 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163822+0000", 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5739999999999998e-06 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163830+0000", 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.515e-06 2024-09-14T05:59:55.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163835+0000", 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6119999999999998e-06 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55113 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.171639+0000", 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.046754452000000002, 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.057383288999999997, 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.011 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55113 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171639+0000", 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171639+0000", 2024-09-14T05:59:55.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171979+0000", 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00034009699999999998 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171983+0000", 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2899999999999996e-06 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.171994+0000", 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0542e-05 2024-09-14T05:59:55.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.172001+0000", 2024-09-14T05:59:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3329999999999999e-06 2024-09-14T05:59:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55145 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.187775+0000", 2024-09-14T05:59:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.030618172999999999, 2024-09-14T05:59:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.041275237999999999, 2024-09-14T05:59:55.014 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55145 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187775+0000", 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.015 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187775+0000", 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187775+0000", 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7599999999999997e-07 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187778+0000", 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3939999999999999e-06 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187785+0000", 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4660000000000002e-06 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.187792+0000", 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1160000000000001e-06 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55361 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.195582+0000", 2024-09-14T05:59:55.017 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.022811354999999998, 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.033504602000000001, 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55361 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195582+0000", 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195582+0000", 2024-09-14T05:59:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195582+0000", 2024-09-14T05:59:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8900000000000001e-07 2024-09-14T05:59:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195583+0000", 2024-09-14T05:59:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2979999999999999e-06 2024-09-14T05:59:55.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195587+0000", 2024-09-14T05:59:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.287e-06 2024-09-14T05:59:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.195590+0000", 2024-09-14T05:59:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7979999999999999e-06 2024-09-14T05:59:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55393 3.1e 3.c481d53e (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.206301+0000", 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.012091741, 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.022814896000000001, 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55393 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.206301+0000", 2024-09-14T05:59:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.206301+0000", 2024-09-14T05:59:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.206802+0000", 2024-09-14T05:59:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00050107400000000001 2024-09-14T05:59:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.206808+0000", 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3879999999999999e-06 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.206822+0000", 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4293e-05 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.206830+0000", 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1620000000000008e-06 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.023 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:55425 3.1e 3.d5073cbe (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.219841+0000", 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9985528, 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0093283480000000002, 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 55425 2024-09-14T05:59:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219841+0000", 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219841+0000", 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219841+0000", 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1100000000000001e-07 2024-09-14T05:59:55.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219842+0000", 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.457e-06 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219846+0000", 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1379999999999999e-06 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.219848+0000", 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.666e-06 2024-09-14T05:59:55.026 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T05:59:55.027 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 245 2024-09-14T05:59:55.027 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:55.028 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:59:55.030 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-14T05:59:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:2571 write 0x678efb6 thru 0x679a3cd (0xb418 bytes) 2024-09-14T05:59:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:2572 read 0xc0de5aa thru 0xc0e41c4 (0x5c1b bytes) 2024-09-14T05:59:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:2573 punch from 0x9765d05 to 0x976cb8f, (0x6e8a bytes) 2024-09-14T05:59:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:2575 write 0x225b2 thru 0x2fa86 (0xd4d5 bytes) 2024-09-14T05:59:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:2577 read 0x9981300 thru 0x9987412 (0x6113 bytes) 2024-09-14T05:59:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:2578 read 0x9e646df thru 0x9e73b00 (0xf422 bytes) 2024-09-14T05:59:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:2581 punch from 0x12eaf37 to 0x12f7007, (0xc0d0 bytes) 2024-09-14T05:59:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:2584 write 0x11ab31a thru 0x11acdba (0x1aa1 bytes) 2024-09-14T05:59:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:2589 read 0x9ef3f32 thru 0x9efee58 (0xaf27 bytes) 2024-09-14T05:59:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:2590 punch from 0xc789f2f to 0xc7925af, (0x8680 bytes) 2024-09-14T05:59:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:2591 read 0x1794ba1 thru 0x17a47c2 (0xfc22 bytes) 2024-09-14T05:59:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:2592 write 0x447465d thru 0x4475d0d (0x16b1 bytes) 2024-09-14T05:59:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:2594 read 0x6e7868e thru 0x6e84ec3 (0xc836 bytes) 2024-09-14T05:59:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:2596 read 0x5a4eec6 thru 0x5a5ac90 (0xbdcb bytes) 2024-09-14T05:59:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:2597 writesame 0x3953390 thru 0x3956a0f data_size 0x20(0x3680 bytes) 2024-09-14T05:59:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:2599 read 0xa705d1a thru 0xa706ab3 (0xd9a bytes) 2024-09-14T05:59:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:2602 write 0x83386a thru 0x834aa8 (0x123f bytes) 2024-09-14T05:59:55.032 INFO:teuthology.orchestra.run.smithi006.stdout:2604 trunc from 0xcbc04cd to 0x1f983ef 2024-09-14T05:59:55.032 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:55.028+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:55.107 INFO:teuthology.orchestra.run.smithi006.stdout:2605 trunc from 0x1f983ef to 0x65d14ae 2024-09-14T05:59:55.127 INFO:teuthology.orchestra.run.smithi006.stdout:2606 trunc from 0x65d14ae to 0xd9a1e41 2024-09-14T05:59:55.129 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:55.125+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:55.135 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:55.138 INFO:teuthology.orchestra.run.smithi006.stdout:2608 trunc from 0xd9a1e41 to 0xc434b60 2024-09-14T05:59:55.147 INFO:teuthology.orchestra.run.smithi006.stdout:2610 writesame 0x69467d5 thru 0x694865b data_size 0x5(0x1e87 bytes) 2024-09-14T05:59:55.170 INFO:teuthology.orchestra.run.smithi006.stdout:2612 trunc from 0xc434b60 to 0x307c232 2024-09-14T05:59:55.180 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:55.181 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:55.181 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:55.201 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:59:55.203 INFO:teuthology.orchestra.run.smithi006.stdout:2613 write 0x64e2100 thru 0x64eafaf (0x8eb0 bytes) 2024-09-14T05:59:55.227 INFO:teuthology.orchestra.run.smithi006.stdout:2614 writesame 0x9bffe74 thru 0x9c0d23f data_size 0xa(0xd3cc bytes) 2024-09-14T05:59:55.227 INFO:teuthology.orchestra.run.smithi006.stdout:2615 read 0x51742e1 thru 0x5183b1b (0xf83b bytes) 2024-09-14T05:59:55.230 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:55.228+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:55.241 INFO:teuthology.orchestra.run.smithi006.stdout:2616 trunc from 0x9c0d240 to 0x16d954 2024-09-14T05:59:55.331 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:55.329+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:55.362 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:55.362 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:55.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:55.362 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:55.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.362 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54658 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 610304~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.362 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139679+0000", 2024-09-14T05:59:55.362 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.221415208, 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091840061000000001, 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54658 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4700000000000002e-07 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139687+0000", 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7170000000000008e-06 2024-09-14T05:59:55.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139694+0000", 2024-09-14T05:59:55.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.063e-06 2024-09-14T05:59:55.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139709+0000", 2024-09-14T05:59:55.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4324999999999999e-05 2024-09-14T05:59:55.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231262+0000", 2024-09-14T05:59:55.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091553866999999997 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231375+0000", 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000112927 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231519+0000", 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014371499999999999 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54659 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 616448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139717+0000", 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.221376861, 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092177035000000004, 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54659 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139718+0000", 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9699999999999996e-07 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139731+0000", 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2993000000000001e-05 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139738+0000", 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4610000000000002e-06 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139744+0000", 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6389999999999997e-06 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231570+0000", 2024-09-14T05:59:55.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091826216000000002 2024-09-14T05:59:55.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231662+0000", 2024-09-14T05:59:55.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2101000000000005e-05 2024-09-14T05:59:55.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231894+0000", 2024-09-14T05:59:55.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023212800000000001 2024-09-14T05:59:55.370 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.370 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54660 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 622592~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139753+0000", 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.2213415270000001, 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092366887999999994, 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54660 2024-09-14T05:59:55.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T05:59:55.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139755+0000", 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139762+0000", 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6719999999999998e-06 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139767+0000", 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9819999999999999e-06 2024-09-14T05:59:55.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231917+0000", 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092149872999999993 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231969+0000", 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2642000000000002e-05 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232120+0000", 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015011899999999999 2024-09-14T05:59:55.374 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.375 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.375 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54844 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 0~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.375 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139774+0000", 2024-09-14T05:59:55.375 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.2213200360000001, 2024-09-14T05:59:55.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092708507999999995, 2024-09-14T05:59:55.375 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.375 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.375 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.375 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.375 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.375 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54844 2024-09-14T05:59:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T05:59:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T05:59:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139775+0000", 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3500000000000002e-07 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139777+0000", 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.979e-06 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139787+0000", 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0779e-05 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139799+0000", 2024-09-14T05:59:55.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1719000000000001e-05 2024-09-14T05:59:55.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232151+0000", 2024-09-14T05:59:55.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092351767000000001 2024-09-14T05:59:55.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232217+0000", 2024-09-14T05:59:55.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6655000000000005e-05 2024-09-14T05:59:55.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232483+0000", 2024-09-14T05:59:55.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026517400000000002 2024-09-14T05:59:55.379 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.379 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.379 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.379 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54845 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 55296~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.379 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139808+0000", 2024-09-14T05:59:55.379 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.2212863650000001, 2024-09-14T05:59:55.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093127583999999999, 2024-09-14T05:59:55.379 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54845 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4899999999999995e-07 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139811+0000", 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000001e-06 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139821+0000", 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0168e-05 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139826+0000", 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2780000000000001e-06 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232556+0000", 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092729729999999996 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232652+0000", 2024-09-14T05:59:55.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680999999999994e-05 2024-09-14T05:59:55.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232935+0000", 2024-09-14T05:59:55.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000283758 2024-09-14T05:59:55.383 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.383 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.383 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.383 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54846 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.383 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139834+0000", 2024-09-14T05:59:55.383 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.2212600579999999, 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093492079000000006, 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54846 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T05:59:55.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139835+0000", 2024-09-14T05:59:55.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T05:59:55.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139837+0000", 2024-09-14T05:59:55.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1059999999999998e-06 2024-09-14T05:59:55.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139845+0000", 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4300000000000006e-06 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139851+0000", 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232987+0000", 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093136073999999999 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233075+0000", 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7318999999999995e-05 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233326+0000", 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025159 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54847 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 67584~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139860+0000", 2024-09-14T05:59:55.387 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.221234342, 2024-09-14T05:59:55.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093777452999999997, 2024-09-14T05:59:55.388 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.388 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.388 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.388 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.388 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.388 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.388 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54847 2024-09-14T05:59:55.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.388 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T05:59:55.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139862+0000", 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0200000000000001e-06 2024-09-14T05:59:55.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139870+0000", 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0520000000000002e-06 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139875+0000", 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233389+0000", 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093514054999999999 2024-09-14T05:59:55.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233443+0000", 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3913999999999999e-05 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233637+0000", 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019392899999999999 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54848 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 73728~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.391 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139883+0000", 2024-09-14T05:59:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.221211246, 2024-09-14T05:59:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094064464, 2024-09-14T05:59:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54848 2024-09-14T05:59:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139885+0000", 2024-09-14T05:59:55.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9929999999999998e-06 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139893+0000", 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9759999999999995e-06 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139898+0000", 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6059999999999996e-06 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233681+0000", 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093782921000000005 2024-09-14T05:59:55.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233730+0000", 2024-09-14T05:59:55.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9410999999999998e-05 2024-09-14T05:59:55.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233947+0000", 2024-09-14T05:59:55.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021710300000000001 2024-09-14T05:59:55.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.395 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.396 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54849 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.396 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139906+0000", 2024-09-14T05:59:55.396 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.2211877900000001, 2024-09-14T05:59:55.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094499257000000003, 2024-09-14T05:59:55.396 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.396 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.396 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.396 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.396 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.396 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.396 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54849 2024-09-14T05:59:55.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.396 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139907+0000", 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T05:59:55.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139909+0000", 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139916+0000", 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139921+0000", 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234032+0000", 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094111037999999994 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234150+0000", 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118408 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234406+0000", 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025540600000000001 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.399 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.400 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54850 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 135168~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.400 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139928+0000", 2024-09-14T05:59:55.400 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.2211660820000001, 2024-09-14T05:59:55.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094814605999999996, 2024-09-14T05:59:55.400 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.400 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.400 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.400 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.400 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.400 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.400 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54850 2024-09-14T05:59:55.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139929+0000", 2024-09-14T05:59:55.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139931+0000", 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.024e-06 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139937+0000", 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3770000000000001e-06 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139942+0000", 2024-09-14T05:59:55.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0289999999999996e-06 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234447+0000", 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094505426000000003 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234539+0000", 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1793999999999996e-05 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234743+0000", 2024-09-14T05:59:55.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020354600000000001 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54851 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 141312~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139950+0000", 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.22114437, 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095179749999999994, 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.404 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54851 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T05:59:55.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T05:59:55.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139952+0000", 2024-09-14T05:59:55.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0600000000000002e-06 2024-09-14T05:59:55.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139959+0000", 2024-09-14T05:59:55.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.584e-06 2024-09-14T05:59:55.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139964+0000", 2024-09-14T05:59:55.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8890000000000001e-06 2024-09-14T05:59:55.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234786+0000", 2024-09-14T05:59:55.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094822241000000002 2024-09-14T05:59:55.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234877+0000", 2024-09-14T05:59:55.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1158999999999999e-05 2024-09-14T05:59:55.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235130+0000", 2024-09-14T05:59:55.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025235999999999998 2024-09-14T05:59:55.408 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.408 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.408 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.408 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54852 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 147456~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.408 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139971+0000", 2024-09-14T05:59:55.408 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.221123242, 2024-09-14T05:59:55.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095437742000000006, 2024-09-14T05:59:55.409 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.409 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.409 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.409 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.409 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.409 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.409 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54852 2024-09-14T05:59:55.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.409 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T05:59:55.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T05:59:55.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140125+0000", 2024-09-14T05:59:55.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154332 2024-09-14T05:59:55.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140130+0000", 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.284e-06 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140140+0000", 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0789e-05 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140147+0000", 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9879999999999998e-06 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235174+0000", 2024-09-14T05:59:55.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095026749999999993 2024-09-14T05:59:55.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235230+0000", 2024-09-14T05:59:55.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6224000000000002e-05 2024-09-14T05:59:55.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235409+0000", 2024-09-14T05:59:55.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017837500000000001 2024-09-14T05:59:55.412 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54853 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 202752~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.140160+0000", 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.2209344200000001, 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095632919999999996, 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.413 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54853 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147748+0000", 2024-09-14T05:59:55.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075884910000000002 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147798+0000", 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0152999999999999e-05 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147814+0000", 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5866e-05 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147831+0000", 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6991999999999999e-05 2024-09-14T05:59:55.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235451+0000", 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087620077000000005 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235539+0000", 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7800000000000006e-05 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235793+0000", 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025354099999999998 2024-09-14T05:59:55.416 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54868 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 442368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148350+0000", 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.2127441000000001, 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091802783999999998, 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54868 2024-09-14T05:59:55.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148351+0000", 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:59:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148353+0000", 2024-09-14T05:59:55.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2299999999999998e-06 2024-09-14T05:59:55.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148362+0000", 2024-09-14T05:59:55.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9800000000000004e-06 2024-09-14T05:59:55.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148367+0000", 2024-09-14T05:59:55.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.327e-06 2024-09-14T05:59:55.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.239863+0000", 2024-09-14T05:59:55.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091496018999999998 2024-09-14T05:59:55.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.239932+0000", 2024-09-14T05:59:55.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8838999999999996e-05 2024-09-14T05:59:55.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240153+0000", 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00022092100000000001 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54869 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 497664~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148376+0000", 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.212718202, 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092147413999999997, 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.421 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54869 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148377+0000", 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148379+0000", 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.429e-06 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148389+0000", 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9029999999999999e-06 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148395+0000", 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5080000000000002e-06 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240191+0000", 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091796066999999995 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240284+0000", 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2445e-05 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240523+0000", 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023954799999999999 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54870 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 503808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148405+0000", 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.2126888730000001, 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092420756000000007, 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.425 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54870 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148406+0000", 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148409+0000", 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148418+0000", 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7329999999999998e-06 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148425+0000", 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2079999999999997e-06 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240591+0000", 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092166441000000002 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240648+0000", 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6733e-05 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240826+0000", 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017834700000000001 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54871 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 509952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148435+0000", 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.2126589130000001, 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092702341999999993, 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.429 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54871 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148436+0000", 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148439+0000", 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8090000000000001e-06 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148449+0000", 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0115000000000001e-05 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148466+0000", 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6761000000000001e-05 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240857+0000", 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092391089999999995 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240939+0000", 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2387999999999998e-05 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241138+0000", 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000198624 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54872 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 516096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148476+0000", 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.2126177149999999, 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093126020000000004, 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.433 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54872 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155484+0000", 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070072429999999998 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155490+0000", 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6379999999999998e-06 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155504+0000", 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4065e-05 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155513+0000", 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6799999999999999e-06 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241216+0000", 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085702922000000001 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241277+0000", 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0980000000000002e-05 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241602+0000", 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032549199999999998 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54888 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 114688~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155921+0000", 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.2051732340000001, 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091627085999999996, 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.437 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.438 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.438 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54888 2024-09-14T05:59:55.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.438 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T05:59:55.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T05:59:55.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T05:59:55.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8299999999999998e-07 2024-09-14T05:59:55.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155923+0000", 2024-09-14T05:59:55.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4720000000000001e-06 2024-09-14T05:59:55.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155926+0000", 2024-09-14T05:59:55.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.444e-06 2024-09-14T05:59:55.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.440 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.440 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155929+0000", 2024-09-14T05:59:55.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7970000000000001e-06 2024-09-14T05:59:55.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.440 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.440 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247321+0000", 2024-09-14T05:59:55.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091391587999999996 2024-09-14T05:59:55.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.440 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.440 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247382+0000", 2024-09-14T05:59:55.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1944000000000002e-05 2024-09-14T05:59:55.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247548+0000", 2024-09-14T05:59:55.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000165558 2024-09-14T05:59:55.441 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.441 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.441 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.441 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54889 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 169984~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:55.441 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155934+0000", 2024-09-14T05:59:55.441 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.2051606340000001, 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091908118999999996, 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54889 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163444+0000", 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00751033 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163454+0000", 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0579e-05 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:55.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163468+0000", 2024-09-14T05:59:55.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3794999999999999e-05 2024-09-14T05:59:55.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:55.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163487+0000", 2024-09-14T05:59:55.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8907999999999999e-05 2024-09-14T05:59:55.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:55.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247591+0000", 2024-09-14T05:59:55.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084103333000000002 2024-09-14T05:59:55.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:55.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247651+0000", 2024-09-14T05:59:55.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0587000000000001e-05 2024-09-14T05:59:55.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:55.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:55.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:55.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247842+0000", 2024-09-14T05:59:55.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019058700000000001 2024-09-14T05:59:55.445 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.445 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.445 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.445 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:55.446 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:55.446 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:55.446 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:59:55.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:59:55.448 INFO:teuthology.orchestra.run.smithi006.stdout:2617 trunc from 0x16d954 to 0xdfbed98 2024-09-14T05:59:55.448 INFO:teuthology.orchestra.run.smithi006.stdout:2618 read 0x17bd1d5 thru 0x17c2d92 (0x5bbe bytes) 2024-09-14T05:59:55.449 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:55.444+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:55.449 INFO:teuthology.orchestra.run.smithi006.stdout:2619 trunc from 0xdfbed98 to 0xb3f3ddd 2024-09-14T05:59:55.460 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:55.460 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:55.474 INFO:teuthology.orchestra.run.smithi006.stdout:2623 trunc from 0xb3f3ddd to 0x3b790f3 2024-09-14T05:59:55.489 INFO:teuthology.orchestra.run.smithi006.stdout:2624 trunc from 0x3b790f3 to 0x6971515 2024-09-14T05:59:55.517 INFO:teuthology.orchestra.run.smithi006.stdout:2625 writesame 0xb89b079 thru 0xb8a8ffd data_size 0x1(0xdf85 bytes) 2024-09-14T05:59:55.517 INFO:teuthology.orchestra.run.smithi006.stdout:2626 read 0x3fdbab5 thru 0x3fe1253 (0x579f bytes) 2024-09-14T05:59:55.517 INFO:teuthology.orchestra.run.smithi006.stdout:2627 write 0x987881a thru 0x987ee6f (0x6656 bytes) 2024-09-14T05:59:55.525 INFO:teuthology.orchestra.run.smithi006.stdout:2628 punch from 0x87755f4 to 0x87779a5, (0x23b1 bytes) 2024-09-14T05:59:55.525 INFO:teuthology.orchestra.run.smithi006.stdout:2629 writesame 0xa870309 thru 0xa871bb6 data_size 0x1b(0x18ae bytes) 2024-09-14T05:59:55.530 INFO:teuthology.orchestra.run.smithi006.stdout:2630 punch from 0x6c43407 to 0x6c4f3bc, (0xbfb5 bytes) 2024-09-14T05:59:55.541 INFO:teuthology.orchestra.run.smithi006.stdout:2631 trunc from 0xb8a8ffe to 0x4c088dc 2024-09-14T05:59:55.548 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:55.544+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:55.557 INFO:teuthology.orchestra.run.smithi006.stdout:2632 punch from 0x3ab69f3 to 0x3ab8d23, (0x2330 bytes) 2024-09-14T05:59:55.558 INFO:teuthology.orchestra.run.smithi006.stdout:2633 punch from 0x4b58fb2 to 0x4b59b4f, (0xb9d bytes) 2024-09-14T05:59:55.558 INFO:teuthology.orchestra.run.smithi006.stdout:2634 write 0x27db153 thru 0x27ea670 (0xf51e bytes) 2024-09-14T05:59:55.569 INFO:teuthology.orchestra.run.smithi006.stdout:2635 read 0x1c4efbc thru 0x1c5bf67 (0xcfac bytes) 2024-09-14T05:59:55.569 INFO:teuthology.orchestra.run.smithi006.stdout:2636 read 0x29f5d46 thru 0x2a01e55 (0xc110 bytes) 2024-09-14T05:59:55.569 INFO:teuthology.orchestra.run.smithi006.stdout:2638 read 0x204c66 thru 0x206962 (0x1cfd bytes) 2024-09-14T05:59:55.570 INFO:teuthology.orchestra.run.smithi006.stdout:2639 punch from 0x5f2b7f to 0x5f8c09, (0x608a bytes) 2024-09-14T05:59:55.570 INFO:teuthology.orchestra.run.smithi006.stdout:2640 read 0x2cfd094 thru 0x2d03d73 (0x6ce0 bytes) 2024-09-14T05:59:55.570 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:55.570 INFO:teuthology.orchestra.run.smithi006.stdout:2642 read 0x1ec2648 thru 0x1ecb8d2 (0x928b bytes) 2024-09-14T05:59:55.579 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:55.579 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:55.579 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:55.579 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:55.583 INFO:teuthology.orchestra.run.smithi006.stdout:2643 write 0x6a8ff13 thru 0x6a97c13 (0x7d01 bytes) 2024-09-14T05:59:55.589 INFO:teuthology.orchestra.run.smithi006.stdout:2644 punch from 0x58ad3ca to 0x58b3c68, (0x689e bytes) 2024-09-14T05:59:55.589 INFO:teuthology.orchestra.run.smithi006.stdout:2645 read 0x4c6d3f9 thru 0x4c74aad (0x76b5 bytes) 2024-09-14T05:59:55.594 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:59:55.596 INFO:teuthology.orchestra.run.smithi006.stdout:2646 trunc from 0x6a97c14 to 0x1e9d581 2024-09-14T05:59:55.624 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T05:59:55.625 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:59:55.631 INFO:teuthology.orchestra.run.smithi006.stdout:2647 write 0xacaef89 thru 0xacb223d (0x32b5 bytes) 2024-09-14T05:59:55.635 INFO:teuthology.orchestra.run.smithi006.stdout:2648 writesame 0x5143cd thru 0x5170a2 data_size 0x3(0x2cd6 bytes) 2024-09-14T05:59:55.640 INFO:teuthology.orchestra.run.smithi006.stdout:2651 writesame 0x1d88db thru 0x1df5bf data_size 0x1(0x6ce5 bytes) 2024-09-14T05:59:55.646 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:55.646 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:55.648 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:55.645+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:55.649 INFO:teuthology.orchestra.run.smithi006.stdout:2652 punch from 0x83e1639 to 0x83eca05, (0xb3cc bytes) 2024-09-14T05:59:55.649 INFO:teuthology.orchestra.run.smithi006.stdout:2653 write 0x4efc2de thru 0x4f0b784 (0xf4a7 bytes) 2024-09-14T05:59:55.660 INFO:teuthology.orchestra.run.smithi006.stdout:2657 write 0x69ee37a thru 0x69f650a (0x8191 bytes) 2024-09-14T05:59:55.666 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:55.666 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:55.671 INFO:teuthology.orchestra.run.smithi006.stdout:2658 trunc from 0xacb223e to 0x897c22a 2024-09-14T05:59:55.685 INFO:teuthology.orchestra.run.smithi006.stdout:2659 trunc from 0x897c22a to 0x9c9554a 2024-09-14T05:59:55.685 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:55.692 INFO:teuthology.orchestra.run.smithi006.stdout:2660 read 0x8a3fb73 thru 0x8a425e5 (0x2a73 bytes) 2024-09-14T05:59:55.692 INFO:teuthology.orchestra.run.smithi006.stdout:2661 read 0x39ab377 thru 0x39b8db9 (0xda43 bytes) 2024-09-14T05:59:55.692 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:55.692 INFO:teuthology.orchestra.run.smithi006.stdout:2664 punch from 0x759159d to 0x759f328, (0xdd8b bytes) 2024-09-14T05:59:55.692 INFO:teuthology.orchestra.run.smithi006.stdout:2665 read 0xbdc21a thru 0xbea09f (0xde86 bytes) 2024-09-14T05:59:55.692 INFO:teuthology.orchestra.run.smithi006.stdout:2666 punch from 0x8454562 to 0x8462acb, (0xe569 bytes) 2024-09-14T05:59:55.692 INFO:teuthology.orchestra.run.smithi006.stdout:2667 write 0xfe39c2 thru 0xfe9fa5 (0x65e4 bytes) 2024-09-14T05:59:55.700 INFO:teuthology.orchestra.run.smithi006.stdout:2668 read 0x112b590 thru 0x1133a24 (0x8495 bytes) 2024-09-14T05:59:55.700 INFO:teuthology.orchestra.run.smithi006.stdout:2669 writesame 0x1889373 thru 0x1892ceb data_size 0x1(0x9979 bytes) 2024-09-14T05:59:55.706 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:55.719 INFO:teuthology.orchestra.run.smithi006.stdout:2672 write 0x7b89b12 thru 0x7b8cf59 (0x3448 bytes) 2024-09-14T05:59:55.725 INFO:teuthology.orchestra.run.smithi006.stdout:2674 read 0x27e899e thru 0x27ee2e7 (0x594a bytes) 2024-09-14T05:59:55.725 INFO:teuthology.orchestra.run.smithi006.stdout:2675 read 0x929e0e0 thru 0x92a73b2 (0x92d3 bytes) 2024-09-14T05:59:55.725 INFO:teuthology.orchestra.run.smithi006.stdout:2676 clone 19 order 19 su 2048 sc 2 2024-09-14T05:59:55.734 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:55.735 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:55.749 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:55.745+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:55.754 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:55.755 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:55.766 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:55.766 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:55.773 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:55.773 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:55.781 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:59:55.850 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T05:59:55.848+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T05:59:55.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:59:55.901 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:55.901 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:55.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:59:55.961 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:55.960+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:55.988 INFO:teuthology.orchestra.run.smithi006.stdout:flattening image image_client.0-clone18 2024-09-14T05:59:56.051 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:56.049+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:56.080 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:56.080 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:56.096 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:59:56.152 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:56.149+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:56.156 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-14T05:59:56.221 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:56.222 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:56.236 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:59:56.281 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:56.280+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:56.354 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:56.352+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:56.360 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:56.361 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:56.375 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T05:59:56.461 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:56.460+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:56.542 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:56.542 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:56.555 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:56.553+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:56.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T05:59:56.564 INFO:teuthology.orchestra.run.smithi006.stdout:2678 write 0x9d0ff7d thru 0x9d112a1 (0x1325 bytes) 2024-09-14T05:59:56.575 INFO:teuthology.orchestra.run.smithi006.stdout:2680 trunc from 0x9d112a2 to 0xc08622e 2024-09-14T05:59:56.585 INFO:teuthology.orchestra.run.smithi006.stdout:2681 writesame 0x437bb0b thru 0x4389b07 data_size 0x1(0xdffd bytes) 2024-09-14T05:59:56.656 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:56.653+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:56.660 INFO:teuthology.orchestra.run.smithi006.stdout:2682 trunc from 0xc08622e to 0x4f675a0 2024-09-14T05:59:56.730 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:56.730 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:56.730 INFO:teuthology.orchestra.run.smithi006.stdout:2683 punch from 0x27940cf to 0x27a2ce9, (0xec1a bytes) 2024-09-14T05:59:56.736 INFO:teuthology.orchestra.run.smithi006.stdout:2684 trunc from 0x4f675a0 to 0x7ce9ad1 2024-09-14T05:59:56.745 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T05:59:56.754 INFO:teuthology.orchestra.run.smithi006.stdout:2685 trunc from 0x7ce9ad1 to 0x580ef71 2024-09-14T05:59:56.770 INFO:teuthology.orchestra.run.smithi006.stdout:2686 trunc from 0x580ef71 to 0x2fb90ea 2024-09-14T05:59:56.788 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:56.788+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:56.800 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-14T05:59:56.800 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:59:56.800 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-14T05:59:56.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-14T05:59:56.837 INFO:teuthology.orchestra.run.smithi006.stdout:2687 write 0xbf7afd8 thru 0xbf8321b (0x8244 bytes) 2024-09-14T05:59:56.844 INFO:teuthology.orchestra.run.smithi006.stdout:2688 read 0x104db61 thru 0x105ce8c (0xf32c bytes) 2024-09-14T05:59:56.848 INFO:teuthology.orchestra.run.smithi006.stdout:2689 read 0x3994e90 thru 0x399a5dd (0x574e bytes) 2024-09-14T05:59:56.848 INFO:teuthology.orchestra.run.smithi006.stdout:2690 writesame 0x7f2e15b thru 0x7f375c1 data_size 0x1(0x9467 bytes) 2024-09-14T05:59:56.858 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:56.856+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:56.870 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:56.876 INFO:teuthology.orchestra.run.smithi006.stdout:2692 trunc from 0xbf8321c to 0x96a5f26 2024-09-14T05:59:56.881 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:56.881 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:56.897 INFO:teuthology.orchestra.run.smithi006.stdout:2693 punch from 0x8aa78d4 to 0x8aac458, (0x4b84 bytes) 2024-09-14T05:59:56.898 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T05:59:56.904 INFO:teuthology.orchestra.run.smithi006.stdout:2694 trunc from 0x96a5f26 to 0x6a2b257 2024-09-14T05:59:56.909 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2024-09-14T05:59:56.935 INFO:teuthology.orchestra.run.smithi006.stdout:2696 trunc from 0x6a2b257 to 0x233c32f 2024-09-14T05:59:56.958 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:56.957+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:56.959 INFO:teuthology.orchestra.run.smithi006.stdout:2697 read 0x295ab0 thru 0x29f900 (0x9e51 bytes) 2024-09-14T05:59:56.990 INFO:teuthology.orchestra.run.smithi006.stdout:2698 writesame 0xe5f2899 thru 0xe5f83b1 data_size 0x1(0x5b19 bytes) 2024-09-14T05:59:56.990 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:56.990 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:56.991 INFO:teuthology.orchestra.run.smithi006.stdout:2701 writesame 0x5acf700 thru 0x5ad9345 data_size 0x53(0x9c46 bytes) 2024-09-14T05:59:57.002 INFO:teuthology.orchestra.run.smithi006.stdout:2702 write 0xe9588ac thru 0xe962c19 (0xa36e bytes) 2024-09-14T05:59:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T05:59:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T05:59:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T05:59:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T05:59:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T05:59:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T05:59:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T05:59:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T05:59:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T05:59:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T05:59:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T05:59:57.006 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T05:59:57.008 INFO:teuthology.orchestra.run.smithi006.stdout:2703 read 0x37f6ed7 thru 0x37fd798 (0x68c2 bytes) 2024-09-14T05:59:57.009 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T05:59:57.009 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T05:59:57.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-14T05:59:57.011 INFO:teuthology.orchestra.run.smithi006.stdout:2704 trunc from 0xe962c1a to 0xca7a033 2024-09-14T05:59:57.023 INFO:teuthology.orchestra.run.smithi006.stdout:2705 read 0xa81ef03 thru 0xa828d1a (0x9e18 bytes) 2024-09-14T05:59:57.024 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.024 INFO:teuthology.orchestra.run.smithi006.stdout:2707 writesame 0x4eb54bd thru 0x4ec1d3f data_size 0x1(0xc883 bytes) 2024-09-14T05:59:57.047 INFO:teuthology.orchestra.run.smithi006.stdout:2708 punch from 0x62746fc to 0x627f510, (0xae14 bytes) 2024-09-14T05:59:57.047 INFO:teuthology.orchestra.run.smithi006.stdout:2709 read 0x56a9b92 thru 0x56b7ab2 (0xdf21 bytes) 2024-09-14T05:59:57.048 INFO:teuthology.orchestra.run.smithi006.stdout:2711 punch from 0x72b5ee9 to 0x72c3d40, (0xde57 bytes) 2024-09-14T05:59:57.048 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.057 INFO:teuthology.orchestra.run.smithi006.stdout:2713 trunc from 0xca7a033 to 0x620a3da 2024-09-14T05:59:57.059 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:57.057+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:57.067 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.068 INFO:teuthology.orchestra.run.smithi006.stdout:2715 write 0x5742f68 thru 0x57447ab (0x1844 bytes) 2024-09-14T05:59:57.071 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:57.071 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:57.085 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T05:59:57.094 INFO:teuthology.orchestra.run.smithi006.stdout:2716 write 0xec62066 thru 0xec657a3 (0x373e bytes) 2024-09-14T05:59:57.099 INFO:teuthology.orchestra.run.smithi006.stdout:2718 read 0xcae2b93 thru 0xcaeb380 (0x87ee bytes) 2024-09-14T05:59:57.099 INFO:teuthology.orchestra.run.smithi006.stdout:2720 writesame 0xe61a50b thru 0xe61d87f data_size 0x1(0x3375 bytes) 2024-09-14T05:59:57.107 INFO:teuthology.orchestra.run.smithi006.stdout:2721 read 0xc70814a thru 0xc70f95e (0x7815 bytes) 2024-09-14T05:59:57.107 INFO:teuthology.orchestra.run.smithi006.stdout:2722 writesame 0xbc7e7bc thru 0xbc87c44 data_size 0x19(0x9489 bytes) 2024-09-14T05:59:57.112 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.112 INFO:teuthology.orchestra.run.smithi006.stdout:2725 write 0x586e170 thru 0x586ff6f (0x1e00 bytes) 2024-09-14T05:59:57.116 INFO:teuthology.orchestra.run.smithi006.stdout:2726 write 0x7e88bac thru 0x7e91d9f (0x91f4 bytes) 2024-09-14T05:59:57.121 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.121 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.121 INFO:teuthology.orchestra.run.smithi006.stdout:2730 writesame 0xcb72f0c thru 0xcb82421 data_size 0x3(0xf516 bytes) 2024-09-14T05:59:57.135 INFO:teuthology.orchestra.run.smithi006.stdout:2731 write 0x9c1b293 thru 0x9c1b92b (0x699 bytes) 2024-09-14T05:59:57.142 INFO:teuthology.orchestra.run.smithi006.stdout:2732 write 0xd269d8f thru 0xd274e26 (0xb098 bytes) 2024-09-14T05:59:57.150 INFO:teuthology.orchestra.run.smithi006.stdout:2734 read 0x25f3e6b thru 0x2603ca9 (0xfe3f bytes) 2024-09-14T05:59:57.150 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.150 INFO:teuthology.orchestra.run.smithi006.stdout:2739 punch from 0x5628e64 to 0x562e435, (0x55d1 bytes) 2024-09-14T05:59:57.150 INFO:teuthology.orchestra.run.smithi006.stdout:2741 write 0x6dc043 thru 0x6e93f6 (0xd3b4 bytes) 2024-09-14T05:59:57.160 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:57.157+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:57.166 INFO:teuthology.orchestra.run.smithi006.stdout:2742 write 0x2015bfd thru 0x20203e1 (0xa7e5 bytes) 2024-09-14T05:59:57.174 INFO:teuthology.orchestra.run.smithi006.stdout:2743 write 0x51b0ef2 thru 0x51be883 (0xd992 bytes) 2024-09-14T05:59:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T05:59:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T05:59:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T05:59:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T05:59:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T05:59:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T05:59:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T05:59:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T05:59:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T05:59:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T05:59:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T05:59:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T05:59:57.180 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.181 INFO:teuthology.orchestra.run.smithi006.stdout:2746 punch from 0x86d82b5 to 0x86dec10, (0x695b bytes) 2024-09-14T05:59:57.181 INFO:teuthology.orchestra.run.smithi006.stdout:2747 read 0xdcb9772 thru 0xdcc4b41 (0xb3d0 bytes) 2024-09-14T05:59:57.181 INFO:teuthology.orchestra.run.smithi006.stdout:2749 writesame 0x72acd15 thru 0x72b5960 data_size 0x92(0x8c4c bytes) 2024-09-14T05:59:57.182 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T05:59:57.183 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T05:59:57.183 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-14T05:59:57.188 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.188 INFO:teuthology.orchestra.run.smithi006.stdout:2752 punch from 0xcf7c393 to 0xcf7ca07, (0x674 bytes) 2024-09-14T05:59:57.188 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.188 INFO:teuthology.orchestra.run.smithi006.stdout:2754 write 0xca16fbc thru 0xca2697f (0xf9c4 bytes) 2024-09-14T05:59:57.194 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.194 INFO:teuthology.orchestra.run.smithi006.stdout:2758 punch from 0xe21c5e6 to 0xe22a4c4, (0xdede bytes) 2024-09-14T05:59:57.215 INFO:teuthology.orchestra.run.smithi006.stdout:2761 trunc from 0xec657a4 to 0x427925 2024-09-14T05:59:57.217 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:57.217 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:57.237 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T05:59:57.280 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:57.280+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:57.284 INFO:teuthology.orchestra.run.smithi006.stdout:2763 write 0xc9bc3f2 thru 0xc9c3f9a (0x7ba9 bytes) 2024-09-14T05:59:57.291 INFO:teuthology.orchestra.run.smithi006.stdout:2764 write 0xb85fc3e thru 0xb867fb4 (0x8377 bytes) 2024-09-14T05:59:57.296 INFO:teuthology.orchestra.run.smithi006.stdout:2766 writesame 0x68bad47 thru 0x68c6588 data_size 0xa(0xb842 bytes) 2024-09-14T05:59:57.312 INFO:teuthology.orchestra.run.smithi006.stdout:2767 write 0xd9dd021 thru 0xd9e6924 (0x9904 bytes) 2024-09-14T05:59:57.321 INFO:teuthology.orchestra.run.smithi006.stdout:2769 writesame 0x737e7aa thru 0x7383401 data_size 0x1c(0x4c58 bytes) 2024-09-14T05:59:57.326 INFO:teuthology.orchestra.run.smithi006.stdout:2770 read 0xd619123 thru 0xd6194cc (0x3aa bytes) 2024-09-14T05:59:57.331 INFO:teuthology.orchestra.run.smithi006.stdout:2771 trunc from 0xd9e6925 to 0xa8285af 2024-09-14T05:59:57.358 INFO:teuthology.orchestra.run.smithi006.stdout:2773 trunc from 0xa8285af to 0x34348f2 2024-09-14T05:59:57.362 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:57.360+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:57.370 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:57.370 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:57.372 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T05:59:57.372 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T05:59:57.372 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T05:59:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T05:59:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T05:59:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T05:59:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T05:59:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T05:59:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T05:59:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T05:59:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T05:59:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T05:59:57.375 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T05:59:57.376 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T05:59:57.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-14T05:59:57.377 INFO:teuthology.orchestra.run.smithi006.stdout:2774 write 0x1fa6413 thru 0x1fb09e5 (0xa5d3 bytes) 2024-09-14T05:59:57.382 INFO:teuthology.orchestra.run.smithi006.stdout:2775 punch from 0x290c27c to 0x2915ee1, (0x9c65 bytes) 2024-09-14T05:59:57.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:59:57.404 INFO:teuthology.orchestra.run.smithi006.stdout:2776 writesame 0xc9544c3 thru 0xc95964e data_size 0x22(0x518c bytes) 2024-09-14T05:59:57.404 INFO:teuthology.orchestra.run.smithi006.stdout:2777 punch from 0x9d09b3f to 0x9d155c9, (0xba8a bytes) 2024-09-14T05:59:57.404 INFO:teuthology.orchestra.run.smithi006.stdout:2779 read 0x776a124 thru 0x7775b85 (0xba62 bytes) 2024-09-14T05:59:57.405 INFO:teuthology.orchestra.run.smithi006.stdout:2780 punch from 0xa9f9990 to 0xaa07b7c, (0xe1ec bytes) 2024-09-14T05:59:57.414 INFO:teuthology.orchestra.run.smithi006.stdout:2782 writesame 0xde93618 thru 0xde993bf data_size 0x6f(0x5da8 bytes) 2024-09-14T05:59:57.414 INFO:teuthology.orchestra.run.smithi006.stdout:2783 write 0xd0215b9 thru 0xd02dd2c (0xc774 bytes) 2024-09-14T05:59:57.419 INFO:teuthology.orchestra.run.smithi006.stdout:2784 read 0xb71f01d thru 0xb727ee6 (0x8eca bytes) 2024-09-14T05:59:57.419 INFO:teuthology.orchestra.run.smithi006.stdout:2787 writesame 0xbb450b1 thru 0xbb4e462 data_size 0x5f(0x93b2 bytes) 2024-09-14T05:59:57.424 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.424 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.424 INFO:teuthology.orchestra.run.smithi006.stdout:2791 writesame 0x9aaaaad thru 0x9aba330 data_size 0xa(0xf884 bytes) 2024-09-14T05:59:57.430 INFO:teuthology.orchestra.run.smithi006.stdout:2792 punch from 0xb7934e to 0xb80cdc, (0x798e bytes) 2024-09-14T05:59:57.430 INFO:teuthology.orchestra.run.smithi006.stdout:2793 writesame 0xab1c21e thru 0xab28d84 data_size 0x11(0xcb67 bytes) 2024-09-14T05:59:57.436 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.436 INFO:teuthology.orchestra.run.smithi006.stdout:2796 write 0x4a4b013 thru 0x4a59d06 (0xecf4 bytes) 2024-09-14T05:59:57.441 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.449 INFO:teuthology.orchestra.run.smithi006.stdout:2798 trunc from 0xde993c0 to 0x85e6958 2024-09-14T05:59:57.462 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:57.461+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:57.468 INFO:teuthology.orchestra.run.smithi006.stdout:2799 read 0x49429cd thru 0x494fc4a (0xd27e bytes) 2024-09-14T05:59:57.468 INFO:teuthology.orchestra.run.smithi006.stdout:2801 read 0x1285c7a thru 0x1292166 (0xc4ed bytes) 2024-09-14T05:59:57.468 INFO:teuthology.orchestra.run.smithi006.stdout:2802 read 0x1118937 thru 0x1121408 (0x8ad2 bytes) 2024-09-14T05:59:57.479 INFO:teuthology.orchestra.run.smithi006.stdout:2804 write 0x95df156 thru 0x95e6465 (0x7310 bytes) 2024-09-14T05:59:57.485 INFO:teuthology.orchestra.run.smithi006.stdout:2805 read 0x2fd62dd thru 0x2fde941 (0x8665 bytes) 2024-09-14T05:59:57.486 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.486 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.486 INFO:teuthology.orchestra.run.smithi006.stdout:2809 read 0x7a05516 thru 0x7a059ae (0x499 bytes) 2024-09-14T05:59:57.486 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.486 INFO:teuthology.orchestra.run.smithi006.stdout:2812 read 0x2dd01b7 thru 0x2ddd2c9 (0xd113 bytes) 2024-09-14T05:59:57.486 INFO:teuthology.orchestra.run.smithi006.stdout:2815 read 0x50db4a2 thru 0x50dd7a3 (0x2302 bytes) 2024-09-14T05:59:57.486 INFO:teuthology.orchestra.run.smithi006.stdout:2816 read 0x1b7b67c thru 0x1b86356 (0xacdb bytes) 2024-09-14T05:59:57.486 INFO:teuthology.orchestra.run.smithi006.stdout:2818 read 0x54cc1e5 thru 0x54ce7e7 (0x2603 bytes) 2024-09-14T05:59:57.486 INFO:teuthology.orchestra.run.smithi006.stdout:2819 write 0x5d7febb thru 0x5d86c29 (0x6d6f bytes) 2024-09-14T05:59:57.492 INFO:teuthology.orchestra.run.smithi006.stdout:2820 read 0x1147434 thru 0x115219c (0xad69 bytes) 2024-09-14T05:59:57.492 INFO:teuthology.orchestra.run.smithi006.stdout:2822 punch from 0x34faaed to 0x3506de2, (0xc2f5 bytes) 2024-09-14T05:59:57.493 INFO:teuthology.orchestra.run.smithi006.stdout:2823 read 0x52e26e6 thru 0x52e7be1 (0x54fc bytes) 2024-09-14T05:59:57.493 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.507 INFO:teuthology.orchestra.run.smithi006.stdout:2825 writesame 0xb5872f4 thru 0xb596322 data_size 0x1(0xf02f bytes) 2024-09-14T05:59:57.518 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:57.519 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:57.521 INFO:teuthology.orchestra.run.smithi006.stdout:2826 write 0xdd53957 thru 0xdd5e908 (0xafb2 bytes) 2024-09-14T05:59:57.529 INFO:teuthology.orchestra.run.smithi006.stdout:2827 read 0x45af349 thru 0x45b9baa (0xa862 bytes) 2024-09-14T05:59:57.529 INFO:teuthology.orchestra.run.smithi006.stdout:2828 write 0x863802 thru 0x86e978 (0xb177 bytes) 2024-09-14T05:59:57.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:59:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T05:59:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T05:59:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T05:59:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T05:59:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T05:59:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T05:59:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T05:59:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T05:59:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T05:59:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T05:59:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T05:59:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T05:59:57.551 INFO:teuthology.orchestra.run.smithi006.stdout:2829 trunc from 0xdd5e909 to 0x1eb9086 2024-09-14T05:59:57.552 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T05:59:57.552 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T05:59:57.552 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 'trim stale osdmaps' 2024-09-14T05:59:57.575 INFO:teuthology.orchestra.run.smithi006.stdout:2830 punch from 0x107ae38 to 0x1082852, (0x7a1a bytes) 2024-09-14T05:59:57.576 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:57.573+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:57.591 INFO:teuthology.orchestra.run.smithi006.stdout:2831 write 0x56d7995 thru 0x56e0151 (0x87bd bytes) 2024-09-14T05:59:57.612 INFO:teuthology.orchestra.run.smithi006.stdout:2833 write 0x57abc25 thru 0x57add2e (0x210a bytes) 2024-09-14T05:59:57.619 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:57.633 INFO:teuthology.orchestra.run.smithi006.stdout:2835 write 0x833d830 thru 0x8341eba (0x468b bytes) 2024-09-14T05:59:57.643 INFO:teuthology.orchestra.run.smithi006.stdout:2836 read 0x1267e03 thru 0x12721c3 (0xa3c1 bytes) 2024-09-14T05:59:57.644 INFO:teuthology.orchestra.run.smithi006.stdout:2838 flatten 2024-09-14T05:59:57.665 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:57.661+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:57.686 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:57.686 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:57.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:59:57.756 INFO:teuthology.orchestra.run.smithi006.stdout:2839 write 0x459d3db thru 0x45a484a (0x7470 bytes) 2024-09-14T05:59:57.761 INFO:teuthology.orchestra.run.smithi006.stdout:2841 writesame 0x38f8d70 thru 0x39028e1 data_size 0x2(0x9b72 bytes) 2024-09-14T05:59:57.764 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:57.764+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T05:59:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T05:59:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T05:59:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T05:59:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T05:59:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T05:59:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T05:59:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T05:59:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T05:59:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T05:59:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T05:59:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T05:59:57.773 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T05:59:57.774 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T05:59:57.774 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 'trim stale osdmaps' 2024-09-14T05:59:57.776 INFO:teuthology.orchestra.run.smithi006.stdout:2844 write 0x8f4e0fe thru 0x8f5d001 (0xef04 bytes) 2024-09-14T05:59:57.782 INFO:teuthology.orchestra.run.smithi006.stdout:2845 punch from 0x745069c to 0x7457bae, (0x7512 bytes) 2024-09-14T05:59:57.791 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:59:57.793 INFO:teuthology.orchestra.run.smithi006.stdout:2846 write 0xd78ce2c thru 0xd790f82 (0x4157 bytes) 2024-09-14T05:59:57.798 INFO:teuthology.orchestra.run.smithi006.stdout:2847 write 0xca6f31d thru 0xca7de6f (0xeb53 bytes) 2024-09-14T05:59:57.803 INFO:teuthology.orchestra.run.smithi006.stdout:2848 punch from 0x832ba45 to 0x832cc2c, (0x11e7 bytes) 2024-09-14T05:59:57.803 INFO:teuthology.orchestra.run.smithi006.stdout:2849 clone 20 order 19 su 16384 sc 4 2024-09-14T05:59:57.865 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:57.861+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:57.873 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T05:59:57.873 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:59:57.888 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:59:57.942 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T05:59:57.942 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T05:59:57.942 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T05:59:57.942 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T05:59:57.942 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T05:59:57.942 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T05:59:57.942 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T05:59:57.942 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T05:59:57.942 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T05:59:57.942 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T05:59:57.943 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T05:59:57.943 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T05:59:57.943 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T05:59:57.943 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:59:57.945 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T05:59:57.946 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T05:59:57.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 'trim stale osdmaps' 2024-09-14T05:59:57.960 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T05:59:57.961 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:59:57.966 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T05:59:57.964+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T05:59:57.980 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T05:59:57.980 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:59:58.007 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T05:59:58.007 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:59:58.028 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T05:59:58.028 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:59:58.052 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:58.052 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:58.052 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:58.052 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:58.064 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T05:59:58.065 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:59:58.066 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:58.064+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:58.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:59:58.088 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T05:59:58.089 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T05:59:58.124 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T05:59:58.124 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T05:59:58.137 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T05:59:58.137 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T05:59:58.137 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T05:59:58.137 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T05:59:58.137 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T05:59:58.137 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T05:59:58.137 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T05:59:58.137 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T05:59:58.137 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T05:59:58.138 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T05:59:58.138 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T05:59:58.138 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T05:59:58.139 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T05:59:58.139 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T05:59:58.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 'trim stale osdmaps' 2024-09-14T05:59:58.191 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:58.189+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-14T05:59:58.205 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:58.205 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:58.205 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:58.206 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:58.206 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:58.223 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:59:58.267 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:58.265+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T05:59:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T05:59:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T05:59:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T05:59:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T05:59:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T05:59:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T05:59:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T05:59:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T05:59:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T05:59:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T05:59:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T05:59:58.345 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T05:59:58.345 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T05:59:58.368 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:58.364+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:58.392 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:58.392 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:58.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:58.392 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:58.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.392 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57124 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.393 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751064+0000", 2024-09-14T05:59:58.393 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.640064282, 2024-09-14T05:59:58.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.044798303999999997, 2024-09-14T05:59:58.393 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.393 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.393 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.393 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.393 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.393 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.393 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57124 2024-09-14T05:59:58.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.393 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751064+0000", 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751064+0000", 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751065+0000", 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6200000000000006e-07 2024-09-14T05:59:58.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751070+0000", 2024-09-14T05:59:58.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1959999999999999e-06 2024-09-14T05:59:58.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751087+0000", 2024-09-14T05:59:58.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6249e-05 2024-09-14T05:59:58.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751096+0000", 2024-09-14T05:59:58.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3519999999999996e-06 2024-09-14T05:59:58.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.795542+0000", 2024-09-14T05:59:58.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.044445813000000001 2024-09-14T05:59:58.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.795623+0000", 2024-09-14T05:59:58.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1317999999999996e-05 2024-09-14T05:59:58.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.795863+0000", 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000239414 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57125 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 243712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751110+0000", 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.6400187509999999, 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045121582, 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.397 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57125 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751110+0000", 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751110+0000", 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751111+0000", 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4199999999999995e-07 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751127+0000", 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6200000000000001e-05 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751143+0000", 2024-09-14T05:59:58.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6013999999999999e-05 2024-09-14T05:59:58.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751154+0000", 2024-09-14T05:59:58.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1622e-05 2024-09-14T05:59:58.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.795885+0000", 2024-09-14T05:59:58.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.044730704000000003 2024-09-14T05:59:58.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.795972+0000", 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6730999999999993e-05 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.796231+0000", 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025956900000000002 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57126 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751170+0000", 2024-09-14T05:59:58.401 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.639958155, 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045455310999999998, 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57126 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751170+0000", 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751170+0000", 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751171+0000", 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8000000000000005e-07 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751175+0000", 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0899999999999998e-06 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751188+0000", 2024-09-14T05:59:58.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.309e-05 2024-09-14T05:59:58.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751197+0000", 2024-09-14T05:59:58.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9290000000000004e-06 2024-09-14T05:59:58.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.796270+0000", 2024-09-14T05:59:58.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045072438999999999 2024-09-14T05:59:58.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.796363+0000", 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2952e-05 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.796626+0000", 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000263031 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57127 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 276480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.405 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751215+0000", 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.639913462, 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045954936000000002, 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57127 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751215+0000", 2024-09-14T05:59:58.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751215+0000", 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751216+0000", 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6199999999999996e-07 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751220+0000", 2024-09-14T05:59:58.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.498e-06 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751234+0000", 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3203999999999999e-05 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751245+0000", 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1786e-05 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.796683+0000", 2024-09-14T05:59:58.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045437014999999997 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.796798+0000", 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000115621 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797170+0000", 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00037195000000000001 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57128 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 292864~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751261+0000", 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.6398674020000001, 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046282656999999998, 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57128 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751261+0000", 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751261+0000", 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751262+0000", 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1800000000000005e-07 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751266+0000", 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751278+0000", 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2612000000000001e-05 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751288+0000", 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8199999999999992e-06 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797214+0000", 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045925437 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797289+0000", 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.559e-05 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797544+0000", 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025461400000000001 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.413 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57129 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 309248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751304+0000", 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.6398246360000002, 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046642827999999997, 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57129 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751304+0000", 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751304+0000", 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751305+0000", 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751309+0000", 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4630000000000003e-06 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751321+0000", 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2018000000000001e-05 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751331+0000", 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2040000000000003e-06 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797547+0000", 2024-09-14T05:59:58.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046216220000000002 2024-09-14T05:59:58.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797661+0000", 2024-09-14T05:59:58.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000114539 2024-09-14T05:59:58.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797947+0000", 2024-09-14T05:59:58.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028538400000000002 2024-09-14T05:59:58.417 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57130 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 325632~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751342+0000", 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.639786279, 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.047033332999999997, 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57130 2024-09-14T05:59:58.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751342+0000", 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751342+0000", 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751343+0000", 2024-09-14T05:59:58.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7800000000000001e-07 2024-09-14T05:59:58.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751346+0000", 2024-09-14T05:59:58.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.422e-06 2024-09-14T05:59:58.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751359+0000", 2024-09-14T05:59:58.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.26e-05 2024-09-14T05:59:58.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751369+0000", 2024-09-14T05:59:58.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6059999999999992e-06 2024-09-14T05:59:58.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797995+0000", 2024-09-14T05:59:58.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046626735000000002 2024-09-14T05:59:58.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.798090+0000", 2024-09-14T05:59:58.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4739000000000002e-05 2024-09-14T05:59:58.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.798376+0000", 2024-09-14T05:59:58.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028555300000000002 2024-09-14T05:59:58.422 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.422 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.422 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.422 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57131 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 342016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.422 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751382+0000", 2024-09-14T05:59:58.422 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.6397470410000001, 2024-09-14T05:59:58.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.047436074000000002, 2024-09-14T05:59:58.422 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.423 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.423 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.423 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.423 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.423 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.423 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57131 2024-09-14T05:59:58.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.423 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751382+0000", 2024-09-14T05:59:58.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751382+0000", 2024-09-14T05:59:58.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751382+0000", 2024-09-14T05:59:58.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7400000000000002e-07 2024-09-14T05:59:58.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751385+0000", 2024-09-14T05:59:58.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9340000000000002e-06 2024-09-14T05:59:58.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751393+0000", 2024-09-14T05:59:58.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.294e-06 2024-09-14T05:59:58.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751398+0000", 2024-09-14T05:59:58.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2020000000000003e-06 2024-09-14T05:59:58.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.798436+0000", 2024-09-14T05:59:58.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.047038583000000002 2024-09-14T05:59:58.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.798543+0000", 2024-09-14T05:59:58.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000106844 2024-09-14T05:59:58.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.798818+0000", 2024-09-14T05:59:58.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027444299999999997 2024-09-14T05:59:58.426 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.426 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.427 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.427 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57132 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.427 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751461+0000", 2024-09-14T05:59:58.427 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.6396674999999998, 2024-09-14T05:59:58.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.047739358000000003, 2024-09-14T05:59:58.427 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.427 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.427 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.427 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.427 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.427 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.427 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57132 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751461+0000", 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751461+0000", 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751462+0000", 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.034e-06 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751466+0000", 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.16e-06 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751483+0000", 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7158000000000001e-05 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751494+0000", 2024-09-14T05:59:58.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0974e-05 2024-09-14T05:59:58.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.798867+0000", 2024-09-14T05:59:58.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.047372174000000003 2024-09-14T05:59:58.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.798948+0000", 2024-09-14T05:59:58.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1079000000000001e-05 2024-09-14T05:59:58.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.799200+0000", 2024-09-14T05:59:58.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025277900000000001 2024-09-14T05:59:58.431 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.431 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.431 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.431 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57133 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 374784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.431 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751514+0000", 2024-09-14T05:59:58.431 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.6396145820000001, 2024-09-14T05:59:58.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048141397000000002, 2024-09-14T05:59:58.431 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.431 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57133 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751514+0000", 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751514+0000", 2024-09-14T05:59:58.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751515+0000", 2024-09-14T05:59:58.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4e-07 2024-09-14T05:59:58.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751517+0000", 2024-09-14T05:59:58.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5560000000000002e-06 2024-09-14T05:59:58.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751531+0000", 2024-09-14T05:59:58.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3818000000000001e-05 2024-09-14T05:59:58.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751540+0000", 2024-09-14T05:59:58.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8489999999999995e-06 2024-09-14T05:59:58.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.799250+0000", 2024-09-14T05:59:58.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.047710176999999999 2024-09-14T05:59:58.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.799361+0000", 2024-09-14T05:59:58.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000110414 2024-09-14T05:59:58.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.799655+0000", 2024-09-14T05:59:58.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029474299999999998 2024-09-14T05:59:58.435 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.435 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.435 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57134 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 391168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751555+0000", 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.6395735409999999, 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048484318999999998, 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57134 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.436 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751555+0000", 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751555+0000", 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751556+0000", 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3799999999999996e-07 2024-09-14T05:59:58.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751561+0000", 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7439999999999998e-06 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751574+0000", 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2918000000000001e-05 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751582+0000", 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8640000000000002e-06 2024-09-14T05:59:58.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.799701+0000", 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048118952 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.799765+0000", 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3382999999999999e-05 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800039+0000", 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027462 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.439 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57135 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 407552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751597+0000", 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.6395314010000002, 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048760876000000002, 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57135 2024-09-14T05:59:58.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751597+0000", 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751597+0000", 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751598+0000", 2024-09-14T05:59:58.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6799999999999999e-07 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751602+0000", 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2239999999999997e-06 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751612+0000", 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0274e-05 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751622+0000", 2024-09-14T05:59:58.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4339999999999998e-06 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800062+0000", 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048439647000000002 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800119+0000", 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7507999999999999e-05 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800358+0000", 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023902099999999999 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.443 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57136 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 423936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751636+0000", 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.6394921990000002, 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049133920999999997, 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57136 2024-09-14T05:59:58.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751636+0000", 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751636+0000", 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751637+0000", 2024-09-14T05:59:58.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3e-07 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751641+0000", 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0899999999999998e-06 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751655+0000", 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3317e-05 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751664+0000", 2024-09-14T05:59:58.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7240000000000004e-06 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800405+0000", 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048741189999999997 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800508+0000", 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102902 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800770+0000", 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026196800000000001 2024-09-14T05:59:58.447 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57137 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 440320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751680+0000", 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.6394485680000002, 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.04945397, 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57137 2024-09-14T05:59:58.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751680+0000", 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751680+0000", 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751681+0000", 2024-09-14T05:59:58.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8800000000000002e-07 2024-09-14T05:59:58.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.450 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.450 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751696+0000", 2024-09-14T05:59:58.450 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5483999999999999e-05 2024-09-14T05:59:58.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.450 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.450 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751713+0000", 2024-09-14T05:59:58.450 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7005999999999999e-05 2024-09-14T05:59:58.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751724+0000", 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0464e-05 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800814+0000", 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049090434000000002 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800888+0000", 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3533000000000002e-05 2024-09-14T05:59:58.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801134+0000", 2024-09-14T05:59:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024626100000000001 2024-09-14T05:59:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57138 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 456704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751741+0000", 2024-09-14T05:59:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.6393877560000001, 2024-09-14T05:59:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049838514, 2024-09-14T05:59:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57138 2024-09-14T05:59:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751741+0000", 2024-09-14T05:59:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751741+0000", 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751742+0000", 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8999999999999995e-07 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751746+0000", 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5159999999999996e-06 2024-09-14T05:59:58.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751758+0000", 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2182e-05 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751768+0000", 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4450000000000002e-06 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801211+0000", 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049443576000000003 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801333+0000", 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000121826 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801579+0000", 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024607900000000001 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57139 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 473088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.456 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751786+0000", 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.6393428750000001, 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050106650000000003, 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57139 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751786+0000", 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751786+0000", 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751787+0000", 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1999999999999998e-07 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751791+0000", 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3800000000000004e-06 2024-09-14T05:59:58.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751804+0000", 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2680000000000001e-05 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751813+0000", 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6180000000000001e-06 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801619+0000", 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049805823999999999 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801677+0000", 2024-09-14T05:59:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8227999999999999e-05 2024-09-14T05:59:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801892+0000", 2024-09-14T05:59:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021499999999999999 2024-09-14T05:59:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.460 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57140 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 489472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751827+0000", 2024-09-14T05:59:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.639301889, 2024-09-14T05:59:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050412314, 2024-09-14T05:59:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57140 2024-09-14T05:59:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.462 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751827+0000", 2024-09-14T05:59:58.462 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751827+0000", 2024-09-14T05:59:58.464 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751828+0000", 2024-09-14T05:59:58.464 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0200000000000001e-07 2024-09-14T05:59:58.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751831+0000", 2024-09-14T05:59:58.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9639999999999997e-06 2024-09-14T05:59:58.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751865+0000", 2024-09-14T05:59:58.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3973999999999997e-05 2024-09-14T05:59:58.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751877+0000", 2024-09-14T05:59:58.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1871e-05 2024-09-14T05:59:58.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801931+0000", 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050053562000000003 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802015+0000", 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3943000000000006e-05 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802239+0000", 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000224198 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.466 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57141 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751895+0000", 2024-09-14T05:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.6392334919999998, 2024-09-14T05:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.05065443, 2024-09-14T05:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57141 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751895+0000", 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751895+0000", 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751896+0000", 2024-09-14T05:59:58.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0599999999999999e-07 2024-09-14T05:59:58.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751906+0000", 2024-09-14T05:59:58.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0138e-05 2024-09-14T05:59:58.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751921+0000", 2024-09-14T05:59:58.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4715999999999999e-05 2024-09-14T05:59:58.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751931+0000", 2024-09-14T05:59:58.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.026e-05 2024-09-14T05:59:58.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802278+0000", 2024-09-14T05:59:58.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050347291000000002 2024-09-14T05:59:58.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802336+0000", 2024-09-14T05:59:58.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7868999999999998e-05 2024-09-14T05:59:58.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802550+0000", 2024-09-14T05:59:58.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021325000000000001 2024-09-14T05:59:58.471 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.471 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.471 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.471 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57142 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 522240~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751987+0000", 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.6391413730000002, 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050884757000000003, 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57142 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.472 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751987+0000", 2024-09-14T05:59:58.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751987+0000", 2024-09-14T05:59:58.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751988+0000", 2024-09-14T05:59:58.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.012e-06 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751993+0000", 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8040000000000001e-06 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.752008+0000", 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5012e-05 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.752021+0000", 2024-09-14T05:59:58.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2897999999999999e-05 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802576+0000", 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050554736000000003 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802633+0000", 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7569999999999999e-05 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802872+0000", 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023872499999999999 2024-09-14T05:59:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:59282 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:55.269668+0000", 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.1214604960000001, 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.044620580999999999, 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:58.476 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 59282 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.269668+0000", 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.269668+0000", 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.477 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.269669+0000", 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9400000000000004e-07 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.269673+0000", 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2189999999999998e-06 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.269689+0000", 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6104e-05 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.478 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.269698+0000", 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7700000000000007e-06 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.314017+0000", 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.044319003000000003 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.314074+0000", 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6647000000000002e-05 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.479 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.314289+0000", 2024-09-14T05:59:58.480 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021504400000000001 2024-09-14T05:59:58.480 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.480 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.480 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.480 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.480 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.480 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:58.481 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:59:58.482 INFO:teuthology.orchestra.run.smithi006.stdout:2850 read 0xd640021 thru 0xd648a41 (0x8a21 bytes) 2024-09-14T05:59:58.482 INFO:teuthology.orchestra.run.smithi006.stdout:2851 punch from 0x3e65fb5 to 0x3e6e7f0, (0x883b bytes) 2024-09-14T05:59:58.482 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:58.477+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:58.483 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:58.483 INFO:teuthology.orchestra.run.smithi006.stdout:2853 write 0x14dafe1 thru 0x14de0c1 (0x30e1 bytes) 2024-09-14T05:59:58.491 INFO:teuthology.orchestra.run.smithi006.stdout:2854 write 0xa97b15e thru 0xa9835ca (0x846d bytes) 2024-09-14T05:59:58.505 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:58.505 INFO:teuthology.orchestra.run.smithi006.stdout:2856 read 0x66df100 thru 0x66e89f8 (0x98f9 bytes) 2024-09-14T05:59:58.505 INFO:teuthology.orchestra.run.smithi006.stdout:2857 read 0x34726b6 thru 0x348022a (0xdb75 bytes) 2024-09-14T05:59:58.505 INFO:teuthology.orchestra.run.smithi006.stdout:2858 punch from 0x70bf121 to 0x70ce37f, (0xf25e bytes) 2024-09-14T05:59:58.505 INFO:teuthology.orchestra.run.smithi006.stdout:2859 read 0x2e83c3f thru 0x2e866fc (0x2abe bytes) 2024-09-14T05:59:58.510 INFO:teuthology.orchestra.run.smithi006.stdout:2861 trunc from 0xd790f83 to 0x881205b 2024-09-14T05:59:58.552 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:58.552 INFO:teuthology.orchestra.run.smithi006.stdout:2865 punch from 0x7f055ab to 0x7f122c6, (0xcd1b bytes) 2024-09-14T05:59:58.553 INFO:teuthology.orchestra.run.smithi006.stdout:2868 trunc from 0x881205b to 0x7aaa4c1 2024-09-14T05:59:58.583 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T05:59:58.581+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T05:59:58.596 INFO:teuthology.orchestra.run.smithi006.stdout:2869 trunc from 0x7aaa4c1 to 0xa366e22 2024-09-14T05:59:58.610 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:58.610 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:58.610 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:58.610 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:58.612 INFO:teuthology.orchestra.run.smithi006.stdout:2871 read 0x8008a75 thru 0x801840f (0xf99b bytes) 2024-09-14T05:59:58.612 INFO:teuthology.orchestra.run.smithi006.stdout:2872 read 0x5f6a88b thru 0x5f70011 (0x5787 bytes) 2024-09-14T05:59:58.612 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:58.612 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:58.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:59:58.635 INFO:teuthology.orchestra.run.smithi006.stdout:2875 writesame 0xe985ea9 thru 0xe991e3e data_size 0x2(0xbf96 bytes) 2024-09-14T05:59:58.635 INFO:teuthology.orchestra.run.smithi006.stdout:2876 write 0xced7b61 thru 0xcedabc7 (0x3067 bytes) 2024-09-14T05:59:58.644 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:58.650 INFO:teuthology.orchestra.run.smithi006.stdout:2878 trunc from 0xe991e3f to 0xbe2cff2 2024-09-14T05:59:58.674 INFO:teuthology.orchestra.run.smithi006.stdout:2880 punch from 0x43e44ac to 0x43e7f7b, (0x3acf bytes) 2024-09-14T05:59:58.674 INFO:teuthology.orchestra.run.smithi006.stdout:2881 punch from 0x49eb7e1 to 0x49fa1ba, (0xe9d9 bytes) 2024-09-14T05:59:58.674 INFO:teuthology.orchestra.run.smithi006.stdout:2882 read 0x8823aff thru 0x882b7c1 (0x7cc3 bytes) 2024-09-14T05:59:58.675 INFO:teuthology.orchestra.run.smithi006.stdout:2883 punch from 0x42bd0b6 to 0x42c5dc2, (0x8d0c bytes) 2024-09-14T05:59:58.675 INFO:teuthology.orchestra.run.smithi006.stdout:2884 read 0xaa5bfaa thru 0xaa66782 (0xa7d9 bytes) 2024-09-14T05:59:58.675 INFO:teuthology.orchestra.run.smithi006.stdout:2885 punch from 0xaf254b6 to 0xaf3028e, (0xadd8 bytes) 2024-09-14T05:59:58.675 INFO:teuthology.orchestra.run.smithi006.stdout:2886 write 0xed3e2 thru 0xeefb8 (0x1bd7 bytes) 2024-09-14T05:59:58.683 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:58.680+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:58.698 INFO:teuthology.orchestra.run.smithi006.stdout:2887 write 0x26029b5 thru 0x260fb9b (0xd1e7 bytes) 2024-09-14T05:59:58.714 INFO:teuthology.orchestra.run.smithi006.stdout:2888 punch from 0xb2399b7 to 0xb23b551, (0x1b9a bytes) 2024-09-14T05:59:58.714 INFO:teuthology.orchestra.run.smithi006.stdout:2889 writesame 0x769bbfd thru 0x769e4bd data_size 0x1(0x28c1 bytes) 2024-09-14T05:59:58.742 INFO:teuthology.orchestra.run.smithi006.stdout:2890 write 0xbead1df thru 0xbeaec7e (0x1aa0 bytes) 2024-09-14T05:59:58.749 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:58.749 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:58.749 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:58.749 INFO:teuthology.orchestra.run.smithi006.stdout:2897 write 0x11004cc thru 0x1100ff5 (0xb2a bytes) 2024-09-14T05:59:58.753 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:58.753 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:58.753 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:58.753 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:58.753 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:58.757 INFO:teuthology.orchestra.run.smithi006.stdout:2898 writesame 0x629a62e thru 0x62a4f48 data_size 0x1(0xa91b bytes) 2024-09-14T05:59:58.767 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:59:58.802 INFO:teuthology.orchestra.run.smithi006.stdout:2899 write 0x804368e thru 0x804c3b2 (0x8d25 bytes) 2024-09-14T05:59:58.802 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:58.801+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:58.816 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:58.816 INFO:teuthology.orchestra.run.smithi006.stdout:2902 write 0xabe5880 thru 0xabf2fbf (0xd740 bytes) 2024-09-14T05:59:58.830 INFO:teuthology.orchestra.run.smithi006.stdout:2905 writesame 0x14a5912 thru 0x14ae662 data_size 0x1f(0x8d51 bytes) 2024-09-14T05:59:58.837 INFO:teuthology.orchestra.run.smithi006.stdout:2907 write 0x4d31d65 thru 0x4d3b603 (0x989f bytes) 2024-09-14T05:59:58.864 INFO:teuthology.orchestra.run.smithi006.stdout:2908 trunc from 0xbeaec7f to 0x2413095 2024-09-14T05:59:58.885 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T05:59:58.884+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T05:59:58.909 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:58.909 INFO:teuthology.orchestra.run.smithi006.stdout:2911 read 0x890c56 thru 0x897c0b (0x6fb6 bytes) 2024-09-14T05:59:58.923 INFO:teuthology.orchestra.run.smithi006.stdout:2912 writesame 0x2c83e33 thru 0x2c84458 data_size 0x1(0x626 bytes) 2024-09-14T05:59:58.923 INFO:teuthology.orchestra.run.smithi006.stdout:2914 punch from 0x1f179cd to 0x1f23d52, (0xc385 bytes) 2024-09-14T05:59:58.923 INFO:teuthology.orchestra.run.smithi006.stdout:2915 punch from 0x63c983 to 0x649e95, (0xd512 bytes) 2024-09-14T05:59:58.933 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:59:58.938 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:58.938 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:58.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:58.938 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:58.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3629 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'31, mlcod=31'25)", 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.606840536999997, 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048071900000000002, 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T05:59:58.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329483+0000", 2024-09-14T05:59:58.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-07 2024-09-14T05:59:58.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329488+0000", 2024-09-14T05:59:58.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000004e-06 2024-09-14T05:59:58.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329496+0000", 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2209999999999997e-06 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329501+0000", 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8729999999999998e-06 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329545+0000", 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4382999999999998e-05 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329564+0000", 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8947999999999999e-05 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334225+0000", 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004660923 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334289+0000", 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4041999999999994e-05 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.943 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3630 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'32, mlcod=31'25)", 2024-09-14T05:59:58.943 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:58.943 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.606092531999998, 2024-09-14T05:59:58.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0040991680000000003, 2024-09-14T05:59:58.943 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.943 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.943 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.943 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:58.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330231+0000", 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4099999999999998e-07 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330235+0000", 2024-09-14T05:59:58.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.391e-06 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330245+0000", 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330249+0000", 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330301+0000", 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1515999999999999e-05 2024-09-14T05:59:58.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330312+0000", 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1603000000000001e-05 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334293+0000", 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039809449999999996 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334329+0000", 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5763000000000003e-05 2024-09-14T05:59:58.946 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3632 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'34, mlcod=31'27)", 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.603718348999998, 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047983469999999997, 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332605+0000", 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5099999999999999e-07 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332611+0000", 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6999999999999996e-06 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332623+0000", 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2401e-05 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332629+0000", 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3720000000000001e-06 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332691+0000", 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1451000000000005e-05 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332711+0000", 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0285e-05 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337341+0000", 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046295900000000003 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337402+0000", 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1797000000000005e-05 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3633 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'35, mlcod=31'27)", 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.602856903999999, 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039783919999999999, 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:58.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:58.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T05:59:58.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1500000000000004e-07 2024-09-14T05:59:58.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333479+0000", 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2918999999999999e-05 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333489+0000", 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0068000000000001e-05 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333494+0000", 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9309999999999999e-06 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333543+0000", 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9293999999999999e-05 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333555+0000", 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1467e-05 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337408+0000", 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038532549999999999 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337444+0000", 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5843000000000002e-05 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3638 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'40, mlcod=31'32)", 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.597576433999997, 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004283345, 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338747+0000", 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0279999999999999e-06 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338756+0000", 2024-09-14T05:59:58.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5909999999999996e-06 2024-09-14T05:59:58.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338774+0000", 2024-09-14T05:59:58.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8073000000000001e-05 2024-09-14T05:59:58.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338785+0000", 2024-09-14T05:59:58.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1017e-05 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338844+0000", 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9292000000000001e-05 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338864+0000", 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9528999999999999e-05 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.342984+0000", 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041207809999999996 2024-09-14T05:59:58.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.343029+0000", 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5034000000000003e-05 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:11218 3.9 e38/24 3:967d83c0:::rbd_data.1127ff8b71e0.0000000000000064:head v 38'37, mlcod=38'35)", 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.691470320999997, 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004035416, 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.959 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T05:59:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244854+0000", 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2350000000000002e-06 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246114+0000", 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012600980000000001 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246158+0000", 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3473000000000002e-05 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246179+0000", 2024-09-14T05:59:58.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0738999999999999e-05 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246306+0000", 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000127238 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246349+0000", 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3211999999999999e-05 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248780+0000", 2024-09-14T05:59:58.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0024304970000000002 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248888+0000", 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010792400000000001 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:17596 3.4 e41/24 3:27f62511:::rbd_data.1127d65075f9.00000000000000ca:head v 41'97, mlcod=41'95)", 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 28.965823870000001, 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049456559999999997, 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.963 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970500+0000", 2024-09-14T05:59:58.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9600000000000008e-07 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970614+0000", 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000113956 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970631+0000", 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7150999999999999e-05 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970643+0000", 2024-09-14T05:59:58.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1868999999999999e-05 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970711+0000", 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8952e-05 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970738+0000", 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6055999999999999e-05 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975388+0000", 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046502499999999999 2024-09-14T05:59:58.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975444+0000", 2024-09-14T05:59:58.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6425999999999998e-05 2024-09-14T05:59:58.967 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.967 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.967 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.967 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24289 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'57, mlcod=41'54)", 2024-09-14T05:59:58.967 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:58.967 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 26.780531691, 2024-09-14T05:59:58.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.060867738999999997, 2024-09-14T05:59:58.967 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T05:59:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155793+0000", 2024-09-14T05:59:58.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9470000000000002e-06 2024-09-14T05:59:58.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181776+0000", 2024-09-14T05:59:58.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.02598313 2024-09-14T05:59:58.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181817+0000", 2024-09-14T05:59:58.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1440000000000003e-05 2024-09-14T05:59:58.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181834+0000", 2024-09-14T05:59:58.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6979000000000001e-05 2024-09-14T05:59:58.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181931+0000", 2024-09-14T05:59:58.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7219999999999994e-05 2024-09-14T05:59:58.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181964+0000", 2024-09-14T05:59:58.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2094999999999997e-05 2024-09-14T05:59:58.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:58.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216586+0000", 2024-09-14T05:59:58.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034622503999999998 2024-09-14T05:59:58.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216658+0000", 2024-09-14T05:59:58.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24309 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'58, mlcod=41'56)", 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 26.681296585999998, 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044435519999999999, 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:58.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T05:59:58.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255027+0000", 2024-09-14T05:59:58.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T05:59:58.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255040+0000", 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2773e-05 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255066+0000", 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5459000000000001e-05 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255076+0000", 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0372e-05 2024-09-14T05:59:58.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255151+0000", 2024-09-14T05:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5444999999999993e-05 2024-09-14T05:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255176+0000", 2024-09-14T05:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5089e-05 2024-09-14T05:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259379+0000", 2024-09-14T05:59:58.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042025439999999999 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259469+0000", 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0407000000000004e-05 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37361 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'280, mlcod=50'278)", 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.041186+0000", 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.895136328, 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075534590000000002, 2024-09-14T05:59:58.976 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041187+0000", 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2160000000000001e-06 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041208+0000", 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0528999999999999e-05 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041225+0000", 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7255e-05 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041235+0000", 2024-09-14T05:59:58.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4190000000000008e-06 2024-09-14T05:59:58.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.979 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.979 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041302+0000", 2024-09-14T05:59:58.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7774000000000005e-05 2024-09-14T05:59:58.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.979 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.979 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041330+0000", 2024-09-14T05:59:58.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7382999999999999e-05 2024-09-14T05:59:58.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.979 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048686+0000", 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073564570000000003 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048740+0000", 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3426e-05 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37362 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'281, mlcod=50'278)", 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.046086+0000", 2024-09-14T05:59:58.980 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.890235928999999, 2024-09-14T05:59:58.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047169380000000004, 2024-09-14T05:59:58.981 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.981 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.981 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.981 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T05:59:58.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T05:59:58.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046087+0000", 2024-09-14T05:59:58.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3600000000000003e-07 2024-09-14T05:59:58.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046093+0000", 2024-09-14T05:59:58.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7869999999999998e-06 2024-09-14T05:59:58.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046106+0000", 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2636999999999999e-05 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046113+0000", 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0129999999999996e-06 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046170+0000", 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7819000000000003e-05 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046194+0000", 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3167999999999999e-05 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050760+0000", 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045665999999999997 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050803+0000", 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3177999999999999e-05 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.984 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39545 3.0 e50/24 3:06bdaf45:::rbd_data.112781171282.0000000000000002:head v 50'347, mlcod=50'345)", 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.578467+0000", 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.357855646999999, 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047008700000000002, 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578468+0000", 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1599999999999999e-06 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579733+0000", 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012647120000000001 2024-09-14T05:59:58.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579755+0000", 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2637999999999999e-05 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579766+0000", 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0264e-05 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579832+0000", 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6531000000000004e-05 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579859+0000", 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6855999999999998e-05 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583098+0000", 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003238632 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583168+0000", 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0077e-05 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.988 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39602 3.9 e50/24 3:909cb01b:::rbd_data.112781171282.000000000000006f:head v 50'86, mlcod=50'84)", 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.746165+0000", 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.190157677, 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041492480000000003, 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746165+0000", 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746165+0000", 2024-09-14T05:59:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746166+0000", 2024-09-14T05:59:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3600000000000002e-07 2024-09-14T05:59:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746287+0000", 2024-09-14T05:59:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000120927 2024-09-14T05:59:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746297+0000", 2024-09-14T05:59:58.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0395e-05 2024-09-14T05:59:58.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746302+0000", 2024-09-14T05:59:58.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2379999999999997e-06 2024-09-14T05:59:58.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746362+0000", 2024-09-14T05:59:58.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9765999999999997e-05 2024-09-14T05:59:58.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746385+0000", 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3357999999999999e-05 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.750213+0000", 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038276019999999998 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.750314+0000", 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010112599999999999 2024-09-14T05:59:58.992 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39765 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'410, mlcod=51'406)", 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.004422+0000", 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.931900846, 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044953839999999998, 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T05:59:58.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T05:59:58.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004423+0000", 2024-09-14T05:59:58.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:59:58.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.995 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004432+0000", 2024-09-14T05:59:58.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2180000000000005e-06 2024-09-14T05:59:58.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.995 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.995 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004453+0000", 2024-09-14T05:59:58.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1182000000000001e-05 2024-09-14T05:59:58.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.995 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:58.995 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004464+0000", 2024-09-14T05:59:58.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1198e-05 2024-09-14T05:59:58.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004520+0000", 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5835999999999999e-05 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004547+0000", 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6454000000000001e-05 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008866+0000", 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043194679999999999 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:58.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008917+0000", 2024-09-14T05:59:58.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0837000000000001e-05 2024-09-14T05:59:58.997 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.997 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:58.997 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:58.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.997 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39847 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'431, mlcod=51'426)", 2024-09-14T05:59:58.997 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.117705+0000", 2024-09-14T05:59:58.997 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.818617497, 2024-09-14T05:59:58.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046358010000000002, 2024-09-14T05:59:58.997 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:58.997 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117706+0000", 2024-09-14T05:59:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4899999999999995e-07 2024-09-14T05:59:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117711+0000", 2024-09-14T05:59:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6890000000000001e-06 2024-09-14T05:59:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117724+0000", 2024-09-14T05:59:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3054000000000001e-05 2024-09-14T05:59:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.000 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117736+0000", 2024-09-14T05:59:59.000 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1654999999999999e-05 2024-09-14T05:59:59.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.000 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.000 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.000 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117788+0000", 2024-09-14T05:59:59.000 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2197000000000002e-05 2024-09-14T05:59:59.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.000 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.000 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.000 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117811+0000", 2024-09-14T05:59:59.000 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2472000000000001e-05 2024-09-14T05:59:59.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.000 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.001 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:59.001 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122292+0000", 2024-09-14T05:59:59.001 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004481596 2024-09-14T05:59:59.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.001 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.001 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.001 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122341+0000", 2024-09-14T05:59:59.001 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8489000000000003e-05 2024-09-14T05:59:59.001 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.001 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.001 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39865 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'438, mlcod=51'434)", 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145039+0000", 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.791283199, 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004519426, 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145040+0000", 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7899999999999998e-07 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145044+0000", 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3789999999999999e-06 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145053+0000", 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2650000000000002e-06 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145058+0000", 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8169999999999998e-06 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145105+0000", 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7176999999999999e-05 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145119+0000", 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3179e-05 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149512+0000", 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043934389999999999 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149559+0000", 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6591000000000002e-05 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39866 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'439, mlcod=51'434)", 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145610+0000", 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.790712259999999, 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039787060000000003, 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145610+0000", 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145610+0000", 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145611+0000", 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7599999999999997e-07 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145615+0000", 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1309999999999999e-06 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145624+0000", 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8480000000000007e-06 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145629+0000", 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7840000000000003e-06 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145679+0000", 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0206e-05 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145699+0000", 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149561+0000", 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038619969999999998 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149589+0000", 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8147999999999999e-05 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.009 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.010 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40245 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'513, mlcod=52'509)", 2024-09-14T05:59:59.010 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.923591+0000", 2024-09-14T05:59:59.010 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.012731171, 2024-09-14T05:59:59.010 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053460410000000002, 2024-09-14T05:59:59.010 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.010 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.010 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:59.010 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.010 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.010 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T05:59:59.010 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.011 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.011 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.011 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T05:59:59.011 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.011 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.011 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923592+0000", 2024-09-14T05:59:59.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6599999999999996e-07 2024-09-14T05:59:59.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.012 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923598+0000", 2024-09-14T05:59:59.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.083e-06 2024-09-14T05:59:59.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923609+0000", 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1137e-05 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923617+0000", 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.401e-06 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924037+0000", 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042046 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.014 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.014 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924082+0000", 2024-09-14T05:59:59.014 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4617000000000003e-05 2024-09-14T05:59:59.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.014 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.014 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:59.014 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928882+0000", 2024-09-14T05:59:59.014 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048000889999999996 2024-09-14T05:59:59.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.014 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.014 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.014 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928937+0000", 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5587999999999997e-05 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40246 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'514, mlcod=52'509)", 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.924626+0000", 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.011696656, 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043609649999999996, 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2099999999999996e-07 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924631+0000", 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8450000000000002e-06 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924641+0000", 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0057e-05 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924649+0000", 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5669999999999997e-06 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925127+0000", 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00047783800000000001 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925171+0000", 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4017000000000002e-05 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928942+0000", 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037716809999999998 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.018 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928987+0000", 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4338999999999997e-05 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:46646 3.0 e56/24 3:01acbe3d:::rbd_data.1127f2f8ff9b.0000000000000015:head v 56'541, mlcod=55'538)", 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:50.461412+0000", 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.4749103859999995, 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064775850000000001, 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461415+0000", 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.666e-06 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463456+0000", 2024-09-14T05:59:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00204177 2024-09-14T05:59:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463488+0000", 2024-09-14T05:59:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1503e-05 2024-09-14T05:59:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463508+0000", 2024-09-14T05:59:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9788000000000001e-05 2024-09-14T05:59:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463697+0000", 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018873499999999999 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463741+0000", 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4333999999999999e-05 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467845+0000", 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041041430000000002 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.022 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.023 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467890+0000", 2024-09-14T05:59:59.023 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4645999999999999e-05 2024-09-14T05:59:59.023 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.023 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.023 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.023 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.023 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.023 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:59.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:59:59.025 INFO:teuthology.orchestra.run.smithi006.stdout:2916 write 0xeca0fa6 thru 0xeca7524 (0x657f bytes) 2024-09-14T05:59:59.026 INFO:teuthology.orchestra.run.smithi006.stdout:2917 read 0x920e3b8 thru 0x9217531 (0x917a bytes) 2024-09-14T05:59:59.026 INFO:teuthology.orchestra.run.smithi006.stdout:2918 writesame 0xf69a7f thru 0xf744e2 data_size 0x1e(0xaa64 bytes) 2024-09-14T05:59:59.026 INFO:teuthology.orchestra.run.smithi006.stdout:2919 read 0xc4db290 thru 0xc4e447c (0x91ed bytes) 2024-09-14T05:59:59.026 INFO:teuthology.orchestra.run.smithi006.stdout:2920 write 0xddd679f thru 0xddde042 (0x78a4 bytes) 2024-09-14T05:59:59.026 INFO:teuthology.orchestra.run.smithi006.stdout:2921 read 0xc4df4ab thru 0xc4dfbf4 (0x74a bytes) 2024-09-14T05:59:59.026 INFO:teuthology.orchestra.run.smithi006.stdout:2922 read 0xdeed818 thru 0xdefa9c9 (0xd1b2 bytes) 2024-09-14T05:59:59.026 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:59.026 INFO:teuthology.orchestra.run.smithi006.stdout:2924 write 0xa4e3032 thru 0xa4edb8c (0xab5b bytes) 2024-09-14T05:59:59.026 INFO:teuthology.orchestra.run.smithi006.stdout:2926 read 0x5998b95 thru 0x59a4ec1 (0xc32d bytes) 2024-09-14T05:59:59.026 INFO:teuthology.orchestra.run.smithi006.stdout:2928 writesame 0xed2eef0 thru 0xed3823c data_size 0x1(0x934d bytes) 2024-09-14T05:59:59.027 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:59.020+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:59.028 INFO:teuthology.orchestra.run.smithi006.stdout:2929 punch from 0x2782eae to 0x27903bb, (0xd50d bytes) 2024-09-14T05:59:59.029 INFO:teuthology.orchestra.run.smithi006.stdout:2931 read 0xd629a8c thru 0xd636b4b (0xd0c0 bytes) 2024-09-14T05:59:59.029 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T05:59:59.029 INFO:teuthology.orchestra.run.smithi006.stdout:2933 punch from 0xbb5a20 to 0xbbf649, (0x9c29 bytes) 2024-09-14T05:59:59.029 INFO:teuthology.orchestra.run.smithi006.stdout:2935 punch from 0x8f67eec to 0x8f76e2c, (0xef40 bytes) 2024-09-14T05:59:59.041 INFO:teuthology.orchestra.run.smithi006.stdout:2936 trunc from 0xed3823d to 0x3dd9bea 2024-09-14T05:59:59.071 INFO:teuthology.orchestra.run.smithi006.stdout:2937 trunc from 0x3dd9bea to 0x92df695 2024-09-14T05:59:59.082 INFO:teuthology.orchestra.run.smithi006.stdout:2938 punch from 0x7705050 to 0x7707c22, (0x2bd2 bytes) 2024-09-14T05:59:59.083 INFO:teuthology.orchestra.run.smithi006.stdout:2941 clone 21 order 18 su 4096 sc 11 2024-09-14T05:59:59.125 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:59.124+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:59.147 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:59.147 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:59.147 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T05:59:59.147 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:59.161 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:59:59.247 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:59.245+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:59.313 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:59.313 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T05:59:59.313 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T05:59:59.313 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T05:59:59.314 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:59.326 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:59:59.367 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T05:59:59.365+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T05:59:59.429 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:59.424+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:59.485 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T05:59:59.485 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T05:59:59.485 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T05:59:59.485 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T05:59:59.485 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.485 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54658 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 610304~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.485 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139679+0000", 2024-09-14T05:59:59.485 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3425994000000001, 2024-09-14T05:59:59.485 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091840061000000001, 2024-09-14T05:59:59.485 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.485 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.485 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54658 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T05:59:59.486 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4700000000000002e-07 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139687+0000", 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7170000000000008e-06 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139694+0000", 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.063e-06 2024-09-14T05:59:59.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139709+0000", 2024-09-14T05:59:59.488 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4324999999999999e-05 2024-09-14T05:59:59.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231262+0000", 2024-09-14T05:59:59.488 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091553866999999997 2024-09-14T05:59:59.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231375+0000", 2024-09-14T05:59:59.488 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000112927 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231519+0000", 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014371499999999999 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54659 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 616448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139717+0000", 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3425610529999998, 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092177035000000004, 2024-09-14T05:59:59.489 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54659 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.490 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139718+0000", 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9699999999999996e-07 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139731+0000", 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2993000000000001e-05 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139738+0000", 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4610000000000002e-06 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139744+0000", 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6389999999999997e-06 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231570+0000", 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091826216000000002 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.492 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231662+0000", 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2101000000000005e-05 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231894+0000", 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023212800000000001 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54660 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 622592~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139753+0000", 2024-09-14T05:59:59.493 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3425257190000002, 2024-09-14T05:59:59.494 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092366887999999994, 2024-09-14T05:59:59.494 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.494 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.494 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.494 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.494 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.494 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.494 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54660 2024-09-14T05:59:59.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.494 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.494 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.494 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T05:59:59.494 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.495 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.495 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T05:59:59.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.495 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.495 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T05:59:59.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T05:59:59.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.496 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.496 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.496 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139755+0000", 2024-09-14T05:59:59.496 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T05:59:59.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.496 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.496 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.496 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139762+0000", 2024-09-14T05:59:59.496 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6719999999999998e-06 2024-09-14T05:59:59.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.497 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.497 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139767+0000", 2024-09-14T05:59:59.497 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9819999999999999e-06 2024-09-14T05:59:59.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.497 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.497 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231917+0000", 2024-09-14T05:59:59.497 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092149872999999993 2024-09-14T05:59:59.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.498 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.498 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231969+0000", 2024-09-14T05:59:59.498 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2642000000000002e-05 2024-09-14T05:59:59.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.498 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.498 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232120+0000", 2024-09-14T05:59:59.498 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015011899999999999 2024-09-14T05:59:59.498 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.498 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.499 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.499 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54844 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 0~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.499 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139774+0000", 2024-09-14T05:59:59.499 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3425042280000001, 2024-09-14T05:59:59.499 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092708507999999995, 2024-09-14T05:59:59.499 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.499 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.499 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.500 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.500 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.500 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.500 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54844 2024-09-14T05:59:59.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.500 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.500 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.500 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T05:59:59.500 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.501 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.501 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T05:59:59.501 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139775+0000", 2024-09-14T05:59:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3500000000000002e-07 2024-09-14T05:59:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.502 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139777+0000", 2024-09-14T05:59:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.979e-06 2024-09-14T05:59:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139787+0000", 2024-09-14T05:59:59.503 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0779e-05 2024-09-14T05:59:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139799+0000", 2024-09-14T05:59:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1719000000000001e-05 2024-09-14T05:59:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.504 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232151+0000", 2024-09-14T05:59:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092351767000000001 2024-09-14T05:59:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232217+0000", 2024-09-14T05:59:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6655000000000005e-05 2024-09-14T05:59:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232483+0000", 2024-09-14T05:59:59.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026517400000000002 2024-09-14T05:59:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54845 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 55296~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139808+0000", 2024-09-14T05:59:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3424705570000004, 2024-09-14T05:59:59.506 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093127583999999999, 2024-09-14T05:59:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54845 2024-09-14T05:59:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T05:59:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T05:59:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T05:59:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4899999999999995e-07 2024-09-14T05:59:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139811+0000", 2024-09-14T05:59:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000001e-06 2024-09-14T05:59:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139821+0000", 2024-09-14T05:59:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0168e-05 2024-09-14T05:59:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139826+0000", 2024-09-14T05:59:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2780000000000001e-06 2024-09-14T05:59:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232556+0000", 2024-09-14T05:59:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092729729999999996 2024-09-14T05:59:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232652+0000", 2024-09-14T05:59:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680999999999994e-05 2024-09-14T05:59:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232935+0000", 2024-09-14T05:59:59.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000283758 2024-09-14T05:59:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54846 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139834+0000", 2024-09-14T05:59:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3424442499999998, 2024-09-14T05:59:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093492079000000006, 2024-09-14T05:59:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.511 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54846 2024-09-14T05:59:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T05:59:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T05:59:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139835+0000", 2024-09-14T05:59:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T05:59:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139837+0000", 2024-09-14T05:59:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1059999999999998e-06 2024-09-14T05:59:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139845+0000", 2024-09-14T05:59:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4300000000000006e-06 2024-09-14T05:59:59.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139851+0000", 2024-09-14T05:59:59.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T05:59:59.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232987+0000", 2024-09-14T05:59:59.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093136073999999999 2024-09-14T05:59:59.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233075+0000", 2024-09-14T05:59:59.515 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7318999999999995e-05 2024-09-14T05:59:59.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.515 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.515 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233326+0000", 2024-09-14T05:59:59.515 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025159 2024-09-14T05:59:59.515 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.515 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.515 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.515 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54847 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 67584~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.515 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139860+0000", 2024-09-14T05:59:59.515 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3424185340000001, 2024-09-14T05:59:59.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093777452999999997, 2024-09-14T05:59:59.516 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.516 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.516 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.516 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.516 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.516 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.516 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54847 2024-09-14T05:59:59.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.516 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.516 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.516 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T05:59:59.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.517 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T05:59:59.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.517 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T05:59:59.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T05:59:59.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139862+0000", 2024-09-14T05:59:59.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0200000000000001e-06 2024-09-14T05:59:59.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139870+0000", 2024-09-14T05:59:59.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0520000000000002e-06 2024-09-14T05:59:59.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139875+0000", 2024-09-14T05:59:59.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T05:59:59.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.519 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.519 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233389+0000", 2024-09-14T05:59:59.519 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093514054999999999 2024-09-14T05:59:59.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.519 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.519 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233443+0000", 2024-09-14T05:59:59.519 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3913999999999999e-05 2024-09-14T05:59:59.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.519 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.519 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233637+0000", 2024-09-14T05:59:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019392899999999999 2024-09-14T05:59:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54848 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 73728~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139883+0000", 2024-09-14T05:59:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3423954379999996, 2024-09-14T05:59:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094064464, 2024-09-14T05:59:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.520 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.521 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.521 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.521 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54848 2024-09-14T05:59:59.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.521 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T05:59:59.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T05:59:59.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T05:59:59.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T05:59:59.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139885+0000", 2024-09-14T05:59:59.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9929999999999998e-06 2024-09-14T05:59:59.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139893+0000", 2024-09-14T05:59:59.523 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9759999999999995e-06 2024-09-14T05:59:59.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.523 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.523 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139898+0000", 2024-09-14T05:59:59.523 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6059999999999996e-06 2024-09-14T05:59:59.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.523 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.523 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233681+0000", 2024-09-14T05:59:59.523 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093782921000000005 2024-09-14T05:59:59.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.523 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233730+0000", 2024-09-14T05:59:59.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9410999999999998e-05 2024-09-14T05:59:59.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.524 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233947+0000", 2024-09-14T05:59:59.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021710300000000001 2024-09-14T05:59:59.524 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.524 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.524 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.524 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54849 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.524 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139906+0000", 2024-09-14T05:59:59.525 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3423719820000004, 2024-09-14T05:59:59.525 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094499257000000003, 2024-09-14T05:59:59.525 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.525 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.525 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.525 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.525 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.525 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.525 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54849 2024-09-14T05:59:59.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.525 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.525 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T05:59:59.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.526 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T05:59:59.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.526 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139907+0000", 2024-09-14T05:59:59.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T05:59:59.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139909+0000", 2024-09-14T05:59:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T05:59:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139916+0000", 2024-09-14T05:59:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T05:59:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139921+0000", 2024-09-14T05:59:59.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T05:59:59.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234032+0000", 2024-09-14T05:59:59.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094111037999999994 2024-09-14T05:59:59.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234150+0000", 2024-09-14T05:59:59.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118408 2024-09-14T05:59:59.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234406+0000", 2024-09-14T05:59:59.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025540600000000001 2024-09-14T05:59:59.529 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.529 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.529 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.529 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54850 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 135168~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.529 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139928+0000", 2024-09-14T05:59:59.529 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3423502740000002, 2024-09-14T05:59:59.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094814605999999996, 2024-09-14T05:59:59.529 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.529 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.529 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.530 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.530 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.530 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.530 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54850 2024-09-14T05:59:59.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.530 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.530 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.530 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T05:59:59.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.530 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.530 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T05:59:59.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139929+0000", 2024-09-14T05:59:59.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T05:59:59.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139931+0000", 2024-09-14T05:59:59.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.024e-06 2024-09-14T05:59:59.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139937+0000", 2024-09-14T05:59:59.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3770000000000001e-06 2024-09-14T05:59:59.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.532 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139942+0000", 2024-09-14T05:59:59.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0289999999999996e-06 2024-09-14T05:59:59.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.532 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234447+0000", 2024-09-14T05:59:59.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094505426000000003 2024-09-14T05:59:59.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234539+0000", 2024-09-14T05:59:59.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1793999999999996e-05 2024-09-14T05:59:59.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234743+0000", 2024-09-14T05:59:59.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020354600000000001 2024-09-14T05:59:59.533 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.533 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.533 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.534 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54851 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 141312~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.534 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139950+0000", 2024-09-14T05:59:59.534 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3423285619999996, 2024-09-14T05:59:59.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095179749999999994, 2024-09-14T05:59:59.534 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.534 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.534 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.534 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.534 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.534 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.534 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54851 2024-09-14T05:59:59.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.534 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.535 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T05:59:59.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.535 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T05:59:59.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.535 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T05:59:59.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T05:59:59.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139952+0000", 2024-09-14T05:59:59.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0600000000000002e-06 2024-09-14T05:59:59.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139959+0000", 2024-09-14T05:59:59.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.584e-06 2024-09-14T05:59:59.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139964+0000", 2024-09-14T05:59:59.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8890000000000001e-06 2024-09-14T05:59:59.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234786+0000", 2024-09-14T05:59:59.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094822241000000002 2024-09-14T05:59:59.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234877+0000", 2024-09-14T05:59:59.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1158999999999999e-05 2024-09-14T05:59:59.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235130+0000", 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025235999999999998 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54852 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 147456~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139971+0000", 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3423074340000003, 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095437742000000006, 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.538 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.539 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.539 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54852 2024-09-14T05:59:59.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.539 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T05:59:59.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T05:59:59.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140125+0000", 2024-09-14T05:59:59.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154332 2024-09-14T05:59:59.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140130+0000", 2024-09-14T05:59:59.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.284e-06 2024-09-14T05:59:59.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140140+0000", 2024-09-14T05:59:59.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0789e-05 2024-09-14T05:59:59.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140147+0000", 2024-09-14T05:59:59.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9879999999999998e-06 2024-09-14T05:59:59.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235174+0000", 2024-09-14T05:59:59.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095026749999999993 2024-09-14T05:59:59.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235230+0000", 2024-09-14T05:59:59.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6224000000000002e-05 2024-09-14T05:59:59.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235409+0000", 2024-09-14T05:59:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017837500000000001 2024-09-14T05:59:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54853 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 202752~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.140160+0000", 2024-09-14T05:59:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3421186120000002, 2024-09-14T05:59:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095632919999999996, 2024-09-14T05:59:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.543 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54853 2024-09-14T05:59:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T05:59:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T05:59:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147748+0000", 2024-09-14T05:59:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075884910000000002 2024-09-14T05:59:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147798+0000", 2024-09-14T05:59:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0152999999999999e-05 2024-09-14T05:59:59.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147814+0000", 2024-09-14T05:59:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5866e-05 2024-09-14T05:59:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147831+0000", 2024-09-14T05:59:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6991999999999999e-05 2024-09-14T05:59:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235451+0000", 2024-09-14T05:59:59.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087620077000000005 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235539+0000", 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7800000000000006e-05 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235793+0000", 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025354099999999998 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.548 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54868 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 442368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.548 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148350+0000", 2024-09-14T05:59:59.548 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3339282920000004, 2024-09-14T05:59:59.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091802783999999998, 2024-09-14T05:59:59.548 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.548 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.548 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.548 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.548 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.548 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.548 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54868 2024-09-14T05:59:59.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.548 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T05:59:59.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T05:59:59.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148351+0000", 2024-09-14T05:59:59.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:59:59.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148353+0000", 2024-09-14T05:59:59.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2299999999999998e-06 2024-09-14T05:59:59.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148362+0000", 2024-09-14T05:59:59.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9800000000000004e-06 2024-09-14T05:59:59.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148367+0000", 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.327e-06 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.239863+0000", 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091496018999999998 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.239932+0000", 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8838999999999996e-05 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240153+0000", 2024-09-14T05:59:59.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00022092100000000001 2024-09-14T05:59:59.552 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.552 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.552 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.552 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54869 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 497664~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.552 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148376+0000", 2024-09-14T05:59:59.552 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3339023939999999, 2024-09-14T05:59:59.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092147413999999997, 2024-09-14T05:59:59.552 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.552 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.553 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.553 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.553 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.553 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.553 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54869 2024-09-14T05:59:59.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.553 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T05:59:59.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T05:59:59.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148377+0000", 2024-09-14T05:59:59.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:59:59.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148379+0000", 2024-09-14T05:59:59.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.429e-06 2024-09-14T05:59:59.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148389+0000", 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9029999999999999e-06 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148395+0000", 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5080000000000002e-06 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240191+0000", 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091796066999999995 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240284+0000", 2024-09-14T05:59:59.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2445e-05 2024-09-14T05:59:59.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240523+0000", 2024-09-14T05:59:59.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023954799999999999 2024-09-14T05:59:59.556 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.556 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.556 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.556 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54870 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 503808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.557 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148405+0000", 2024-09-14T05:59:59.557 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3338730649999997, 2024-09-14T05:59:59.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092420756000000007, 2024-09-14T05:59:59.557 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.557 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.557 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.557 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.557 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.557 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.557 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54870 2024-09-14T05:59:59.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.557 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T05:59:59.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T05:59:59.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148406+0000", 2024-09-14T05:59:59.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T05:59:59.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148409+0000", 2024-09-14T05:59:59.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T05:59:59.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148418+0000", 2024-09-14T05:59:59.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7329999999999998e-06 2024-09-14T05:59:59.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148425+0000", 2024-09-14T05:59:59.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2079999999999997e-06 2024-09-14T05:59:59.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240591+0000", 2024-09-14T05:59:59.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092166441000000002 2024-09-14T05:59:59.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240648+0000", 2024-09-14T05:59:59.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6733e-05 2024-09-14T05:59:59.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240826+0000", 2024-09-14T05:59:59.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017834700000000001 2024-09-14T05:59:59.561 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.561 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.561 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.561 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54871 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 509952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.561 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148435+0000", 2024-09-14T05:59:59.561 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3338431049999997, 2024-09-14T05:59:59.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092702341999999993, 2024-09-14T05:59:59.561 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.561 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.561 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.561 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54871 2024-09-14T05:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T05:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T05:59:59.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148436+0000", 2024-09-14T05:59:59.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:59:59.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148439+0000", 2024-09-14T05:59:59.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8090000000000001e-06 2024-09-14T05:59:59.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148449+0000", 2024-09-14T05:59:59.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0115000000000001e-05 2024-09-14T05:59:59.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148466+0000", 2024-09-14T05:59:59.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6761000000000001e-05 2024-09-14T05:59:59.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240857+0000", 2024-09-14T05:59:59.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092391089999999995 2024-09-14T05:59:59.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240939+0000", 2024-09-14T05:59:59.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2387999999999998e-05 2024-09-14T05:59:59.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241138+0000", 2024-09-14T05:59:59.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000198624 2024-09-14T05:59:59.565 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.568 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.568 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.568 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54872 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 516096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.568 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148476+0000", 2024-09-14T05:59:59.568 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3338019069999998, 2024-09-14T05:59:59.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093126020000000004, 2024-09-14T05:59:59.568 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.568 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.569 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.569 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.569 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.569 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.569 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54872 2024-09-14T05:59:59.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.569 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T05:59:59.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.570 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T05:59:59.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.570 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.570 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155484+0000", 2024-09-14T05:59:59.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070072429999999998 2024-09-14T05:59:59.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.570 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.570 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155490+0000", 2024-09-14T05:59:59.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6379999999999998e-06 2024-09-14T05:59:59.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155504+0000", 2024-09-14T05:59:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4065e-05 2024-09-14T05:59:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155513+0000", 2024-09-14T05:59:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6799999999999999e-06 2024-09-14T05:59:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241216+0000", 2024-09-14T05:59:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085702922000000001 2024-09-14T05:59:59.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241277+0000", 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0980000000000002e-05 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241602+0000", 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032549199999999998 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.572 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54888 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 114688~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.573 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155921+0000", 2024-09-14T05:59:59.573 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3263574260000004, 2024-09-14T05:59:59.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091627085999999996, 2024-09-14T05:59:59.573 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.573 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.573 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.573 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.573 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.573 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.573 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54888 2024-09-14T05:59:59.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.573 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.574 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T05:59:59.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.574 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.574 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T05:59:59.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.574 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.574 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T05:59:59.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8299999999999998e-07 2024-09-14T05:59:59.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155923+0000", 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4720000000000001e-06 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155926+0000", 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.444e-06 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155929+0000", 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7970000000000001e-06 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247321+0000", 2024-09-14T05:59:59.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091391587999999996 2024-09-14T05:59:59.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247382+0000", 2024-09-14T05:59:59.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1944000000000002e-05 2024-09-14T05:59:59.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247548+0000", 2024-09-14T05:59:59.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000165558 2024-09-14T05:59:59.576 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.577 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.577 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.577 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54889 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 169984~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T05:59:59.577 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155934+0000", 2024-09-14T05:59:59.577 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3263448259999997, 2024-09-14T05:59:59.577 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091908118999999996, 2024-09-14T05:59:59.577 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T05:59:59.577 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T05:59:59.577 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T05:59:59.577 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T05:59:59.577 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T05:59:59.577 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54889 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.578 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163444+0000", 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00751033 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163454+0000", 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0579e-05 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163468+0000", 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3794999999999999e-05 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.579 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T05:59:59.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163487+0000", 2024-09-14T05:59:59.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8907999999999999e-05 2024-09-14T05:59:59.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T05:59:59.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247591+0000", 2024-09-14T05:59:59.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084103333000000002 2024-09-14T05:59:59.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T05:59:59.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247651+0000", 2024-09-14T05:59:59.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0587000000000001e-05 2024-09-14T05:59:59.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T05:59:59.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T05:59:59.581 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T05:59:59.581 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247842+0000", 2024-09-14T05:59:59.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019058700000000001 2024-09-14T05:59:59.581 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.581 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.581 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.581 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T05:59:59.581 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T05:59:59.581 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T05:59:59.583 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:59:59.583 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:59.581+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T05:59:59.684 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T05:59:59.680+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T05:59:59.714 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:59.714 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:59.714 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T05:59:59.714 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:59.728 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:59:59.785 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:59.781+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:59.886 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T05:59:59.881+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T05:59:59.897 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T05:59:59.897 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T05:59:59.898 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T05:59:59.898 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T05:59:59.898 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T05:59:59.911 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:59:59.921 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2024-09-14T05:59:59.995 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T05:59:59.993+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:00.037 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone20 from 0x92df695 (overlap 0x2413095) to 0xad282c 2024-09-14T06:00:00.045 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:00.045 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:00.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:00.045 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:00.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.046 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23550 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 606208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.046 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:00.046 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.093679421000001, 2024-09-14T06:00:00.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048793072999999999, 2024-09-14T06:00:00.046 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.046 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.046 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.046 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.046 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.046 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.046 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23550 2024-09-14T06:00:00.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.047 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:00.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:00.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:00.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7800000000000002e-07 2024-09-14T06:00:00.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948677+0000", 2024-09-14T06:00:00.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1949999999999997e-06 2024-09-14T06:00:00.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948687+0000", 2024-09-14T06:00:00.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0849000000000001e-05 2024-09-14T06:00:00.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948692+0000", 2024-09-14T06:00:00.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8670000000000002e-06 2024-09-14T06:00:00.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997290+0000", 2024-09-14T06:00:00.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048597596999999999 2024-09-14T06:00:00.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997367+0000", 2024-09-14T06:00:00.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7236000000000004e-05 2024-09-14T06:00:00.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997462+0000", 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4951000000000006e-05 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23551 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 620544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.093648563999999, 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048938838999999998, 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.050 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.051 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.051 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.051 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.051 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.051 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23551 2024-09-14T06:00:00.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.051 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:00.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1e-07 2024-09-14T06:00:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948701+0000", 2024-09-14T06:00:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2950000000000001e-06 2024-09-14T06:00:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948705+0000", 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7929999999999999e-06 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948709+0000", 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997535+0000", 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048826181000000003 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997580+0000", 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5355000000000002e-05 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997639+0000", 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8479e-05 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.093633087000001, 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T06:00:00.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T06:00:00.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T06:00:00.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T06:00:00.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T06:00:00.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T06:00:00.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.058 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.059 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:00.059 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.093613812000001, 2024-09-14T06:00:00.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T06:00:00.059 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.059 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.059 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.059 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.059 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.059 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.059 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T06:00:00.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.059 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T06:00:00.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T06:00:00.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T06:00:00.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T06:00:00.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T06:00:00.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T06:00:00.062 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.093594236000001, 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.063 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T06:00:00.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.064 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:00.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:00.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T06:00:00.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T06:00:00.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T06:00:00.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T06:00:00.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T06:00:00.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:00.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T06:00:00.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T06:00:00.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T06:00:00.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T06:00:00.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T06:00:00.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T06:00:00.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.093574779000001, 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.067 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:00.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T06:00:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T06:00:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T06:00:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T06:00:00.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T06:00:00.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T06:00:00.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T06:00:00.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T06:00:00.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T06:00:00.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.093555727999998, 2024-09-14T06:00:00.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T06:00:00.072 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.072 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.072 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.072 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.072 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.072 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.072 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T06:00:00.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.072 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:00.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T06:00:00.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T06:00:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T06:00:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T06:00:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T06:00:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T06:00:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.093536047000001, 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:00.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:00.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T06:00:00.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T06:00:00.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.079 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.080 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.080 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:00.080 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.093516095999998, 2024-09-14T06:00:00.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T06:00:00.080 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.080 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.080 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.080 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.080 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.080 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.080 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T06:00:00.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.081 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:00.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:00.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T06:00:00.083 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.093496783999999, 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T06:00:00.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.085 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:00.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:00.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:00.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T06:00:00.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T06:00:00.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T06:00:00.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T06:00:00.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T06:00:00.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.093477022999998, 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.088 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T06:00:00.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:00:00.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T06:00:00.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T06:00:00.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T06:00:00.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T06:00:00.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T06:00:00.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T06:00:00.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.093456102000001, 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.096 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.092296768000001, 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.097 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:00.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:00.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T06:00:00.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T06:00:00.101 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.101 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.101 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.101 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.101 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:00.101 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.091997985999999, 2024-09-14T06:00:00.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T06:00:00.101 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.101 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.101 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.101 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.102 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.102 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.102 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T06:00:00.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.102 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:00.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T06:00:00.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T06:00:00.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T06:00:00.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T06:00:00.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T06:00:00.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T06:00:00.105 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.105 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.105 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.091847248000001, 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:00.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:00.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T06:00:00.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T06:00:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T06:00:00.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T06:00:00.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T06:00:00.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T06:00:00.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T06:00:00.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T06:00:00.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T06:00:00.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.110 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.110 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23582 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 911360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.110 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:00.110 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.090921861000002, 2024-09-14T06:00:00.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048708939999999999, 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23582 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6300000000000005e-07 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951430+0000", 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5179999999999999e-06 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951437+0000", 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0940000000000002e-06 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951443+0000", 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7910000000000001e-06 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000047+0000", 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048604550000000003 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000095+0000", 2024-09-14T06:00:00.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7735999999999998e-05 2024-09-14T06:00:00.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000135+0000", 2024-09-14T06:00:00.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0587999999999998e-05 2024-09-14T06:00:00.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.114 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.114 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23588 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 722944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.114 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:00.114 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.090896996000001, 2024-09-14T06:00:00.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048792653999999998, 2024-09-14T06:00:00.115 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.115 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.115 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.115 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23588 2024-09-14T06:00:00.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.115 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951665+0000", 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021337600000000001 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951669+0000", 2024-09-14T06:00:00.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3460000000000004e-06 2024-09-14T06:00:00.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951688+0000", 2024-09-14T06:00:00.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9042000000000002e-05 2024-09-14T06:00:00.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951696+0000", 2024-09-14T06:00:00.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6660000000000008e-06 2024-09-14T06:00:00.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000162+0000", 2024-09-14T06:00:00.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048465824999999997 2024-09-14T06:00:00.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000199+0000", 2024-09-14T06:00:00.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7143e-05 2024-09-14T06:00:00.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000244+0000", 2024-09-14T06:00:00.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5256000000000002e-05 2024-09-14T06:00:00.119 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.119 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.119 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.119 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23590 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 745472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.119 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:00.119 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.090639541000002, 2024-09-14T06:00:00.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048677684999999998, 2024-09-14T06:00:00.119 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.119 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.119 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:00.119 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23590 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951850+0000", 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014113 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951855+0000", 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6349999999999997e-06 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951863+0000", 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8189999999999998e-06 2024-09-14T06:00:00.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951871+0000", 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2030000000000003e-06 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000283+0000", 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048412531000000002 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000338+0000", 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4462000000000001e-05 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000387+0000", 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8905e-05 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.466545685, 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:00.123 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T06:00:00.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T06:00:00.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T06:00:00.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T06:00:00.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T06:00:00.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T06:00:00.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T06:00:00.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T06:00:00.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T06:00:00.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T06:00:00.127 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.127 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.127 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.127 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:00.127 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:00.127 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.943455746000001, 2024-09-14T06:00:00.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T06:00:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T06:00:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T06:00:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T06:00:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T06:00:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T06:00:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T06:00:00.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T06:00:00.132 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.133 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.133 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.133 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:00.134 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:00:00.134 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:00.132+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:00.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:00:00.181 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-14T06:00:00.235 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:00.233+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:00.309 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:00.309 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:00.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.309 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:64738 3.16 3.7bba4d16 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e63)", 2024-09-14T06:00:00.309 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:00.310287+0000", 2024-09-14T06:00:00.309 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.000350055, 2024-09-14T06:00:00.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037687300000000001, 2024-09-14T06:00:00.309 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.309 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.309 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:00.309 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.309 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64738 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:00.310287+0000", 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:00.310287+0000", 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:00.310288+0000", 2024-09-14T06:00:00.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.35e-06 2024-09-14T06:00:00.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:00.310294+0000", 2024-09-14T06:00:00.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7230000000000001e-06 2024-09-14T06:00:00.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:00.310312+0000", 2024-09-14T06:00:00.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8232000000000001e-05 2024-09-14T06:00:00.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:00.310326+0000", 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4003e-05 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:64705 3.16 3:6f681a7c:::rbd_data.112791a51352.00000000000000b9:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e63)", 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:00.310139+0000", 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00049831099999999998, 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00060024199999999996, 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:00.312 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64705 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:00.310139+0000", 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:00.310139+0000", 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:00.310140+0000", 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.207e-06 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:00.310146+0000", 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2230000000000004e-06 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:00.310166+0000", 2024-09-14T06:00:00.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9406e-05 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:00.310180+0000", 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4335000000000001e-05 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:00.310622+0000", 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00044219099999999998 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 2 2024-09-14T06:00:00.315 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:00.328 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:00:00.335 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:00.333+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:00.339 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:00.356 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:00.356 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:00.374 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:00.374 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:00.392 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:00.392 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:00.411 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:00.436 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:00.433+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:00.437 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:00.452 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:00.452 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:00.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:00:00.468 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:00.468 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:00.486 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:00.486 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:00.547 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:00.545+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:00.592 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:00.593 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:00.604 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:00:00.611 INFO:teuthology.orchestra.run.smithi006.stdout:2942 read 0x620e9ab thru 0x6218916 (0x9f6c bytes) 2024-09-14T06:00:00.613 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:00.637 INFO:teuthology.orchestra.run.smithi006.stdout:2944 writesame 0xe997018 thru 0xe999858 data_size 0xf(0x2841 bytes) 2024-09-14T06:00:00.637 INFO:teuthology.orchestra.run.smithi006.stdout:2946 punch from 0x91b9be to 0x929735, (0xdd77 bytes) 2024-09-14T06:00:00.637 INFO:teuthology.orchestra.run.smithi006.stdout:2947 write 0xcca693e thru 0xccb4053 (0xd716 bytes) 2024-09-14T06:00:00.649 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:00.648+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:00.655 INFO:teuthology.orchestra.run.smithi006.stdout:2948 read 0x2b725f4 thru 0x2b80c85 (0xe692 bytes) 2024-09-14T06:00:00.655 INFO:teuthology.orchestra.run.smithi006.stdout:2950 write 0x759fe6d thru 0x75af123 (0xf2b7 bytes) 2024-09-14T06:00:00.673 INFO:teuthology.orchestra.run.smithi006.stdout:2951 write 0x2cec4c3 thru 0x2cf575a (0x9298 bytes) 2024-09-14T06:00:00.693 INFO:teuthology.orchestra.run.smithi006.stdout:2953 read 0x3706bcc thru 0x37136e4 (0xcb19 bytes) 2024-09-14T06:00:00.717 INFO:teuthology.orchestra.run.smithi006.stdout:2955 trunc from 0xe999859 to 0x2179614 2024-09-14T06:00:00.739 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:00.736+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:00.755 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:00.755 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:00.765 INFO:teuthology.orchestra.run.smithi006.stdout:2956 punch from 0x1affbd9 to 0x1b083d0, (0x87f7 bytes) 2024-09-14T06:00:00.765 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:00.770 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:00:00.775 INFO:teuthology.orchestra.run.smithi006.stdout:2960 writesame 0x278b735 thru 0x2792679 data_size 0x2d(0x6f45 bytes) 2024-09-14T06:00:00.775 INFO:teuthology.orchestra.run.smithi006.stdout:2961 punch from 0x50217a to 0x50eda9, (0xcc2f bytes) 2024-09-14T06:00:00.805 INFO:teuthology.orchestra.run.smithi006.stdout:2962 writesame 0xbe133d5 thru 0xbe1395c data_size 0xc(0x588 bytes) 2024-09-14T06:00:00.822 INFO:teuthology.orchestra.run.smithi006.stdout:2963 write 0xd9a38e8 thru 0xd9aedc1 (0xb4da bytes) 2024-09-14T06:00:00.860 INFO:teuthology.orchestra.run.smithi006.stdout:2964 write 0xe0540f3 thru 0xe0569a3 (0x28b1 bytes) 2024-09-14T06:00:00.865 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:00.864+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:00.867 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:00.867 INFO:teuthology.orchestra.run.smithi006.stdout:2969 punch from 0x6cd5d2c to 0x6cdd841, (0x7b15 bytes) 2024-09-14T06:00:00.867 INFO:teuthology.orchestra.run.smithi006.stdout:2970 write 0xd783e16 thru 0xd785a0c (0x1bf7 bytes) 2024-09-14T06:00:00.875 INFO:teuthology.orchestra.run.smithi006.stdout:2971 punch from 0x71744a8 to 0x717b505, (0x705d bytes) 2024-09-14T06:00:00.875 INFO:teuthology.orchestra.run.smithi006.stdout:2972 write 0x893c9bb thru 0x89487a5 (0xbdeb bytes) 2024-09-14T06:00:00.894 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:00.894 INFO:teuthology.orchestra.run.smithi006.stdout:2975 punch from 0x9c82b67 to 0x9c90bf9, (0xe092 bytes) 2024-09-14T06:00:00.894 INFO:teuthology.orchestra.run.smithi006.stdout:2976 write 0x85b7864 thru 0x85bee88 (0x7625 bytes) 2024-09-14T06:00:00.911 INFO:teuthology.orchestra.run.smithi006.stdout:2977 writesame 0x2ed195c thru 0x2edea16 data_size 0x1(0xd0bb bytes) 2024-09-14T06:00:00.941 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:00.940+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:00.942 INFO:teuthology.orchestra.run.smithi006.stdout:2978 write 0x8f5f40b thru 0x8f5fedb (0xad1 bytes) 2024-09-14T06:00:00.947 INFO:teuthology.orchestra.run.smithi006.stdout:2979 write 0x4d47c39 thru 0x4d4ac4b (0x3013 bytes) 2024-09-14T06:00:00.957 INFO:teuthology.orchestra.run.smithi006.stdout:2980 punch from 0x485b9a1 to 0x4860e24, (0x5483 bytes) 2024-09-14T06:00:00.957 INFO:teuthology.orchestra.run.smithi006.stdout:2982 writesame 0xd2ee808 thru 0xd2f1d42 data_size 0x1(0x353b bytes) 2024-09-14T06:00:00.964 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:00.964 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:00.970 INFO:teuthology.orchestra.run.smithi006.stdout:2983 read 0x1650b71 thru 0x1650c65 (0xf5 bytes) 2024-09-14T06:00:00.970 INFO:teuthology.orchestra.run.smithi006.stdout:2985 read 0x80457b3 thru 0x804adc3 (0x5611 bytes) 2024-09-14T06:00:00.970 INFO:teuthology.orchestra.run.smithi006.stdout:2986 write 0x1dcc96b thru 0x1dd67b3 (0x9e49 bytes) 2024-09-14T06:00:00.981 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:00:00.994 INFO:teuthology.orchestra.run.smithi006.stdout:2987 trunc from 0xe0569a4 to 0xd093cb1 2024-09-14T06:00:01.019 INFO:teuthology.orchestra.run.smithi006.stdout:2988 write 0xae4aeb1 thru 0xae4dd51 (0x2ea1 bytes) 2024-09-14T06:00:01.028 INFO:teuthology.orchestra.run.smithi006.stdout:2989 read 0x68943b9 thru 0x6895fee (0x1c36 bytes) 2024-09-14T06:00:01.028 INFO:teuthology.orchestra.run.smithi006.stdout:2991 write 0x5a397f3 thru 0x5a472c2 (0xdad0 bytes) 2024-09-14T06:00:01.048 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:01.048 INFO:teuthology.orchestra.run.smithi006.stdout:2993 writesame 0x386a66c thru 0x38700de data_size 0xb(0x5a73 bytes) 2024-09-14T06:00:01.069 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:01.068+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:01.080 INFO:teuthology.orchestra.run.smithi006.stdout:2994 trunc from 0xd093cb1 to 0x7743504 2024-09-14T06:00:01.109 INFO:teuthology.orchestra.run.smithi006.stdout:2995 read 0x4725798 thru 0x472b613 (0x5e7c bytes) 2024-09-14T06:00:01.126 INFO:teuthology.orchestra.run.smithi006.stdout:2997 write 0x8c04cfe thru 0x8c053dd (0x6e0 bytes) 2024-09-14T06:00:01.132 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:01.132 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:01.132 INFO:teuthology.orchestra.run.smithi006.stdout:3003 read 0x3f563a5 thru 0x3f648e7 (0xe543 bytes) 2024-09-14T06:00:01.136 INFO:teuthology.orchestra.run.smithi006.stdout:3004 trunc from 0x8c053de to 0xa2317bf 2024-09-14T06:00:01.143 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:01.141+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:01.148 INFO:teuthology.orchestra.run.smithi006.stdout:3005 read 0x3f29a0f thru 0x3f35843 (0xbe35 bytes) 2024-09-14T06:00:01.148 INFO:teuthology.orchestra.run.smithi006.stdout:3006 write 0x147a24d thru 0x147d2d1 (0x3085 bytes) 2024-09-14T06:00:01.159 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:01.159 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:01.177 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:00:01.198 INFO:teuthology.orchestra.run.smithi006.stdout:3007 writesame 0xba9f097 thru 0xbaa2c41 data_size 0x2f(0x3bab bytes) 2024-09-14T06:00:01.201 INFO:teuthology.orchestra.run.smithi006.stdout:3008 trunc from 0xbaa2c42 to 0xae98900 2024-09-14T06:00:01.214 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:01.214 INFO:teuthology.orchestra.run.smithi006.stdout:3010 punch from 0x8678b57 to 0x867c1e6, (0x368f bytes) 2024-09-14T06:00:01.214 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:01.214 INFO:teuthology.orchestra.run.smithi006.stdout:3013 read 0x43fdf53 thru 0x4409d24 (0xbdd2 bytes) 2024-09-14T06:00:01.214 INFO:teuthology.orchestra.run.smithi006.stdout:3014 punch from 0x304b650 to 0x3053120, (0x7ad0 bytes) 2024-09-14T06:00:01.214 INFO:teuthology.orchestra.run.smithi006.stdout:3016 write 0x2758284 thru 0x275c6b2 (0x442f bytes) 2024-09-14T06:00:01.226 INFO:teuthology.orchestra.run.smithi006.stdout:3017 read 0x3f0bf19 thru 0x3f0f2bc (0x33a4 bytes) 2024-09-14T06:00:01.235 INFO:teuthology.orchestra.run.smithi006.stdout:3018 trunc from 0xae98900 to 0x7e5d54c 2024-09-14T06:00:01.265 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:01.264+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:01.265 INFO:teuthology.orchestra.run.smithi006.stdout:3019 trunc from 0x7e5d54c to 0x4bed486 2024-09-14T06:00:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:3020 write 0xe268dab thru 0xe26aeb5 (0x210b bytes) 2024-09-14T06:00:01.344 INFO:teuthology.orchestra.run.smithi006.stdout:3021 read 0x8787b71 thru 0x87932e0 (0xb770 bytes) 2024-09-14T06:00:01.344 INFO:teuthology.orchestra.run.smithi006.stdout:3022 read 0xcad5c02 thru 0xcadbb64 (0x5f63 bytes) 2024-09-14T06:00:01.345 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:01.344+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:01.349 INFO:teuthology.orchestra.run.smithi006.stdout:3024 trunc from 0xe26aeb6 to 0xc889246 2024-09-14T06:00:01.351 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:01.351 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:01.367 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:00:01.386 INFO:teuthology.orchestra.run.smithi006.stdout:3025 trunc from 0xc889246 to 0x881cbe3 2024-09-14T06:00:01.410 INFO:teuthology.orchestra.run.smithi006.stdout:3026 trunc from 0x881cbe3 to 0xd146730 2024-09-14T06:00:01.424 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:01.424 INFO:teuthology.orchestra.run.smithi006.stdout:3028 punch from 0x37f2726 to 0x37f7cc3, (0x559d bytes) 2024-09-14T06:00:01.424 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:01.424 INFO:teuthology.orchestra.run.smithi006.stdout:3032 write 0x7d4e1c7 thru 0x7d54035 (0x5e6f bytes) 2024-09-14T06:00:01.436 INFO:teuthology.orchestra.run.smithi006.stdout:3034 writesame 0x4e5eec9 thru 0x4e63eb5 data_size 0x25(0x4fed bytes) 2024-09-14T06:00:01.446 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:01.441+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:01.448 INFO:teuthology.orchestra.run.smithi006.stdout:3035 flatten 2024-09-14T06:00:01.546 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:01.541+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:01.561 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:01.562 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:01.577 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:00:01.647 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:01.645+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:01.699 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:01.699 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:01.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:00:01.748 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:01.744+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:01.819 INFO:teuthology.orchestra.run.smithi006.stdout:3036 read 0x12bc378 thru 0x12c2cd8 (0x6961 bytes) 2024-09-14T06:00:01.820 INFO:teuthology.orchestra.run.smithi006.stdout:3037 punch from 0x64a3bd9 to 0x64aa503, (0x692a bytes) 2024-09-14T06:00:01.820 INFO:teuthology.orchestra.run.smithi006.stdout:3038 writesame 0xe2d46f thru 0xe3a142 data_size 0x2(0xccd4 bytes) 2024-09-14T06:00:01.842 INFO:teuthology.orchestra.run.smithi006.stdout:3039 writesame 0xd7d9e47 thru 0xd7dc2d4 data_size 0x1(0x248e bytes) 2024-09-14T06:00:01.842 INFO:teuthology.orchestra.run.smithi006.stdout:3040 read 0x52a03e thru 0x5384d5 (0xe498 bytes) 2024-09-14T06:00:01.842 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:01.849 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:01.848+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:01.860 INFO:teuthology.orchestra.run.smithi006.stdout:3042 trunc from 0xd7dc2d5 to 0xab3ac8 2024-09-14T06:00:01.898 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:01.898 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:01.916 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:00:01.920 INFO:teuthology.orchestra.run.smithi006.stdout:3043 write 0x543ccdf thru 0x5447bf3 (0xaf15 bytes) 2024-09-14T06:00:01.940 INFO:teuthology.orchestra.run.smithi006.stdout:3045 read 0x169417d thru 0x169cbc3 (0x8a47 bytes) 2024-09-14T06:00:01.946 INFO:teuthology.orchestra.run.smithi006.stdout:3046 trunc from 0x5447bf4 to 0x16c8c8e 2024-09-14T06:00:01.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T06:00:01.950 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:01.945+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:01.962 INFO:teuthology.orchestra.run.smithi006.stdout:3047 read 0xbd01a2 thru 0xbdf3b7 (0xf216 bytes) 2024-09-14T06:00:01.972 INFO:teuthology.orchestra.run.smithi006.stdout:3048 write 0x362e383 thru 0x3630cbd (0x293b bytes) 2024-09-14T06:00:02.001 INFO:teuthology.orchestra.run.smithi006.stdout:3050 write 0xa9c08de thru 0xa9c9824 (0x8f47 bytes) 2024-09-14T06:00:02.029 INFO:teuthology.orchestra.run.smithi006.stdout:3051 write 0x94831c0 thru 0x9489841 (0x6682 bytes) 2024-09-14T06:00:02.050 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:02.050 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:02.050 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:02.048+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:02.054 INFO:teuthology.orchestra.run.smithi006.stdout:3053 trunc from 0xa9c9825 to 0x4fa142f 2024-09-14T06:00:02.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:00:02.087 INFO:teuthology.orchestra.run.smithi006.stdout:3054 write 0x75d14e4 thru 0x75e10e8 (0xfc05 bytes) 2024-09-14T06:00:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:3056 read 0x64c95cc thru 0x64cbcc5 (0x26fa bytes) 2024-09-14T06:00:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:3057 read 0x17f25b6 thru 0x180187f (0xf2ca bytes) 2024-09-14T06:00:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:3058 punch from 0x31463fc to 0x3148bc7, (0x27cb bytes) 2024-09-14T06:00:02.126 INFO:teuthology.orchestra.run.smithi006.stdout:3059 write 0x96234a8 thru 0x962adbc (0x7915 bytes) 2024-09-14T06:00:02.148 INFO:teuthology.orchestra.run.smithi006.stdout:3060 punch from 0x33dcc7c to 0x33e31a7, (0x652b bytes) 2024-09-14T06:00:02.148 INFO:teuthology.orchestra.run.smithi006.stdout:3062 write 0x3f30eb thru 0x401b1e (0xea34 bytes) 2024-09-14T06:00:02.150 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:02.148+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:02.174 INFO:teuthology.orchestra.run.smithi006.stdout:3064 punch from 0x885e7b0 to 0x8862d0b, (0x455b bytes) 2024-09-14T06:00:02.187 INFO:teuthology.orchestra.run.smithi006.stdout:3066 write 0xd10d3d5 thru 0xd10e74d (0x1379 bytes) 2024-09-14T06:00:02.195 INFO:teuthology.orchestra.run.smithi006.stdout:3067 read 0xaf3d30a thru 0xaf49993 (0xc68a bytes) 2024-09-14T06:00:02.195 INFO:teuthology.orchestra.run.smithi006.stdout:3068 write 0x427ccbe thru 0x4285aee (0x8e31 bytes) 2024-09-14T06:00:02.216 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:02.216 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:02.220 INFO:teuthology.orchestra.run.smithi006.stdout:3069 read 0x4027fa6 thru 0x4037bb5 (0xfc10 bytes) 2024-09-14T06:00:02.220 INFO:teuthology.orchestra.run.smithi006.stdout:3070 writesame 0x38bec5a thru 0x38cd5cb data_size 0x1(0xe972 bytes) 2024-09-14T06:00:02.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:00:02.252 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:02.248+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:02.252 INFO:teuthology.orchestra.run.smithi006.stdout:3072 write 0x3e7fb40 thru 0x3e8a57e (0xaa3f bytes) 2024-09-14T06:00:02.270 INFO:teuthology.orchestra.run.smithi006.stdout:3074 read 0x96c5a51 thru 0x96c82ea (0x289a bytes) 2024-09-14T06:00:02.288 INFO:teuthology.orchestra.run.smithi006.stdout:3078 trunc from 0xd10e74e to 0x12a0db2 2024-09-14T06:00:02.316 INFO:teuthology.orchestra.run.smithi006.stdout:3080 read 0x8a8aed thru 0x8ae8c7 (0x5ddb bytes) 2024-09-14T06:00:02.326 INFO:teuthology.orchestra.run.smithi006.stdout:3081 writesame 0x2e5a6b5 thru 0x2e5e156 data_size 0x26(0x3aa2 bytes) 2024-09-14T06:00:02.344 INFO:teuthology.orchestra.run.smithi006.stdout:3082 write 0x96aa0d3 thru 0x96b9f2e (0xfe5c bytes) 2024-09-14T06:00:02.353 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:02.349+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:02.365 INFO:teuthology.orchestra.run.smithi006.stdout:3083 punch from 0x708ad1d to 0x7090faf, (0x6292 bytes) 2024-09-14T06:00:02.365 INFO:teuthology.orchestra.run.smithi006.stdout:3085 punch from 0x27b331d to 0x27bcdbd, (0x9aa0 bytes) 2024-09-14T06:00:02.366 INFO:teuthology.orchestra.run.smithi006.stdout:3086 read 0x612b421 thru 0x613968c (0xe26c bytes) 2024-09-14T06:00:02.380 INFO:teuthology.orchestra.run.smithi006.stdout:3088 trunc from 0x96b9f2f to 0x96f1ce 2024-09-14T06:00:02.391 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:02.391 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:02.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:00:02.428 INFO:teuthology.orchestra.run.smithi006.stdout:3089 write 0x71a77c1 thru 0x71b5c7a (0xe4ba bytes) 2024-09-14T06:00:02.454 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:02.452+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:02.463 INFO:teuthology.orchestra.run.smithi006.stdout:3094 read 0x5b87766 thru 0x5b925b3 (0xae4e bytes) 2024-09-14T06:00:02.463 INFO:teuthology.orchestra.run.smithi006.stdout:3095 write 0x39c6f22 thru 0x39d074a (0x9829 bytes) 2024-09-14T06:00:02.490 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:02.491 INFO:teuthology.orchestra.run.smithi006.stdout:3098 trunc from 0x71b5c7b to 0x675c459 2024-09-14T06:00:02.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:00:02.512 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:02.512 INFO:teuthology.orchestra.run.smithi006.stdout:3100 read 0x2fef7fe thru 0x2fef930 (0x133 bytes) 2024-09-14T06:00:02.512 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:02.513 INFO:teuthology.orchestra.run.smithi006.stdout:3104 read 0x1b5dfec thru 0x1b65472 (0x7487 bytes) 2024-09-14T06:00:02.513 INFO:teuthology.orchestra.run.smithi006.stdout:3105 writesame 0x4ab82a4 thru 0x4ac7098 data_size 0x1(0xedf5 bytes) 2024-09-14T06:00:02.551 INFO:teuthology.orchestra.run.smithi006.stdout:3107 trunc from 0x675c459 to 0x245d7a5 2024-09-14T06:00:02.556 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:02.553+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:02.566 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:02.566 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:02.588 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:00:02.599 INFO:teuthology.orchestra.run.smithi006.stdout:3108 write 0xcfe0b60 thru 0xcfe7bc7 (0x7068 bytes) 2024-09-14T06:00:02.629 INFO:teuthology.orchestra.run.smithi006.stdout:3109 read 0x83526a1 thru 0x835a342 (0x7ca2 bytes) 2024-09-14T06:00:02.629 INFO:teuthology.orchestra.run.smithi006.stdout:3110 write 0x3afc322 thru 0x3b0846b (0xc14a bytes) 2024-09-14T06:00:02.656 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:02.652+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:02.657 INFO:teuthology.orchestra.run.smithi006.stdout:3111 punch from 0x2c2aa2c to 0x2c35750, (0xad24 bytes) 2024-09-14T06:00:02.657 INFO:teuthology.orchestra.run.smithi006.stdout:3112 read 0x138ed8e thru 0x139df39 (0xf1ac bytes) 2024-09-14T06:00:02.657 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:02.657 INFO:teuthology.orchestra.run.smithi006.stdout:3114 punch from 0x2c616ff to 0x2c68915, (0x7216 bytes) 2024-09-14T06:00:02.657 INFO:teuthology.orchestra.run.smithi006.stdout:3115 write 0x2f15540 thru 0x2f1a7d5 (0x5296 bytes) 2024-09-14T06:00:02.668 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:02.669 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:02.677 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:02.677 INFO:teuthology.orchestra.run.smithi006.stdout:3118 writesame 0x614617f thru 0x614d0d4 data_size 0x1(0x6f56 bytes) 2024-09-14T06:00:02.687 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:02.687 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:02.703 INFO:teuthology.orchestra.run.smithi006.stdout:3119 writesame 0x37d32ec thru 0x37dbd79 data_size 0x5(0x8a8e bytes) 2024-09-14T06:00:02.706 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:02.706 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:02.725 INFO:teuthology.orchestra.run.smithi006.stdout:3120 trunc from 0xcfe7bc8 to 0xa4171eb 2024-09-14T06:00:02.727 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:02.727 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:02.735 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:00:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:00:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.735 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57124 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751064+0000", 2024-09-14T06:00:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9832409220000002, 2024-09-14T06:00:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.044798303999999997, 2024-09-14T06:00:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57124 2024-09-14T06:00:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751064+0000", 2024-09-14T06:00:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751064+0000", 2024-09-14T06:00:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751065+0000", 2024-09-14T06:00:02.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6200000000000006e-07 2024-09-14T06:00:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751070+0000", 2024-09-14T06:00:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1959999999999999e-06 2024-09-14T06:00:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751087+0000", 2024-09-14T06:00:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6249e-05 2024-09-14T06:00:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751096+0000", 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3519999999999996e-06 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.795542+0000", 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.044445813000000001 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.795623+0000", 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1317999999999996e-05 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.795863+0000", 2024-09-14T06:00:02.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000239414 2024-09-14T06:00:02.740 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.740 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.740 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.740 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57125 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 243712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.740 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751110+0000", 2024-09-14T06:00:02.740 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9831953909999998, 2024-09-14T06:00:02.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045121582, 2024-09-14T06:00:02.740 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.740 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.740 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.740 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.741 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.741 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.741 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57125 2024-09-14T06:00:02.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.741 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.741 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.741 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751110+0000", 2024-09-14T06:00:02.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.741 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.741 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751110+0000", 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751111+0000", 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4199999999999995e-07 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751127+0000", 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6200000000000001e-05 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751143+0000", 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6013999999999999e-05 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751154+0000", 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1622e-05 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.795885+0000", 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.044730704000000003 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.795972+0000", 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6730999999999993e-05 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.796231+0000", 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025956900000000002 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57126 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751170+0000", 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9831347949999998, 2024-09-14T06:00:02.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045455310999999998, 2024-09-14T06:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57126 2024-09-14T06:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751170+0000", 2024-09-14T06:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.746 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.746 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751170+0000", 2024-09-14T06:00:02.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.746 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.746 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751171+0000", 2024-09-14T06:00:02.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8000000000000005e-07 2024-09-14T06:00:02.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.746 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.746 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751175+0000", 2024-09-14T06:00:02.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0899999999999998e-06 2024-09-14T06:00:02.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.747 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751188+0000", 2024-09-14T06:00:02.747 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.309e-05 2024-09-14T06:00:02.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.747 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751197+0000", 2024-09-14T06:00:02.747 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9290000000000004e-06 2024-09-14T06:00:02.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.796270+0000", 2024-09-14T06:00:02.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045072438999999999 2024-09-14T06:00:02.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.796363+0000", 2024-09-14T06:00:02.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2952e-05 2024-09-14T06:00:02.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.796626+0000", 2024-09-14T06:00:02.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000263031 2024-09-14T06:00:02.749 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.749 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.749 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.749 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57127 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 276480~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.749 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751215+0000", 2024-09-14T06:00:02.749 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9830901020000002, 2024-09-14T06:00:02.749 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045954936000000002, 2024-09-14T06:00:02.749 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.749 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.749 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.749 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.749 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.750 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.750 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57127 2024-09-14T06:00:02.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.750 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.750 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.750 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751215+0000", 2024-09-14T06:00:02.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.750 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.750 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751215+0000", 2024-09-14T06:00:02.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751216+0000", 2024-09-14T06:00:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6199999999999996e-07 2024-09-14T06:00:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751220+0000", 2024-09-14T06:00:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.498e-06 2024-09-14T06:00:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751234+0000", 2024-09-14T06:00:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3203999999999999e-05 2024-09-14T06:00:02.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.752 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751245+0000", 2024-09-14T06:00:02.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1786e-05 2024-09-14T06:00:02.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.752 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.796683+0000", 2024-09-14T06:00:02.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045437014999999997 2024-09-14T06:00:02.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.752 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.796798+0000", 2024-09-14T06:00:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000115621 2024-09-14T06:00:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797170+0000", 2024-09-14T06:00:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00037195000000000001 2024-09-14T06:00:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57128 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 292864~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751261+0000", 2024-09-14T06:00:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9830440419999995, 2024-09-14T06:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046282656999999998, 2024-09-14T06:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57128 2024-09-14T06:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751261+0000", 2024-09-14T06:00:02.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751261+0000", 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751262+0000", 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1800000000000005e-07 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751266+0000", 2024-09-14T06:00:02.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8659999999999999e-06 2024-09-14T06:00:02.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751278+0000", 2024-09-14T06:00:02.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2612000000000001e-05 2024-09-14T06:00:02.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751288+0000", 2024-09-14T06:00:02.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8199999999999992e-06 2024-09-14T06:00:02.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797214+0000", 2024-09-14T06:00:02.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045925437 2024-09-14T06:00:02.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797289+0000", 2024-09-14T06:00:02.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.559e-05 2024-09-14T06:00:02.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797544+0000", 2024-09-14T06:00:02.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025461400000000001 2024-09-14T06:00:02.757 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.758 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.758 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.758 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57129 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 309248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.758 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751304+0000", 2024-09-14T06:00:02.758 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9830012759999995, 2024-09-14T06:00:02.758 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046642827999999997, 2024-09-14T06:00:02.758 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.758 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.758 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.758 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.758 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.758 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.759 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57129 2024-09-14T06:00:02.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.759 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.759 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.759 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751304+0000", 2024-09-14T06:00:02.759 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.759 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.759 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751304+0000", 2024-09-14T06:00:02.759 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751305+0000", 2024-09-14T06:00:02.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9999999999999995e-07 2024-09-14T06:00:02.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751309+0000", 2024-09-14T06:00:02.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4630000000000003e-06 2024-09-14T06:00:02.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751321+0000", 2024-09-14T06:00:02.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2018000000000001e-05 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751331+0000", 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2040000000000003e-06 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797547+0000", 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046216220000000002 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797661+0000", 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000114539 2024-09-14T06:00:02.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.762 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.762 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797947+0000", 2024-09-14T06:00:02.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028538400000000002 2024-09-14T06:00:02.762 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.762 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.762 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.762 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57130 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 325632~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.762 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751342+0000", 2024-09-14T06:00:02.762 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9829629190000002, 2024-09-14T06:00:02.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.047033332999999997, 2024-09-14T06:00:02.763 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.763 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.763 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.763 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.763 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.763 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57130 2024-09-14T06:00:02.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.763 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751342+0000", 2024-09-14T06:00:02.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751342+0000", 2024-09-14T06:00:02.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751343+0000", 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7800000000000001e-07 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751346+0000", 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.422e-06 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751359+0000", 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.26e-05 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751369+0000", 2024-09-14T06:00:02.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6059999999999992e-06 2024-09-14T06:00:02.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.797995+0000", 2024-09-14T06:00:02.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046626735000000002 2024-09-14T06:00:02.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.798090+0000", 2024-09-14T06:00:02.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4739000000000002e-05 2024-09-14T06:00:02.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.798376+0000", 2024-09-14T06:00:02.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028555300000000002 2024-09-14T06:00:02.767 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.767 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.767 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.767 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57131 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 342016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.767 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751382+0000", 2024-09-14T06:00:02.767 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9829236809999999, 2024-09-14T06:00:02.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.047436074000000002, 2024-09-14T06:00:02.768 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.768 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.768 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.768 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.768 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.768 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.768 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57131 2024-09-14T06:00:02.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.768 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.768 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.768 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751382+0000", 2024-09-14T06:00:02.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751382+0000", 2024-09-14T06:00:02.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751382+0000", 2024-09-14T06:00:02.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7400000000000002e-07 2024-09-14T06:00:02.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.770 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751385+0000", 2024-09-14T06:00:02.770 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9340000000000002e-06 2024-09-14T06:00:02.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.770 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.770 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751393+0000", 2024-09-14T06:00:02.770 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.294e-06 2024-09-14T06:00:02.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.770 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.770 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751398+0000", 2024-09-14T06:00:02.770 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2020000000000003e-06 2024-09-14T06:00:02.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.771 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.798436+0000", 2024-09-14T06:00:02.771 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.047038583000000002 2024-09-14T06:00:02.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.771 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.798543+0000", 2024-09-14T06:00:02.771 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000106844 2024-09-14T06:00:02.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.771 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.798818+0000", 2024-09-14T06:00:02.771 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027444299999999997 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57132 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 358400~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751461+0000", 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9828441400000001, 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.047739358000000003, 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.772 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.773 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57132 2024-09-14T06:00:02.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.773 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751461+0000", 2024-09-14T06:00:02.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751461+0000", 2024-09-14T06:00:02.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751462+0000", 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.034e-06 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751466+0000", 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.16e-06 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751483+0000", 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7158000000000001e-05 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751494+0000", 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0974e-05 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.798867+0000", 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.047372174000000003 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.798948+0000", 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1079000000000001e-05 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.776 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.776 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.799200+0000", 2024-09-14T06:00:02.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025277900000000001 2024-09-14T06:00:02.776 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.776 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.776 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.776 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57133 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 374784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.776 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751514+0000", 2024-09-14T06:00:02.776 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9827912220000004, 2024-09-14T06:00:02.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048141397000000002, 2024-09-14T06:00:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57133 2024-09-14T06:00:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751514+0000", 2024-09-14T06:00:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751514+0000", 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751515+0000", 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4e-07 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751517+0000", 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5560000000000002e-06 2024-09-14T06:00:02.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.779 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.779 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751531+0000", 2024-09-14T06:00:02.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3818000000000001e-05 2024-09-14T06:00:02.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.779 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.779 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751540+0000", 2024-09-14T06:00:02.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8489999999999995e-06 2024-09-14T06:00:02.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.779 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.779 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.799250+0000", 2024-09-14T06:00:02.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.047710176999999999 2024-09-14T06:00:02.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.780 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.780 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.799361+0000", 2024-09-14T06:00:02.780 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000110414 2024-09-14T06:00:02.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.780 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.780 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.799655+0000", 2024-09-14T06:00:02.780 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029474299999999998 2024-09-14T06:00:02.780 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.780 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.780 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.781 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57134 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 391168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.781 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751555+0000", 2024-09-14T06:00:02.781 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9827501810000001, 2024-09-14T06:00:02.781 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048484318999999998, 2024-09-14T06:00:02.781 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.781 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.781 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.781 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.781 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.781 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.781 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57134 2024-09-14T06:00:02.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.781 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751555+0000", 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751555+0000", 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751556+0000", 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3799999999999996e-07 2024-09-14T06:00:02.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751561+0000", 2024-09-14T06:00:02.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7439999999999998e-06 2024-09-14T06:00:02.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751574+0000", 2024-09-14T06:00:02.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2918000000000001e-05 2024-09-14T06:00:02.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751582+0000", 2024-09-14T06:00:02.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8640000000000002e-06 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.799701+0000", 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048118952 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.799765+0000", 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3382999999999999e-05 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800039+0000", 2024-09-14T06:00:02.784 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027462 2024-09-14T06:00:02.785 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.785 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.785 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.785 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57135 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 407552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.785 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751597+0000", 2024-09-14T06:00:02.785 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9827080410000004, 2024-09-14T06:00:02.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048760876000000002, 2024-09-14T06:00:02.785 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.785 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.785 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.785 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.786 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.786 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.786 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57135 2024-09-14T06:00:02.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.786 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751597+0000", 2024-09-14T06:00:02.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751597+0000", 2024-09-14T06:00:02.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751598+0000", 2024-09-14T06:00:02.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6799999999999999e-07 2024-09-14T06:00:02.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751602+0000", 2024-09-14T06:00:02.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2239999999999997e-06 2024-09-14T06:00:02.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751612+0000", 2024-09-14T06:00:02.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0274e-05 2024-09-14T06:00:02.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.788 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751622+0000", 2024-09-14T06:00:02.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4339999999999998e-06 2024-09-14T06:00:02.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.788 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800062+0000", 2024-09-14T06:00:02.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048439647000000002 2024-09-14T06:00:02.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.789 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800119+0000", 2024-09-14T06:00:02.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7507999999999999e-05 2024-09-14T06:00:02.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.789 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800358+0000", 2024-09-14T06:00:02.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023902099999999999 2024-09-14T06:00:02.789 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.789 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.789 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.790 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57136 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 423936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.790 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751636+0000", 2024-09-14T06:00:02.790 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9826688390000005, 2024-09-14T06:00:02.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049133920999999997, 2024-09-14T06:00:02.790 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.790 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.790 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.790 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.790 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.790 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.790 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57136 2024-09-14T06:00:02.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.790 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751636+0000", 2024-09-14T06:00:02.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751636+0000", 2024-09-14T06:00:02.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751637+0000", 2024-09-14T06:00:02.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3e-07 2024-09-14T06:00:02.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751641+0000", 2024-09-14T06:00:02.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0899999999999998e-06 2024-09-14T06:00:02.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751655+0000", 2024-09-14T06:00:02.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3317e-05 2024-09-14T06:00:02.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751664+0000", 2024-09-14T06:00:02.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7240000000000004e-06 2024-09-14T06:00:02.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800405+0000", 2024-09-14T06:00:02.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048741189999999997 2024-09-14T06:00:02.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800508+0000", 2024-09-14T06:00:02.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000102902 2024-09-14T06:00:02.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.794 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.794 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800770+0000", 2024-09-14T06:00:02.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026196800000000001 2024-09-14T06:00:02.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.794 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.794 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57137 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 440320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.794 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751680+0000", 2024-09-14T06:00:02.795 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.982625208, 2024-09-14T06:00:02.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.04945397, 2024-09-14T06:00:02.795 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.795 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.795 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.795 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.795 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.795 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.795 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57137 2024-09-14T06:00:02.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.795 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751680+0000", 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751680+0000", 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751681+0000", 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8800000000000002e-07 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751696+0000", 2024-09-14T06:00:02.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5483999999999999e-05 2024-09-14T06:00:02.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.797 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751713+0000", 2024-09-14T06:00:02.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7005999999999999e-05 2024-09-14T06:00:02.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.797 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751724+0000", 2024-09-14T06:00:02.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0464e-05 2024-09-14T06:00:02.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.797 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800814+0000", 2024-09-14T06:00:02.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049090434000000002 2024-09-14T06:00:02.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.798 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.800888+0000", 2024-09-14T06:00:02.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3533000000000002e-05 2024-09-14T06:00:02.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.798 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801134+0000", 2024-09-14T06:00:02.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024626100000000001 2024-09-14T06:00:02.798 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.798 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.799 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.799 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57138 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 456704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.799 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751741+0000", 2024-09-14T06:00:02.799 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9825643959999999, 2024-09-14T06:00:02.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049838514, 2024-09-14T06:00:02.799 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.799 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.799 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.799 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.799 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.799 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.799 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57138 2024-09-14T06:00:02.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.800 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751741+0000", 2024-09-14T06:00:02.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751741+0000", 2024-09-14T06:00:02.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751742+0000", 2024-09-14T06:00:02.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8999999999999995e-07 2024-09-14T06:00:02.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751746+0000", 2024-09-14T06:00:02.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5159999999999996e-06 2024-09-14T06:00:02.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751758+0000", 2024-09-14T06:00:02.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2182e-05 2024-09-14T06:00:02.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751768+0000", 2024-09-14T06:00:02.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4450000000000002e-06 2024-09-14T06:00:02.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801211+0000", 2024-09-14T06:00:02.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049443576000000003 2024-09-14T06:00:02.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801333+0000", 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000121826 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801579+0000", 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024607900000000001 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57139 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 473088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751786+0000", 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9825195149999999, 2024-09-14T06:00:02.803 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050106650000000003, 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57139 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751786+0000", 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751786+0000", 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751787+0000", 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1999999999999998e-07 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751791+0000", 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3800000000000004e-06 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.806 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.806 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751804+0000", 2024-09-14T06:00:02.806 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2680000000000001e-05 2024-09-14T06:00:02.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.806 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.806 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751813+0000", 2024-09-14T06:00:02.806 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6180000000000001e-06 2024-09-14T06:00:02.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.806 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.806 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801619+0000", 2024-09-14T06:00:02.806 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049805823999999999 2024-09-14T06:00:02.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.807 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.807 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801677+0000", 2024-09-14T06:00:02.807 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8227999999999999e-05 2024-09-14T06:00:02.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.807 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.807 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801892+0000", 2024-09-14T06:00:02.807 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021499999999999999 2024-09-14T06:00:02.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.807 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.807 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.808 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57140 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 489472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.808 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751827+0000", 2024-09-14T06:00:02.808 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9824785289999998, 2024-09-14T06:00:02.808 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050412314, 2024-09-14T06:00:02.808 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.808 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.808 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.808 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.808 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.808 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.808 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57140 2024-09-14T06:00:02.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.808 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751827+0000", 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751827+0000", 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751828+0000", 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0200000000000001e-07 2024-09-14T06:00:02.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.810 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.810 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751831+0000", 2024-09-14T06:00:02.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9639999999999997e-06 2024-09-14T06:00:02.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.810 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.810 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751865+0000", 2024-09-14T06:00:02.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3973999999999997e-05 2024-09-14T06:00:02.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.810 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.810 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751877+0000", 2024-09-14T06:00:02.811 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1871e-05 2024-09-14T06:00:02.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.811 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.801931+0000", 2024-09-14T06:00:02.811 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050053562000000003 2024-09-14T06:00:02.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.811 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802015+0000", 2024-09-14T06:00:02.811 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3943000000000006e-05 2024-09-14T06:00:02.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.812 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802239+0000", 2024-09-14T06:00:02.812 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000224198 2024-09-14T06:00:02.812 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.812 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.812 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.812 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57141 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.812 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751895+0000", 2024-09-14T06:00:02.812 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.982410132, 2024-09-14T06:00:02.812 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.05065443, 2024-09-14T06:00:02.812 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.812 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.813 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.813 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.813 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.813 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.813 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57141 2024-09-14T06:00:02.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.813 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.813 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.813 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751895+0000", 2024-09-14T06:00:02.813 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.813 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751895+0000", 2024-09-14T06:00:02.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751896+0000", 2024-09-14T06:00:02.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0599999999999999e-07 2024-09-14T06:00:02.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751906+0000", 2024-09-14T06:00:02.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0138e-05 2024-09-14T06:00:02.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751921+0000", 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4715999999999999e-05 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751931+0000", 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.026e-05 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802278+0000", 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050347291000000002 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802336+0000", 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7868999999999998e-05 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802550+0000", 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021325000000000001 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:57142 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 522240~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.816 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.751987+0000", 2024-09-14T06:00:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.9823180130000004, 2024-09-14T06:00:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050884757000000003, 2024-09-14T06:00:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 57142 2024-09-14T06:00:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.817 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751987+0000", 2024-09-14T06:00:02.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.818 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.818 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751987+0000", 2024-09-14T06:00:02.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.818 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.818 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751988+0000", 2024-09-14T06:00:02.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.012e-06 2024-09-14T06:00:02.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.818 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.751993+0000", 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8040000000000001e-06 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.752008+0000", 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5012e-05 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.752021+0000", 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2897999999999999e-05 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.819 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802576+0000", 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050554736000000003 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802633+0000", 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7569999999999999e-05 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.802872+0000", 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023872499999999999 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.820 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:59282 3.0 3:04b777ef:::rbd_data.1127e0283608.0000000000000003:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:55.269668+0000", 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 7.4646371360000003, 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.044620580999999999, 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 59282 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.821 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:02.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.822 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:02.822 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.269668+0000", 2024-09-14T06:00:02.822 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.822 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:02.822 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.269668+0000", 2024-09-14T06:00:02.822 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:02.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.822 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:02.822 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.269669+0000", 2024-09-14T06:00:02.822 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9400000000000004e-07 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.269673+0000", 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2189999999999998e-06 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.269689+0000", 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6104e-05 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.269698+0000", 2024-09-14T06:00:02.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7700000000000007e-06 2024-09-14T06:00:02.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.824 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:02.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.314017+0000", 2024-09-14T06:00:02.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.044319003000000003 2024-09-14T06:00:02.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.824 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:02.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.314074+0000", 2024-09-14T06:00:02.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6647000000000002e-05 2024-09-14T06:00:02.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:02.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:02.824 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:02.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:55.314289+0000", 2024-09-14T06:00:02.825 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021504400000000001 2024-09-14T06:00:02.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.825 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:02.825 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:02.825 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:02.826 INFO:teuthology.orchestra.run.smithi006.stdout:3121 read 0x5b57b13 thru 0x5b5d1a8 (0x5696 bytes) 2024-09-14T06:00:02.826 INFO:teuthology.orchestra.run.smithi006.stdout:3122 punch from 0x5f23c38 to 0x5f33bde, (0xffa6 bytes) 2024-09-14T06:00:02.826 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:02.827 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:02.827 INFO:teuthology.orchestra.run.smithi006.stdout:3124 write 0xd9a127c thru 0xd9a4a40 (0x37c5 bytes) 2024-09-14T06:00:02.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:00:02.828 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:02.829 INFO:teuthology.orchestra.run.smithi006.stdout:3126 trunc from 0xd9a4a41 to 0xdca3837 2024-09-14T06:00:02.829 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:02.829 INFO:teuthology.orchestra.run.smithi006.stdout:3128 read 0xb25b275 thru 0xb25d91d (0x26a9 bytes) 2024-09-14T06:00:02.829 INFO:teuthology.orchestra.run.smithi006.stdout:3129 write 0x4bb250e thru 0x4bba68b (0x817e bytes) 2024-09-14T06:00:02.830 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:02.830 INFO:teuthology.orchestra.run.smithi006.stdout:3130 writesame 0xf875ce thru 0xf92360 data_size 0x1(0xad93 bytes) 2024-09-14T06:00:02.831 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:02.831 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:02.831 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:02.824+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:02.836 INFO:teuthology.orchestra.run.smithi006.stdout:3131 trunc from 0xdca3837 to 0x3b6bc5e 2024-09-14T06:00:02.858 INFO:teuthology.orchestra.run.smithi006.stdout:3132 read 0x732a3d thru 0x739746 (0x6d0a bytes) 2024-09-14T06:00:02.858 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:02.859 INFO:teuthology.orchestra.run.smithi006.stdout:3134 read 0x1d1ce53 thru 0x1d22df8 (0x5fa6 bytes) 2024-09-14T06:00:02.859 INFO:teuthology.orchestra.run.smithi006.stdout:3135 read 0x1d8bf8d thru 0x1d9283d (0x68b1 bytes) 2024-09-14T06:00:02.859 INFO:teuthology.orchestra.run.smithi006.stdout:3137 read 0xa34f0d thru 0xa44d74 (0xfe68 bytes) 2024-09-14T06:00:02.859 INFO:teuthology.orchestra.run.smithi006.stdout:3138 read 0x2cbea49 thru 0x2cc7cea (0x92a2 bytes) 2024-09-14T06:00:02.880 INFO:teuthology.orchestra.run.smithi006.stdout:3140 write 0xafb91bd thru 0xafc155d (0x83a1 bytes) 2024-09-14T06:00:02.920 INFO:teuthology.orchestra.run.smithi006.stdout:3141 writesame 0xc282ae8 thru 0xc28bd7c data_size 0x4f(0x9295 bytes) 2024-09-14T06:00:02.921 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:02.921 INFO:teuthology.orchestra.run.smithi006.stdout:3143 punch from 0x617a151 to 0x6184d0a, (0xabb9 bytes) 2024-09-14T06:00:02.921 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:02.921 INFO:teuthology.orchestra.run.smithi006.stdout:3145 write 0x5440923 thru 0x544e6ac (0xdd8a bytes) 2024-09-14T06:00:02.927 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:02.924+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:02.946 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2024-09-14T06:00:02.956 INFO:teuthology.orchestra.run.smithi006.stdout:3147 read 0x13adc8d thru 0x13b113a (0x34ae bytes) 2024-09-14T06:00:02.956 INFO:teuthology.orchestra.run.smithi006.stdout:3148 write 0xa086461 thru 0xa08dd01 (0x78a1 bytes) 2024-09-14T06:00:02.970 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:02.971 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:02.971 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:00:02.971 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:02.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:00:02.989 INFO:teuthology.orchestra.run.smithi006.stdout:3149 write 0xe1075c3 thru 0xe11294b (0xb389 bytes) 2024-09-14T06:00:03.009 INFO:teuthology.orchestra.run.smithi006.stdout:3150 writesame 0xd6c1fcb thru 0xd6cca6f data_size 0x1(0xaaa5 bytes) 2024-09-14T06:00:03.028 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:03.025+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:03.034 INFO:teuthology.orchestra.run.smithi006.stdout:3151 write 0x8c1cff thru 0x8c5159 (0x345b bytes) 2024-09-14T06:00:03.037 INFO:teuthology.orchestra.run.smithi006.stdout:3152 read 0x7073667 thru 0x7073b62 (0x4fc bytes) 2024-09-14T06:00:03.037 INFO:teuthology.orchestra.run.smithi006.stdout:3153 write 0x558b855 thru 0x5590e85 (0x5631 bytes) 2024-09-14T06:00:03.047 INFO:teuthology.orchestra.run.smithi006.stdout:3154 write 0x8423925 thru 0x842bc3c (0x8318 bytes) 2024-09-14T06:00:03.066 INFO:teuthology.orchestra.run.smithi006.stdout:3155 write 0xb39ef71 thru 0xb3ae479 (0xf509 bytes) 2024-09-14T06:00:03.088 INFO:teuthology.orchestra.run.smithi006.stdout:3156 write 0xb58956d thru 0xb58a6e0 (0x1174 bytes) 2024-09-14T06:00:03.094 INFO:teuthology.orchestra.run.smithi006.stdout:3157 punch from 0x32845ba to 0x32903fc, (0xbe42 bytes) 2024-09-14T06:00:03.094 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:03.094 INFO:teuthology.orchestra.run.smithi006.stdout:3160 read 0x633e040 thru 0x6346ba5 (0x8b66 bytes) 2024-09-14T06:00:03.094 INFO:teuthology.orchestra.run.smithi006.stdout:3162 read 0x9e3c916 thru 0x9e49710 (0xcdfb bytes) 2024-09-14T06:00:03.094 INFO:teuthology.orchestra.run.smithi006.stdout:3163 writesame 0x92bbc8a thru 0x92c8c6b data_size 0x52(0xcfe2 bytes) 2024-09-14T06:00:03.113 INFO:teuthology.orchestra.run.smithi006.stdout:3165 punch from 0x523417 to 0x52d826, (0xa40f bytes) 2024-09-14T06:00:03.113 INFO:teuthology.orchestra.run.smithi006.stdout:3166 read 0x8591076 thru 0x859c0a6 (0xb031 bytes) 2024-09-14T06:00:03.114 INFO:teuthology.orchestra.run.smithi006.stdout:3167 write 0x2ab1aee thru 0x2ab4f20 (0x3433 bytes) 2024-09-14T06:00:03.115 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:03.115 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:03.116 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:03.116 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:03.116 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:03.121 INFO:teuthology.orchestra.run.smithi006.stdout:3169 read 0xb0140f2 thru 0xb01fdaa (0xbcb9 bytes) 2024-09-14T06:00:03.121 INFO:teuthology.orchestra.run.smithi006.stdout:3170 read 0xdf6672b thru 0xdf733e7 (0xccbd bytes) 2024-09-14T06:00:03.122 INFO:teuthology.orchestra.run.smithi006.stdout:3171 read 0x34d1842 thru 0x34db7e6 (0x9fa5 bytes) 2024-09-14T06:00:03.129 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:03.125+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:03.135 INFO:teuthology.orchestra.run.smithi006.stdout:3172 trunc from 0xe11294c to 0x4bb7c5a 2024-09-14T06:00:03.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:00:03.170 INFO:teuthology.orchestra.run.smithi006.stdout:3174 trunc from 0x4bb7c5a to 0x239ed26 2024-09-14T06:00:03.190 INFO:teuthology.orchestra.run.smithi006.stdout:3175 read 0x4d840a thru 0x4d9823 (0x141a bytes) 2024-09-14T06:00:03.190 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:03.190 INFO:teuthology.orchestra.run.smithi006.stdout:3178 punch from 0x98afc6 to 0x98db00, (0x2b3a bytes) 2024-09-14T06:00:03.205 INFO:teuthology.orchestra.run.smithi006.stdout:3179 write 0x76e86a7 thru 0x76ee596 (0x5ef0 bytes) 2024-09-14T06:00:03.217 INFO:teuthology.orchestra.run.smithi006.stdout:3180 read 0x2406b7c thru 0x2411f8b (0xb410 bytes) 2024-09-14T06:00:03.217 INFO:teuthology.orchestra.run.smithi006.stdout:3181 writesame 0x221a33 thru 0x22c36b data_size 0x1(0xa939 bytes) 2024-09-14T06:00:03.229 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:03.225+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:03.236 INFO:teuthology.orchestra.run.smithi006.stdout:3182 write 0x8f51dc3 thru 0x8f5f6f0 (0xd92e bytes) 2024-09-14T06:00:03.256 INFO:teuthology.orchestra.run.smithi006.stdout:3183 read 0x3cbf042 thru 0x3cc44a0 (0x545f bytes) 2024-09-14T06:00:03.256 INFO:teuthology.orchestra.run.smithi006.stdout:3184 write 0x5f83238 thru 0x5f84927 (0x16f0 bytes) 2024-09-14T06:00:03.261 INFO:teuthology.orchestra.run.smithi006.stdout:3186 punch from 0x3daad51 to 0x3daea17, (0x3cc6 bytes) 2024-09-14T06:00:03.261 INFO:teuthology.orchestra.run.smithi006.stdout:3188 punch from 0x7f14f4f to 0x7f22fac, (0xe05d bytes) 2024-09-14T06:00:03.261 INFO:teuthology.orchestra.run.smithi006.stdout:3189 read 0x8f271c9 thru 0x8f3569c (0xe4d4 bytes) 2024-09-14T06:00:03.273 INFO:teuthology.orchestra.run.smithi006.stdout:3191 trunc from 0x8f5f6f1 to 0x12dbdca 2024-09-14T06:00:03.293 INFO:teuthology.orchestra.run.smithi006.stdout:3193 read 0x2da77e thru 0x2dab55 (0x3d8 bytes) 2024-09-14T06:00:03.311 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:03.311 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:00:03.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:00:03.311 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:03.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.311 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3629 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'31, mlcod=31'25)", 2024-09-14T06:00:03.311 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:00:03.311 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 45.980087834999999, 2024-09-14T06:00:03.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048071900000000002, 2024-09-14T06:00:03.311 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.311 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329483+0000", 2024-09-14T06:00:03.312 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-07 2024-09-14T06:00:03.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.313 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.313 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329488+0000", 2024-09-14T06:00:03.313 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000004e-06 2024-09-14T06:00:03.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.313 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.313 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329496+0000", 2024-09-14T06:00:03.313 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2209999999999997e-06 2024-09-14T06:00:03.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329501+0000", 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8729999999999998e-06 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329545+0000", 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4382999999999998e-05 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329564+0000", 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8947999999999999e-05 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334225+0000", 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004660923 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334289+0000", 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4041999999999994e-05 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3630 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'32, mlcod=31'25)", 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.330230+0000", 2024-09-14T06:00:03.315 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 45.979339830000001, 2024-09-14T06:00:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0040991680000000003, 2024-09-14T06:00:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T06:00:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T06:00:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330231+0000", 2024-09-14T06:00:03.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4099999999999998e-07 2024-09-14T06:00:03.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330235+0000", 2024-09-14T06:00:03.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.391e-06 2024-09-14T06:00:03.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330245+0000", 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6169999999999996e-06 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330249+0000", 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330301+0000", 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1515999999999999e-05 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330312+0000", 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1603000000000001e-05 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334293+0000", 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039809449999999996 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334329+0000", 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5763000000000003e-05 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3632 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'34, mlcod=31'27)", 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 45.976965647, 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047983469999999997, 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332605+0000", 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5099999999999999e-07 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332611+0000", 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6999999999999996e-06 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.321 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332623+0000", 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2401e-05 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332629+0000", 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3720000000000001e-06 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332691+0000", 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1451000000000005e-05 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332711+0000", 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0285e-05 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337341+0000", 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046295900000000003 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337402+0000", 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1797000000000005e-05 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3633 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'35, mlcod=31'27)", 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.333466+0000", 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 45.976104202000002, 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039783919999999999, 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1500000000000004e-07 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333479+0000", 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2918999999999999e-05 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.325 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333489+0000", 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0068000000000001e-05 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333494+0000", 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9309999999999999e-06 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333543+0000", 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9293999999999999e-05 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333555+0000", 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1467e-05 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337408+0000", 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038532549999999999 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337444+0000", 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5843000000000002e-05 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.327 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3638 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'40, mlcod=31'32)", 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 45.970823731999999, 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004283345, 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338747+0000", 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338756+0000", 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5909999999999996e-06 2024-09-14T06:00:03.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338774+0000", 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8073000000000001e-05 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338785+0000", 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1017e-05 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338844+0000", 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9292000000000001e-05 2024-09-14T06:00:03.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338864+0000", 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9528999999999999e-05 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.342984+0000", 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041207809999999996 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.343029+0000", 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5034000000000003e-05 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.331 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:11218 3.9 e38/24 3:967d83c0:::rbd_data.1127ff8b71e0.0000000000000064:head v 38'37, mlcod=38'35)", 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.244852+0000", 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 37.064717619, 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004035416, 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244854+0000", 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2350000000000002e-06 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246114+0000", 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012600980000000001 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246158+0000", 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3473000000000002e-05 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246179+0000", 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0738999999999999e-05 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246306+0000", 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000127238 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246349+0000", 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3211999999999999e-05 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248780+0000", 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0024304970000000002 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248888+0000", 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010792400000000001 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.335 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:17596 3.4 e41/24 3:27f62511:::rbd_data.1127d65075f9.00000000000000ca:head v 41'97, mlcod=41'95)", 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 33.339071167999997, 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049456559999999997, 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:00:03.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970500+0000", 2024-09-14T06:00:03.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9600000000000008e-07 2024-09-14T06:00:03.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970614+0000", 2024-09-14T06:00:03.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000113956 2024-09-14T06:00:03.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970631+0000", 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7150999999999999e-05 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970643+0000", 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1868999999999999e-05 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970711+0000", 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8952e-05 2024-09-14T06:00:03.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970738+0000", 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6055999999999999e-05 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975388+0000", 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046502499999999999 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975444+0000", 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6425999999999998e-05 2024-09-14T06:00:03.339 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24289 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'57, mlcod=41'54)", 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 31.153778988999999, 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.060867738999999997, 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.340 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:00:03.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:00:03.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155793+0000", 2024-09-14T06:00:03.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9470000000000002e-06 2024-09-14T06:00:03.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181776+0000", 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.02598313 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181817+0000", 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1440000000000003e-05 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181834+0000", 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6979000000000001e-05 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181931+0000", 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7219999999999994e-05 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181964+0000", 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2094999999999997e-05 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216586+0000", 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034622503999999998 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216658+0000", 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2423999999999996e-05 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24309 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'58, mlcod=41'56)", 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 31.054543884000001, 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044435519999999999, 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:00:03.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:00:03.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255027+0000", 2024-09-14T06:00:03.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T06:00:03.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255040+0000", 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2773e-05 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255066+0000", 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5459000000000001e-05 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255076+0000", 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0372e-05 2024-09-14T06:00:03.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255151+0000", 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5444999999999993e-05 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255176+0000", 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5089e-05 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259379+0000", 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042025439999999999 2024-09-14T06:00:03.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259469+0000", 2024-09-14T06:00:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0407000000000004e-05 2024-09-14T06:00:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37361 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'280, mlcod=50'278)", 2024-09-14T06:00:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:00:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.268383625999999, 2024-09-14T06:00:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075534590000000002, 2024-09-14T06:00:03.348 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.349 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.349 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.349 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.349 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:00:03.349 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.349 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.349 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:00:03.349 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041187+0000", 2024-09-14T06:00:03.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2160000000000001e-06 2024-09-14T06:00:03.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041208+0000", 2024-09-14T06:00:03.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0528999999999999e-05 2024-09-14T06:00:03.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041225+0000", 2024-09-14T06:00:03.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7255e-05 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041235+0000", 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4190000000000008e-06 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041302+0000", 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7774000000000005e-05 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041330+0000", 2024-09-14T06:00:03.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7382999999999999e-05 2024-09-14T06:00:03.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048686+0000", 2024-09-14T06:00:03.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073564570000000003 2024-09-14T06:00:03.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048740+0000", 2024-09-14T06:00:03.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3426e-05 2024-09-14T06:00:03.352 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.352 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.352 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.353 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37362 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'281, mlcod=50'278)", 2024-09-14T06:00:03.353 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:00:03.353 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.263483226999998, 2024-09-14T06:00:03.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047169380000000004, 2024-09-14T06:00:03.353 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.353 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.353 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.353 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.353 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:00:03.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:00:03.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046087+0000", 2024-09-14T06:00:03.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3600000000000003e-07 2024-09-14T06:00:03.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046093+0000", 2024-09-14T06:00:03.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7869999999999998e-06 2024-09-14T06:00:03.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046106+0000", 2024-09-14T06:00:03.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2636999999999999e-05 2024-09-14T06:00:03.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046113+0000", 2024-09-14T06:00:03.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0129999999999996e-06 2024-09-14T06:00:03.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046170+0000", 2024-09-14T06:00:03.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7819000000000003e-05 2024-09-14T06:00:03.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046194+0000", 2024-09-14T06:00:03.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3167999999999999e-05 2024-09-14T06:00:03.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050760+0000", 2024-09-14T06:00:03.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045665999999999997 2024-09-14T06:00:03.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050803+0000", 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3177999999999999e-05 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39545 3.0 e50/24 3:06bdaf45:::rbd_data.112781171282.0000000000000002:head v 50'347, mlcod=50'345)", 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.731102945, 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047008700000000002, 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.357 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:00:03.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:00:03.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578468+0000", 2024-09-14T06:00:03.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1599999999999999e-06 2024-09-14T06:00:03.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579733+0000", 2024-09-14T06:00:03.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012647120000000001 2024-09-14T06:00:03.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579755+0000", 2024-09-14T06:00:03.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2637999999999999e-05 2024-09-14T06:00:03.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579766+0000", 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0264e-05 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579832+0000", 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6531000000000004e-05 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579859+0000", 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6855999999999998e-05 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583098+0000", 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003238632 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583168+0000", 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0077e-05 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39602 3.9 e50/24 3:909cb01b:::rbd_data.112781171282.000000000000006f:head v 50'86, mlcod=50'84)", 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.746165+0000", 2024-09-14T06:00:03.361 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.563404975000001, 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041492480000000003, 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746165+0000", 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746165+0000", 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746166+0000", 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3600000000000002e-07 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746287+0000", 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000120927 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746297+0000", 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0395e-05 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746302+0000", 2024-09-14T06:00:03.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2379999999999997e-06 2024-09-14T06:00:03.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746362+0000", 2024-09-14T06:00:03.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9765999999999997e-05 2024-09-14T06:00:03.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746385+0000", 2024-09-14T06:00:03.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3357999999999999e-05 2024-09-14T06:00:03.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.750213+0000", 2024-09-14T06:00:03.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038276019999999998 2024-09-14T06:00:03.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.750314+0000", 2024-09-14T06:00:03.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010112599999999999 2024-09-14T06:00:03.365 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.365 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.365 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.365 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39765 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'410, mlcod=51'406)", 2024-09-14T06:00:03.366 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:00:03.366 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.305148144, 2024-09-14T06:00:03.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044953839999999998, 2024-09-14T06:00:03.366 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.366 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.366 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:00:03.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004423+0000", 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1909999999999999e-06 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004432+0000", 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2180000000000005e-06 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004453+0000", 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1182000000000001e-05 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004464+0000", 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1198e-05 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004520+0000", 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5835999999999999e-05 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004547+0000", 2024-09-14T06:00:03.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6454000000000001e-05 2024-09-14T06:00:03.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008866+0000", 2024-09-14T06:00:03.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043194679999999999 2024-09-14T06:00:03.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008917+0000", 2024-09-14T06:00:03.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0837000000000001e-05 2024-09-14T06:00:03.369 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.370 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.370 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.370 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39847 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'431, mlcod=51'426)", 2024-09-14T06:00:03.370 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:00:03.370 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.191864795000001, 2024-09-14T06:00:03.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046358010000000002, 2024-09-14T06:00:03.370 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.370 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.370 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.370 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117706+0000", 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4899999999999995e-07 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117711+0000", 2024-09-14T06:00:03.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6890000000000001e-06 2024-09-14T06:00:03.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117724+0000", 2024-09-14T06:00:03.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3054000000000001e-05 2024-09-14T06:00:03.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117736+0000", 2024-09-14T06:00:03.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1654999999999999e-05 2024-09-14T06:00:03.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117788+0000", 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2197000000000002e-05 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117811+0000", 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2472000000000001e-05 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122292+0000", 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004481596 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122341+0000", 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8489000000000003e-05 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39865 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'438, mlcod=51'434)", 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.164530497000001, 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004519426, 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.374 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145040+0000", 2024-09-14T06:00:03.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7899999999999998e-07 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145044+0000", 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3789999999999999e-06 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145053+0000", 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2650000000000002e-06 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145058+0000", 2024-09-14T06:00:03.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8169999999999998e-06 2024-09-14T06:00:03.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145105+0000", 2024-09-14T06:00:03.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7176999999999999e-05 2024-09-14T06:00:03.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145119+0000", 2024-09-14T06:00:03.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3179e-05 2024-09-14T06:00:03.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149512+0000", 2024-09-14T06:00:03.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043934389999999999 2024-09-14T06:00:03.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149559+0000", 2024-09-14T06:00:03.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6591000000000002e-05 2024-09-14T06:00:03.378 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.378 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.378 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.378 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39866 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'439, mlcod=51'434)", 2024-09-14T06:00:03.378 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145610+0000", 2024-09-14T06:00:03.379 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.163959557999998, 2024-09-14T06:00:03.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039787060000000003, 2024-09-14T06:00:03.379 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.379 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.379 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.379 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145610+0000", 2024-09-14T06:00:03.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145610+0000", 2024-09-14T06:00:03.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145611+0000", 2024-09-14T06:00:03.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7599999999999997e-07 2024-09-14T06:00:03.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145615+0000", 2024-09-14T06:00:03.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1309999999999999e-06 2024-09-14T06:00:03.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145624+0000", 2024-09-14T06:00:03.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8480000000000007e-06 2024-09-14T06:00:03.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145629+0000", 2024-09-14T06:00:03.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7840000000000003e-06 2024-09-14T06:00:03.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145679+0000", 2024-09-14T06:00:03.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0206e-05 2024-09-14T06:00:03.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145699+0000", 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0015999999999999e-05 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149561+0000", 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038619969999999998 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149589+0000", 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8147999999999999e-05 2024-09-14T06:00:03.382 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40245 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'513, mlcod=52'509)", 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.385978469000001, 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053460410000000002, 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923592+0000", 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6599999999999996e-07 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923598+0000", 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.083e-06 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923609+0000", 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1137e-05 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923617+0000", 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.401e-06 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924037+0000", 2024-09-14T06:00:03.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042046 2024-09-14T06:00:03.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924082+0000", 2024-09-14T06:00:03.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4617000000000003e-05 2024-09-14T06:00:03.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928882+0000", 2024-09-14T06:00:03.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048000889999999996 2024-09-14T06:00:03.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928937+0000", 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5587999999999997e-05 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40246 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'514, mlcod=52'509)", 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.384943954000001, 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043609649999999996, 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2099999999999996e-07 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924631+0000", 2024-09-14T06:00:03.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8450000000000002e-06 2024-09-14T06:00:03.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924641+0000", 2024-09-14T06:00:03.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0057e-05 2024-09-14T06:00:03.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924649+0000", 2024-09-14T06:00:03.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5669999999999997e-06 2024-09-14T06:00:03.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925127+0000", 2024-09-14T06:00:03.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00047783800000000001 2024-09-14T06:00:03.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925171+0000", 2024-09-14T06:00:03.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4017000000000002e-05 2024-09-14T06:00:03.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928942+0000", 2024-09-14T06:00:03.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037716809999999998 2024-09-14T06:00:03.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928987+0000", 2024-09-14T06:00:03.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4338999999999997e-05 2024-09-14T06:00:03.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.391 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.391 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:46646 3.0 e56/24 3:01acbe3d:::rbd_data.1127f2f8ff9b.0000000000000015:head v 56'541, mlcod=55'538)", 2024-09-14T06:00:03.391 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:00:03.391 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 12.848157684, 2024-09-14T06:00:03.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064775850000000001, 2024-09-14T06:00:03.392 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.392 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:03.392 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:00:03.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:00:03.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461415+0000", 2024-09-14T06:00:03.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.666e-06 2024-09-14T06:00:03.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463456+0000", 2024-09-14T06:00:03.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00204177 2024-09-14T06:00:03.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463488+0000", 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1503e-05 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463508+0000", 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9788000000000001e-05 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463697+0000", 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018873499999999999 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463741+0000", 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4333999999999999e-05 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467845+0000", 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041041430000000002 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467890+0000", 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4645999999999999e-05 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.395 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.396 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:03.396 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-14T06:00:03.396 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T06:00:03.396 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-14T06:00:03.396 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-14T06:00:03.398 INFO:teuthology.orchestra.run.smithi006.stdout:3195 writesame 0xa2f9a59 thru 0xa303ee5 data_size 0x19(0xa48d bytes) 2024-09-14T06:00:03.398 INFO:teuthology.orchestra.run.smithi006.stdout:3196 read 0x8748108 thru 0x874abf8 (0x2af1 bytes) 2024-09-14T06:00:03.398 INFO:teuthology.orchestra.run.smithi006.stdout:3198 read 0x84a0d96 thru 0x84a1bd3 (0xe3e bytes) 2024-09-14T06:00:03.398 INFO:teuthology.orchestra.run.smithi006.stdout:3199 read 0x6b6307a thru 0x6b6a18f (0x7116 bytes) 2024-09-14T06:00:03.398 INFO:teuthology.orchestra.run.smithi006.stdout:3200 write 0x770e8fe thru 0x771216d (0x3870 bytes) 2024-09-14T06:00:03.399 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:00:03.399 INFO:teuthology.orchestra.run.smithi006.stdout:3202 read 0x5622552 thru 0x562ae19 (0x88c8 bytes) 2024-09-14T06:00:03.400 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:03.400 INFO:teuthology.orchestra.run.smithi006.stdout:3204 punch from 0x54549c7 to 0x545d991, (0x8fca bytes) 2024-09-14T06:00:03.400 INFO:teuthology.orchestra.run.smithi006.stdout:3205 writesame 0x61f0367 thru 0x61fa8c7 data_size 0x1(0xa561 bytes) 2024-09-14T06:00:03.400 INFO:teuthology.orchestra.run.smithi006.stdout:3210 writesame 0x5dc70b4 thru 0x5dcd2eb data_size 0x1c(0x6238 bytes) 2024-09-14T06:00:03.400 INFO:teuthology.orchestra.run.smithi006.stdout:3211 writesame 0x5ca9c74 thru 0x5cb03b9 data_size 0x1(0x6746 bytes) 2024-09-14T06:00:03.400 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:03.393+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:03.402 INFO:teuthology.orchestra.run.smithi006.stdout:3212 read 0x63ee1dd thru 0x63f080f (0x2633 bytes) 2024-09-14T06:00:03.403 INFO:teuthology.orchestra.run.smithi006.stdout:3213 read 0x5583f44 thru 0x5586640 (0x26fd bytes) 2024-09-14T06:00:03.404 INFO:teuthology.orchestra.run.smithi006.stdout:3215 writesame 0x7715ad1 thru 0x7721f41 data_size 0x1(0xc471 bytes) 2024-09-14T06:00:03.437 INFO:teuthology.orchestra.run.smithi006.stdout:3217 trunc from 0xa303ee6 to 0xdc1aec 2024-09-14T06:00:03.498 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:03.493+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:03.514 INFO:teuthology.orchestra.run.smithi006.stdout:3218 writesame 0xb8325ec thru 0xb842449 data_size 0x3(0xfe5e bytes) 2024-09-14T06:00:03.514 INFO:teuthology.orchestra.run.smithi006.stdout:3219 write 0x596e0be thru 0x5977ef8 (0x9e3b bytes) 2024-09-14T06:00:03.537 INFO:teuthology.orchestra.run.smithi006.stdout:3220 read 0x2c1d5e5 thru 0x2c23dde (0x67fa bytes) 2024-09-14T06:00:03.537 INFO:teuthology.orchestra.run.smithi006.stdout:3221 punch from 0xa0ae575 to 0xa0b96ea, (0xb175 bytes) 2024-09-14T06:00:03.546 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:03.547 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:03.547 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:00:03.547 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:03.549 INFO:teuthology.orchestra.run.smithi006.stdout:3222 write 0xe4e5052 thru 0xe4ea2a7 (0x5256 bytes) 2024-09-14T06:00:03.562 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:03.562 INFO:teuthology.orchestra.run.smithi006.stdout:3224 read 0xbcd65f4 thru 0xbce4552 (0xdf5f bytes) 2024-09-14T06:00:03.562 INFO:teuthology.orchestra.run.smithi006.stdout:3226 read 0x888fdf thru 0x889d39 (0xd5b bytes) 2024-09-14T06:00:03.563 INFO:teuthology.orchestra.run.smithi006.stdout:3227 read 0xdddc1f9 thru 0xdde716d (0xaf75 bytes) 2024-09-14T06:00:03.563 INFO:teuthology.orchestra.run.smithi006.stdout:3228 punch from 0xa5dcb45 to 0xa5eac1a, (0xe0d5 bytes) 2024-09-14T06:00:03.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:00:03.584 INFO:teuthology.orchestra.run.smithi006.stdout:3229 trunc from 0xe4ea2a8 to 0x1ea5381 2024-09-14T06:00:03.594 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T06:00:03.594 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T06:00:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T06:00:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T06:00:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T06:00:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T06:00:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T06:00:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T06:00:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T06:00:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T06:00:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T06:00:03.595 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T06:00:03.597 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T06:00:03.598 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T06:00:03.598 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-14T06:00:03.605 INFO:teuthology.orchestra.run.smithi006.stdout:3232 read 0x128cbe0 thru 0x128cd48 (0x169 bytes) 2024-09-14T06:00:03.605 INFO:teuthology.orchestra.run.smithi006.stdout:3233 writesame 0xc6a973 thru 0xc74a82 data_size 0x18(0xa110 bytes) 2024-09-14T06:00:03.605 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:03.601+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:03.628 INFO:teuthology.orchestra.run.smithi006.stdout:3235 read 0x1affc2e thru 0x1b0a25c (0xa62f bytes) 2024-09-14T06:00:03.628 INFO:teuthology.orchestra.run.smithi006.stdout:3236 read 0x8bc861 thru 0x8cb453 (0xebf3 bytes) 2024-09-14T06:00:03.642 INFO:teuthology.orchestra.run.smithi006.stdout:3237 writesame 0x649d489 thru 0x64a6747 data_size 0x1(0x92bf bytes) 2024-09-14T06:00:03.642 INFO:teuthology.orchestra.run.smithi006.stdout:3239 writesame 0x531cf5d thru 0x5328166 data_size 0xd(0xb20a bytes) 2024-09-14T06:00:03.665 INFO:teuthology.orchestra.run.smithi006.stdout:3243 writesame 0x16a8ad1 thru 0x16b3b71 data_size 0x1(0xb0a1 bytes) 2024-09-14T06:00:03.690 INFO:teuthology.orchestra.run.smithi006.stdout:3244 read 0x2b826ee thru 0x2b900e6 (0xd9f9 bytes) 2024-09-14T06:00:03.690 INFO:teuthology.orchestra.run.smithi006.stdout:3245 read 0x604d93f thru 0x604dd41 (0x403 bytes) 2024-09-14T06:00:03.698 INFO:teuthology.orchestra.run.smithi006.stdout:3246 trunc from 0x64a6748 to 0xac0f468 2024-09-14T06:00:03.700 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:03.697+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:03.706 INFO:teuthology.orchestra.run.smithi006.stdout:3247 punch from 0x4e78cf2 to 0x4e885c0, (0xf8ce bytes) 2024-09-14T06:00:03.706 INFO:teuthology.orchestra.run.smithi006.stdout:3248 write 0x860af9d thru 0x8610f42 (0x5fa6 bytes) 2024-09-14T06:00:03.717 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:03.717 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:03.717 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:03.717 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:03.717 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:03.721 INFO:teuthology.orchestra.run.smithi006.stdout:3249 write 0x6203316 thru 0x620e42b (0xb116 bytes) 2024-09-14T06:00:03.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:00:03.753 INFO:teuthology.orchestra.run.smithi006.stdout:3250 writesame 0xdb26390 thru 0xdb3135f data_size 0x74(0xafd0 bytes) 2024-09-14T06:00:03.753 INFO:teuthology.orchestra.run.smithi006.stdout:3251 write 0x9d65d57 thru 0x9d6cdf5 (0x709f bytes) 2024-09-14T06:00:03.768 INFO:teuthology.orchestra.run.smithi006.stdout:3252 punch from 0x5dc5f22 to 0x5dcb83d, (0x591b bytes) 2024-09-14T06:00:03.771 INFO:teuthology.orchestra.run.smithi006.stdout:3253 trunc from 0xdb31360 to 0xbaac7b4 2024-09-14T06:00:03.778 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T06:00:03.778 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T06:00:03.778 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T06:00:03.778 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T06:00:03.778 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T06:00:03.778 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T06:00:03.778 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T06:00:03.778 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T06:00:03.778 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T06:00:03.779 INFO:teuthology.orchestra.run.smithi006.stdout:3254 read 0x8929660 thru 0x893856d (0xef0e bytes) 2024-09-14T06:00:03.779 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T06:00:03.779 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T06:00:03.779 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T06:00:03.779 INFO:teuthology.orchestra.run.smithi006.stdout:3255 write 0x8098033 thru 0x8098ed3 (0xea1 bytes) 2024-09-14T06:00:03.781 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T06:00:03.781 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T06:00:03.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-14T06:00:03.783 INFO:teuthology.orchestra.run.smithi006.stdout:3256 read 0x919cba5 thru 0x91a184d (0x4ca9 bytes) 2024-09-14T06:00:03.783 INFO:teuthology.orchestra.run.smithi006.stdout:3259 punch from 0x724fb59 to 0x7254cdc, (0x5183 bytes) 2024-09-14T06:00:03.784 INFO:teuthology.orchestra.run.smithi006.stdout:3260 read 0x30d5618 thru 0x30da609 (0x4ff2 bytes) 2024-09-14T06:00:03.784 INFO:teuthology.orchestra.run.smithi006.stdout:3261 write 0xed2a45 thru 0xeddbbe (0xb17a bytes) 2024-09-14T06:00:03.801 INFO:teuthology.orchestra.run.smithi006.stdout:3262 writesame 0x280ee06 thru 0x281daab data_size 0x17(0xeca6 bytes) 2024-09-14T06:00:03.802 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:03.797+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:03.819 INFO:teuthology.orchestra.run.smithi006.stdout:3264 punch from 0x180c524 to 0x180e387, (0x1e63 bytes) 2024-09-14T06:00:03.825 INFO:teuthology.orchestra.run.smithi006.stdout:3266 trunc from 0xbaac7b4 to 0x76a84f0 2024-09-14T06:00:03.842 INFO:teuthology.orchestra.run.smithi006.stdout:3267 read 0x61673b7 thru 0x616a801 (0x344b bytes) 2024-09-14T06:00:03.858 INFO:teuthology.orchestra.run.smithi006.stdout:3268 write 0xd892293 thru 0xd8a19fa (0xf768 bytes) 2024-09-14T06:00:03.876 INFO:teuthology.orchestra.run.smithi006.stdout:3269 read 0x1af47a6 thru 0x1afed6c (0xa5c7 bytes) 2024-09-14T06:00:03.876 INFO:teuthology.orchestra.run.smithi006.stdout:3270 write 0x72c820d thru 0x72c9a34 (0x1828 bytes) 2024-09-14T06:00:03.881 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:03.887 INFO:teuthology.orchestra.run.smithi006.stdout:3272 trunc from 0xd8a19fb to 0x9a74a72 2024-09-14T06:00:03.888 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:03.888 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:00:03.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:00:03.888 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:03.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.888 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54658 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 610304~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.888 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:03.889 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.747761144, 2024-09-14T06:00:03.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091840061000000001, 2024-09-14T06:00:03.889 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.889 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.889 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.889 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.889 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.889 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.889 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54658 2024-09-14T06:00:03.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.889 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.889 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.889 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:03.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:03.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:03.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4700000000000002e-07 2024-09-14T06:00:03.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139687+0000", 2024-09-14T06:00:03.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7170000000000008e-06 2024-09-14T06:00:03.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139694+0000", 2024-09-14T06:00:03.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.063e-06 2024-09-14T06:00:03.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139709+0000", 2024-09-14T06:00:03.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4324999999999999e-05 2024-09-14T06:00:03.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231262+0000", 2024-09-14T06:00:03.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091553866999999997 2024-09-14T06:00:03.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231375+0000", 2024-09-14T06:00:03.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000112927 2024-09-14T06:00:03.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.893 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.893 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231519+0000", 2024-09-14T06:00:03.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014371499999999999 2024-09-14T06:00:03.893 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.893 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.893 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.894 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54659 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 616448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.894 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:03.894 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7477227969999998, 2024-09-14T06:00:03.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092177035000000004, 2024-09-14T06:00:03.894 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.894 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.894 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.894 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.894 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.894 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.894 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54659 2024-09-14T06:00:03.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.894 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:03.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:03.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139718+0000", 2024-09-14T06:00:03.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9699999999999996e-07 2024-09-14T06:00:03.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139731+0000", 2024-09-14T06:00:03.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2993000000000001e-05 2024-09-14T06:00:03.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139738+0000", 2024-09-14T06:00:03.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4610000000000002e-06 2024-09-14T06:00:03.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139744+0000", 2024-09-14T06:00:03.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6389999999999997e-06 2024-09-14T06:00:03.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231570+0000", 2024-09-14T06:00:03.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091826216000000002 2024-09-14T06:00:03.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231662+0000", 2024-09-14T06:00:03.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2101000000000005e-05 2024-09-14T06:00:03.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.898 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.898 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231894+0000", 2024-09-14T06:00:03.898 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023212800000000001 2024-09-14T06:00:03.898 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.898 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.898 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.898 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54660 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 622592~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.898 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:03.898 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7476874630000001, 2024-09-14T06:00:03.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092366887999999994, 2024-09-14T06:00:03.899 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.899 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.899 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.899 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.899 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.899 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.899 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54660 2024-09-14T06:00:03.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.899 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:03.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139755+0000", 2024-09-14T06:00:03.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T06:00:03.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139762+0000", 2024-09-14T06:00:03.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6719999999999998e-06 2024-09-14T06:00:03.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139767+0000", 2024-09-14T06:00:03.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9819999999999999e-06 2024-09-14T06:00:03.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231917+0000", 2024-09-14T06:00:03.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092149872999999993 2024-09-14T06:00:03.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.902 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.902 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231969+0000", 2024-09-14T06:00:03.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2642000000000002e-05 2024-09-14T06:00:03.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.902 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.902 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232120+0000", 2024-09-14T06:00:03.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015011899999999999 2024-09-14T06:00:03.902 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.902 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.902 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.903 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54844 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 0~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.903 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:03.903 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7476659720000001, 2024-09-14T06:00:03.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092708507999999995, 2024-09-14T06:00:03.903 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.903 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.903 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.903 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.903 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.903 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.903 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54844 2024-09-14T06:00:03.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.904 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:03.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:03.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139775+0000", 2024-09-14T06:00:03.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3500000000000002e-07 2024-09-14T06:00:03.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139777+0000", 2024-09-14T06:00:03.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.979e-06 2024-09-14T06:00:03.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139787+0000", 2024-09-14T06:00:03.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0779e-05 2024-09-14T06:00:03.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.906 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.906 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139799+0000", 2024-09-14T06:00:03.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1719000000000001e-05 2024-09-14T06:00:03.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.906 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.906 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232151+0000", 2024-09-14T06:00:03.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092351767000000001 2024-09-14T06:00:03.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.906 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.906 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232217+0000", 2024-09-14T06:00:03.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6655000000000005e-05 2024-09-14T06:00:03.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232483+0000", 2024-09-14T06:00:03.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026517400000000002 2024-09-14T06:00:03.907 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.907 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.907 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.907 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54845 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 55296~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.907 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:03.907 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7476323009999994, 2024-09-14T06:00:03.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093127583999999999, 2024-09-14T06:00:03.908 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.908 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.908 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.908 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.908 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.908 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.908 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54845 2024-09-14T06:00:03.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.908 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:03.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:03.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:03.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4899999999999995e-07 2024-09-14T06:00:03.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139811+0000", 2024-09-14T06:00:03.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000001e-06 2024-09-14T06:00:03.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139821+0000", 2024-09-14T06:00:03.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0168e-05 2024-09-14T06:00:03.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139826+0000", 2024-09-14T06:00:03.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2780000000000001e-06 2024-09-14T06:00:03.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232556+0000", 2024-09-14T06:00:03.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092729729999999996 2024-09-14T06:00:03.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232652+0000", 2024-09-14T06:00:03.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680999999999994e-05 2024-09-14T06:00:03.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232935+0000", 2024-09-14T06:00:03.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000283758 2024-09-14T06:00:03.912 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.912 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.912 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.912 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54846 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.912 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:03.912 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7476059940000006, 2024-09-14T06:00:03.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093492079000000006, 2024-09-14T06:00:03.912 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.912 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.912 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.912 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.913 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.913 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.913 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54846 2024-09-14T06:00:03.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.913 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:03.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:03.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139835+0000", 2024-09-14T06:00:03.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T06:00:03.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139837+0000", 2024-09-14T06:00:03.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1059999999999998e-06 2024-09-14T06:00:03.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139845+0000", 2024-09-14T06:00:03.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4300000000000006e-06 2024-09-14T06:00:03.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139851+0000", 2024-09-14T06:00:03.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T06:00:03.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232987+0000", 2024-09-14T06:00:03.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093136073999999999 2024-09-14T06:00:03.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233075+0000", 2024-09-14T06:00:03.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7318999999999995e-05 2024-09-14T06:00:03.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233326+0000", 2024-09-14T06:00:03.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025159 2024-09-14T06:00:03.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.916 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.916 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54847 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 67584~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7475802780000009, 2024-09-14T06:00:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093777452999999997, 2024-09-14T06:00:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54847 2024-09-14T06:00:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T06:00:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139862+0000", 2024-09-14T06:00:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0200000000000001e-06 2024-09-14T06:00:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139870+0000", 2024-09-14T06:00:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0520000000000002e-06 2024-09-14T06:00:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139875+0000", 2024-09-14T06:00:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:00:03.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233389+0000", 2024-09-14T06:00:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093514054999999999 2024-09-14T06:00:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233443+0000", 2024-09-14T06:00:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3913999999999999e-05 2024-09-14T06:00:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233637+0000", 2024-09-14T06:00:03.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019392899999999999 2024-09-14T06:00:03.921 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.921 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.921 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.921 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54848 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 73728~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.921 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:03.921 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7475571819999995, 2024-09-14T06:00:03.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094064464, 2024-09-14T06:00:03.921 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.921 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.921 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54848 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:03.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T06:00:03.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139885+0000", 2024-09-14T06:00:03.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9929999999999998e-06 2024-09-14T06:00:03.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139893+0000", 2024-09-14T06:00:03.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9759999999999995e-06 2024-09-14T06:00:03.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139898+0000", 2024-09-14T06:00:03.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6059999999999996e-06 2024-09-14T06:00:03.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233681+0000", 2024-09-14T06:00:03.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093782921000000005 2024-09-14T06:00:03.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233730+0000", 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9410999999999998e-05 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233947+0000", 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021710300000000001 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54849 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.925 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:03.926 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7475337260000003, 2024-09-14T06:00:03.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094499257000000003, 2024-09-14T06:00:03.926 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.926 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.926 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.926 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.926 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.926 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.926 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54849 2024-09-14T06:00:03.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.926 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:03.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:03.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139907+0000", 2024-09-14T06:00:03.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T06:00:03.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139909+0000", 2024-09-14T06:00:03.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T06:00:03.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139916+0000", 2024-09-14T06:00:03.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T06:00:03.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139921+0000", 2024-09-14T06:00:03.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:00:03.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234032+0000", 2024-09-14T06:00:03.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094111037999999994 2024-09-14T06:00:03.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234150+0000", 2024-09-14T06:00:03.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118408 2024-09-14T06:00:03.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234406+0000", 2024-09-14T06:00:03.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025540600000000001 2024-09-14T06:00:03.929 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.930 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.930 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.930 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54850 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 135168~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.930 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:03.930 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7475120180000001, 2024-09-14T06:00:03.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094814605999999996, 2024-09-14T06:00:03.930 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.930 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.930 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.930 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.930 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.930 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54850 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139929+0000", 2024-09-14T06:00:03.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T06:00:03.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139931+0000", 2024-09-14T06:00:03.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.024e-06 2024-09-14T06:00:03.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139937+0000", 2024-09-14T06:00:03.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3770000000000001e-06 2024-09-14T06:00:03.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139942+0000", 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0289999999999996e-06 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234447+0000", 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094505426000000003 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234539+0000", 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1793999999999996e-05 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234743+0000", 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020354600000000001 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54851 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 141312~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7474903059999995, 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095179749999999994, 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.934 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54851 2024-09-14T06:00:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:03.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.936 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:03.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:00:03.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.936 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139952+0000", 2024-09-14T06:00:03.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0600000000000002e-06 2024-09-14T06:00:03.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139959+0000", 2024-09-14T06:00:03.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.584e-06 2024-09-14T06:00:03.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139964+0000", 2024-09-14T06:00:03.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8890000000000001e-06 2024-09-14T06:00:03.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234786+0000", 2024-09-14T06:00:03.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094822241000000002 2024-09-14T06:00:03.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234877+0000", 2024-09-14T06:00:03.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1158999999999999e-05 2024-09-14T06:00:03.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235130+0000", 2024-09-14T06:00:03.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025235999999999998 2024-09-14T06:00:03.938 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.938 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.938 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.938 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54852 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 147456~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.939 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:03.939 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7474691779999993, 2024-09-14T06:00:03.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095437742000000006, 2024-09-14T06:00:03.939 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.939 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.939 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.939 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.939 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.939 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.939 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54852 2024-09-14T06:00:03.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.939 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:03.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:03.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140125+0000", 2024-09-14T06:00:03.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154332 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140130+0000", 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.284e-06 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140140+0000", 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0789e-05 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140147+0000", 2024-09-14T06:00:03.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9879999999999998e-06 2024-09-14T06:00:03.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235174+0000", 2024-09-14T06:00:03.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095026749999999993 2024-09-14T06:00:03.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235230+0000", 2024-09-14T06:00:03.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6224000000000002e-05 2024-09-14T06:00:03.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235409+0000", 2024-09-14T06:00:03.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017837500000000001 2024-09-14T06:00:03.943 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.943 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.943 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.943 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54853 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 202752~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.943 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:03.943 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7472803559999992, 2024-09-14T06:00:03.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095632919999999996, 2024-09-14T06:00:03.944 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.944 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.944 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.944 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.944 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.944 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.944 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54853 2024-09-14T06:00:03.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.944 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:03.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147748+0000", 2024-09-14T06:00:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075884910000000002 2024-09-14T06:00:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147798+0000", 2024-09-14T06:00:03.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0152999999999999e-05 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147814+0000", 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5866e-05 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147831+0000", 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6991999999999999e-05 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235451+0000", 2024-09-14T06:00:03.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087620077000000005 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235539+0000", 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7800000000000006e-05 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235793+0000", 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025354099999999998 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.948 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54868 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 442368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.948 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:03.948 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7390900360000003, 2024-09-14T06:00:03.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091802783999999998, 2024-09-14T06:00:03.948 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.948 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.948 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.948 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.948 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.948 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.948 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54868 2024-09-14T06:00:03.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.948 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:03.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:03.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148351+0000", 2024-09-14T06:00:03.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6800000000000001e-07 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148353+0000", 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2299999999999998e-06 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148362+0000", 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9800000000000004e-06 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148367+0000", 2024-09-14T06:00:03.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.327e-06 2024-09-14T06:00:03.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.239863+0000", 2024-09-14T06:00:03.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091496018999999998 2024-09-14T06:00:03.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.239932+0000", 2024-09-14T06:00:03.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8838999999999996e-05 2024-09-14T06:00:03.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240153+0000", 2024-09-14T06:00:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00022092100000000001 2024-09-14T06:00:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54869 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 497664~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7390641379999998, 2024-09-14T06:00:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092147413999999997, 2024-09-14T06:00:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.952 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54869 2024-09-14T06:00:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:03.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148377+0000", 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1399999999999997e-07 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148379+0000", 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.429e-06 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148389+0000", 2024-09-14T06:00:03.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9029999999999999e-06 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148395+0000", 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5080000000000002e-06 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240191+0000", 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091796066999999995 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240284+0000", 2024-09-14T06:00:03.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2445e-05 2024-09-14T06:00:03.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240523+0000", 2024-09-14T06:00:03.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023954799999999999 2024-09-14T06:00:03.956 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.956 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.956 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.956 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54870 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 503808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.956 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:03.956 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7390348089999996, 2024-09-14T06:00:03.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092420756000000007, 2024-09-14T06:00:03.957 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.957 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.957 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.957 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.957 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.957 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.957 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54870 2024-09-14T06:00:03.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.957 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:03.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:03.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148406+0000", 2024-09-14T06:00:03.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T06:00:03.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148409+0000", 2024-09-14T06:00:03.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T06:00:03.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148418+0000", 2024-09-14T06:00:03.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7329999999999998e-06 2024-09-14T06:00:03.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148425+0000", 2024-09-14T06:00:03.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2079999999999997e-06 2024-09-14T06:00:03.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240591+0000", 2024-09-14T06:00:03.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092166441000000002 2024-09-14T06:00:03.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240648+0000", 2024-09-14T06:00:03.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6733e-05 2024-09-14T06:00:03.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240826+0000", 2024-09-14T06:00:03.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017834700000000001 2024-09-14T06:00:03.961 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.961 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.961 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.961 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54871 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 509952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.961 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:03.961 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7390048490000005, 2024-09-14T06:00:03.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092702341999999993, 2024-09-14T06:00:03.961 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.961 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.961 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.961 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.961 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.962 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.962 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54871 2024-09-14T06:00:03.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.962 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:03.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:03.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148436+0000", 2024-09-14T06:00:03.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5499999999999998e-07 2024-09-14T06:00:03.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148439+0000", 2024-09-14T06:00:03.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8090000000000001e-06 2024-09-14T06:00:03.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148449+0000", 2024-09-14T06:00:03.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0115000000000001e-05 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148466+0000", 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6761000000000001e-05 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240857+0000", 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092391089999999995 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240939+0000", 2024-09-14T06:00:03.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2387999999999998e-05 2024-09-14T06:00:03.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241138+0000", 2024-09-14T06:00:03.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000198624 2024-09-14T06:00:03.965 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.965 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.965 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.965 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54872 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 516096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.965 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:03.965 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7389636510000006, 2024-09-14T06:00:03.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093126020000000004, 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54872 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:03.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155484+0000", 2024-09-14T06:00:03.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070072429999999998 2024-09-14T06:00:03.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155490+0000", 2024-09-14T06:00:03.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6379999999999998e-06 2024-09-14T06:00:03.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155504+0000", 2024-09-14T06:00:03.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4065e-05 2024-09-14T06:00:03.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155513+0000", 2024-09-14T06:00:03.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6799999999999999e-06 2024-09-14T06:00:03.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241216+0000", 2024-09-14T06:00:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085702922000000001 2024-09-14T06:00:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241277+0000", 2024-09-14T06:00:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0980000000000002e-05 2024-09-14T06:00:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241602+0000", 2024-09-14T06:00:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032549199999999998 2024-09-14T06:00:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.970 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54888 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 114688~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.970 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:03.970 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7315191700000003, 2024-09-14T06:00:03.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091627085999999996, 2024-09-14T06:00:03.970 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.970 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.970 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.970 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.970 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.970 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.970 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54888 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:03.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8299999999999998e-07 2024-09-14T06:00:03.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155923+0000", 2024-09-14T06:00:03.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4720000000000001e-06 2024-09-14T06:00:03.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155926+0000", 2024-09-14T06:00:03.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.444e-06 2024-09-14T06:00:03.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155929+0000", 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247321+0000", 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091391587999999996 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247382+0000", 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1944000000000002e-05 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247548+0000", 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000165558 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54889 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 169984~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 9.7315065700000005, 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091908118999999996, 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:03.974 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:03.975 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:03.975 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:03.975 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:03.975 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54889 2024-09-14T06:00:03.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.975 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:03.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:03.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:03.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:03.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:03.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:03.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:03.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163444+0000", 2024-09-14T06:00:03.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00751033 2024-09-14T06:00:03.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:03.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163454+0000", 2024-09-14T06:00:03.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0579e-05 2024-09-14T06:00:03.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163468+0000", 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3794999999999999e-05 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163487+0000", 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8907999999999999e-05 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247591+0000", 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084103333000000002 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:03.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247651+0000", 2024-09-14T06:00:03.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0587000000000001e-05 2024-09-14T06:00:03.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:03.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:03.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:03.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247842+0000", 2024-09-14T06:00:03.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019058700000000001 2024-09-14T06:00:03.978 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.978 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.978 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.978 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:03.978 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:03.978 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:03.979 INFO:teuthology.orchestra.run.smithi006.stdout:3273 write 0x992fd6e thru 0x993e2bf (0xe552 bytes) 2024-09-14T06:00:03.980 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:00:03.981 INFO:teuthology.orchestra.run.smithi006.stdout:3274 read 0x18a4dd8 thru 0x18a614d (0x1376 bytes) 2024-09-14T06:00:03.981 INFO:teuthology.orchestra.run.smithi006.stdout:3275 trunc from 0x9a74a72 to 0x1eb6ec1 2024-09-14T06:00:03.981 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T06:00:03.981 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T06:00:03.981 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T06:00:03.981 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T06:00:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T06:00:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T06:00:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T06:00:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T06:00:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T06:00:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T06:00:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T06:00:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T06:00:03.982 INFO:teuthology.orchestra.run.smithi006.stdout:3276 read 0x936bfd thru 0x93f1f9 (0x85fd bytes) 2024-09-14T06:00:03.983 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T06:00:03.983 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T06:00:03.983 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-14T06:00:03.984 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:03.976+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:03.986 INFO:teuthology.orchestra.run.smithi006.stdout:3277 write 0xed6d3ae thru 0xed7a1e6 (0xce39 bytes) 2024-09-14T06:00:04.004 INFO:teuthology.orchestra.run.smithi006.stdout:3280 write 0x7f5789d thru 0x7f5ccb9 (0x541d bytes) 2024-09-14T06:00:04.015 INFO:teuthology.orchestra.run.smithi006.stdout:3281 write 0xb5c3b18 thru 0xb5d2f95 (0xf47e bytes) 2024-09-14T06:00:04.033 INFO:teuthology.orchestra.run.smithi006.stdout:3282 read 0x6ac8b28 thru 0x6ace38b (0x5864 bytes) 2024-09-14T06:00:04.033 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:04.033 INFO:teuthology.orchestra.run.smithi006.stdout:3286 writesame 0x4fe0a4f thru 0x4fe768d data_size 0x3(0x6c3f bytes) 2024-09-14T06:00:04.049 INFO:teuthology.orchestra.run.smithi006.stdout:3287 writesame 0xad0470 thru 0xad1edf data_size 0x30(0x1a70 bytes) 2024-09-14T06:00:04.050 INFO:teuthology.orchestra.run.smithi006.stdout:3288 read 0xc345e37 thru 0xc34b66f (0x5839 bytes) 2024-09-14T06:00:04.050 INFO:teuthology.orchestra.run.smithi006.stdout:3289 writesame 0x3363d12 thru 0x3366dd2 data_size 0x1(0x30c1 bytes) 2024-09-14T06:00:04.061 INFO:teuthology.orchestra.run.smithi006.stdout:3290 writesame 0x424061a thru 0x424d15f data_size 0x93(0xcb46 bytes) 2024-09-14T06:00:04.080 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:04.077+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:04.088 INFO:teuthology.orchestra.run.smithi006.stdout:3291 trunc from 0xed7a1e7 to 0x8d8fa54 2024-09-14T06:00:04.120 INFO:teuthology.orchestra.run.smithi006.stdout:3292 writesame 0xecf9909 thru 0xed06615 data_size 0x1(0xcd0d bytes) 2024-09-14T06:00:04.121 INFO:teuthology.orchestra.run.smithi006.stdout:3293 write 0x56a1e90 thru 0x56a5f9d (0x410e bytes) 2024-09-14T06:00:04.133 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:04.133 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:04.134 INFO:teuthology.orchestra.run.smithi006.stdout:3295 read 0xe3384fc thru 0xe34682f (0xe334 bytes) 2024-09-14T06:00:04.134 INFO:teuthology.orchestra.run.smithi006.stdout:3296 write 0xea89e7b thru 0xea8b811 (0x1997 bytes) 2024-09-14T06:00:04.142 INFO:teuthology.orchestra.run.smithi006.stdout:3298 read 0xabc4f16 thru 0xabd0799 (0xb884 bytes) 2024-09-14T06:00:04.142 INFO:teuthology.orchestra.run.smithi006.stdout:3299 writesame 0xb9ced1e thru 0xb9cf082 data_size 0x1(0x365 bytes) 2024-09-14T06:00:04.148 INFO:teuthology.orchestra.run.smithi006.stdout:3300 read 0xd18b7e9 thru 0xd199d75 (0xe58d bytes) 2024-09-14T06:00:04.148 INFO:teuthology.orchestra.run.smithi006.stdout:3301 punch from 0x1f713a8 to 0x1f7277c, (0x13d4 bytes) 2024-09-14T06:00:04.148 INFO:teuthology.orchestra.run.smithi006.stdout:3304 read 0x330cab4 thru 0x33159cd (0x8f1a bytes) 2024-09-14T06:00:04.149 INFO:teuthology.orchestra.run.smithi006.stdout:3305 read 0x45ba5d7 thru 0x45ca001 (0xfa2b bytes) 2024-09-14T06:00:04.149 INFO:teuthology.orchestra.run.smithi006.stdout:3306 punch from 0x6a746ad to 0x6a7bc61, (0x75b4 bytes) 2024-09-14T06:00:04.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:00:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T06:00:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T06:00:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T06:00:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T06:00:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T06:00:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T06:00:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T06:00:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T06:00:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T06:00:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T06:00:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T06:00:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T06:00:04.157 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T06:00:04.157 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T06:00:04.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 'trim stale osdmaps' 2024-09-14T06:00:04.167 INFO:teuthology.orchestra.run.smithi006.stdout:3307 trunc from 0xed06616 to 0x285cb73 2024-09-14T06:00:04.186 INFO:teuthology.orchestra.run.smithi006.stdout:3308 read 0xad4079 thru 0xae1337 (0xd2bf bytes) 2024-09-14T06:00:04.196 INFO:teuthology.orchestra.run.smithi006.stdout:3309 write 0x3ffda6c thru 0x400774d (0x9ce2 bytes) 2024-09-14T06:00:04.196 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:04.196+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:04.212 INFO:teuthology.orchestra.run.smithi006.stdout:3310 read 0x2853e30 thru 0x28549b0 (0xb81 bytes) 2024-09-14T06:00:04.222 INFO:teuthology.orchestra.run.smithi006.stdout:3313 trunc from 0x400774e to 0xb3ad9f4 2024-09-14T06:00:04.228 INFO:teuthology.orchestra.run.smithi006.stdout:3314 read 0x257a8e thru 0x263360 (0xb8d3 bytes) 2024-09-14T06:00:04.235 INFO:teuthology.orchestra.run.smithi006.stdout:3315 trunc from 0xb3ad9f4 to 0x7875043 2024-09-14T06:00:04.242 INFO:teuthology.orchestra.run.smithi006.stdout:3316 punch from 0x198b346 to 0x198d4bf, (0x2179 bytes) 2024-09-14T06:00:04.242 INFO:teuthology.orchestra.run.smithi006.stdout:3317 read 0x1352b4f thru 0x135968a (0x6b3c bytes) 2024-09-14T06:00:04.251 INFO:teuthology.orchestra.run.smithi006.stdout:3318 writesame 0x9440745 thru 0x944d212 data_size 0x33(0xcace bytes) 2024-09-14T06:00:04.252 INFO:teuthology.orchestra.run.smithi006.stdout:3319 punch from 0x4145ff2 to 0x414b771, (0x577f bytes) 2024-09-14T06:00:04.252 INFO:teuthology.orchestra.run.smithi006.stdout:3320 read 0x4ff8281 thru 0x4ff8486 (0x206 bytes) 2024-09-14T06:00:04.252 INFO:teuthology.orchestra.run.smithi006.stdout:3322 read 0x17300d9 thru 0x1731c73 (0x1b9b bytes) 2024-09-14T06:00:04.252 INFO:teuthology.orchestra.run.smithi006.stdout:3323 punch from 0x2632088 to 0x26341ea, (0x2162 bytes) 2024-09-14T06:00:04.252 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:04.252 INFO:teuthology.orchestra.run.smithi006.stdout:3326 write 0x49e0d82 thru 0x49eec02 (0xde81 bytes) 2024-09-14T06:00:04.272 INFO:teuthology.orchestra.run.smithi006.stdout:3327 write 0x76a8d9f thru 0x76ae41b (0x567d bytes) 2024-09-14T06:00:04.281 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:04.277+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:04.284 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:04.287 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:04.287 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:04.287 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:04.287 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:04.287 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:04.294 INFO:teuthology.orchestra.run.smithi006.stdout:3329 writesame 0xad504f7 thru 0xad5450b data_size 0x5(0x4015 bytes) 2024-09-14T06:00:04.294 INFO:teuthology.orchestra.run.smithi006.stdout:3330 writesame 0x41ac788 thru 0x41b3da7 data_size 0x90(0x7620 bytes) 2024-09-14T06:00:04.297 INFO:teuthology.orchestra.run.smithi006.stdout:3331 read 0x3e4995d thru 0x3e4fd9a (0x643e bytes) 2024-09-14T06:00:04.297 INFO:teuthology.orchestra.run.smithi006.stdout:3335 writesame 0x3fe689f thru 0x3fe77b6 data_size 0x8(0xf18 bytes) 2024-09-14T06:00:04.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:00:04.309 INFO:teuthology.orchestra.run.smithi006.stdout:3336 writesame 0xe12620d thru 0xe130035 data_size 0x1(0x9e29 bytes) 2024-09-14T06:00:04.309 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:04.309 INFO:teuthology.orchestra.run.smithi006.stdout:3343 read 0x413b006 thru 0x413cc5d (0x1c58 bytes) 2024-09-14T06:00:04.323 INFO:teuthology.orchestra.run.smithi006.stdout:3345 trunc from 0xe130036 to 0x29aa6f6 2024-09-14T06:00:04.335 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T06:00:04.335 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T06:00:04.335 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T06:00:04.335 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T06:00:04.335 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T06:00:04.335 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T06:00:04.335 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T06:00:04.336 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T06:00:04.336 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T06:00:04.336 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T06:00:04.336 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T06:00:04.336 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T06:00:04.338 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T06:00:04.339 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T06:00:04.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 'trim stale osdmaps' 2024-09-14T06:00:04.347 INFO:teuthology.orchestra.run.smithi006.stdout:3346 writesame 0x3157896 thru 0x3166fbb data_size 0xbe(0xf726 bytes) 2024-09-14T06:00:04.347 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:04.347 INFO:teuthology.orchestra.run.smithi006.stdout:3350 read 0x21dd438 thru 0x21eb972 (0xe53b bytes) 2024-09-14T06:00:04.347 INFO:teuthology.orchestra.run.smithi006.stdout:3351 read 0x1025c4d thru 0x1029350 (0x3704 bytes) 2024-09-14T06:00:04.347 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:04.358 INFO:teuthology.orchestra.run.smithi006.stdout:3356 trunc from 0x3166fbc to 0xce6e11e 2024-09-14T06:00:04.364 INFO:teuthology.orchestra.run.smithi006.stdout:3358 write 0x6774ba0 thru 0x67845f2 (0xfa53 bytes) 2024-09-14T06:00:04.382 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:04.377+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:04.387 INFO:teuthology.orchestra.run.smithi006.stdout:3359 trunc from 0xce6e11e to 0x9d20f9e 2024-09-14T06:00:04.393 INFO:teuthology.orchestra.run.smithi006.stdout:3360 write 0x2be2f16 thru 0x2be7151 (0x423c bytes) 2024-09-14T06:00:04.404 INFO:teuthology.orchestra.run.smithi006.stdout:3361 punch from 0x39f4cc9 to 0x3a0144b, (0xc782 bytes) 2024-09-14T06:00:04.411 INFO:teuthology.orchestra.run.smithi006.stdout:3362 trunc from 0x9d20f9e to 0x33b561e 2024-09-14T06:00:04.443 INFO:teuthology.orchestra.run.smithi006.stdout:3366 trunc from 0x33b561e to 0xd92957f 2024-09-14T06:00:04.451 INFO:teuthology.orchestra.run.smithi006.stdout:3367 write 0x5d58461 thru 0x5d65d19 (0xd8b9 bytes) 2024-09-14T06:00:04.472 INFO:teuthology.orchestra.run.smithi006.stdout:3368 read 0x5c455b2 thru 0x5c51247 (0xbc96 bytes) 2024-09-14T06:00:04.473 INFO:teuthology.orchestra.run.smithi006.stdout:3369 read 0x95d6f86 thru 0x95def16 (0x7f91 bytes) 2024-09-14T06:00:04.484 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:04.484 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:04.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:04.484 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:04.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23550 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 606208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.532714478000003, 2024-09-14T06:00:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048793072999999999, 2024-09-14T06:00:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23550 2024-09-14T06:00:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7800000000000002e-07 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948677+0000", 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1949999999999997e-06 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948687+0000", 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0849000000000001e-05 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948692+0000", 2024-09-14T06:00:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8670000000000002e-06 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997290+0000", 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048597596999999999 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997367+0000", 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7236000000000004e-05 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997462+0000", 2024-09-14T06:00:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4951000000000006e-05 2024-09-14T06:00:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23551 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 620544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.532683620999997, 2024-09-14T06:00:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048938838999999998, 2024-09-14T06:00:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23551 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1e-07 2024-09-14T06:00:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948701+0000", 2024-09-14T06:00:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2950000000000001e-06 2024-09-14T06:00:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948705+0000", 2024-09-14T06:00:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7929999999999999e-06 2024-09-14T06:00:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948709+0000", 2024-09-14T06:00:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T06:00:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997535+0000", 2024-09-14T06:00:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048826181000000003 2024-09-14T06:00:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997580+0000", 2024-09-14T06:00:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5355000000000002e-05 2024-09-14T06:00:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997639+0000", 2024-09-14T06:00:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8479e-05 2024-09-14T06:00:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.532668143999999, 2024-09-14T06:00:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T06:00:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T06:00:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T06:00:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T06:00:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T06:00:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T06:00:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T06:00:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T06:00:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T06:00:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T06:00:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.532648868999999, 2024-09-14T06:00:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T06:00:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T06:00:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T06:00:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T06:00:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T06:00:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T06:00:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T06:00:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T06:00:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T06:00:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T06:00:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T06:00:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.532629292999999, 2024-09-14T06:00:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T06:00:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T06:00:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T06:00:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T06:00:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T06:00:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T06:00:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T06:00:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T06:00:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T06:00:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T06:00:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T06:00:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T06:00:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T06:00:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T06:00:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T06:00:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.532609835999999, 2024-09-14T06:00:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T06:00:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T06:00:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T06:00:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T06:00:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T06:00:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T06:00:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T06:00:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T06:00:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T06:00:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T06:00:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T06:00:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T06:00:04.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T06:00:04.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T06:00:04.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T06:00:04.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.511 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.511 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.512 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:04.512 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.532590784999996, 2024-09-14T06:00:04.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T06:00:04.512 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.512 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.512 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T06:00:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T06:00:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T06:00:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T06:00:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T06:00:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T06:00:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T06:00:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T06:00:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T06:00:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T06:00:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T06:00:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T06:00:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T06:00:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T06:00:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.532571103999999, 2024-09-14T06:00:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T06:00:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T06:00:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T06:00:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T06:00:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T06:00:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T06:00:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T06:00:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T06:00:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T06:00:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T06:00:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.532551153, 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T06:00:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T06:00:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T06:00:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T06:00:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T06:00:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T06:00:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T06:00:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T06:00:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T06:00:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T06:00:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T06:00:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.532531841000001, 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T06:00:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T06:00:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T06:00:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T06:00:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T06:00:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T06:00:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T06:00:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T06:00:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T06:00:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T06:00:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T06:00:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T06:00:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T06:00:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.532512080000004, 2024-09-14T06:00:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T06:00:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T06:00:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T06:00:04.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T06:00:04.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T06:00:04.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T06:00:04.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T06:00:04.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T06:00:04.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T06:00:04.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T06:00:04.536 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.536 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.536 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.536 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.536 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:04.537 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.532491159000003, 2024-09-14T06:00:04.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T06:00:04.537 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.537 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.537 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.537 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.537 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.537 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.537 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T06:00:04.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.537 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:04.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:04.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T06:00:04.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T06:00:04.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T06:00:04.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T06:00:04.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T06:00:04.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T06:00:04.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T06:00:04.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T06:00:04.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T06:00:04.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T06:00:04.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T06:00:04.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T06:00:04.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T06:00:04.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T06:00:04.541 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.541 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.541 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.541 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.541 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:04.541 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.531331825000002, 2024-09-14T06:00:04.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T06:00:04.541 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.541 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.542 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.542 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.542 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.542 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.542 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T06:00:04.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.542 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:04.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T06:00:04.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T06:00:04.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T06:00:04.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T06:00:04.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T06:00:04.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T06:00:04.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T06:00:04.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T06:00:04.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T06:00:04.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T06:00:04.545 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.545 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.545 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.531033043000001, 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:04.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:04.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T06:00:04.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T06:00:04.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T06:00:04.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T06:00:04.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T06:00:04.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T06:00:04.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T06:00:04.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T06:00:04.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T06:00:04.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T06:00:04.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T06:00:04.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T06:00:04.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T06:00:04.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T06:00:04.550 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.550 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.550 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.550 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.550 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:04.550 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.530882304999999, 2024-09-14T06:00:04.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T06:00:04.551 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.551 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.551 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.551 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.551 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.551 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.551 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T06:00:04.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.551 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:04.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:04.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T06:00:04.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T06:00:04.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T06:00:04.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T06:00:04.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T06:00:04.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T06:00:04.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T06:00:04.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T06:00:04.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T06:00:04.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T06:00:04.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T06:00:04.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T06:00:04.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T06:00:04.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T06:00:04.555 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.555 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.555 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.555 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23582 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 911360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.555 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:04.555 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.529956918000003, 2024-09-14T06:00:04.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048708939999999999, 2024-09-14T06:00:04.556 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.556 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.556 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.556 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.556 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.556 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.556 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23582 2024-09-14T06:00:04.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.556 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:04.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6300000000000005e-07 2024-09-14T06:00:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951430+0000", 2024-09-14T06:00:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5179999999999999e-06 2024-09-14T06:00:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951437+0000", 2024-09-14T06:00:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0940000000000002e-06 2024-09-14T06:00:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951443+0000", 2024-09-14T06:00:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7910000000000001e-06 2024-09-14T06:00:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000047+0000", 2024-09-14T06:00:04.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048604550000000003 2024-09-14T06:00:04.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000095+0000", 2024-09-14T06:00:04.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7735999999999998e-05 2024-09-14T06:00:04.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000135+0000", 2024-09-14T06:00:04.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0587999999999998e-05 2024-09-14T06:00:04.560 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.560 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.560 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.560 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23588 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 722944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.560 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:04.560 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.529932053000003, 2024-09-14T06:00:04.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048792653999999998, 2024-09-14T06:00:04.560 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.560 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.561 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.561 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.561 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.561 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.561 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23588 2024-09-14T06:00:04.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.561 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:04.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:04.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951665+0000", 2024-09-14T06:00:04.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021337600000000001 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951669+0000", 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3460000000000004e-06 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951688+0000", 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9042000000000002e-05 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951696+0000", 2024-09-14T06:00:04.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6660000000000008e-06 2024-09-14T06:00:04.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000162+0000", 2024-09-14T06:00:04.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048465824999999997 2024-09-14T06:00:04.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000199+0000", 2024-09-14T06:00:04.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7143e-05 2024-09-14T06:00:04.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000244+0000", 2024-09-14T06:00:04.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5256000000000002e-05 2024-09-14T06:00:04.565 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.565 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.565 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.565 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23590 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 745472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.565 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:04.565 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.529674598, 2024-09-14T06:00:04.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048677684999999998, 2024-09-14T06:00:04.565 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.565 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.565 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23590 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:04.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951850+0000", 2024-09-14T06:00:04.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014113 2024-09-14T06:00:04.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951855+0000", 2024-09-14T06:00:04.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6349999999999997e-06 2024-09-14T06:00:04.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951863+0000", 2024-09-14T06:00:04.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8189999999999998e-06 2024-09-14T06:00:04.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951871+0000", 2024-09-14T06:00:04.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2030000000000003e-06 2024-09-14T06:00:04.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000283+0000", 2024-09-14T06:00:04.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048412531000000002 2024-09-14T06:00:04.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000338+0000", 2024-09-14T06:00:04.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4462000000000001e-05 2024-09-14T06:00:04.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000387+0000", 2024-09-14T06:00:04.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8905e-05 2024-09-14T06:00:04.570 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.570 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.570 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.570 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T06:00:04.570 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:04.570 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.905580741999998, 2024-09-14T06:00:04.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T06:00:04.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T06:00:04.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T06:00:04.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T06:00:04.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T06:00:04.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T06:00:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T06:00:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T06:00:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T06:00:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T06:00:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.575 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:04.575 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:04.575 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.382490803000003, 2024-09-14T06:00:04.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T06:00:04.575 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:04.575 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:04.575 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:04.575 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:04.575 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:04.575 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:04.575 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T06:00:04.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.575 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:04.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:04.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:04.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:04.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:04.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:04.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:04.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T06:00:04.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T06:00:04.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:04.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T06:00:04.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T06:00:04.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:04.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T06:00:04.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T06:00:04.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:04.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T06:00:04.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T06:00:04.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T06:00:04.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:04.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T06:00:04.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T06:00:04.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:04.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T06:00:04.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T06:00:04.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T06:00:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T06:00:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T06:00:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T06:00:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:04.580 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:04.582 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:00:04.583 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:04.580+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:04.583 INFO:teuthology.orchestra.run.smithi006.stdout:3370 trunc from 0xd92957f to 0x645c5f1 2024-09-14T06:00:04.583 INFO:teuthology.orchestra.run.smithi006.stdout:3371 punch from 0x47673b1 to 0x4767477, (0xc6 bytes) 2024-09-14T06:00:04.583 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:04.583 INFO:teuthology.orchestra.run.smithi006.stdout:3373 trunc from 0x645c5f1 to 0x39f18c8 2024-09-14T06:00:04.583 INFO:teuthology.orchestra.run.smithi006.stdout:3374 read 0xdd0963 thru 0xddd15d (0xc7fb bytes) 2024-09-14T06:00:04.584 INFO:teuthology.orchestra.run.smithi006.stdout:3375 punch from 0x30be84a to 0x30c5638, (0x6dee bytes) 2024-09-14T06:00:04.584 INFO:teuthology.orchestra.run.smithi006.stdout:3377 writesame 0x187b7d thru 0x187dbb data_size 0x5(0x23f bytes) 2024-09-14T06:00:04.584 INFO:teuthology.orchestra.run.smithi006.stdout:3378 punch from 0x2c55faa to 0x2c5d8dd, (0x7933 bytes) 2024-09-14T06:00:04.584 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T06:00:04.584 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T06:00:04.584 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T06:00:04.585 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T06:00:04.585 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T06:00:04.585 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T06:00:04.585 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T06:00:04.585 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T06:00:04.585 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T06:00:04.585 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T06:00:04.585 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T06:00:04.585 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T06:00:04.585 INFO:teuthology.orchestra.run.smithi006.stdout:3379 trunc from 0x39f18c8 to 0xa92eb63 2024-09-14T06:00:04.586 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T06:00:04.586 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T06:00:04.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 'trim stale osdmaps' 2024-09-14T06:00:04.588 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:04.588 INFO:teuthology.orchestra.run.smithi006.stdout:3382 writesame 0x567cb63 thru 0x5686d20 data_size 0x6(0xa1be bytes) 2024-09-14T06:00:04.588 INFO:teuthology.orchestra.run.smithi006.stdout:3383 writesame 0xc9682d0 thru 0xc975381 data_size 0x1(0xd0b2 bytes) 2024-09-14T06:00:04.588 INFO:teuthology.orchestra.run.smithi006.stdout:3384 trunc from 0xc975382 to 0xe31174f 2024-09-14T06:00:04.588 INFO:teuthology.orchestra.run.smithi006.stdout:3386 read 0xcd51915 thru 0xcd61542 (0xfc2e bytes) 2024-09-14T06:00:04.589 INFO:teuthology.orchestra.run.smithi006.stdout:3387 read 0x6d62d85 thru 0x6d68b5f (0x5ddb bytes) 2024-09-14T06:00:04.589 INFO:teuthology.orchestra.run.smithi006.stdout:3390 write 0x772299c thru 0x7732385 (0xf9ea bytes) 2024-09-14T06:00:04.589 INFO:teuthology.orchestra.run.smithi006.stdout:3391 write 0xc6954a3 thru 0xc6962d8 (0xe36 bytes) 2024-09-14T06:00:04.591 INFO:teuthology.orchestra.run.smithi006.stdout:3392 write 0xbebce88 thru 0xbec6a48 (0x9bc1 bytes) 2024-09-14T06:00:04.612 INFO:teuthology.orchestra.run.smithi006.stdout:3393 writesame 0xc826811 thru 0xc82964d data_size 0x13(0x2e3d bytes) 2024-09-14T06:00:04.624 INFO:teuthology.orchestra.run.smithi006.stdout:3394 write 0xb696ae0 thru 0xb6a1a77 (0xaf98 bytes) 2024-09-14T06:00:04.649 INFO:teuthology.orchestra.run.smithi006.stdout:3395 writesame 0xe663100 thru 0xe6684aa data_size 0x1(0x53ab bytes) 2024-09-14T06:00:04.649 INFO:teuthology.orchestra.run.smithi006.stdout:3396 writesame 0x8fefab7 thru 0x8ff4ada data_size 0x2e(0x5024 bytes) 2024-09-14T06:00:04.661 INFO:teuthology.orchestra.run.smithi006.stdout:3397 trunc from 0xe6684ab to 0xdaed478 2024-09-14T06:00:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:3399 read 0x84e28d5 thru 0x84e4bd0 (0x22fc bytes) 2024-09-14T06:00:04.667 INFO:teuthology.orchestra.run.smithi006.stdout:3400 write 0x969edfb thru 0x96a66db (0x78e1 bytes) 2024-09-14T06:00:04.682 INFO:teuthology.orchestra.run.smithi006.stdout:3401 writesame 0x6c90857 thru 0x6c90f6b data_size 0x7(0x715 bytes) 2024-09-14T06:00:04.682 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:04.680+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:04.693 INFO:teuthology.orchestra.run.smithi006.stdout:3402 writesame 0xe3a9096 thru 0xe3b6931 data_size 0x6(0xd89c bytes) 2024-09-14T06:00:04.693 INFO:teuthology.orchestra.run.smithi006.stdout:3403 write 0xa947f0d thru 0xa94da14 (0x5b08 bytes) 2024-09-14T06:00:04.705 INFO:teuthology.orchestra.run.smithi006.stdout:3404 punch from 0x35c0628 to 0x35c0c1a, (0x5f2 bytes) 2024-09-14T06:00:04.705 INFO:teuthology.orchestra.run.smithi006.stdout:3406 write 0x71a674f thru 0x71a80b1 (0x1963 bytes) 2024-09-14T06:00:04.712 INFO:teuthology.orchestra.run.smithi006.stdout:3407 trunc from 0xe3b6932 to 0xcbd9db8 2024-09-14T06:00:04.719 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:04.719 INFO:teuthology.orchestra.run.smithi006.stdout:3410 writesame 0x31dfc80 thru 0x31e20c9 data_size 0x5(0x244a bytes) 2024-09-14T06:00:04.726 INFO:teuthology.orchestra.run.smithi006.stdout:3411 read 0x681b468 thru 0x682a9f5 (0xf58e bytes) 2024-09-14T06:00:04.740 INFO:teuthology.orchestra.run.smithi006.stdout:3412 trunc from 0xcbd9db8 to 0x31f1b88 2024-09-14T06:00:04.770 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:04.770 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:04.770 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:04.771 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T06:00:04.771 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T06:00:04.771 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T06:00:04.771 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T06:00:04.771 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T06:00:04.771 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T06:00:04.771 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T06:00:04.772 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T06:00:04.772 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T06:00:04.772 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T06:00:04.772 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T06:00:04.772 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T06:00:04.772 INFO:teuthology.orchestra.run.smithi006.stdout:3414 trunc from 0x31f1b88 to 0x1ee634a 2024-09-14T06:00:04.774 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T06:00:04.775 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T06:00:04.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 'trim stale osdmaps' 2024-09-14T06:00:04.783 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:04.780+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:04.784 INFO:teuthology.orchestra.run.smithi006.stdout:3415 read 0x1153d6d thru 0x1158996 (0x4c2a bytes) 2024-09-14T06:00:04.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:00:04.788 INFO:teuthology.orchestra.run.smithi006.stdout:3416 trunc from 0x1ee634a to 0x5a47aaf 2024-09-14T06:00:04.800 INFO:teuthology.orchestra.run.smithi006.stdout:3417 write 0x63b0c4d thru 0x63ba7d9 (0x9b8d bytes) 2024-09-14T06:00:04.831 INFO:teuthology.orchestra.run.smithi006.stdout:3418 write 0xe2ceffa thru 0xe2de801 (0xf808 bytes) 2024-09-14T06:00:04.837 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:00:04.858 INFO:teuthology.orchestra.run.smithi006.stdout:3419 trunc from 0xe2de802 to 0x38e225d 2024-09-14T06:00:04.873 INFO:teuthology.orchestra.run.smithi006.stdout:3420 write 0x1c8220 thru 0x1d5a87 (0xd868 bytes) 2024-09-14T06:00:04.877 INFO:teuthology.orchestra.run.smithi006.stdout:3421 read 0x2aa5916 thru 0x2ab3317 (0xda02 bytes) 2024-09-14T06:00:04.884 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:04.881+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:04.890 INFO:teuthology.orchestra.run.smithi006.stdout:3423 writesame 0x99c979b thru 0x99caf98 data_size 0x25(0x17fe bytes) 2024-09-14T06:00:04.890 INFO:teuthology.orchestra.run.smithi006.stdout:3424 read 0xeac34a thru 0xebb786 (0xf43d bytes) 2024-09-14T06:00:04.891 INFO:teuthology.orchestra.run.smithi006.stdout:3425 writesame 0x5b55797 thru 0x5b56bfe data_size 0x4(0x1468 bytes) 2024-09-14T06:00:04.896 INFO:teuthology.orchestra.run.smithi006.stdout:3426 read 0x932846c thru 0x932f80b (0x73a0 bytes) 2024-09-14T06:00:04.896 INFO:teuthology.orchestra.run.smithi006.stdout:3427 punch from 0x927b86d to 0x928ab02, (0xf295 bytes) 2024-09-14T06:00:04.896 INFO:teuthology.orchestra.run.smithi006.stdout:3428 punch from 0x48c8839 to 0x48d0855, (0x801c bytes) 2024-09-14T06:00:04.907 INFO:teuthology.orchestra.run.smithi006.stdout:3429 writesame 0xd3ae125 thru 0xd3b1460 data_size 0x6(0x333c bytes) 2024-09-14T06:00:04.914 INFO:teuthology.orchestra.run.smithi006.stdout:3430 write 0xd7e809c thru 0xd7eb2ca (0x322f bytes) 2024-09-14T06:00:04.924 INFO:teuthology.orchestra.run.smithi006.stdout:3431 writesame 0xa0e8d2a thru 0xa0eb671 data_size 0x4(0x2948 bytes) 2024-09-14T06:00:04.938 INFO:teuthology.orchestra.run.smithi006.stdout:3432 trunc from 0xd7eb2cb to 0x9e4949d 2024-09-14T06:00:04.951 INFO:teuthology.orchestra.run.smithi006.stdout:3433 read 0x2fa1e8a thru 0x2fae986 (0xcafd bytes) 2024-09-14T06:00:04.951 INFO:teuthology.orchestra.run.smithi006.stdout:3434 read 0x959f411 thru 0x95a195f (0x254f bytes) 2024-09-14T06:00:04.951 INFO:teuthology.orchestra.run.smithi006.stdout:3435 clone 22 order 22 su 524288 sc 14 2024-09-14T06:00:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:no valid command found; 10 closest matches: 2024-09-14T06:00:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:0 2024-09-14T06:00:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:1 2024-09-14T06:00:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:2 2024-09-14T06:00:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:abort 2024-09-14T06:00:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:assert 2024-09-14T06:00:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:bench [] [] [] [] 2024-09-14T06:00:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs debug_inject_read_zeros 2024-09-14T06:00:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs files list 2024-09-14T06:00:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:bluefs stats 2024-09-14T06:00:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:bluestore allocator dump block 2024-09-14T06:00:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:Error EINVAL: invalid command 2024-09-14T06:00:04.955 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T06:00:04.955 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-14T06:00:04.958 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:04.958 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:04.958 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:04.958 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:04.959 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:04.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T06:00:04.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:00:04.990 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:05.008 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:05.008 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:05.021 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:05.020+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:05.025 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:05.025 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:05.042 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:05.043 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:05.059 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:05.060 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:05.078 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:05.078 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:05.085 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:05.081+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:05.093 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:05.093 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:05.097 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:05.097 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:05.107 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:00:05.119 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:05.119 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:05.150 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-14T06:00:05.186 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:05.185+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:05.198 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.211 INFO:teuthology.orchestra.run.smithi006.stdout:3438 writesame 0xb90911f thru 0xb90a758 data_size 0x5(0x163a bytes) 2024-09-14T06:00:05.224 INFO:teuthology.orchestra.run.smithi006.stdout:3439 trunc from 0xb90a759 to 0x1a510e5 2024-09-14T06:00:05.283 INFO:teuthology.orchestra.run.smithi006.stdout:3440 write 0x5acc009 thru 0x5adba26 (0xfa1e bytes) 2024-09-14T06:00:05.287 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.287 INFO:teuthology.orchestra.run.smithi006.stdout:3444 punch from 0x129ffe2 to 0x12a4645, (0x4663 bytes) 2024-09-14T06:00:05.287 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:05.285+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:05.288 INFO:teuthology.orchestra.run.smithi006.stdout:3445 writesame 0x17b4264 thru 0x17b9022 data_size 0x1(0x4dbf bytes) 2024-09-14T06:00:05.290 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:05.290 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:05.305 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:00:05.308 INFO:teuthology.orchestra.run.smithi006.stdout:3446 write 0x8a4cb18 thru 0x8a4f740 (0x2c29 bytes) 2024-09-14T06:00:05.313 INFO:teuthology.orchestra.run.smithi006.stdout:3447 read 0x7c461a8 thru 0x7c4b0ec (0x4f45 bytes) 2024-09-14T06:00:05.314 INFO:teuthology.orchestra.run.smithi006.stdout:3448 read 0x2e7a260 thru 0x2e8166b (0x740c bytes) 2024-09-14T06:00:05.314 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.322 INFO:teuthology.orchestra.run.smithi006.stdout:3451 trunc from 0x8a4f741 to 0x31572be 2024-09-14T06:00:05.361 INFO:teuthology.orchestra.run.smithi006.stdout:3452 writesame 0xb995b00 thru 0xb99e649 data_size 0x7(0x8b4a bytes) 2024-09-14T06:00:05.361 INFO:teuthology.orchestra.run.smithi006.stdout:3455 read 0x313ec2a thru 0x31426aa (0x3a81 bytes) 2024-09-14T06:00:05.362 INFO:teuthology.orchestra.run.smithi006.stdout:3456 punch from 0x466c490 to 0x466e158, (0x1cc8 bytes) 2024-09-14T06:00:05.374 INFO:teuthology.orchestra.run.smithi006.stdout:3458 write 0xe575700 thru 0xe57810f (0x2a10 bytes) 2024-09-14T06:00:05.378 INFO:teuthology.orchestra.run.smithi006.stdout:3459 read 0xd369a11 thru 0xd37423a (0xa82a bytes) 2024-09-14T06:00:05.378 INFO:teuthology.orchestra.run.smithi006.stdout:3460 writesame 0xaa79eec thru 0xaa7a328 data_size 0x7(0x43d bytes) 2024-09-14T06:00:05.382 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.388 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:05.385+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:05.390 INFO:teuthology.orchestra.run.smithi006.stdout:3463 write 0xe583225 thru 0xe589ef4 (0x6cd0 bytes) 2024-09-14T06:00:05.395 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.396 INFO:teuthology.orchestra.run.smithi006.stdout:3466 writesame 0x28f53bd thru 0x29034df data_size 0x1(0xe123 bytes) 2024-09-14T06:00:05.435 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:05.435 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:05.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:00:05.453 INFO:teuthology.orchestra.run.smithi006.stdout:3467 writesame 0xbc6e734 thru 0xbc7870c data_size 0x1(0x9fd9 bytes) 2024-09-14T06:00:05.483 INFO:teuthology.orchestra.run.smithi006.stdout:3468 read 0x9f320ad thru 0x9f392b2 (0x7206 bytes) 2024-09-14T06:00:05.483 INFO:teuthology.orchestra.run.smithi006.stdout:3470 punch from 0x8f2d6df to 0x8f39842, (0xc163 bytes) 2024-09-14T06:00:05.489 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:05.485+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:05.506 INFO:teuthology.orchestra.run.smithi006.stdout:3471 trunc from 0xe589ef5 to 0x4a68a69 2024-09-14T06:00:05.531 INFO:teuthology.orchestra.run.smithi006.stdout:3472 punch from 0x382194d to 0x3823924, (0x1fd7 bytes) 2024-09-14T06:00:05.557 INFO:teuthology.orchestra.run.smithi006.stdout:3474 write 0x9ebbc14 thru 0x9ec2c44 (0x7031 bytes) 2024-09-14T06:00:05.565 INFO:teuthology.orchestra.run.smithi006.stdout:3477 read 0x23d1a2d thru 0x23d364c (0x1c20 bytes) 2024-09-14T06:00:05.566 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.566 INFO:teuthology.orchestra.run.smithi006.stdout:3479 punch from 0x7b101cc to 0x7b19e9d, (0x9cd1 bytes) 2024-09-14T06:00:05.566 INFO:teuthology.orchestra.run.smithi006.stdout:3481 write 0x919e4e8 thru 0x91a778d (0x92a6 bytes) 2024-09-14T06:00:05.574 INFO:teuthology.orchestra.run.smithi006.stdout:3482 write 0x5ee7bfa thru 0x5ef6f17 (0xf31e bytes) 2024-09-14T06:00:05.585 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:05.585 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:05.591 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:05.588+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:05.599 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:00:05.605 INFO:teuthology.orchestra.run.smithi006.stdout:3483 trunc from 0x9ec2c45 to 0x16cd9c4 2024-09-14T06:00:05.635 INFO:teuthology.orchestra.run.smithi006.stdout:3484 read 0xac7a4e thru 0xacdc14 (0x61c7 bytes) 2024-09-14T06:00:05.666 INFO:teuthology.orchestra.run.smithi006.stdout:3485 write 0x871a126 thru 0x871ab78 (0xa53 bytes) 2024-09-14T06:00:05.672 INFO:teuthology.orchestra.run.smithi006.stdout:3486 write 0x2aeb1bb thru 0x2af0e37 (0x5c7d bytes) 2024-09-14T06:00:05.675 INFO:teuthology.orchestra.run.smithi006.stdout:3487 write 0x6d59d72 thru 0x6d625bc (0x884b bytes) 2024-09-14T06:00:05.682 INFO:teuthology.orchestra.run.smithi006.stdout:3488 write 0x32e8a6e thru 0x32ef166 (0x66f9 bytes) 2024-09-14T06:00:05.686 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.686 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.686 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.692 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:05.688+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:05.693 INFO:teuthology.orchestra.run.smithi006.stdout:3494 trunc from 0x871ab79 to 0x5dbb879 2024-09-14T06:00:05.717 INFO:teuthology.orchestra.run.smithi006.stdout:3495 write 0x2c56c7 thru 0x2c8452 (0x2d8c bytes) 2024-09-14T06:00:05.738 INFO:teuthology.orchestra.run.smithi006.stdout:3496 write 0x78204f7 thru 0x7828a4c (0x8556 bytes) 2024-09-14T06:00:05.746 INFO:teuthology.orchestra.run.smithi006.stdout:3497 read 0x3e135e2 thru 0x3e1f443 (0xbe62 bytes) 2024-09-14T06:00:05.746 INFO:teuthology.orchestra.run.smithi006.stdout:3499 read 0x186ae6d thru 0x1874a34 (0x9bc8 bytes) 2024-09-14T06:00:05.747 INFO:teuthology.orchestra.run.smithi006.stdout:3500 punch from 0x3056343 to 0x3064f64, (0xec21 bytes) 2024-09-14T06:00:05.758 INFO:teuthology.orchestra.run.smithi006.stdout:3501 trunc from 0x7828a4d to 0x34bbd56 2024-09-14T06:00:05.763 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:05.763 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:05.779 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:00:05.793 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:05.789+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:05.813 INFO:teuthology.orchestra.run.smithi006.stdout:3502 writesame 0x8d3fbdd thru 0x8d48547 data_size 0x1(0x896b bytes) 2024-09-14T06:00:05.813 INFO:teuthology.orchestra.run.smithi006.stdout:3503 read 0x82f3d5a thru 0x82fb4c5 (0x776c bytes) 2024-09-14T06:00:05.813 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.813 INFO:teuthology.orchestra.run.smithi006.stdout:3505 write 0x94f59f thru 0x95b5d1 (0xc033 bytes) 2024-09-14T06:00:05.817 INFO:teuthology.orchestra.run.smithi006.stdout:3506 read 0x6f10a30 thru 0x6f1f809 (0xedda bytes) 2024-09-14T06:00:05.817 INFO:teuthology.orchestra.run.smithi006.stdout:3508 write 0x15afad thru 0x15f69a (0x46ee bytes) 2024-09-14T06:00:05.821 INFO:teuthology.orchestra.run.smithi006.stdout:3509 writesame 0x8b20453 thru 0x8b2df22 data_size 0x18(0xdad0 bytes) 2024-09-14T06:00:05.830 INFO:teuthology.orchestra.run.smithi006.stdout:3511 write 0x6010197 thru 0x60178c1 (0x772b bytes) 2024-09-14T06:00:05.837 INFO:teuthology.orchestra.run.smithi006.stdout:3512 read 0x79b7fe5 thru 0x79c4ffe (0xd01a bytes) 2024-09-14T06:00:05.837 INFO:teuthology.orchestra.run.smithi006.stdout:3513 read 0x6c05a9c thru 0x6c120ab (0xc610 bytes) 2024-09-14T06:00:05.837 INFO:teuthology.orchestra.run.smithi006.stdout:3514 writesame 0x5ea5c58 thru 0x5eada0b data_size 0xa(0x7db4 bytes) 2024-09-14T06:00:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:3516 read 0x3fb30b9 thru 0x3fb98fa (0x6842 bytes) 2024-09-14T06:00:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:3517 punch from 0x76cc0e1 to 0x76d7f43, (0xbe62 bytes) 2024-09-14T06:00:05.846 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.859 INFO:teuthology.orchestra.run.smithi006.stdout:3519 trunc from 0x8d48548 to 0xd846813 2024-09-14T06:00:05.870 INFO:teuthology.orchestra.run.smithi006.stdout:3520 writesame 0x244b5d5 thru 0x2456a84 data_size 0x76(0xb4b0 bytes) 2024-09-14T06:00:05.872 INFO:teuthology.orchestra.run.smithi006.stdout:3521 punch from 0x957d085 to 0x9582af3, (0x5a6e bytes) 2024-09-14T06:00:05.874 INFO:teuthology.orchestra.run.smithi006.stdout:3522 trunc from 0xd846813 to 0xcd63117 2024-09-14T06:00:05.886 INFO:teuthology.orchestra.run.smithi006.stdout:3523 write 0x4d3e01f thru 0x4d3fb72 (0x1b54 bytes) 2024-09-14T06:00:05.892 INFO:teuthology.orchestra.run.smithi006.stdout:3524 punch from 0xb4b5c8 to 0xb4c382, (0xdba bytes) 2024-09-14T06:00:05.892 INFO:teuthology.orchestra.run.smithi006.stdout:3525 punch from 0x8f637fa to 0x8f6e0f3, (0xa8f9 bytes) 2024-09-14T06:00:05.892 INFO:teuthology.orchestra.run.smithi006.stdout:3526 write 0x4a4987b thru 0x4a5075a (0x6ee0 bytes) 2024-09-14T06:00:05.893 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:05.892+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:05.898 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.898 INFO:teuthology.orchestra.run.smithi006.stdout:3528 read 0xbc4e022 thru 0xbc5aea5 (0xce84 bytes) 2024-09-14T06:00:05.899 INFO:teuthology.orchestra.run.smithi006.stdout:3529 write 0x83462e8 thru 0x8352dd6 (0xcaef bytes) 2024-09-14T06:00:05.906 INFO:teuthology.orchestra.run.smithi006.stdout:3530 write 0x6b34a1c thru 0x6b3c466 (0x7a4b bytes) 2024-09-14T06:00:05.915 INFO:teuthology.orchestra.run.smithi006.stdout:3533 writesame 0xc9a6544 thru 0xc9b0140 data_size 0x57(0x9bfd bytes) 2024-09-14T06:00:05.931 INFO:teuthology.orchestra.run.smithi006.stdout:3534 trunc from 0xcd63117 to 0x9f0576d 2024-09-14T06:00:05.944 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:05.944 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:05.959 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:00:05.960 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.969 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2024-09-14T06:00:05.982 INFO:teuthology.orchestra.run.smithi006.stdout:3536 writesame 0xccb5455 thru 0xccc033a data_size 0x3d(0xaee6 bytes) 2024-09-14T06:00:05.982 INFO:teuthology.orchestra.run.smithi006.stdout:3537 read 0x798a808 thru 0x79931d1 (0x89ca bytes) 2024-09-14T06:00:05.982 INFO:teuthology.orchestra.run.smithi006.stdout:3538 read 0x8d3e889 thru 0x8d4dcff (0xf477 bytes) 2024-09-14T06:00:05.982 INFO:teuthology.orchestra.run.smithi006.stdout:3541 read 0x50f04a9 thru 0x50f2fa3 (0x2afb bytes) 2024-09-14T06:00:05.991 INFO:teuthology.orchestra.run.smithi006.stdout:3542 write 0xcf53326 thru 0xcf54378 (0x1053 bytes) 2024-09-14T06:00:05.994 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:05.989+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:05.998 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.998 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.998 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:05.998 INFO:teuthology.orchestra.run.smithi006.stdout:3547 write 0x780fe39 thru 0x7814d16 (0x4ede bytes) 2024-09-14T06:00:06.003 INFO:teuthology.orchestra.run.smithi006.stdout:3548 read 0x6565fd4 thru 0x65728ec (0xc919 bytes) 2024-09-14T06:00:06.003 INFO:teuthology.orchestra.run.smithi006.stdout:3549 read 0xb8d135b thru 0xb8ddeb9 (0xcb5f bytes) 2024-09-14T06:00:06.004 INFO:teuthology.orchestra.run.smithi006.stdout:3551 punch from 0x59747f7 to 0x597ac33, (0x643c bytes) 2024-09-14T06:00:06.004 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:06.004 INFO:teuthology.orchestra.run.smithi006.stdout:3554 write 0x5878fbc thru 0x5884c1d (0xbc62 bytes) 2024-09-14T06:00:06.011 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:06.011 INFO:teuthology.orchestra.run.smithi006.stdout:3557 write 0xc6ac2da thru 0xc6b81af (0xbed6 bytes) 2024-09-14T06:00:06.015 INFO:teuthology.orchestra.run.smithi006.stdout:3559 read 0x5d9af8 thru 0x5e6cb1 (0xd1ba bytes) 2024-09-14T06:00:06.031 INFO:teuthology.orchestra.run.smithi006.stdout:3561 trunc from 0xcf54379 to 0x4b0f13f 2024-09-14T06:00:06.059 INFO:teuthology.orchestra.run.smithi006.stdout:3562 trunc from 0x4b0f13f to 0x1340707 2024-09-14T06:00:06.095 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:06.093+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:06.130 INFO:teuthology.orchestra.run.smithi006.stdout:3563 write 0xbd75abd thru 0xbd788c3 (0x2e07 bytes) 2024-09-14T06:00:06.133 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:06.133 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:06.136 INFO:teuthology.orchestra.run.smithi006.stdout:3564 read 0x5369ba6 thru 0x5371914 (0x7d6f bytes) 2024-09-14T06:00:06.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:00:06.158 INFO:teuthology.orchestra.run.smithi006.stdout:3566 trunc from 0xbd788c4 to 0x21f83c8 2024-09-14T06:00:06.184 INFO:teuthology.orchestra.run.smithi006.stdout:3567 read 0x1161518 thru 0x116adbf (0x98a8 bytes) 2024-09-14T06:00:06.195 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:06.193+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:06.222 INFO:teuthology.orchestra.run.smithi006.stdout:3568 writesame 0xd4043a1 thru 0xd405e10 data_size 0x9(0x1a70 bytes) 2024-09-14T06:00:06.224 INFO:teuthology.orchestra.run.smithi006.stdout:3569 trunc from 0xd405e11 to 0xe1e035e 2024-09-14T06:00:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:3570 read 0xc427305 thru 0xc43115c (0x9e58 bytes) 2024-09-14T06:00:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:3573 writesame 0x7831684 thru 0x783a711 data_size 0x1(0x908e bytes) 2024-09-14T06:00:06.278 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:06.278 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:06.291 INFO:teuthology.orchestra.run.smithi006.stdout:3574 read 0x5713f01 thru 0x5721733 (0xd833 bytes) 2024-09-14T06:00:06.291 INFO:teuthology.orchestra.run.smithi006.stdout:3575 read 0xc2f2d75 thru 0xc2fcc9d (0x9f29 bytes) 2024-09-14T06:00:06.292 INFO:teuthology.orchestra.run.smithi006.stdout:3577 trunc from 0xe1e035e to 0xdafdfa2 2024-09-14T06:00:06.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:00:06.296 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:06.292+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:06.307 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:06.307 INFO:teuthology.orchestra.run.smithi006.stdout:3579 read 0x7e753c9 thru 0x7e7f724 (0xa35c bytes) 2024-09-14T06:00:06.307 INFO:teuthology.orchestra.run.smithi006.stdout:3581 write 0x32e1764 thru 0x32ef6ff (0xdf9c bytes) 2024-09-14T06:00:06.337 INFO:teuthology.orchestra.run.smithi006.stdout:3583 trunc from 0xdafdfa2 to 0x290deca 2024-09-14T06:00:06.368 INFO:teuthology.orchestra.run.smithi006.stdout:3586 read 0xbae704 thru 0xbb31fa (0x4af7 bytes) 2024-09-14T06:00:06.369 INFO:teuthology.orchestra.run.smithi006.stdout:3588 punch from 0xabbd5e to 0xac23e6, (0x6688 bytes) 2024-09-14T06:00:06.369 INFO:teuthology.orchestra.run.smithi006.stdout:3589 writesame 0x15a61ac thru 0x15aec93 data_size 0x7f(0x8ae8 bytes) 2024-09-14T06:00:06.373 INFO:teuthology.orchestra.run.smithi006.stdout:3590 read 0x9376c9 thru 0x93b6ac (0x3fe4 bytes) 2024-09-14T06:00:06.393 INFO:teuthology.orchestra.run.smithi006.stdout:3591 write 0x6de7ab7 thru 0x6def3bb (0x7905 bytes) 2024-09-14T06:00:06.397 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:06.396+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:06.425 INFO:teuthology.orchestra.run.smithi006.stdout:3592 writesame 0xbca2931 thru 0xbcab11c data_size 0x2(0x87ec bytes) 2024-09-14T06:00:06.425 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:06.425 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:06.439 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:06.439 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:06.444 INFO:teuthology.orchestra.run.smithi006.stdout:3595 trunc from 0xbcab11d to 0x2f58e0f 2024-09-14T06:00:06.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:00:06.474 INFO:teuthology.orchestra.run.smithi006.stdout:3597 punch from 0x22d56ed to 0x22de3ea, (0x8cfd bytes) 2024-09-14T06:00:06.474 INFO:teuthology.orchestra.run.smithi006.stdout:3599 read 0xf74ffb thru 0xf7ab5f (0x5b65 bytes) 2024-09-14T06:00:06.516 INFO:teuthology.orchestra.run.smithi006.stdout:3601 writesame 0xe62e897 thru 0xe63c656 data_size 0x20(0xddc0 bytes) 2024-09-14T06:00:06.517 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:06.513+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:06.529 INFO:teuthology.orchestra.run.smithi006.stdout:3602 trunc from 0xe63c657 to 0x97da84a 2024-09-14T06:00:06.555 INFO:teuthology.orchestra.run.smithi006.stdout:3604 write 0x9e4f300 thru 0x9e53cda (0x49db bytes) 2024-09-14T06:00:06.561 INFO:teuthology.orchestra.run.smithi006.stdout:3606 punch from 0x9d98354 to 0x9d9bcd8, (0x3984 bytes) 2024-09-14T06:00:06.579 INFO:teuthology.orchestra.run.smithi006.stdout:3607 write 0xca1b07d thru 0xca2662e (0xb5b2 bytes) 2024-09-14T06:00:06.584 INFO:teuthology.orchestra.run.smithi006.stdout:3608 write 0x7e9bdc0 thru 0x7ea4a49 (0x8c8a bytes) 2024-09-14T06:00:06.590 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:06.590 INFO:teuthology.orchestra.run.smithi006.stdout:3610 punch from 0x2defe77 to 0x2df1b4f, (0x1cd8 bytes) 2024-09-14T06:00:06.590 INFO:teuthology.orchestra.run.smithi006.stdout:3612 punch from 0xad20709 to 0xad2f003, (0xe8fa bytes) 2024-09-14T06:00:06.590 INFO:teuthology.orchestra.run.smithi006.stdout:3613 write 0x17a8a24 thru 0x17addd6 (0x53b3 bytes) 2024-09-14T06:00:06.593 INFO:teuthology.orchestra.run.smithi006.stdout:3615 write 0x7b43c1d thru 0x7b49e08 (0x61ec bytes) 2024-09-14T06:00:06.596 INFO:teuthology.orchestra.run.smithi006.stdout:3617 read 0x41ac3b9 thru 0x41b1ce2 (0x592a bytes) 2024-09-14T06:00:06.596 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:06.596 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:06.596 INFO:teuthology.orchestra.run.smithi006.stdout:3623 read 0x441d696 thru 0x442c3d4 (0xed3f bytes) 2024-09-14T06:00:06.596 INFO:teuthology.orchestra.run.smithi006.stdout:3624 punch from 0x61aaf90 to 0x61ac58f, (0x15ff bytes) 2024-09-14T06:00:06.599 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:06.596+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:06.611 INFO:teuthology.orchestra.run.smithi006.stdout:3625 write 0xe1a2db8 thru 0xe1add84 (0xafcd bytes) 2024-09-14T06:00:06.612 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:06.612 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:06.616 INFO:teuthology.orchestra.run.smithi006.stdout:3626 write 0x9f1c22b thru 0x9f26242 (0xa018 bytes) 2024-09-14T06:00:06.622 INFO:teuthology.orchestra.run.smithi006.stdout:3627 read 0x4f4b9c2 thru 0x4f5b177 (0xf7b6 bytes) 2024-09-14T06:00:06.622 INFO:teuthology.orchestra.run.smithi006.stdout:3628 write 0xb18b979 thru 0xb19ad1e (0xf3a6 bytes) 2024-09-14T06:00:06.629 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:06.629 INFO:teuthology.orchestra.run.smithi006.stdout:3630 read 0x5a0c262 thru 0x5a153df (0x917e bytes) 2024-09-14T06:00:06.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:00:06.645 INFO:teuthology.orchestra.run.smithi006.stdout:3632 trunc from 0xe1add85 to 0x23829ed 2024-09-14T06:00:06.696 INFO:teuthology.orchestra.run.smithi006.stdout:3633 writesame 0x8310b16 thru 0x831553c data_size 0x1(0x4a27 bytes) 2024-09-14T06:00:06.696 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:06.696 INFO:teuthology.orchestra.run.smithi006.stdout:3635 read 0x67d6622 thru 0x67d9d47 (0x3726 bytes) 2024-09-14T06:00:06.696 INFO:teuthology.orchestra.run.smithi006.stdout:3636 read 0x545d30b thru 0x5463b09 (0x67ff bytes) 2024-09-14T06:00:06.700 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:06.696+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:06.703 INFO:teuthology.orchestra.run.smithi006.stdout:3638 trunc from 0x831553d to 0xc5909bd 2024-09-14T06:00:06.714 INFO:teuthology.orchestra.run.smithi006.stdout:3639 write 0x896189e thru 0x8969b68 (0x82cb bytes) 2024-09-14T06:00:06.721 INFO:teuthology.orchestra.run.smithi006.stdout:3642 read 0xc40d610 thru 0xc414745 (0x7136 bytes) 2024-09-14T06:00:06.721 INFO:teuthology.orchestra.run.smithi006.stdout:3643 read 0x709d912 thru 0x70aa5e8 (0xccd7 bytes) 2024-09-14T06:00:06.721 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:06.721 INFO:teuthology.orchestra.run.smithi006.stdout:3645 read 0x29f731c thru 0x29fb0f8 (0x3ddd bytes) 2024-09-14T06:00:06.721 INFO:teuthology.orchestra.run.smithi006.stdout:3646 read 0x3dc111e thru 0x3dc3a6d (0x2950 bytes) 2024-09-14T06:00:06.721 INFO:teuthology.orchestra.run.smithi006.stdout:3647 read 0x320f44a thru 0x321b227 (0xbdde bytes) 2024-09-14T06:00:06.722 INFO:teuthology.orchestra.run.smithi006.stdout:3648 read 0x9243924 thru 0x9250ccb (0xd3a8 bytes) 2024-09-14T06:00:06.722 INFO:teuthology.orchestra.run.smithi006.stdout:3649 read 0x5a40c36 thru 0x5a4ddae (0xd179 bytes) 2024-09-14T06:00:06.727 INFO:teuthology.orchestra.run.smithi006.stdout:3650 trunc from 0xc5909bd to 0x917b0ad 2024-09-14T06:00:06.742 INFO:teuthology.orchestra.run.smithi006.stdout:3651 punch from 0x5900fed to 0x59076dd, (0x66f0 bytes) 2024-09-14T06:00:06.742 INFO:teuthology.orchestra.run.smithi006.stdout:3652 writesame 0x7895f4 thru 0x7981b3 data_size 0x4(0xebc0 bytes) 2024-09-14T06:00:06.783 INFO:teuthology.orchestra.run.smithi006.stdout:3653 write 0xce20190 thru 0xce2727c (0x70ed bytes) 2024-09-14T06:00:06.785 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:06.785 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:06.788 INFO:teuthology.orchestra.run.smithi006.stdout:3654 read 0xbecc225 thru 0xbed581b (0x95f7 bytes) 2024-09-14T06:00:06.788 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:06.788 INFO:teuthology.orchestra.run.smithi006.stdout:3656 read 0x269e5c8 thru 0x26a6626 (0x805f bytes) 2024-09-14T06:00:06.792 INFO:teuthology.orchestra.run.smithi006.stdout:3658 trunc from 0xce2727d to 0xab5c037 2024-09-14T06:00:06.801 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:06.796+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:06.806 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:00:06.806 INFO:teuthology.orchestra.run.smithi006.stdout:3659 writesame 0xac91ff thru 0xac940a data_size 0x2(0x20c bytes) 2024-09-14T06:00:06.823 INFO:teuthology.orchestra.run.smithi006.stdout:3660 write 0xc3aff1e thru 0xc3b05ef (0x6d2 bytes) 2024-09-14T06:00:06.829 INFO:teuthology.orchestra.run.smithi006.stdout:3661 read 0x9ce5b5d thru 0x9cf51c7 (0xf66b bytes) 2024-09-14T06:00:06.829 INFO:teuthology.orchestra.run.smithi006.stdout:3662 punch from 0x478e277 to 0x4799675, (0xb3fe bytes) 2024-09-14T06:00:06.829 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:06.829 INFO:teuthology.orchestra.run.smithi006.stdout:3665 punch from 0xbf9fdc2 to 0xbfae7e2, (0xea20 bytes) 2024-09-14T06:00:06.829 INFO:teuthology.orchestra.run.smithi006.stdout:3667 read 0x978f5ee thru 0x9793d78 (0x478b bytes) 2024-09-14T06:00:06.829 INFO:teuthology.orchestra.run.smithi006.stdout:3668 clone 23 order 19 su 16384 sc 6 2024-09-14T06:00:06.901 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:06.900+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:06.928 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:06.928 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:06.942 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:00:07.031 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:07.029+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:07.102 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:07.097+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:07.110 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:07.110 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:07.120 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone22 from 0xc3b05f0 (overlap 0x1340707) to 0x9a0383 2024-09-14T06:00:07.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:00:07.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:00:07.215 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:07.213+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:07.245 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-14T06:00:07.296 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:07.296 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:07.304 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:07.301+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:07.324 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:00:07.333 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:07.333 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:07.359 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:07.377 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:07.377 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:07.394 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:07.405 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:07.401+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:07.415 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:07.416 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:07.437 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:07.437 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:07.459 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:07.461 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:07.461 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:07.461 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:07.461 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:07.461 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:07.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:00:07.481 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:07.481 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:07.506 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:07.504+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:07.563 INFO:teuthology.orchestra.run.smithi006.stdout:3669 write 0x3c76b4b thru 0x3c85b81 (0xf037 bytes) 2024-09-14T06:00:07.577 INFO:teuthology.orchestra.run.smithi006.stdout:3670 write 0x7dd3eec thru 0x7dd4900 (0xa15 bytes) 2024-09-14T06:00:07.586 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:07.587 INFO:teuthology.orchestra.run.smithi006.stdout:3672 writesame 0x2de3ab6 thru 0x2de4e3d data_size 0xa(0x1388 bytes) 2024-09-14T06:00:07.597 INFO:teuthology.orchestra.run.smithi006.stdout:3673 read 0x3028732 thru 0x3037ceb (0xf5ba bytes) 2024-09-14T06:00:07.599 INFO:teuthology.orchestra.run.smithi006.stdout:3675 write 0x39c5f00 thru 0x39cfb90 (0x9c91 bytes) 2024-09-14T06:00:07.606 INFO:teuthology.orchestra.run.smithi006.stdout:3676 read 0x9ed4560 thru 0x9ed63aa (0x1e4b bytes) 2024-09-14T06:00:07.607 INFO:teuthology.orchestra.run.smithi006.stdout:3677 writesame 0xadb5cd5 thru 0xadbe072 data_size 0x11(0x839e bytes) 2024-09-14T06:00:07.607 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:07.605+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:07.608 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:07.608 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:00:07.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:00:07.608 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:07.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.608 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3629 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'31, mlcod=31'25)", 2024-09-14T06:00:07.608 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:00:07.609 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 50.277436352999999, 2024-09-14T06:00:07.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048071900000000002, 2024-09-14T06:00:07.609 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.609 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.609 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.609 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.609 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:00:07.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.609 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:00:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329483+0000", 2024-09-14T06:00:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-07 2024-09-14T06:00:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329488+0000", 2024-09-14T06:00:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000004e-06 2024-09-14T06:00:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329496+0000", 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2209999999999997e-06 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329501+0000", 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8729999999999998e-06 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329545+0000", 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4382999999999998e-05 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329564+0000", 2024-09-14T06:00:07.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8947999999999999e-05 2024-09-14T06:00:07.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334225+0000", 2024-09-14T06:00:07.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004660923 2024-09-14T06:00:07.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334289+0000", 2024-09-14T06:00:07.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4041999999999994e-05 2024-09-14T06:00:07.612 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.613 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.613 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.613 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3630 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'32, mlcod=31'25)", 2024-09-14T06:00:07.613 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.330230+0000", 2024-09-14T06:00:07.613 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 50.276688348, 2024-09-14T06:00:07.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0040991680000000003, 2024-09-14T06:00:07.613 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.613 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.613 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.613 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330230+0000", 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330231+0000", 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4099999999999998e-07 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330235+0000", 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.391e-06 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330245+0000", 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6169999999999996e-06 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330249+0000", 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330301+0000", 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1515999999999999e-05 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.330312+0000", 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1603000000000001e-05 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334293+0000", 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039809449999999996 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334329+0000", 2024-09-14T06:00:07.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5763000000000003e-05 2024-09-14T06:00:07.617 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.617 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.617 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.617 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3632 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'34, mlcod=31'27)", 2024-09-14T06:00:07.617 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:00:07.617 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 50.274314165, 2024-09-14T06:00:07.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047983469999999997, 2024-09-14T06:00:07.617 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.617 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.617 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.617 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332605+0000", 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5099999999999999e-07 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332611+0000", 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6999999999999996e-06 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332623+0000", 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2401e-05 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332629+0000", 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3720000000000001e-06 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332691+0000", 2024-09-14T06:00:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1451000000000005e-05 2024-09-14T06:00:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332711+0000", 2024-09-14T06:00:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0285e-05 2024-09-14T06:00:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337341+0000", 2024-09-14T06:00:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046295900000000003 2024-09-14T06:00:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337402+0000", 2024-09-14T06:00:07.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1797000000000005e-05 2024-09-14T06:00:07.621 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.621 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.621 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.621 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3633 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'35, mlcod=31'27)", 2024-09-14T06:00:07.621 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.333466+0000", 2024-09-14T06:00:07.621 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 50.273452720000002, 2024-09-14T06:00:07.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039783919999999999, 2024-09-14T06:00:07.622 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.622 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.622 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.622 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T06:00:07.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T06:00:07.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.623 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.623 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333466+0000", 2024-09-14T06:00:07.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1500000000000004e-07 2024-09-14T06:00:07.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.623 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.623 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333479+0000", 2024-09-14T06:00:07.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2918999999999999e-05 2024-09-14T06:00:07.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.623 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.623 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333489+0000", 2024-09-14T06:00:07.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0068000000000001e-05 2024-09-14T06:00:07.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.624 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.624 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333494+0000", 2024-09-14T06:00:07.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9309999999999999e-06 2024-09-14T06:00:07.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.624 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.624 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333543+0000", 2024-09-14T06:00:07.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9293999999999999e-05 2024-09-14T06:00:07.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.333555+0000", 2024-09-14T06:00:07.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1467e-05 2024-09-14T06:00:07.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337408+0000", 2024-09-14T06:00:07.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038532549999999999 2024-09-14T06:00:07.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337444+0000", 2024-09-14T06:00:07.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5843000000000002e-05 2024-09-14T06:00:07.626 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.626 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.626 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.626 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3638 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'40, mlcod=31'32)", 2024-09-14T06:00:07.626 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:00:07.626 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 50.268172249999999, 2024-09-14T06:00:07.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004283345, 2024-09-14T06:00:07.626 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.626 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.626 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.626 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:00:07.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:00:07.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338747+0000", 2024-09-14T06:00:07.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:00:07.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.628 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.628 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338756+0000", 2024-09-14T06:00:07.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5909999999999996e-06 2024-09-14T06:00:07.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.628 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.628 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338774+0000", 2024-09-14T06:00:07.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8073000000000001e-05 2024-09-14T06:00:07.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.628 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.628 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338785+0000", 2024-09-14T06:00:07.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1017e-05 2024-09-14T06:00:07.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338844+0000", 2024-09-14T06:00:07.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9292000000000001e-05 2024-09-14T06:00:07.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338864+0000", 2024-09-14T06:00:07.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9528999999999999e-05 2024-09-14T06:00:07.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.630 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.342984+0000", 2024-09-14T06:00:07.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041207809999999996 2024-09-14T06:00:07.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.630 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.343029+0000", 2024-09-14T06:00:07.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5034000000000003e-05 2024-09-14T06:00:07.630 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.630 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.630 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.631 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:11218 3.9 e38/24 3:967d83c0:::rbd_data.1127ff8b71e0.0000000000000064:head v 38'37, mlcod=38'35)", 2024-09-14T06:00:07.631 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:26.244852+0000", 2024-09-14T06:00:07.631 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 41.362066136999999, 2024-09-14T06:00:07.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004035416, 2024-09-14T06:00:07.631 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.631 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.631 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.631 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T06:00:07.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244852+0000", 2024-09-14T06:00:07.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.244854+0000", 2024-09-14T06:00:07.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2350000000000002e-06 2024-09-14T06:00:07.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246114+0000", 2024-09-14T06:00:07.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012600980000000001 2024-09-14T06:00:07.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.633 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.633 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246158+0000", 2024-09-14T06:00:07.633 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3473000000000002e-05 2024-09-14T06:00:07.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.633 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.633 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246179+0000", 2024-09-14T06:00:07.633 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0738999999999999e-05 2024-09-14T06:00:07.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.633 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246306+0000", 2024-09-14T06:00:07.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000127238 2024-09-14T06:00:07.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.246349+0000", 2024-09-14T06:00:07.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3211999999999999e-05 2024-09-14T06:00:07.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248780+0000", 2024-09-14T06:00:07.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0024304970000000002 2024-09-14T06:00:07.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:26.248888+0000", 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010792400000000001 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:17596 3.4 e41/24 3:27f62511:::rbd_data.1127d65075f9.00000000000000ca:head v 41'97, mlcod=41'95)", 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 37.636419685999996, 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049456559999999997, 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.635 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.636 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:00:07.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:00:07.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970500+0000", 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9600000000000008e-07 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970614+0000", 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000113956 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970631+0000", 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7150999999999999e-05 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.637 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970643+0000", 2024-09-14T06:00:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1868999999999999e-05 2024-09-14T06:00:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970711+0000", 2024-09-14T06:00:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8952e-05 2024-09-14T06:00:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970738+0000", 2024-09-14T06:00:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6055999999999999e-05 2024-09-14T06:00:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.639 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.639 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975388+0000", 2024-09-14T06:00:07.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046502499999999999 2024-09-14T06:00:07.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.639 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.639 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975444+0000", 2024-09-14T06:00:07.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6425999999999998e-05 2024-09-14T06:00:07.639 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.639 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.639 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24289 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'57, mlcod=41'54)", 2024-09-14T06:00:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:00:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 35.451127507000002, 2024-09-14T06:00:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.060867738999999997, 2024-09-14T06:00:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:00:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:00:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155793+0000", 2024-09-14T06:00:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9470000000000002e-06 2024-09-14T06:00:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181776+0000", 2024-09-14T06:00:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.02598313 2024-09-14T06:00:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181817+0000", 2024-09-14T06:00:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1440000000000003e-05 2024-09-14T06:00:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181834+0000", 2024-09-14T06:00:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6979000000000001e-05 2024-09-14T06:00:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181931+0000", 2024-09-14T06:00:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7219999999999994e-05 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181964+0000", 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2094999999999997e-05 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216586+0000", 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034622503999999998 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216658+0000", 2024-09-14T06:00:07.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2423999999999996e-05 2024-09-14T06:00:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24309 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'58, mlcod=41'56)", 2024-09-14T06:00:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:00:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 35.351892401999997, 2024-09-14T06:00:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044435519999999999, 2024-09-14T06:00:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255027+0000", 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255040+0000", 2024-09-14T06:00:07.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2773e-05 2024-09-14T06:00:07.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255066+0000", 2024-09-14T06:00:07.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5459000000000001e-05 2024-09-14T06:00:07.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255076+0000", 2024-09-14T06:00:07.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0372e-05 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255151+0000", 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5444999999999993e-05 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255176+0000", 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5089e-05 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259379+0000", 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042025439999999999 2024-09-14T06:00:07.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259469+0000", 2024-09-14T06:00:07.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0407000000000004e-05 2024-09-14T06:00:07.648 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.648 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.648 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.648 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37361 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'280, mlcod=50'278)", 2024-09-14T06:00:07.648 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:00:07.648 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.565732144000002, 2024-09-14T06:00:07.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075534590000000002, 2024-09-14T06:00:07.648 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.650 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041187+0000", 2024-09-14T06:00:07.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2160000000000001e-06 2024-09-14T06:00:07.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.650 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.650 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041208+0000", 2024-09-14T06:00:07.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0528999999999999e-05 2024-09-14T06:00:07.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.650 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.650 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041225+0000", 2024-09-14T06:00:07.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7255e-05 2024-09-14T06:00:07.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041235+0000", 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4190000000000008e-06 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041302+0000", 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7774000000000005e-05 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041330+0000", 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7382999999999999e-05 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048686+0000", 2024-09-14T06:00:07.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073564570000000003 2024-09-14T06:00:07.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048740+0000", 2024-09-14T06:00:07.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3426e-05 2024-09-14T06:00:07.652 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.652 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.652 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.652 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37362 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'281, mlcod=50'278)", 2024-09-14T06:00:07.653 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:00:07.653 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.560831745000002, 2024-09-14T06:00:07.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047169380000000004, 2024-09-14T06:00:07.653 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.653 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.653 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.653 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:00:07.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.654 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:00:07.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.654 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.654 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046087+0000", 2024-09-14T06:00:07.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3600000000000003e-07 2024-09-14T06:00:07.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.654 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.654 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046093+0000", 2024-09-14T06:00:07.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7869999999999998e-06 2024-09-14T06:00:07.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.655 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.655 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046106+0000", 2024-09-14T06:00:07.655 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2636999999999999e-05 2024-09-14T06:00:07.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.655 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.655 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046113+0000", 2024-09-14T06:00:07.655 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0129999999999996e-06 2024-09-14T06:00:07.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.655 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.655 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046170+0000", 2024-09-14T06:00:07.655 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7819000000000003e-05 2024-09-14T06:00:07.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046194+0000", 2024-09-14T06:00:07.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3167999999999999e-05 2024-09-14T06:00:07.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050760+0000", 2024-09-14T06:00:07.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045665999999999997 2024-09-14T06:00:07.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050803+0000", 2024-09-14T06:00:07.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3177999999999999e-05 2024-09-14T06:00:07.657 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.657 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.657 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.657 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39545 3.0 e50/24 3:06bdaf45:::rbd_data.112781171282.0000000000000002:head v 50'347, mlcod=50'345)", 2024-09-14T06:00:07.657 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:00:07.657 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.028451463, 2024-09-14T06:00:07.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047008700000000002, 2024-09-14T06:00:07.657 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.657 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.657 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.657 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:00:07.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:00:07.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578468+0000", 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1599999999999999e-06 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579733+0000", 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012647120000000001 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579755+0000", 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2637999999999999e-05 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.659 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579766+0000", 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0264e-05 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579832+0000", 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6531000000000004e-05 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579859+0000", 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6855999999999998e-05 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.660 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583098+0000", 2024-09-14T06:00:07.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003238632 2024-09-14T06:00:07.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.661 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583168+0000", 2024-09-14T06:00:07.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0077e-05 2024-09-14T06:00:07.661 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.661 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.661 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.661 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39602 3.9 e50/24 3:909cb01b:::rbd_data.112781171282.000000000000006f:head v 50'86, mlcod=50'84)", 2024-09-14T06:00:07.661 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.746165+0000", 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.860753493000001, 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041492480000000003, 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746165+0000", 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746165+0000", 2024-09-14T06:00:07.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746166+0000", 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3600000000000002e-07 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746287+0000", 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000120927 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746297+0000", 2024-09-14T06:00:07.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0395e-05 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746302+0000", 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2379999999999997e-06 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746362+0000", 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9765999999999997e-05 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.746385+0000", 2024-09-14T06:00:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3357999999999999e-05 2024-09-14T06:00:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.750213+0000", 2024-09-14T06:00:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038276019999999998 2024-09-14T06:00:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.750314+0000", 2024-09-14T06:00:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010112599999999999 2024-09-14T06:00:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39765 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'410, mlcod=51'406)", 2024-09-14T06:00:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:00:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.602496662, 2024-09-14T06:00:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044953839999999998, 2024-09-14T06:00:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:00:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004423+0000", 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1909999999999999e-06 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004432+0000", 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2180000000000005e-06 2024-09-14T06:00:07.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004453+0000", 2024-09-14T06:00:07.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1182000000000001e-05 2024-09-14T06:00:07.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004464+0000", 2024-09-14T06:00:07.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1198e-05 2024-09-14T06:00:07.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004520+0000", 2024-09-14T06:00:07.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5835999999999999e-05 2024-09-14T06:00:07.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004547+0000", 2024-09-14T06:00:07.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6454000000000001e-05 2024-09-14T06:00:07.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008866+0000", 2024-09-14T06:00:07.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043194679999999999 2024-09-14T06:00:07.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008917+0000", 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0837000000000001e-05 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39847 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'431, mlcod=51'426)", 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.489213313, 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046358010000000002, 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.670 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117706+0000", 2024-09-14T06:00:07.671 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4899999999999995e-07 2024-09-14T06:00:07.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.672 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.672 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117711+0000", 2024-09-14T06:00:07.672 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6890000000000001e-06 2024-09-14T06:00:07.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.672 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.672 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117724+0000", 2024-09-14T06:00:07.672 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3054000000000001e-05 2024-09-14T06:00:07.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.672 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117736+0000", 2024-09-14T06:00:07.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1654999999999999e-05 2024-09-14T06:00:07.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.673 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117788+0000", 2024-09-14T06:00:07.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2197000000000002e-05 2024-09-14T06:00:07.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.673 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117811+0000", 2024-09-14T06:00:07.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2472000000000001e-05 2024-09-14T06:00:07.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.674 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.674 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122292+0000", 2024-09-14T06:00:07.674 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004481596 2024-09-14T06:00:07.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.674 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.674 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122341+0000", 2024-09-14T06:00:07.674 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8489000000000003e-05 2024-09-14T06:00:07.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.674 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.675 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39865 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'438, mlcod=51'434)", 2024-09-14T06:00:07.675 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:00:07.675 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.461879015000001, 2024-09-14T06:00:07.675 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004519426, 2024-09-14T06:00:07.675 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.675 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.675 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.675 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.675 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.675 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:00:07.675 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.676 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.676 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:00:07.676 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.676 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.676 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145040+0000", 2024-09-14T06:00:07.676 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7899999999999998e-07 2024-09-14T06:00:07.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.676 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.676 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145044+0000", 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3789999999999999e-06 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145053+0000", 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2650000000000002e-06 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145058+0000", 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8169999999999998e-06 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.677 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145105+0000", 2024-09-14T06:00:07.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7176999999999999e-05 2024-09-14T06:00:07.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145119+0000", 2024-09-14T06:00:07.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3179e-05 2024-09-14T06:00:07.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149512+0000", 2024-09-14T06:00:07.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043934389999999999 2024-09-14T06:00:07.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.679 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.679 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149559+0000", 2024-09-14T06:00:07.679 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6591000000000002e-05 2024-09-14T06:00:07.679 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.679 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.679 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.679 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39866 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'439, mlcod=51'434)", 2024-09-14T06:00:07.679 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145610+0000", 2024-09-14T06:00:07.679 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.461308076000002, 2024-09-14T06:00:07.679 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039787060000000003, 2024-09-14T06:00:07.679 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145610+0000", 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145610+0000", 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.680 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.681 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145611+0000", 2024-09-14T06:00:07.681 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7599999999999997e-07 2024-09-14T06:00:07.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.681 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.681 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145615+0000", 2024-09-14T06:00:07.681 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1309999999999999e-06 2024-09-14T06:00:07.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.681 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.681 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145624+0000", 2024-09-14T06:00:07.681 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8480000000000007e-06 2024-09-14T06:00:07.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145629+0000", 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7840000000000003e-06 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145679+0000", 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0206e-05 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145699+0000", 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0015999999999999e-05 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149561+0000", 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038619969999999998 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149589+0000", 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8147999999999999e-05 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40245 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'513, mlcod=52'509)", 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:00:07.683 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.683326987000001, 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053460410000000002, 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923592+0000", 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6599999999999996e-07 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923598+0000", 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.083e-06 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923609+0000", 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1137e-05 2024-09-14T06:00:07.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.686 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.686 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923617+0000", 2024-09-14T06:00:07.686 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.401e-06 2024-09-14T06:00:07.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.686 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.686 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924037+0000", 2024-09-14T06:00:07.686 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042046 2024-09-14T06:00:07.686 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.686 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.686 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.686 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924082+0000", 2024-09-14T06:00:07.686 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4617000000000003e-05 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928882+0000", 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048000889999999996 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928937+0000", 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5587999999999997e-05 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.687 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40246 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'514, mlcod=52'509)", 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.682292472, 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043609649999999996, 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.688 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:00:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:00:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2099999999999996e-07 2024-09-14T06:00:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924631+0000", 2024-09-14T06:00:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8450000000000002e-06 2024-09-14T06:00:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.689 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924641+0000", 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0057e-05 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924649+0000", 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5669999999999997e-06 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925127+0000", 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00047783800000000001 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.690 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925171+0000", 2024-09-14T06:00:07.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4017000000000002e-05 2024-09-14T06:00:07.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.691 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928942+0000", 2024-09-14T06:00:07.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037716809999999998 2024-09-14T06:00:07.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.691 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.691 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.691 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928987+0000", 2024-09-14T06:00:07.691 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4338999999999997e-05 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:46646 3.0 e56/24 3:01acbe3d:::rbd_data.1127f2f8ff9b.0000000000000015:head v 56'541, mlcod=55'538)", 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.145506202, 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064775850000000001, 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.692 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:00:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:00:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461415+0000", 2024-09-14T06:00:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.666e-06 2024-09-14T06:00:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.694 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:07.694 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463456+0000", 2024-09-14T06:00:07.694 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00204177 2024-09-14T06:00:07.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.694 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:07.694 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463488+0000", 2024-09-14T06:00:07.694 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1503e-05 2024-09-14T06:00:07.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.694 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.694 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:07.694 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463508+0000", 2024-09-14T06:00:07.694 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9788000000000001e-05 2024-09-14T06:00:07.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.695 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:07.695 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463697+0000", 2024-09-14T06:00:07.695 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018873499999999999 2024-09-14T06:00:07.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.695 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:07.695 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463741+0000", 2024-09-14T06:00:07.695 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4333999999999999e-05 2024-09-14T06:00:07.695 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.695 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.695 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:07.695 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467845+0000", 2024-09-14T06:00:07.696 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041041430000000002 2024-09-14T06:00:07.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:07.696 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:07.696 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:07.696 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467890+0000", 2024-09-14T06:00:07.696 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4645999999999999e-05 2024-09-14T06:00:07.696 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.696 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.696 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.696 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:07.696 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:07.696 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:07.697 INFO:teuthology.orchestra.run.smithi006.stdout:3679 write 0x79e0514 thru 0x79e9109 (0x8bf6 bytes) 2024-09-14T06:00:07.698 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:00:07.698 INFO:teuthology.orchestra.run.smithi006.stdout:3682 write 0x12efe3f thru 0x12f13ff (0x15c1 bytes) 2024-09-14T06:00:07.698 INFO:teuthology.orchestra.run.smithi006.stdout:3684 clone 24 order 20 su 32768 sc 15 2024-09-14T06:00:07.708 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:07.704+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:07.809 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:07.808+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:07.865 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:07.865 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:07.865 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:00:07.865 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:07.879 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:00:07.910 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:07.908+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:07.995 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T06:00:08.011 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:08.008+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:08.015 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:08.016 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:08.016 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:08.016 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:08.016 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:08.031 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:00:08.095 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone23 from 0xc3b05f0 (overlap 0xc3b05f0) to 0x88fb75b 2024-09-14T06:00:08.112 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:08.109+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:08.213 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:08.212+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:08.248 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:08.249 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:00:08.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:00:08.249 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:08.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.249 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54658 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 610304~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.249 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:08.249 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.108344912, 2024-09-14T06:00:08.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091840061000000001, 2024-09-14T06:00:08.249 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.249 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.249 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.249 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.249 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54658 2024-09-14T06:00:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4700000000000002e-07 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139687+0000", 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7170000000000008e-06 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139694+0000", 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.063e-06 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139709+0000", 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4324999999999999e-05 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231262+0000", 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091553866999999997 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231375+0000", 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000112927 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231519+0000", 2024-09-14T06:00:08.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014371499999999999 2024-09-14T06:00:08.253 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.253 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.253 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.253 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54659 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 616448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.253 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:08.253 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.108306564999999, 2024-09-14T06:00:08.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092177035000000004, 2024-09-14T06:00:08.254 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.254 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.254 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.254 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.254 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.254 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.254 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54659 2024-09-14T06:00:08.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.254 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.254 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:08.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:08.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139718+0000", 2024-09-14T06:00:08.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9699999999999996e-07 2024-09-14T06:00:08.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139731+0000", 2024-09-14T06:00:08.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2993000000000001e-05 2024-09-14T06:00:08.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139738+0000", 2024-09-14T06:00:08.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4610000000000002e-06 2024-09-14T06:00:08.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139744+0000", 2024-09-14T06:00:08.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6389999999999997e-06 2024-09-14T06:00:08.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231570+0000", 2024-09-14T06:00:08.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091826216000000002 2024-09-14T06:00:08.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231662+0000", 2024-09-14T06:00:08.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2101000000000005e-05 2024-09-14T06:00:08.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.258 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.258 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231894+0000", 2024-09-14T06:00:08.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023212800000000001 2024-09-14T06:00:08.258 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.258 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.258 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.258 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54660 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 622592~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.258 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:08.258 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.108271231, 2024-09-14T06:00:08.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092366887999999994, 2024-09-14T06:00:08.258 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.259 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.259 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.259 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.259 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.259 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.259 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54660 2024-09-14T06:00:08.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.259 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:08.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T06:00:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139755+0000", 2024-09-14T06:00:08.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T06:00:08.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.261 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139762+0000", 2024-09-14T06:00:08.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6719999999999998e-06 2024-09-14T06:00:08.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.261 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139767+0000", 2024-09-14T06:00:08.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9819999999999999e-06 2024-09-14T06:00:08.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231917+0000", 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092149872999999993 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231969+0000", 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2642000000000002e-05 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232120+0000", 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015011899999999999 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.262 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54844 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 0~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.10824974, 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092708507999999995, 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54844 2024-09-14T06:00:08.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.264 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:08.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:08.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139775+0000", 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3500000000000002e-07 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139777+0000", 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.979e-06 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139787+0000", 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0779e-05 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139799+0000", 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1719000000000001e-05 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232151+0000", 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092351767000000001 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232217+0000", 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6655000000000005e-05 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232483+0000", 2024-09-14T06:00:08.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026517400000000002 2024-09-14T06:00:08.267 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.267 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.267 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.267 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54845 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 55296~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.267 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:08.267 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.108216068999999, 2024-09-14T06:00:08.267 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093127583999999999, 2024-09-14T06:00:08.267 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.267 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.267 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.267 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.267 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54845 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.268 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4899999999999995e-07 2024-09-14T06:00:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139811+0000", 2024-09-14T06:00:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000001e-06 2024-09-14T06:00:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139821+0000", 2024-09-14T06:00:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0168e-05 2024-09-14T06:00:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139826+0000", 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2780000000000001e-06 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232556+0000", 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092729729999999996 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232652+0000", 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680999999999994e-05 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232935+0000", 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000283758 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54846 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.108189762, 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093492079000000006, 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.271 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54846 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.273 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.273 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139835+0000", 2024-09-14T06:00:08.273 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T06:00:08.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.273 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.273 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139837+0000", 2024-09-14T06:00:08.273 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1059999999999998e-06 2024-09-14T06:00:08.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.273 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.273 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139845+0000", 2024-09-14T06:00:08.273 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4300000000000006e-06 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139851+0000", 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232987+0000", 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093136073999999999 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233075+0000", 2024-09-14T06:00:08.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7318999999999995e-05 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233326+0000", 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025159 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54847 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 67584~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.108164046000001, 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093777452999999997, 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.275 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54847 2024-09-14T06:00:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.276 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139862+0000", 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0200000000000001e-06 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139870+0000", 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0520000000000002e-06 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139875+0000", 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233389+0000", 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093514054999999999 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233443+0000", 2024-09-14T06:00:08.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3913999999999999e-05 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233637+0000", 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019392899999999999 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54848 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 73728~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.108140949999999, 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094064464, 2024-09-14T06:00:08.279 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54848 2024-09-14T06:00:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:08.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:08.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T06:00:08.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139885+0000", 2024-09-14T06:00:08.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9929999999999998e-06 2024-09-14T06:00:08.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139893+0000", 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9759999999999995e-06 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139898+0000", 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6059999999999996e-06 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233681+0000", 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093782921000000005 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233730+0000", 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9410999999999998e-05 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233947+0000", 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021710300000000001 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54849 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:08.283 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.108117494, 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094499257000000003, 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54849 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:08.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139907+0000", 2024-09-14T06:00:08.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T06:00:08.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139909+0000", 2024-09-14T06:00:08.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T06:00:08.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139916+0000", 2024-09-14T06:00:08.286 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T06:00:08.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139921+0000", 2024-09-14T06:00:08.286 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:00:08.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234032+0000", 2024-09-14T06:00:08.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094111037999999994 2024-09-14T06:00:08.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.287 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234150+0000", 2024-09-14T06:00:08.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118408 2024-09-14T06:00:08.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.287 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234406+0000", 2024-09-14T06:00:08.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025540600000000001 2024-09-14T06:00:08.287 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.287 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.287 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54850 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 135168~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.108095786, 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094814605999999996, 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54850 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.288 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:08.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:08.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139929+0000", 2024-09-14T06:00:08.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T06:00:08.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.290 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139931+0000", 2024-09-14T06:00:08.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.024e-06 2024-09-14T06:00:08.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.290 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139937+0000", 2024-09-14T06:00:08.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3770000000000001e-06 2024-09-14T06:00:08.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139942+0000", 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0289999999999996e-06 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234447+0000", 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094505426000000003 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234539+0000", 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1793999999999996e-05 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234743+0000", 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020354600000000001 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54851 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 141312~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.108074073999999, 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095179749999999994, 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.292 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54851 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:08.293 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139952+0000", 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0600000000000002e-06 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139959+0000", 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.584e-06 2024-09-14T06:00:08.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139964+0000", 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8890000000000001e-06 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234786+0000", 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094822241000000002 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234877+0000", 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1158999999999999e-05 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235130+0000", 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025235999999999998 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54852 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 147456~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.108052946000001, 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095437742000000006, 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.296 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54852 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140125+0000", 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154332 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140130+0000", 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.284e-06 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140140+0000", 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0789e-05 2024-09-14T06:00:08.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140147+0000", 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9879999999999998e-06 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235174+0000", 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095026749999999993 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235230+0000", 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6224000000000002e-05 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235409+0000", 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017837500000000001 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54853 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 202752~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.107864124000001, 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095632919999999996, 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.300 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54853 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147748+0000", 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075884910000000002 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147798+0000", 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0152999999999999e-05 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147814+0000", 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5866e-05 2024-09-14T06:00:08.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147831+0000", 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6991999999999999e-05 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235451+0000", 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087620077000000005 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235539+0000", 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7800000000000006e-05 2024-09-14T06:00:08.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235793+0000", 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025354099999999998 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54868 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 442368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.099673804, 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091802783999999998, 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.304 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54868 2024-09-14T06:00:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.305 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148351+0000", 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6800000000000001e-07 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148353+0000", 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2299999999999998e-06 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.306 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148362+0000", 2024-09-14T06:00:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9800000000000004e-06 2024-09-14T06:00:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148367+0000", 2024-09-14T06:00:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.327e-06 2024-09-14T06:00:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.239863+0000", 2024-09-14T06:00:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091496018999999998 2024-09-14T06:00:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.307 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.308 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.239932+0000", 2024-09-14T06:00:08.308 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8838999999999996e-05 2024-09-14T06:00:08.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.308 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.308 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240153+0000", 2024-09-14T06:00:08.308 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00022092100000000001 2024-09-14T06:00:08.308 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.308 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.308 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.308 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54869 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 497664~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.309 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:08.309 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.099647906, 2024-09-14T06:00:08.309 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092147413999999997, 2024-09-14T06:00:08.309 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.309 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.309 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.309 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.309 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.309 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.309 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54869 2024-09-14T06:00:08.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.309 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.310 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:08.310 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.310 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:08.310 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.310 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148377+0000", 2024-09-14T06:00:08.310 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1399999999999997e-07 2024-09-14T06:00:08.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148379+0000", 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.429e-06 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148389+0000", 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9029999999999999e-06 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148395+0000", 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5080000000000002e-06 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240191+0000", 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091796066999999995 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240284+0000", 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2445e-05 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240523+0000", 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023954799999999999 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.312 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54870 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 503808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.099618576999999, 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092420756000000007, 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54870 2024-09-14T06:00:08.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148406+0000", 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T06:00:08.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148409+0000", 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148418+0000", 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7329999999999998e-06 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148425+0000", 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2079999999999997e-06 2024-09-14T06:00:08.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240591+0000", 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092166441000000002 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240648+0000", 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6733e-05 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240826+0000", 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017834700000000001 2024-09-14T06:00:08.316 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54871 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 509952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.099588617, 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092702341999999993, 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54871 2024-09-14T06:00:08.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148436+0000", 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5499999999999998e-07 2024-09-14T06:00:08.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148439+0000", 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8090000000000001e-06 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148449+0000", 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0115000000000001e-05 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148466+0000", 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6761000000000001e-05 2024-09-14T06:00:08.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240857+0000", 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092391089999999995 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240939+0000", 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2387999999999998e-05 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241138+0000", 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000198624 2024-09-14T06:00:08.320 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54872 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 516096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.099547419, 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093126020000000004, 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.321 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54872 2024-09-14T06:00:08.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.322 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:08.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:08.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155484+0000", 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070072429999999998 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155490+0000", 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6379999999999998e-06 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155504+0000", 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4065e-05 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155513+0000", 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6799999999999999e-06 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241216+0000", 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085702922000000001 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241277+0000", 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0980000000000002e-05 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241602+0000", 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032549199999999998 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54888 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 114688~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.092102938, 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091627085999999996, 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.325 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54888 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:08.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8299999999999998e-07 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155923+0000", 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4720000000000001e-06 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155926+0000", 2024-09-14T06:00:08.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.444e-06 2024-09-14T06:00:08.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155929+0000", 2024-09-14T06:00:08.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:08.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247321+0000", 2024-09-14T06:00:08.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091391587999999996 2024-09-14T06:00:08.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247382+0000", 2024-09-14T06:00:08.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1944000000000002e-05 2024-09-14T06:00:08.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247548+0000", 2024-09-14T06:00:08.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000165558 2024-09-14T06:00:08.329 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.329 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.329 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.329 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54889 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 169984~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:08.329 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:08.329 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 14.092090338, 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091908118999999996, 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54889 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:08.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:08.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:08.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:08.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163444+0000", 2024-09-14T06:00:08.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00751033 2024-09-14T06:00:08.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:08.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163454+0000", 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0579e-05 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163468+0000", 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3794999999999999e-05 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163487+0000", 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8907999999999999e-05 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:08.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247591+0000", 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084103333000000002 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247651+0000", 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0587000000000001e-05 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247842+0000", 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019058700000000001 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:08.334 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:08.334 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:08.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:00:08.335 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:08.336+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:08.396 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-14T06:00:08.415 INFO:teuthology.orchestra.run.smithi006.stdout:3685 write 0x3820d76 thru 0x3828586 (0x7811 bytes) 2024-09-14T06:00:08.433 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:08.433 INFO:teuthology.orchestra.run.smithi006.stdout:3689 write 0xad90ae4 thru 0xad96776 (0x5c93 bytes) 2024-09-14T06:00:08.436 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:08.433+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:08.439 INFO:teuthology.orchestra.run.smithi006.stdout:3690 read 0x457b6e4 thru 0x457f8ae (0x41cb bytes) 2024-09-14T06:00:08.439 INFO:teuthology.orchestra.run.smithi006.stdout:3691 trunc from 0xc3b05f0 to 0xc60f0df 2024-09-14T06:00:08.450 INFO:teuthology.orchestra.run.smithi006.stdout:3692 read 0x8e0b2ab thru 0x8e13ec3 (0x8c19 bytes) 2024-09-14T06:00:08.450 INFO:teuthology.orchestra.run.smithi006.stdout:3693 write 0x48115e7 thru 0x4819672 (0x808c bytes) 2024-09-14T06:00:08.457 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:08.457 INFO:teuthology.orchestra.run.smithi006.stdout:3695 read 0x6b2088b thru 0x6b26208 (0x597e bytes) 2024-09-14T06:00:08.457 INFO:teuthology.orchestra.run.smithi006.stdout:3696 writesame 0x691cfae thru 0x6925472 data_size 0x1(0x84c5 bytes) 2024-09-14T06:00:08.475 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:08.475 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:08.475 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:08.475 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:08.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:00:08.498 INFO:teuthology.orchestra.run.smithi006.stdout:3698 punch from 0xb820c39 to 0xb82b738, (0xaaff bytes) 2024-09-14T06:00:08.498 INFO:teuthology.orchestra.run.smithi006.stdout:3699 write 0x2472ffa thru 0x247ded8 (0xaedf bytes) 2024-09-14T06:00:08.519 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:08.519 INFO:teuthology.orchestra.run.smithi006.stdout:3701 write 0x52d28fc thru 0x52d932c (0x6a31 bytes) 2024-09-14T06:00:08.529 INFO:teuthology.orchestra.run.smithi006.stdout:3703 punch from 0xa1f5c23 to 0xa1fd389, (0x7766 bytes) 2024-09-14T06:00:08.529 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:08.529 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:08.529 INFO:teuthology.orchestra.run.smithi006.stdout:3707 write 0xbce3bd3 thru 0xbceb00f (0x743d bytes) 2024-09-14T06:00:08.537 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:08.533+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:08.543 INFO:teuthology.orchestra.run.smithi006.stdout:3710 write 0xb35255d thru 0xb35d619 (0xb0bd bytes) 2024-09-14T06:00:08.563 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:08.563 INFO:teuthology.orchestra.run.smithi006.stdout:3712 read 0xbcd0db8 thru 0xbcd6204 (0x544d bytes) 2024-09-14T06:00:08.564 INFO:teuthology.orchestra.run.smithi006.stdout:3713 read 0x45a7d6e thru 0x45aa0f8 (0x238b bytes) 2024-09-14T06:00:08.564 INFO:teuthology.orchestra.run.smithi006.stdout:3714 read 0x158508e thru 0x158707c (0x1fef bytes) 2024-09-14T06:00:08.565 INFO:teuthology.orchestra.run.smithi006.stdout:3716 punch from 0x86ff04a to 0x87079dc, (0x8992 bytes) 2024-09-14T06:00:08.565 INFO:teuthology.orchestra.run.smithi006.stdout:3719 write 0xa0fc37a thru 0xa103b65 (0x77ec bytes) 2024-09-14T06:00:08.583 INFO:teuthology.orchestra.run.smithi006.stdout:3720 trunc from 0xc60f0df to 0xdf4876e 2024-09-14T06:00:08.595 INFO:teuthology.orchestra.run.smithi006.stdout:3721 read 0x2a1288b thru 0x2a1d98b (0xb101 bytes) 2024-09-14T06:00:08.596 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:08.596 INFO:teuthology.orchestra.run.smithi006.stdout:3723 write 0x771288b thru 0x7718438 (0x5bae bytes) 2024-09-14T06:00:08.616 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:08.616 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:08.616 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:08.616 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:08.616 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:08.630 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:00:08.634 INFO:teuthology.orchestra.run.smithi006.stdout:3725 trunc from 0xdf4876e to 0x417c2a5 2024-09-14T06:00:08.638 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:08.633+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:08.709 INFO:teuthology.orchestra.run.smithi006.stdout:3726 read 0x315a616 thru 0x3162d5e (0x8749 bytes) 2024-09-14T06:00:08.710 INFO:teuthology.orchestra.run.smithi006.stdout:3727 write 0x2723600 thru 0x2724ad9 (0x14da bytes) 2024-09-14T06:00:08.739 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:08.737+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:08.753 INFO:teuthology.orchestra.run.smithi006.stdout:3728 write 0xdb22db1 thru 0xdb25682 (0x28d2 bytes) 2024-09-14T06:00:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:3730 punch from 0xa7b3fb3 to 0xa7bc213, (0x8260 bytes) 2024-09-14T06:00:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:3731 write 0x80f1638 thru 0x80f8b94 (0x755d bytes) 2024-09-14T06:00:08.762 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:08.762 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:08.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:08.762 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:08.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.762 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23550 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 606208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.762 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:08.762 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.813764181000003, 2024-09-14T06:00:08.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048793072999999999, 2024-09-14T06:00:08.763 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.763 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.763 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.763 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23550 2024-09-14T06:00:08.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.763 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:08.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7800000000000002e-07 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948677+0000", 2024-09-14T06:00:08.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1949999999999997e-06 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948687+0000", 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0849000000000001e-05 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948692+0000", 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8670000000000002e-06 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997290+0000", 2024-09-14T06:00:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048597596999999999 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997367+0000", 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7236000000000004e-05 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997462+0000", 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4951000000000006e-05 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23551 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 620544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.813733323999998, 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048938838999999998, 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23551 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1e-07 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948701+0000", 2024-09-14T06:00:08.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2950000000000001e-06 2024-09-14T06:00:08.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948705+0000", 2024-09-14T06:00:08.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7929999999999999e-06 2024-09-14T06:00:08.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948709+0000", 2024-09-14T06:00:08.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T06:00:08.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997535+0000", 2024-09-14T06:00:08.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048826181000000003 2024-09-14T06:00:08.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997580+0000", 2024-09-14T06:00:08.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5355000000000002e-05 2024-09-14T06:00:08.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997639+0000", 2024-09-14T06:00:08.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8479e-05 2024-09-14T06:00:08.770 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.813717846999999, 2024-09-14T06:00:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T06:00:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.771 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.772 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T06:00:08.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.772 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:08.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:08.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T06:00:08.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T06:00:08.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T06:00:08.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T06:00:08.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T06:00:08.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T06:00:08.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T06:00:08.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T06:00:08.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T06:00:08.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T06:00:08.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T06:00:08.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T06:00:08.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T06:00:08.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T06:00:08.775 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.775 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.775 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.775 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.775 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:08.776 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.813698572, 2024-09-14T06:00:08.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T06:00:08.776 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.776 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.776 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.776 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.776 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.776 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.776 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T06:00:08.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:08.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T06:00:08.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T06:00:08.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T06:00:08.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T06:00:08.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T06:00:08.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T06:00:08.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T06:00:08.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T06:00:08.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T06:00:08.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T06:00:08.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T06:00:08.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T06:00:08.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T06:00:08.780 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.780 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.780 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.780 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.780 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:08.780 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.813678996, 2024-09-14T06:00:08.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T06:00:08.781 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.781 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.781 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.781 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T06:00:08.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.781 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:08.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:08.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T06:00:08.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T06:00:08.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T06:00:08.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T06:00:08.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T06:00:08.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:08.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T06:00:08.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T06:00:08.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T06:00:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T06:00:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T06:00:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T06:00:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T06:00:08.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.813659539, 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.785 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:08.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T06:00:08.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T06:00:08.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T06:00:08.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T06:00:08.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T06:00:08.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T06:00:08.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T06:00:08.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.789 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.789 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.789 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:08.789 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.813640487999997, 2024-09-14T06:00:08.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T06:00:08.790 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.790 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.790 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.790 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T06:00:08.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.790 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:08.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T06:00:08.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T06:00:08.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T06:00:08.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T06:00:08.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T06:00:08.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T06:00:08.793 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.793 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.793 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.813620807, 2024-09-14T06:00:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T06:00:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T06:00:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T06:00:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T06:00:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T06:00:08.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T06:00:08.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T06:00:08.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:08.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T06:00:08.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T06:00:08.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T06:00:08.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T06:00:08.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T06:00:08.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T06:00:08.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.813600856000001, 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.798 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.799 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.799 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T06:00:08.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.799 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:08.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:08.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T06:00:08.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T06:00:08.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T06:00:08.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:00:08.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T06:00:08.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T06:00:08.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T06:00:08.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T06:00:08.802 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.802 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.802 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.802 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.802 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:08.802 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.813581544000002, 2024-09-14T06:00:08.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T06:00:08.803 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.803 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.803 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.803 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.803 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.803 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.803 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T06:00:08.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.803 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:08.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:08.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:08.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T06:00:08.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T06:00:08.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T06:00:08.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T06:00:08.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T06:00:08.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T06:00:08.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T06:00:08.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T06:00:08.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T06:00:08.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T06:00:08.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T06:00:08.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T06:00:08.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.813561782999997, 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.808 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T06:00:08.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.808 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:08.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:08.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T06:00:08.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:00:08.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T06:00:08.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T06:00:08.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T06:00:08.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T06:00:08.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T06:00:08.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T06:00:08.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T06:00:08.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T06:00:08.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T06:00:08.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T06:00:08.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T06:00:08.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T06:00:08.811 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.811 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.811 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.811 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.811 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.813540861999996, 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:08.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T06:00:08.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T06:00:08.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T06:00:08.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T06:00:08.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T06:00:08.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T06:00:08.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T06:00:08.815 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.815 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.815 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.812381528000003, 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.816 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T06:00:08.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.819 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.812082746000002, 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T06:00:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.821 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:08.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:08.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T06:00:08.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T06:00:08.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T06:00:08.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T06:00:08.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T06:00:08.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T06:00:08.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T06:00:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T06:00:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.811932007999999, 2024-09-14T06:00:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T06:00:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T06:00:08.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T06:00:08.828 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.828 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.828 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.828 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23582 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 911360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.828 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:08.828 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.811006620999997, 2024-09-14T06:00:08.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048708939999999999, 2024-09-14T06:00:08.828 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.828 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.829 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.829 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.829 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.829 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.829 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23582 2024-09-14T06:00:08.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.829 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:08.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:08.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:08.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6300000000000005e-07 2024-09-14T06:00:08.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951430+0000", 2024-09-14T06:00:08.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5179999999999999e-06 2024-09-14T06:00:08.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951437+0000", 2024-09-14T06:00:08.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0940000000000002e-06 2024-09-14T06:00:08.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951443+0000", 2024-09-14T06:00:08.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7910000000000001e-06 2024-09-14T06:00:08.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000047+0000", 2024-09-14T06:00:08.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048604550000000003 2024-09-14T06:00:08.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000095+0000", 2024-09-14T06:00:08.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7735999999999998e-05 2024-09-14T06:00:08.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000135+0000", 2024-09-14T06:00:08.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0587999999999998e-05 2024-09-14T06:00:08.832 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.832 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.833 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.833 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23588 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 722944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.833 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:08.833 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.810981755999997, 2024-09-14T06:00:08.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048792653999999998, 2024-09-14T06:00:08.833 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.833 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.833 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.833 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.833 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.833 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.834 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23588 2024-09-14T06:00:08.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.834 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:08.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:08.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951665+0000", 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021337600000000001 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951669+0000", 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3460000000000004e-06 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951688+0000", 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9042000000000002e-05 2024-09-14T06:00:08.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951696+0000", 2024-09-14T06:00:08.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6660000000000008e-06 2024-09-14T06:00:08.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000162+0000", 2024-09-14T06:00:08.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048465824999999997 2024-09-14T06:00:08.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000199+0000", 2024-09-14T06:00:08.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7143e-05 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000244+0000", 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5256000000000002e-05 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23590 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 745472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.810724301, 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048677684999999998, 2024-09-14T06:00:08.837 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23590 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951850+0000", 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014113 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951855+0000", 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6349999999999997e-06 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951863+0000", 2024-09-14T06:00:08.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8189999999999998e-06 2024-09-14T06:00:08.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951871+0000", 2024-09-14T06:00:08.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2030000000000003e-06 2024-09-14T06:00:08.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000283+0000", 2024-09-14T06:00:08.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048412531000000002 2024-09-14T06:00:08.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000338+0000", 2024-09-14T06:00:08.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4462000000000001e-05 2024-09-14T06:00:08.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000387+0000", 2024-09-14T06:00:08.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8905e-05 2024-09-14T06:00:08.841 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.841 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.841 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.186630444999999, 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.663540505999997, 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:08.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T06:00:08.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T06:00:08.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:08.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T06:00:08.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T06:00:08.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T06:00:08.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T06:00:08.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T06:00:08.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T06:00:08.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:08.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:08.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:08.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T06:00:08.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T06:00:08.851 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.851 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.851 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.851 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:08.851 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:08.851 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:08.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:00:08.853 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:08.848+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:08.854 INFO:teuthology.orchestra.run.smithi006.stdout:3732 writesame 0xcd42aab thru 0xcd4fe97 data_size 0x1(0xd3ed bytes) 2024-09-14T06:00:08.854 INFO:teuthology.orchestra.run.smithi006.stdout:3734 read 0x323422a thru 0x323a607 (0x63de bytes) 2024-09-14T06:00:08.854 INFO:teuthology.orchestra.run.smithi006.stdout:3735 read 0x3d84e0d thru 0x3d85bba (0xdae bytes) 2024-09-14T06:00:08.854 INFO:teuthology.orchestra.run.smithi006.stdout:3736 read 0x3b9b6e4 thru 0x3b9c51c (0xe39 bytes) 2024-09-14T06:00:08.854 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:08.854 INFO:teuthology.orchestra.run.smithi006.stdout:3739 writesame 0xcc50cba thru 0xcc55864 data_size 0xb(0x4bab bytes) 2024-09-14T06:00:08.854 INFO:teuthology.orchestra.run.smithi006.stdout:3740 punch from 0x212efe2 to 0x21331b9, (0x41d7 bytes) 2024-09-14T06:00:08.854 INFO:teuthology.orchestra.run.smithi006.stdout:3741 punch from 0x5120283 to 0x51215db, (0x1358 bytes) 2024-09-14T06:00:08.855 INFO:teuthology.orchestra.run.smithi006.stdout:3743 trunc from 0xdb25683 to 0x77afbca 2024-09-14T06:00:08.855 INFO:teuthology.orchestra.run.smithi006.stdout:3745 write 0x306594b thru 0x30756ef (0xfda5 bytes) 2024-09-14T06:00:08.912 INFO:teuthology.orchestra.run.smithi006.stdout:3746 writesame 0xb46441f thru 0xb47330f data_size 0x1(0xeef1 bytes) 2024-09-14T06:00:08.912 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:08.912 INFO:teuthology.orchestra.run.smithi006.stdout:3749 punch from 0x46de3e9 to 0x46e1566, (0x317d bytes) 2024-09-14T06:00:08.932 INFO:teuthology.orchestra.run.smithi006.stdout:3750 write 0xe202380 thru 0xe205581 (0x3202 bytes) 2024-09-14T06:00:08.954 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:08.949+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:08.970 INFO:teuthology.orchestra.run.smithi006.stdout:3751 trunc from 0xe205582 to 0x5d2516 2024-09-14T06:00:09.027 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2024-09-14T06:00:09.051 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:09.051 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:09.051 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:09.055 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:09.053+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:09.071 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:00:09.121 INFO:teuthology.orchestra.run.smithi006.stdout:3752 trunc from 0x5d2516 to 0xce365f4 2024-09-14T06:00:09.128 INFO:teuthology.orchestra.run.smithi006.stdout:3753 read 0x1f767de thru 0x1f80997 (0xa1ba bytes) 2024-09-14T06:00:09.128 INFO:teuthology.orchestra.run.smithi006.stdout:3754 flatten 2024-09-14T06:00:09.136 INFO:teuthology.orchestra.run.smithi006.stdout:3757 write 0xb19fd13 thru 0xb1a45a7 (0x4895 bytes) 2024-09-14T06:00:09.140 INFO:teuthology.orchestra.run.smithi006.stdout:3759 read 0x434dbfd thru 0x434eccb (0x10cf bytes) 2024-09-14T06:00:09.147 INFO:teuthology.orchestra.run.smithi006.stdout:3760 write 0xd71a98f thru 0xd71ca3e (0x20b0 bytes) 2024-09-14T06:00:09.151 INFO:teuthology.orchestra.run.smithi006.stdout:3761 write 0x1bdb0ef thru 0x1be3065 (0x7f77 bytes) 2024-09-14T06:00:09.155 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:09.152+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:09.157 INFO:teuthology.orchestra.run.smithi006.stdout:3762 read 0x7d53691 thru 0x7d5f463 (0xbdd3 bytes) 2024-09-14T06:00:09.169 INFO:teuthology.orchestra.run.smithi006.stdout:3763 trunc from 0xd71ca3f to 0x6118421 2024-09-14T06:00:09.186 INFO:teuthology.orchestra.run.smithi006.stdout:3764 write 0x580776f thru 0x58157d3 (0xe065 bytes) 2024-09-14T06:00:09.194 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:09.194 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:09.194 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:09.195 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:09.195 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:09.198 INFO:teuthology.orchestra.run.smithi006.stdout:3765 punch from 0x100683f to 0x1013d36, (0xd4f7 bytes) 2024-09-14T06:00:09.199 INFO:teuthology.orchestra.run.smithi006.stdout:3767 punch from 0x3a757d2 to 0x3a80030, (0xa85e bytes) 2024-09-14T06:00:09.208 INFO:teuthology.orchestra.run.smithi006.stdout:3768 trunc from 0x6118421 to 0x9cd5e2 2024-09-14T06:00:09.209 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:00:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:3769 punch from 0x6683b4 to 0x66bb71, (0x37bd bytes) 2024-09-14T06:00:09.232 INFO:teuthology.orchestra.run.smithi006.stdout:3770 read 0xf7207 thru 0xf7ea1 (0xc9b bytes) 2024-09-14T06:00:09.233 INFO:teuthology.orchestra.run.smithi006.stdout:3771 trunc from 0x9cd5e2 to 0x11787ed 2024-09-14T06:00:09.255 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:09.253+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:09.257 INFO:teuthology.orchestra.run.smithi006.stdout:3772 write 0x3e1e2e4 thru 0x3e25fa3 (0x7cc0 bytes) 2024-09-14T06:00:09.265 INFO:teuthology.orchestra.run.smithi006.stdout:3773 trunc from 0x3e25fa4 to 0x3245cc8 2024-09-14T06:00:09.305 INFO:teuthology.orchestra.run.smithi006.stdout:3774 trunc from 0x3245cc8 to 0xcfde90e 2024-09-14T06:00:09.327 INFO:teuthology.orchestra.run.smithi006.stdout:3776 trunc from 0xcfde90e to 0x7b80f5c 2024-09-14T06:00:09.339 INFO:teuthology.orchestra.run.smithi006.stdout:3777 read 0x4362805 thru 0x4366ac8 (0x42c4 bytes) 2024-09-14T06:00:09.339 INFO:teuthology.orchestra.run.smithi006.stdout:3779 read 0x1a9dbb6 thru 0x1aa6dc3 (0x920e bytes) 2024-09-14T06:00:09.339 INFO:teuthology.orchestra.run.smithi006.stdout:3780 read 0xc7e9a thru 0xcdec7 (0x602e bytes) 2024-09-14T06:00:09.340 INFO:teuthology.orchestra.run.smithi006.stdout:3783 read 0x1141224 thru 0x11487b1 (0x758e bytes) 2024-09-14T06:00:09.355 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:09.353+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:09.370 INFO:teuthology.orchestra.run.smithi006.stdout:3784 write 0xd7a1254 thru 0xd7acdba (0xbb67 bytes) 2024-09-14T06:00:09.379 INFO:teuthology.orchestra.run.smithi006.stdout:3786 read 0x8653ef1 thru 0x865c969 (0x8a79 bytes) 2024-09-14T06:00:09.379 INFO:teuthology.orchestra.run.smithi006.stdout:3787 writesame 0x3c6bfc1 thru 0x3c73f67 data_size 0x3(0x7fa7 bytes) 2024-09-14T06:00:09.381 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.833190424999998, 2024-09-14T06:00:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:00:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.381 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:00:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:00:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:00:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:00:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:00:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:00:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:00:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:00:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:00:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:00:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:00:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:00:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:00:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:00:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:00:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:00:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:00:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:00:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:00:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:00:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38842 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.858063703999999, 2024-09-14T06:00:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083698121, 2024-09-14T06:00:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38842 2024-09-14T06:00:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521563+0000", 2024-09-14T06:00:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:00:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521566+0000", 2024-09-14T06:00:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1140000000000002e-06 2024-09-14T06:00:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521575+0000", 2024-09-14T06:00:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8769999999999999e-06 2024-09-14T06:00:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521581+0000", 2024-09-14T06:00:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2369999999999997e-06 2024-09-14T06:00:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605076+0000", 2024-09-14T06:00:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083494992000000004 2024-09-14T06:00:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605168+0000", 2024-09-14T06:00:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1731999999999995e-05 2024-09-14T06:00:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605260+0000", 2024-09-14T06:00:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2511999999999998e-05 2024-09-14T06:00:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38844 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9469952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.858036337000001, 2024-09-14T06:00:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084006762999999998, 2024-09-14T06:00:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38844 2024-09-14T06:00:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521590+0000", 2024-09-14T06:00:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9699999999999996e-07 2024-09-14T06:00:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521593+0000", 2024-09-14T06:00:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5909999999999998e-06 2024-09-14T06:00:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521603+0000", 2024-09-14T06:00:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0642000000000001e-05 2024-09-14T06:00:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521609+0000", 2024-09-14T06:00:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1020000000000002e-06 2024-09-14T06:00:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605318+0000", 2024-09-14T06:00:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083709166000000002 2024-09-14T06:00:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605454+0000", 2024-09-14T06:00:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013557400000000001 2024-09-14T06:00:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605596+0000", 2024-09-14T06:00:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014209100000000001 2024-09-14T06:00:09.396 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38845 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9650176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.858008037000001, 2024-09-14T06:00:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084212700000000001, 2024-09-14T06:00:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.397 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38845 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1200000000000003e-07 2024-09-14T06:00:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521628+0000", 2024-09-14T06:00:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0196e-05 2024-09-14T06:00:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521637+0000", 2024-09-14T06:00:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6649999999999992e-06 2024-09-14T06:00:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521643+0000", 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.285e-06 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605652+0000", 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084009025000000001 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605741+0000", 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8473000000000005e-05 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605830+0000", 2024-09-14T06:00:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9444000000000006e-05 2024-09-14T06:00:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38848 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8536064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.857970028, 2024-09-14T06:00:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084375567999999998, 2024-09-14T06:00:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.401 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38848 2024-09-14T06:00:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0200000000000002e-07 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521659+0000", 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7800000000000001e-06 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521667+0000", 2024-09-14T06:00:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6599999999999995e-06 2024-09-14T06:00:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521674+0000", 2024-09-14T06:00:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4560000000000003e-06 2024-09-14T06:00:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605872+0000", 2024-09-14T06:00:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084198010000000004 2024-09-14T06:00:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605945+0000", 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2681000000000004e-05 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606031+0000", 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6378999999999994e-05 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38849 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9748480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.405 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.857939601999998, 2024-09-14T06:00:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084581577000000005, 2024-09-14T06:00:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38849 2024-09-14T06:00:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521687+0000", 2024-09-14T06:00:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9400000000000005e-07 2024-09-14T06:00:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521729+0000", 2024-09-14T06:00:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2657000000000002e-05 2024-09-14T06:00:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521749+0000", 2024-09-14T06:00:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9264000000000001e-05 2024-09-14T06:00:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521761+0000", 2024-09-14T06:00:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2289999999999999e-05 2024-09-14T06:00:09.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606078+0000", 2024-09-14T06:00:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084316772999999998 2024-09-14T06:00:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606176+0000", 2024-09-14T06:00:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7992999999999995e-05 2024-09-14T06:00:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606268+0000", 2024-09-14T06:00:09.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2006e-05 2024-09-14T06:00:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38851 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9928704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.857844289999999, 2024-09-14T06:00:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084695081000000005, 2024-09-14T06:00:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.410 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38851 2024-09-14T06:00:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:09.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521783+0000", 2024-09-14T06:00:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1000000000000001e-06 2024-09-14T06:00:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521788+0000", 2024-09-14T06:00:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2619999999999998e-06 2024-09-14T06:00:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521803+0000", 2024-09-14T06:00:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5421999999999999e-05 2024-09-14T06:00:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521815+0000", 2024-09-14T06:00:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.171e-05 2024-09-14T06:00:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606320+0000", 2024-09-14T06:00:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084504698000000003 2024-09-14T06:00:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606404+0000", 2024-09-14T06:00:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4379e-05 2024-09-14T06:00:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606476+0000", 2024-09-14T06:00:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2509999999999995e-05 2024-09-14T06:00:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.414 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.857793539999999, 2024-09-14T06:00:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:00:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:00:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:00:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:00:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:00:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:00:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:00:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:00:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:00:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:00:09.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.418 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.857755217000001, 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.419 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:00:09.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:00:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:00:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:00:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:00:09.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:00:09.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:00:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.857728524999999, 2024-09-14T06:00:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:00:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.857702659000001, 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:00:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:00:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.856602290000001, 2024-09-14T06:00:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:00:09.431 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:00:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:00:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:00:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:00:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:00:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.435 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.856558311000001, 2024-09-14T06:00:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:00:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:00:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.436 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:00:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:00:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:00:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:00:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:00:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:00:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:00:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:00:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:00:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:00:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:00:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:00:09.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:00:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:00:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38865 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1392640~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.855579933000001, 2024-09-14T06:00:09.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084340500999999998, 2024-09-14T06:00:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38865 2024-09-14T06:00:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:09.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524047+0000", 2024-09-14T06:00:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5290000000000001e-06 2024-09-14T06:00:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524054+0000", 2024-09-14T06:00:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1910000000000003e-06 2024-09-14T06:00:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524074+0000", 2024-09-14T06:00:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9383999999999999e-05 2024-09-14T06:00:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524089+0000", 2024-09-14T06:00:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4647000000000001e-05 2024-09-14T06:00:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608123+0000", 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084034837000000001 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608224+0000", 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100182 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608386+0000", 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162731 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.444 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.855496551000002, 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38869 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.855091081000001, 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084608905999999998, 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38869 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525138+0000", 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00060367999999999999 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525160+0000", 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1875999999999999e-05 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525182+0000", 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1427e-05 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525198+0000", 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507e-05 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608907+0000", 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083708535000000001 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609011+0000", 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010461199999999999 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609144+0000", 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013226899999999999 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38871 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1671168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.854399870999998, 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084308214000000006, 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38871 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525487+0000", 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026091100000000001 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525493+0000", 2024-09-14T06:00:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.742e-06 2024-09-14T06:00:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525508+0000", 2024-09-14T06:00:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525518+0000", 2024-09-14T06:00:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8500000000000006e-06 2024-09-14T06:00:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609229+0000", 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083711775000000002 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609388+0000", 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158286 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609534+0000", 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000146308 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38873 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 737280~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.854088299000001, 2024-09-14T06:00:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084288875999999999, 2024-09-14T06:00:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38873 2024-09-14T06:00:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.457 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526372+0000", 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00083508200000000001 2024-09-14T06:00:09.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526383+0000", 2024-09-14T06:00:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0282000000000001e-05 2024-09-14T06:00:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526445+0000", 2024-09-14T06:00:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1975000000000002e-05 2024-09-14T06:00:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526460+0000", 2024-09-14T06:00:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5233e-05 2024-09-14T06:00:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609585+0000", 2024-09-14T06:00:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083125216000000002 2024-09-14T06:00:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609689+0000", 2024-09-14T06:00:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104126 2024-09-14T06:00:09.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609826+0000", 2024-09-14T06:00:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013696199999999999 2024-09-14T06:00:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38874 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:09.461 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.853121365, 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083631987000000005, 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38874 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526505+0000", 2024-09-14T06:00:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7699999999999992e-07 2024-09-14T06:00:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526511+0000", 2024-09-14T06:00:09.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9139999999999996e-06 2024-09-14T06:00:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526525+0000", 2024-09-14T06:00:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3644e-05 2024-09-14T06:00:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526533+0000", 2024-09-14T06:00:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6510000000000001e-06 2024-09-14T06:00:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609897+0000", 2024-09-14T06:00:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083364173 2024-09-14T06:00:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610007+0000", 2024-09-14T06:00:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110707 2024-09-14T06:00:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610136+0000", 2024-09-14T06:00:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012892099999999999 2024-09-14T06:00:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38877 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1949696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.853076672, 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083886717, 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38877 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.466 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529354+0000", 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028049170000000001 2024-09-14T06:00:09.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529373+0000", 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.933e-05 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529399+0000", 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6129e-05 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529418+0000", 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8944e-05 2024-09-14T06:00:09.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610197+0000", 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080778271999999998 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610300+0000", 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103868 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610436+0000", 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013525700000000001 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.469 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:09.470 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:09.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:00:09.472 INFO:teuthology.orchestra.run.smithi006.stdout:3789 punch from 0x76341fe to 0x76348f2, (0x6f4 bytes) 2024-09-14T06:00:09.473 INFO:teuthology.orchestra.run.smithi006.stdout:3790 writesame 0x44f6393 thru 0x44f9ab0 data_size 0x53(0x371e bytes) 2024-09-14T06:00:09.473 INFO:teuthology.orchestra.run.smithi006.stdout:3791 writesame 0x5db627d thru 0x5dc16e4 data_size 0x5c(0xb468 bytes) 2024-09-14T06:00:09.473 INFO:teuthology.orchestra.run.smithi006.stdout:3793 read 0x9045cd9 thru 0x9051bb4 (0xbedc bytes) 2024-09-14T06:00:09.473 INFO:teuthology.orchestra.run.smithi006.stdout:3795 writesame 0x245568d thru 0x2459c11 data_size 0xd(0x4585 bytes) 2024-09-14T06:00:09.473 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:09.473 INFO:teuthology.orchestra.run.smithi006.stdout:3797 write 0xd690b64 thru 0xd69c70f (0xbbac bytes) 2024-09-14T06:00:09.473 INFO:teuthology.orchestra.run.smithi006.stdout:3798 read 0x802ea50 thru 0x8031f3e (0x34ef bytes) 2024-09-14T06:00:09.473 INFO:teuthology.orchestra.run.smithi006.stdout:3799 read 0x91d4be9 thru 0x91e31d6 (0xe5ee bytes) 2024-09-14T06:00:09.473 INFO:teuthology.orchestra.run.smithi006.stdout:3800 punch from 0x4ae337f to 0x4af0eaf, (0xdb30 bytes) 2024-09-14T06:00:09.473 INFO:teuthology.orchestra.run.smithi006.stdout:3801 trunc from 0xd7acdbb to 0x411975f 2024-09-14T06:00:09.473 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:09.469+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:09.502 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:00:09.512 INFO:teuthology.orchestra.run.smithi006.stdout:3803 write 0x80fda6c thru 0x810d99d (0xff32 bytes) 2024-09-14T06:00:09.524 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:09.524 INFO:teuthology.orchestra.run.smithi006.stdout:3805 punch from 0x7eb665e to 0x7ebd397, (0x6d39 bytes) 2024-09-14T06:00:09.524 INFO:teuthology.orchestra.run.smithi006.stdout:3806 write 0x2983866 thru 0x298d335 (0x9ad0 bytes) 2024-09-14T06:00:09.529 INFO:teuthology.orchestra.run.smithi006.stdout:3807 write 0x6616a0a thru 0x6616a22 (0x19 bytes) 2024-09-14T06:00:09.534 INFO:teuthology.orchestra.run.smithi006.stdout:3808 punch from 0x41cbd2e to 0x41dbd20, (0xfff2 bytes) 2024-09-14T06:00:09.534 INFO:teuthology.orchestra.run.smithi006.stdout:3810 read 0x7dbae2c thru 0x7dc8146 (0xd31b bytes) 2024-09-14T06:00:09.541 INFO:teuthology.orchestra.run.smithi006.stdout:3811 trunc from 0x810d99e to 0x5e8e4ac 2024-09-14T06:00:09.556 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:09.572 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:09.568+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:09.580 INFO:teuthology.orchestra.run.smithi006.stdout:3813 write 0xbc23e22 thru 0xbc28c76 (0x4e55 bytes) 2024-09-14T06:00:09.586 INFO:teuthology.orchestra.run.smithi006.stdout:3816 read 0x82e2af0 thru 0x82e434c (0x185d bytes) 2024-09-14T06:00:09.586 INFO:teuthology.orchestra.run.smithi006.stdout:3817 write 0x3591a8f thru 0x359f006 (0xd578 bytes) 2024-09-14T06:00:09.592 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:09.592 INFO:teuthology.orchestra.run.smithi006.stdout:3819 read 0x714b7c4 thru 0x7157113 (0xb950 bytes) 2024-09-14T06:00:09.592 INFO:teuthology.orchestra.run.smithi006.stdout:3821 writesame 0x82c92d thru 0x82d0ff data_size 0x1(0x7d3 bytes) 2024-09-14T06:00:09.596 INFO:teuthology.orchestra.run.smithi006.stdout:3822 read 0x7f88f36 thru 0x7f92303 (0x93ce bytes) 2024-09-14T06:00:09.596 INFO:teuthology.orchestra.run.smithi006.stdout:3823 writesame 0x69cf3fc thru 0x69d5a62 data_size 0x31(0x6667 bytes) 2024-09-14T06:00:09.603 INFO:teuthology.orchestra.run.smithi006.stdout:3825 read 0x6e75c8d thru 0x6e7b491 (0x5805 bytes) 2024-09-14T06:00:09.605 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:09.605 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:09.605 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:09.605 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:09.615 INFO:teuthology.orchestra.run.smithi006.stdout:3826 trunc from 0xbc28c77 to 0x65e98e5 2024-09-14T06:00:09.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:00:09.647 INFO:teuthology.orchestra.run.smithi006.stdout:3827 trunc from 0x65e98e5 to 0xa9a242 2024-09-14T06:00:09.667 INFO:teuthology.orchestra.run.smithi006.stdout:3828 read 0xb331b thru 0xbb469 (0x814f bytes) 2024-09-14T06:00:09.676 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:09.685 INFO:teuthology.orchestra.run.smithi006.stdout:3829 write 0x8623884 thru 0x863361f (0xfd9c bytes) 2024-09-14T06:00:09.691 INFO:teuthology.orchestra.run.smithi006.stdout:3830 writesame 0x221794 thru 0x22d3ed data_size 0x1(0xbc5a bytes) 2024-09-14T06:00:09.695 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:09.695 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:09.706 INFO:teuthology.orchestra.run.smithi006.stdout:3831 punch from 0x6e7721a to 0x6e7ffe8, (0x8dce bytes) 2024-09-14T06:00:09.706 INFO:teuthology.orchestra.run.smithi006.stdout:3832 writesame 0x3128245 thru 0x313212e data_size 0x1(0x9eea bytes) 2024-09-14T06:00:09.713 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:09.712+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:09.713 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:09.713 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:09.730 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:09.730 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:09.746 INFO:teuthology.orchestra.run.smithi006.stdout:3833 read 0x1ff1fe5 thru 0x1ff439e (0x23ba bytes) 2024-09-14T06:00:09.748 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:09.749 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:09.761 INFO:teuthology.orchestra.run.smithi006.stdout:3837 trunc from 0x8633620 to 0x18d2ab6 2024-09-14T06:00:09.771 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:09.771 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:09.773 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:09.772+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:09.793 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:09.793 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:09.793 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:09.794 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:09.794 INFO:teuthology.orchestra.run.smithi006.stdout:3838 writesame 0x78e27f3 thru 0x78e6824 data_size 0x42(0x4032 bytes) 2024-09-14T06:00:09.795 INFO:teuthology.orchestra.run.smithi006.stdout:3839 read 0x7789360 thru 0x7793f07 (0xaba8 bytes) 2024-09-14T06:00:09.795 INFO:teuthology.orchestra.run.smithi006.stdout:3840 punch from 0x6c45326 to 0x6c50406, (0xb0e0 bytes) 2024-09-14T06:00:09.795 INFO:teuthology.orchestra.run.smithi006.stdout:3841 read 0x1e1d2ea thru 0x1e246e2 (0x73f9 bytes) 2024-09-14T06:00:09.795 INFO:teuthology.orchestra.run.smithi006.stdout:3842 read 0x34aa13b thru 0x34b5dd9 (0xbc9f bytes) 2024-09-14T06:00:09.795 INFO:teuthology.orchestra.run.smithi006.stdout:3843 write 0x2ad0f25 thru 0x2adb689 (0xa765 bytes) 2024-09-14T06:00:09.799 INFO:teuthology.orchestra.run.smithi006.stdout:3844 punch from 0x6675332 to 0x667abcf, (0x589d bytes) 2024-09-14T06:00:09.799 INFO:teuthology.orchestra.run.smithi006.stdout:3845 writesame 0x3cfb121 thru 0x3d08bc2 data_size 0x3a(0xdaa2 bytes) 2024-09-14T06:00:09.809 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:00:09.815 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:09.816 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:09.820 INFO:teuthology.orchestra.run.smithi006.stdout:3846 write 0xb98cb6a thru 0xb9994ae (0xc945 bytes) 2024-09-14T06:00:09.830 INFO:teuthology.orchestra.run.smithi006.stdout:3847 trunc from 0xb9994af to 0xdaf4e36 2024-09-14T06:00:09.836 INFO:teuthology.orchestra.run.smithi006.stdout:3848 write 0x87b5394 thru 0x87b7b73 (0x27e0 bytes) 2024-09-14T06:00:09.840 INFO:teuthology.orchestra.run.smithi006.stdout:3849 write 0xc6678e9 thru 0xc66fa11 (0x8129 bytes) 2024-09-14T06:00:09.845 INFO:teuthology.orchestra.run.smithi006.stdout:3850 read 0x2bf1d68 thru 0x2bf970a (0x79a3 bytes) 2024-09-14T06:00:09.845 INFO:teuthology.orchestra.run.smithi006.stdout:3853 write 0x7371b05 thru 0x737f495 (0xd991 bytes) 2024-09-14T06:00:09.851 INFO:teuthology.orchestra.run.smithi006.stdout:3854 write 0x39b3142 thru 0x39b6e6c (0x3d2b bytes) 2024-09-14T06:00:09.855 INFO:teuthology.orchestra.run.smithi006.stdout:3855 write 0x63faf79 thru 0x640307f (0x8107 bytes) 2024-09-14T06:00:09.861 INFO:teuthology.orchestra.run.smithi006.stdout:3856 write 0x1a807d8 thru 0x1a89834 (0x905d bytes) 2024-09-14T06:00:09.874 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:09.869+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:09.882 INFO:teuthology.orchestra.run.smithi006.stdout:3857 trunc from 0xdaf4e36 to 0x4aa8ad3 2024-09-14T06:00:09.925 INFO:teuthology.orchestra.run.smithi006.stdout:3858 writesame 0xc90055e thru 0xc90cd2a data_size 0x1(0xc7cd bytes) 2024-09-14T06:00:09.940 INFO:teuthology.orchestra.run.smithi006.stdout:3859 write 0xe769488 thru 0xe776b16 (0xd68f bytes) 2024-09-14T06:00:09.951 INFO:teuthology.orchestra.run.smithi006.stdout:3862 write 0x4dcb468 thru 0x4dd8d06 (0xd89f bytes) 2024-09-14T06:00:09.956 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-14T06:00:09.956 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T06:00:09.956 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-14T06:00:09.956 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T06:00:09.956 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T06:00:09.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-14T06:00:09.961 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:09.961 INFO:teuthology.orchestra.run.smithi006.stdout:3864 write 0x98e9d90 thru 0x98f3275 (0x94e6 bytes) 2024-09-14T06:00:09.970 INFO:teuthology.orchestra.run.smithi006.stdout:3865 write 0x5cfa60a thru 0x5d09a6d (0xf464 bytes) 2024-09-14T06:00:09.974 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:09.969+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:09.981 INFO:teuthology.orchestra.run.smithi006.stdout:3868 punch from 0x6d115ba to 0x6d1e771, (0xd1b7 bytes) 2024-09-14T06:00:09.981 INFO:teuthology.orchestra.run.smithi006.stdout:3869 read 0xa2ca0d6 thru 0xa2caf97 (0xec2 bytes) 2024-09-14T06:00:09.982 INFO:teuthology.orchestra.run.smithi006.stdout:3870 punch from 0x608b020 to 0x6097c61, (0xcc41 bytes) 2024-09-14T06:00:09.982 INFO:teuthology.orchestra.run.smithi006.stdout:3872 read 0x352bdad thru 0x3534afb (0x8d4f bytes) 2024-09-14T06:00:09.982 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:09.982 INFO:teuthology.orchestra.run.smithi006.stdout:3875 punch from 0xe3bbf1d to 0xe3cbbec, (0xfccf bytes) 2024-09-14T06:00:09.982 INFO:teuthology.orchestra.run.smithi006.stdout:3876 writesame 0xbbc2d79 thru 0xbbcacb5 data_size 0x1(0x7f3d bytes) 2024-09-14T06:00:09.983 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:09.983 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:10.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:00:10.006 INFO:teuthology.orchestra.run.smithi006.stdout:3879 write 0x4abc9d6 thru 0x4ac47fc (0x7e27 bytes) 2024-09-14T06:00:10.014 INFO:teuthology.orchestra.run.smithi006.stdout:3880 read 0x9eb6cea thru 0x9ebf92b (0x8c42 bytes) 2024-09-14T06:00:10.025 INFO:teuthology.orchestra.run.smithi006.stdout:3881 trunc from 0xe776b17 to 0x834ddf7 2024-09-14T06:00:10.041 INFO:teuthology.orchestra.run.smithi006.stdout:3882 read 0x70c0df7 thru 0x70c80e2 (0x72ec bytes) 2024-09-14T06:00:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:3883 write 0x65fceb3 thru 0x65ffd51 (0x2e9f bytes) 2024-09-14T06:00:10.046 INFO:teuthology.orchestra.run.smithi006.stdout:3884 punch from 0x55aa00a to 0x55b02a7, (0x629d bytes) 2024-09-14T06:00:10.046 INFO:teuthology.orchestra.run.smithi006.stdout:3886 write 0x432b1aa thru 0x43368b7 (0xb70e bytes) 2024-09-14T06:00:10.052 INFO:teuthology.orchestra.run.smithi006.stdout:3887 read 0x1adf8a8 thru 0x1ae5ce2 (0x643b bytes) 2024-09-14T06:00:10.055 INFO:teuthology.orchestra.run.smithi006.stdout:3888 trunc from 0x834ddf7 to 0x5dbb306 2024-09-14T06:00:10.066 INFO:teuthology.orchestra.run.smithi006.stdout:3889 read 0x427d782 thru 0x428a384 (0xcc03 bytes) 2024-09-14T06:00:10.066 INFO:teuthology.orchestra.run.smithi006.stdout:3890 punch from 0x27b2fa8 to 0x27b6b31, (0x3b89 bytes) 2024-09-14T06:00:10.067 INFO:teuthology.orchestra.run.smithi006.stdout:3892 punch from 0x55ef536 to 0x55fed4f, (0xf819 bytes) 2024-09-14T06:00:10.067 INFO:teuthology.orchestra.run.smithi006.stdout:3893 read 0x52a8394 thru 0x52b6dc7 (0xea34 bytes) 2024-09-14T06:00:10.067 INFO:teuthology.orchestra.run.smithi006.stdout:3895 write 0xcf9586 thru 0xd03c75 (0xa6f0 bytes) 2024-09-14T06:00:10.069 INFO:teuthology.orchestra.run.smithi006.stdout:3896 read 0x2132c61 thru 0x213513f (0x24df bytes) 2024-09-14T06:00:10.069 INFO:teuthology.orchestra.run.smithi006.stdout:3897 punch from 0x1db8fdd to 0x1dc7916, (0xe939 bytes) 2024-09-14T06:00:10.069 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:10.069 INFO:teuthology.orchestra.run.smithi006.stdout:3900 write 0x985611 thru 0x986b27 (0x1517 bytes) 2024-09-14T06:00:10.075 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:10.073+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:10.080 INFO:teuthology.orchestra.run.smithi006.stdout:3901 trunc from 0x5dbb306 to 0xcbdb5d4 2024-09-14T06:00:10.089 INFO:teuthology.orchestra.run.smithi006.stdout:3904 write 0x1d39988 thru 0x1d44935 (0xafae bytes) 2024-09-14T06:00:10.094 INFO:teuthology.orchestra.run.smithi006.stdout:3905 write 0x49267b8 thru 0x4928031 (0x187a bytes) 2024-09-14T06:00:10.099 INFO:teuthology.orchestra.run.smithi006.stdout:3906 punch from 0x6ec72ff to 0x6ecafac, (0x3cad bytes) 2024-09-14T06:00:10.099 INFO:teuthology.orchestra.run.smithi006.stdout:3908 write 0x1371773 thru 0x137bd0a (0xa598 bytes) 2024-09-14T06:00:10.100 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:10.100 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T06:00:10.100 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:10.112 INFO:teuthology.orchestra.run.smithi006.stdout:3909 trunc from 0xcbdb5d4 to 0x6f62717 2024-09-14T06:00:10.123 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:10.134 INFO:teuthology.orchestra.run.smithi006.stdout:3912 write 0x7b92426 thru 0x7ba0dea (0xe9c5 bytes) 2024-09-14T06:00:10.135 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:10.135 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:10.144 INFO:teuthology.orchestra.run.smithi006.stdout:3913 read 0xbab398 thru 0xbb3346 (0x7faf bytes) 2024-09-14T06:00:10.145 INFO:teuthology.orchestra.run.smithi006.stdout:3914 punch from 0x7092a43 to 0x709bc3b, (0x91f8 bytes) 2024-09-14T06:00:10.145 INFO:teuthology.orchestra.run.smithi006.stdout:3915 write 0x50211c4 thru 0x5024752 (0x358f bytes) 2024-09-14T06:00:10.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:00:10.158 INFO:teuthology.orchestra.run.smithi006.stdout:3916 trunc from 0x7ba0deb to 0xfebe4d 2024-09-14T06:00:10.180 INFO:teuthology.orchestra.run.smithi006.stdout:3918 read 0xeb24b3 thru 0xec1477 (0xefc5 bytes) 2024-09-14T06:00:10.196 INFO:teuthology.orchestra.run.smithi006.stdout:3919 write 0x2946af1 thru 0x294993f (0x2e4f bytes) 2024-09-14T06:00:10.197 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:10.196+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:10.205 INFO:teuthology.orchestra.run.smithi006.stdout:3920 read 0x20345fb thru 0x203f45c (0xae62 bytes) 2024-09-14T06:00:10.205 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:10.228 INFO:teuthology.orchestra.run.smithi006.stdout:3922 writesame 0x72318f8 thru 0x7234205 data_size 0x5(0x290e bytes) 2024-09-14T06:00:10.229 INFO:teuthology.orchestra.run.smithi006.stdout:3924 punch from 0x37c7605 to 0x37cd299, (0x5c94 bytes) 2024-09-14T06:00:10.229 INFO:teuthology.orchestra.run.smithi006.stdout:3925 read 0x45c73f2 thru 0x45ca134 (0x2d43 bytes) 2024-09-14T06:00:10.259 INFO:teuthology.orchestra.run.smithi006.stdout:3930 write 0xda26358 thru 0xda2e502 (0x81ab bytes) 2024-09-14T06:00:10.270 INFO:teuthology.orchestra.run.smithi006.stdout:3931 read 0xd24d919 thru 0xd258524 (0xac0c bytes) 2024-09-14T06:00:10.270 INFO:teuthology.orchestra.run.smithi006.stdout:3932 write 0x3375cd4 thru 0x3376495 (0x7c2 bytes) 2024-09-14T06:00:10.272 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:10.272 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:10.277 INFO:teuthology.orchestra.run.smithi006.stdout:3933 read 0x8a290ce thru 0x8a2a091 (0xfc4 bytes) 2024-09-14T06:00:10.277 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:10.273+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:10.277 INFO:teuthology.orchestra.run.smithi006.stdout:3934 read 0xa5be5e1 thru 0xa5be977 (0x397 bytes) 2024-09-14T06:00:10.278 INFO:teuthology.orchestra.run.smithi006.stdout:3935 read 0x9a445ab thru 0x9a4f5e5 (0xb03b bytes) 2024-09-14T06:00:10.278 INFO:teuthology.orchestra.run.smithi006.stdout:3936 write 0x974bdfd thru 0x97587b1 (0xc9b5 bytes) 2024-09-14T06:00:10.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:00:10.289 INFO:teuthology.orchestra.run.smithi006.stdout:3937 writesame 0x9cdeea thru 0x9d618a data_size 0x47(0x82a1 bytes) 2024-09-14T06:00:10.299 INFO:teuthology.orchestra.run.smithi006.stdout:3939 trunc from 0xda2e503 to 0xc2ee855 2024-09-14T06:00:10.323 INFO:teuthology.orchestra.run.smithi006.stdout:3942 write 0x248151 thru 0x25455d (0xc40d bytes) 2024-09-14T06:00:10.328 INFO:teuthology.orchestra.run.smithi006.stdout:3943 read 0x293ae1b thru 0x29459b1 (0xab97 bytes) 2024-09-14T06:00:10.329 INFO:teuthology.orchestra.run.smithi006.stdout:3944 writesame 0xb7996da thru 0xb7a33b2 data_size 0x1(0x9cd9 bytes) 2024-09-14T06:00:10.377 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:10.376+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:10.382 INFO:teuthology.orchestra.run.smithi006.stdout:3945 punch from 0x7f4d168 to 0x7f55fff, (0x8e97 bytes) 2024-09-14T06:00:10.382 INFO:teuthology.orchestra.run.smithi006.stdout:3946 writesame 0x3a899eb thru 0x3a975fe data_size 0x5a(0xdc14 bytes) 2024-09-14T06:00:10.391 INFO:teuthology.orchestra.run.smithi006.stdout:3948 read 0x60ff909 thru 0x610df99 (0xe691 bytes) 2024-09-14T06:00:10.392 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:10.392 INFO:teuthology.orchestra.run.smithi006.stdout:3950 punch from 0xbbd98 to 0xca224, (0xe48c bytes) 2024-09-14T06:00:10.392 INFO:teuthology.orchestra.run.smithi006.stdout:3951 read 0xb299176 thru 0xb2a671c (0xd5a7 bytes) 2024-09-14T06:00:10.392 INFO:teuthology.orchestra.run.smithi006.stdout:3952 read 0x294cc8 thru 0x29ba27 (0x6d60 bytes) 2024-09-14T06:00:10.393 INFO:teuthology.orchestra.run.smithi006.stdout:3953 read 0x2973d0d thru 0x29830c7 (0xf3bb bytes) 2024-09-14T06:00:10.393 INFO:teuthology.orchestra.run.smithi006.stdout:3955 writesame 0x1a0642d thru 0x1a09e58 data_size 0x33(0x3a2c bytes) 2024-09-14T06:00:10.397 INFO:teuthology.orchestra.run.smithi006.stdout:3956 read 0x792c03 thru 0x79f06f (0xc46d bytes) 2024-09-14T06:00:10.399 INFO:teuthology.orchestra.run.smithi006.stdout:3957 read 0x9ff89de thru 0x9ffa7bb (0x1dde bytes) 2024-09-14T06:00:10.399 INFO:teuthology.orchestra.run.smithi006.stdout:3958 write 0x71abb45 thru 0x71b49cb (0x8e87 bytes) 2024-09-14T06:00:10.408 INFO:teuthology.orchestra.run.smithi006.stdout:3959 read 0xa212f6e thru 0xa21ec9b (0xbd2e bytes) 2024-09-14T06:00:10.409 INFO:teuthology.orchestra.run.smithi006.stdout:3960 read 0x8f8b2b1 thru 0x8f96cd7 (0xba27 bytes) 2024-09-14T06:00:10.440 INFO:teuthology.orchestra.run.smithi006.stdout:3961 trunc from 0xc2ee855 to 0xc6ed5d 2024-09-14T06:00:10.461 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:10.461 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:10.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:00:10.479 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:10.476+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:10.493 INFO:teuthology.orchestra.run.smithi006.stdout:3962 write 0x287b549 thru 0x2889a47 (0xe4ff bytes) 2024-09-14T06:00:10.501 INFO:teuthology.orchestra.run.smithi006.stdout:3963 read 0x15acf35 thru 0x15aee56 (0x1f22 bytes) 2024-09-14T06:00:10.505 INFO:teuthology.orchestra.run.smithi006.stdout:3966 trunc from 0x2889a48 to 0x5dc4c4 2024-09-14T06:00:10.535 INFO:teuthology.orchestra.run.smithi006.stdout:3970 trunc from 0x5dc4c4 to 0x3072e30 2024-09-14T06:00:10.547 INFO:teuthology.orchestra.run.smithi006.stdout:3971 read 0x220623f thru 0x221287f (0xc641 bytes) 2024-09-14T06:00:10.547 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:10.547 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:10.547 INFO:teuthology.orchestra.run.smithi006.stdout:3974 punch from 0x18b5d0d to 0x18c5785, (0xfa78 bytes) 2024-09-14T06:00:10.548 INFO:teuthology.orchestra.run.smithi006.stdout:3975 write 0x7981b5 thru 0x79b83a (0x3686 bytes) 2024-09-14T06:00:10.549 INFO:teuthology.orchestra.run.smithi006.stdout:3976 read 0x18fc0a5 thru 0x18ff2bb (0x3217 bytes) 2024-09-14T06:00:10.571 INFO:teuthology.orchestra.run.smithi006.stdout:3977 writesame 0xb017126 thru 0xb020725 data_size 0x6(0x9600 bytes) 2024-09-14T06:00:10.571 INFO:teuthology.orchestra.run.smithi006.stdout:3978 read 0x7b0db2d thru 0x7b1b96a (0xde3e bytes) 2024-09-14T06:00:10.571 INFO:teuthology.orchestra.run.smithi006.stdout:3979 write 0x7a54f90 thru 0x7a5d93f (0x89b0 bytes) 2024-09-14T06:00:10.579 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:10.579 INFO:teuthology.orchestra.run.smithi006.stdout:3984 write 0x86b484a thru 0x86c13f1 (0xcba8 bytes) 2024-09-14T06:00:10.579 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:10.577+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:10.603 INFO:teuthology.orchestra.run.smithi006.stdout:3985 write 0xe61441e thru 0xe623042 (0xec25 bytes) 2024-09-14T06:00:10.610 INFO:teuthology.orchestra.run.smithi006.stdout:3986 writesame 0xc59a49f thru 0xc59dcfa data_size 0x2(0x385c bytes) 2024-09-14T06:00:10.623 INFO:teuthology.orchestra.run.smithi006.stdout:3989 writesame 0x5e77b6c thru 0x5e78cce data_size 0x1(0x1163 bytes) 2024-09-14T06:00:10.629 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:10.629 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:10.633 INFO:teuthology.orchestra.run.smithi006.stdout:3990 write 0xa23f61d thru 0xa244435 (0x4e19 bytes) 2024-09-14T06:00:10.641 INFO:teuthology.orchestra.run.smithi006.stdout:3991 write 0x6f0e6d7 thru 0x6f18211 (0x9b3b bytes) 2024-09-14T06:00:10.646 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:00:10.651 INFO:teuthology.orchestra.run.smithi006.stdout:3992 read 0x765a239 thru 0x765f1ca (0x4f92 bytes) 2024-09-14T06:00:10.651 INFO:teuthology.orchestra.run.smithi006.stdout:3993 write 0x7636dee thru 0x76389bb (0x1bce bytes) 2024-09-14T06:00:10.659 INFO:teuthology.orchestra.run.smithi006.stdout:3995 write 0xb737b5f thru 0xb73fc4f (0x80f1 bytes) 2024-09-14T06:00:10.667 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:10.667 INFO:teuthology.orchestra.run.smithi006.stdout:3999 read 0x926b3ea thru 0x9271abf (0x66d6 bytes) 2024-09-14T06:00:10.667 INFO:teuthology.orchestra.run.smithi006.stdout:4000 write 0xae610c thru 0xaef746 (0x963b bytes) 2024-09-14T06:00:10.670 INFO:teuthology.orchestra.run.smithi006.stdout:4001 write 0xdebb53e thru 0xdec73a3 (0xbe66 bytes) 2024-09-14T06:00:10.677 INFO:teuthology.orchestra.run.smithi006.stdout:4002 write 0xcd0f18e thru 0xcd18fd8 (0x9e4b bytes) 2024-09-14T06:00:10.681 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:10.677+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:10.685 INFO:teuthology.orchestra.run.smithi006.stdout:4004 read 0xe076558 thru 0xe084554 (0xdffd bytes) 2024-09-14T06:00:10.685 INFO:teuthology.orchestra.run.smithi006.stdout:4005 read 0xb9f702b thru 0xba04bef (0xdbc5 bytes) 2024-09-14T06:00:10.685 INFO:teuthology.orchestra.run.smithi006.stdout:4007 read 0xa6cdfaf thru 0xa6dbcb3 (0xdd05 bytes) 2024-09-14T06:00:10.688 INFO:teuthology.orchestra.run.smithi006.stdout:4009 trunc from 0xe623043 to 0xcc05897 2024-09-14T06:00:10.724 INFO:teuthology.orchestra.run.smithi006.stdout:4010 writesame 0xdea86ae thru 0xdeae572 data_size 0x1(0x5ec5 bytes) 2024-09-14T06:00:10.724 INFO:teuthology.orchestra.run.smithi006.stdout:4011 write 0xab9c5a thru 0xabf78f (0x5b36 bytes) 2024-09-14T06:00:10.739 INFO:teuthology.orchestra.run.smithi006.stdout:4013 write 0xeb236d7 thru 0xeb31793 (0xe0bd bytes) 2024-09-14T06:00:10.748 INFO:teuthology.orchestra.run.smithi006.stdout:4014 write 0xaa7d8cd thru 0xaa898d5 (0xc009 bytes) 2024-09-14T06:00:10.758 INFO:teuthology.orchestra.run.smithi006.stdout:4015 read 0x4cf3f1a thru 0x4cfccad (0x8d94 bytes) 2024-09-14T06:00:10.759 INFO:teuthology.orchestra.run.smithi006.stdout:4017 write 0x3619eec thru 0x3627315 (0xd42a bytes) 2024-09-14T06:00:10.765 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:10.765 INFO:teuthology.orchestra.run.smithi006.stdout:4019 read 0xa499fed thru 0xa4a6e77 (0xce8b bytes) 2024-09-14T06:00:10.765 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:10.765 INFO:teuthology.orchestra.run.smithi006.stdout:4022 punch from 0x779c4c3 to 0x77ac3d8, (0xff15 bytes) 2024-09-14T06:00:10.765 INFO:teuthology.orchestra.run.smithi006.stdout:4023 write 0x658e359 thru 0x659847a (0xa122 bytes) 2024-09-14T06:00:10.782 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:10.780+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:10.788 INFO:teuthology.orchestra.run.smithi006.stdout:4025 trunc from 0xeb31794 to 0x76a3e5a 2024-09-14T06:00:10.790 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:10.790 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:10.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:00:10.843 INFO:teuthology.orchestra.run.smithi006.stdout:4026 write 0xeb09296 thru 0xeb16e22 (0xdb8d bytes) 2024-09-14T06:00:10.850 INFO:teuthology.orchestra.run.smithi006.stdout:4027 write 0x4e188f9 thru 0x4e1e861 (0x5f69 bytes) 2024-09-14T06:00:10.856 INFO:teuthology.orchestra.run.smithi006.stdout:4028 read 0xde748d9 thru 0xde8241c (0xdb44 bytes) 2024-09-14T06:00:10.856 INFO:teuthology.orchestra.run.smithi006.stdout:4029 writesame 0x6b374ec thru 0x6b3b0c1 data_size 0x4a(0x3bd6 bytes) 2024-09-14T06:00:10.863 INFO:teuthology.orchestra.run.smithi006.stdout:4036 read 0xcecdb23 thru 0xced13cb (0x38a9 bytes) 2024-09-14T06:00:10.863 INFO:teuthology.orchestra.run.smithi006.stdout:4038 read 0x873573c thru 0x8737445 (0x1d0a bytes) 2024-09-14T06:00:10.880 INFO:teuthology.orchestra.run.smithi006.stdout:4041 trunc from 0xeb16e23 to 0x4a3ae7b 2024-09-14T06:00:10.882 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:10.881+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:10.902 INFO:teuthology.orchestra.run.smithi006.stdout:4042 read 0x4240a15 thru 0x424e726 (0xdd12 bytes) 2024-09-14T06:00:10.902 INFO:teuthology.orchestra.run.smithi006.stdout:4044 write 0x3e066bf thru 0x3e14fc0 (0xe902 bytes) 2024-09-14T06:00:10.910 INFO:teuthology.orchestra.run.smithi006.stdout:4045 punch from 0x2cf87a9 to 0x2cfdbfd, (0x5454 bytes) 2024-09-14T06:00:10.910 INFO:teuthology.orchestra.run.smithi006.stdout:4046 read 0x3aca77c thru 0x3acbff9 (0x187e bytes) 2024-09-14T06:00:10.911 INFO:teuthology.orchestra.run.smithi006.stdout:4047 write 0x26adcd5 thru 0x26b9c28 (0xbf54 bytes) 2024-09-14T06:00:10.918 INFO:teuthology.orchestra.run.smithi006.stdout:4048 write 0x2669f47 thru 0x2679c06 (0xfcc0 bytes) 2024-09-14T06:00:10.926 INFO:teuthology.orchestra.run.smithi006.stdout:4049 punch from 0x1565196 to 0x1574708, (0xf572 bytes) 2024-09-14T06:00:10.926 INFO:teuthology.orchestra.run.smithi006.stdout:4050 read 0x17d0520 thru 0x17d21b7 (0x1c98 bytes) 2024-09-14T06:00:10.926 INFO:teuthology.orchestra.run.smithi006.stdout:4051 punch from 0x23ea092 to 0x23f44d0, (0xa43e bytes) 2024-09-14T06:00:10.926 INFO:teuthology.orchestra.run.smithi006.stdout:4052 punch from 0xa7c49b to 0xa889d1, (0xc536 bytes) 2024-09-14T06:00:10.926 INFO:teuthology.orchestra.run.smithi006.stdout:4054 write 0x4627083 thru 0x4632010 (0xaf8e bytes) 2024-09-14T06:00:10.933 INFO:teuthology.orchestra.run.smithi006.stdout:4055 write 0x25615fb thru 0x2561ea0 (0x8a6 bytes) 2024-09-14T06:00:10.939 INFO:teuthology.orchestra.run.smithi006.stdout:4057 read 0x3cdf00f thru 0x3ce8eca (0x9ebc bytes) 2024-09-14T06:00:10.939 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:10.939 INFO:teuthology.orchestra.run.smithi006.stdout:4059 writesame 0x268ace6 thru 0x2690749 data_size 0x59(0x5a64 bytes) 2024-09-14T06:00:10.959 INFO:teuthology.orchestra.run.smithi006.stdout:4060 writesame 0x6ac7d10 thru 0x6ad2f38 data_size 0x17(0xb229 bytes) 2024-09-14T06:00:10.959 INFO:teuthology.orchestra.run.smithi006.stdout:4061 trunc from 0x6ad2f39 to 0x694e9e7 2024-09-14T06:00:10.970 INFO:teuthology.orchestra.run.smithi006.stdout:4063 writesame 0x440b785 thru 0x4414a19 data_size 0x1(0x9295 bytes) 2024-09-14T06:00:10.981 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:10.981 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:10.983 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:10.980+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:10.997 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:00:11.014 INFO:teuthology.orchestra.run.smithi006.stdout:4064 trunc from 0x694e9e7 to 0xf17b8 2024-09-14T06:00:11.052 INFO:teuthology.orchestra.run.smithi006.stdout:4065 read 0xab2d8 thru 0xb5454 (0xa17d bytes) 2024-09-14T06:00:11.053 INFO:teuthology.orchestra.run.smithi006.stdout:4066 read 0xde21c thru 0xe61d3 (0x7fb8 bytes) 2024-09-14T06:00:11.054 INFO:teuthology.orchestra.run.smithi006.stdout:4067 punch from 0x19691 to 0x246bf, (0xb02e bytes) 2024-09-14T06:00:11.070 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T06:00:11.077 INFO:teuthology.orchestra.run.smithi006.stdout:4068 write 0x4487ff3 thru 0x44910f8 (0x9106 bytes) 2024-09-14T06:00:11.083 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:11.081+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:11.088 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:11.088 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:11.088 INFO:teuthology.orchestra.run.smithi006.stdout:4072 read 0x1d5b44a thru 0x1d5f0e1 (0x3c98 bytes) 2024-09-14T06:00:11.088 INFO:teuthology.orchestra.run.smithi006.stdout:4074 read 0x2835b9e thru 0x28393ea (0x384d bytes) 2024-09-14T06:00:11.088 INFO:teuthology.orchestra.run.smithi006.stdout:4076 read 0x4165a64 thru 0x4173862 (0xddff bytes) 2024-09-14T06:00:11.113 INFO:teuthology.orchestra.run.smithi006.stdout:4077 write 0xd3a5d5c thru 0xd3af7c7 (0x9a6c bytes) 2024-09-14T06:00:11.120 INFO:teuthology.orchestra.run.smithi006.stdout:4079 read 0x6d92d0d thru 0x6da136b (0xe65f bytes) 2024-09-14T06:00:11.131 INFO:teuthology.orchestra.run.smithi006.stdout:4080 write 0xdabfb57 thru 0xdacda4a (0xdef4 bytes) 2024-09-14T06:00:11.139 INFO:teuthology.orchestra.run.smithi006.stdout:4081 read 0x79bf6c4 thru 0x79cedfa (0xf737 bytes) 2024-09-14T06:00:11.139 INFO:teuthology.orchestra.run.smithi006.stdout:4084 write 0x401d8d1 thru 0x4025b55 (0x8285 bytes) 2024-09-14T06:00:11.146 INFO:teuthology.orchestra.run.smithi006.stdout:4085 punch from 0x7f33ecc to 0x7f34177, (0x2ab bytes) 2024-09-14T06:00:11.146 INFO:teuthology.orchestra.run.smithi006.stdout:4086 trunc from 0xdacda4b to 0xde68789 2024-09-14T06:00:11.156 INFO:teuthology.orchestra.run.smithi006.stdout:4087 read 0x7c37aba thru 0x7c42c3a (0xb181 bytes) 2024-09-14T06:00:11.157 INFO:teuthology.orchestra.run.smithi006.stdout:4089 writesame 0xc73496c thru 0xc73f791 data_size 0x2(0xae26 bytes) 2024-09-14T06:00:11.166 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:11.166 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:11.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:00:11.184 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:11.180+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:11.186 INFO:teuthology.orchestra.run.smithi006.stdout:4090 write 0x4b96c72 thru 0x4ba3bfc (0xcf8b bytes) 2024-09-14T06:00:11.209 INFO:teuthology.orchestra.run.smithi006.stdout:4091 trunc from 0xde68789 to 0x4f7f0c9 2024-09-14T06:00:11.252 INFO:teuthology.orchestra.run.smithi006.stdout:4092 write 0xa4a823c thru 0xa4b0f90 (0x8d55 bytes) 2024-09-14T06:00:11.258 INFO:teuthology.orchestra.run.smithi006.stdout:4093 write 0x508ee92 thru 0x5092351 (0x34c0 bytes) 2024-09-14T06:00:11.275 INFO:teuthology.orchestra.run.smithi006.stdout:4094 write 0xadae816 thru 0xadb6160 (0x794b bytes) 2024-09-14T06:00:11.283 INFO:teuthology.orchestra.run.smithi006.stdout:4095 write 0x4a35b94 thru 0x4a364fa (0x967 bytes) 2024-09-14T06:00:11.285 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:11.281+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:11.285 INFO:teuthology.orchestra.run.smithi006.stdout:4096 writesame 0x64a719c thru 0x64abf4a data_size 0x7(0x4daf bytes) 2024-09-14T06:00:11.292 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:11.292 INFO:teuthology.orchestra.run.smithi006.stdout:4098 punch from 0x55cd0f9 to 0x55d9f0f, (0xce16 bytes) 2024-09-14T06:00:11.292 INFO:teuthology.orchestra.run.smithi006.stdout:4102 read 0x3f883d3 thru 0x3f8cc02 (0x4830 bytes) 2024-09-14T06:00:11.292 INFO:teuthology.orchestra.run.smithi006.stdout:4105 writesame 0x400c2de thru 0x401af84 data_size 0x1(0xeca7 bytes) 2024-09-14T06:00:11.326 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:11.326 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:11.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:00:11.369 INFO:teuthology.orchestra.run.smithi006.stdout:4109 writesame 0xd2340cf thru 0xd23ed2c data_size 0x1(0xac5e bytes) 2024-09-14T06:00:11.369 INFO:teuthology.orchestra.run.smithi006.stdout:4110 write 0x5625f4 thru 0x5651fa (0x2c07 bytes) 2024-09-14T06:00:11.372 INFO:teuthology.orchestra.run.smithi006.stdout:4111 read 0x8169a71 thru 0x816f0ec (0x567c bytes) 2024-09-14T06:00:11.372 INFO:teuthology.orchestra.run.smithi006.stdout:4112 read 0xac24bdf thru 0xac2750d (0x292f bytes) 2024-09-14T06:00:11.372 INFO:teuthology.orchestra.run.smithi006.stdout:4114 write 0x6c84a35 thru 0x6c92371 (0xd93d bytes) 2024-09-14T06:00:11.386 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:11.381+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:11.399 INFO:teuthology.orchestra.run.smithi006.stdout:4115 write 0xeb5cd98 thru 0xeb60f14 (0x417d bytes) 2024-09-14T06:00:11.407 INFO:teuthology.orchestra.run.smithi006.stdout:4118 read 0x1508fe2 thru 0x150bc1e (0x2c3d bytes) 2024-09-14T06:00:11.407 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:11.408 INFO:teuthology.orchestra.run.smithi006.stdout:4121 writesame 0xf1efff thru 0xf2aace data_size 0x3d(0xbad0 bytes) 2024-09-14T06:00:11.417 INFO:teuthology.orchestra.run.smithi006.stdout:4122 read 0x27a7f59 thru 0x27ab4b9 (0x3561 bytes) 2024-09-14T06:00:11.417 INFO:teuthology.orchestra.run.smithi006.stdout:4123 writesame 0x1fdc1cf thru 0x1fe3cc5 data_size 0x7(0x7af7 bytes) 2024-09-14T06:00:11.444 INFO:teuthology.orchestra.run.smithi006.stdout:4124 trunc from 0xeb60f15 to 0x6a156b 2024-09-14T06:00:11.485 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2024-09-14T06:00:11.487 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:11.485+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:11.508 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:11.508 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:11.509 INFO:teuthology.orchestra.run.smithi006.stdout:4125 writesame 0x67e4ee2 thru 0x67eab37 data_size 0x35(0x5c56 bytes) 2024-09-14T06:00:11.512 INFO:teuthology.orchestra.run.smithi006.stdout:4127 trunc from 0x67eab38 to 0x45ae1d6 2024-09-14T06:00:11.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:00:11.526 INFO:teuthology.orchestra.run.smithi006.stdout:4128 write 0x246c2c4 thru 0x2475cc9 (0x9a06 bytes) 2024-09-14T06:00:11.535 INFO:teuthology.orchestra.run.smithi006.stdout:4129 read 0x28e9431 thru 0x28f4dfa (0xb9ca bytes) 2024-09-14T06:00:11.535 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:11.535 INFO:teuthology.orchestra.run.smithi006.stdout:4133 punch from 0x2d0843d to 0x2d15208, (0xcdcb bytes) 2024-09-14T06:00:11.535 INFO:teuthology.orchestra.run.smithi006.stdout:4135 trunc from 0x45ae1d6 to 0x414b467 2024-09-14T06:00:11.546 INFO:teuthology.orchestra.run.smithi006.stdout:4136 write 0x30975ed thru 0x309c55a (0x4f6e bytes) 2024-09-14T06:00:11.555 INFO:teuthology.orchestra.run.smithi006.stdout:4137 writesame 0xa4d486 thru 0xa5c4fe data_size 0x1(0xf079 bytes) 2024-09-14T06:00:11.587 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:11.585+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:11.626 INFO:teuthology.orchestra.run.smithi006.stdout:4138 writesame 0xa2d4351 thru 0xa2db4d3 data_size 0x1(0x7183 bytes) 2024-09-14T06:00:11.626 INFO:teuthology.orchestra.run.smithi006.stdout:4139 read 0x6c8a485 thru 0x6c93e02 (0x997e bytes) 2024-09-14T06:00:11.626 INFO:teuthology.orchestra.run.smithi006.stdout:4141 punch from 0x127ec24 to 0x128b869, (0xcc45 bytes) 2024-09-14T06:00:11.626 INFO:teuthology.orchestra.run.smithi006.stdout:4143 punch from 0x4ccf8c2 to 0x4cd66c6, (0x6e04 bytes) 2024-09-14T06:00:11.644 INFO:teuthology.orchestra.run.smithi006.stdout:4144 writesame 0xe6e4e17 thru 0xe6ee70f data_size 0x1(0x98f9 bytes) 2024-09-14T06:00:11.644 INFO:teuthology.orchestra.run.smithi006.stdout:4146 write 0xe4d3303 thru 0xe4ddf3a (0xac38 bytes) 2024-09-14T06:00:11.651 INFO:teuthology.orchestra.run.smithi006.stdout:4147 write 0xdfbae3a thru 0xdfca6cf (0xf896 bytes) 2024-09-14T06:00:11.659 INFO:teuthology.orchestra.run.smithi006.stdout:4149 punch from 0xa18aa62 to 0xa19578c, (0xad2a bytes) 2024-09-14T06:00:11.659 INFO:teuthology.orchestra.run.smithi006.stdout:4151 write 0xa96a3fb thru 0xa976e90 (0xca96 bytes) 2024-09-14T06:00:11.665 INFO:teuthology.orchestra.run.smithi006.stdout:4152 read 0x337ecbb thru 0x338bd1a (0xd060 bytes) 2024-09-14T06:00:11.665 INFO:teuthology.orchestra.run.smithi006.stdout:4153 punch from 0xd881fa to 0xd97aac, (0xf8b2 bytes) 2024-09-14T06:00:11.665 INFO:teuthology.orchestra.run.smithi006.stdout:4154 writesame 0x271062b thru 0x271c2fe data_size 0xa(0xbcd4 bytes) 2024-09-14T06:00:11.673 INFO:teuthology.orchestra.run.smithi006.stdout:4156 punch from 0x4989dc to 0x4a431d, (0xb941 bytes) 2024-09-14T06:00:11.679 INFO:teuthology.orchestra.run.smithi006.stdout:4157 trunc from 0xe6ee710 to 0xadf2f1a 2024-09-14T06:00:11.685 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:11.685 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:11.687 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:11.684+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:11.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:00:11.707 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:11.707 INFO:teuthology.orchestra.run.smithi006.stdout:4159 read 0x5da2319 thru 0x5daa57d (0x8265 bytes) 2024-09-14T06:00:11.708 INFO:teuthology.orchestra.run.smithi006.stdout:4161 trunc from 0xadf2f1a to 0xb0f5e71 2024-09-14T06:00:11.734 INFO:teuthology.orchestra.run.smithi006.stdout:4163 write 0xb841868 thru 0xb842111 (0x8aa bytes) 2024-09-14T06:00:11.754 INFO:teuthology.orchestra.run.smithi006.stdout:4164 write 0xd389755 thru 0xd3936f5 (0x9fa1 bytes) 2024-09-14T06:00:11.760 INFO:teuthology.orchestra.run.smithi006.stdout:4165 punch from 0x2d0d6a7 to 0x2d148e9, (0x7242 bytes) 2024-09-14T06:00:11.760 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:11.760 INFO:teuthology.orchestra.run.smithi006.stdout:4167 writesame 0x85b7e6b thru 0x85c6d53 data_size 0x39(0xeee9 bytes) 2024-09-14T06:00:11.787 INFO:teuthology.orchestra.run.smithi006.stdout:4168 trunc from 0xd3936f6 to 0x198ed7 2024-09-14T06:00:11.788 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:11.785+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:11.819 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:11.834 INFO:teuthology.orchestra.run.smithi006.stdout:4171 write 0x153ac54 thru 0x154300d (0x83ba bytes) 2024-09-14T06:00:11.839 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:00:11.842 INFO:teuthology.orchestra.run.smithi006.stdout:4172 read 0x3a71d0 thru 0x3af7cd (0x85fe bytes) 2024-09-14T06:00:11.849 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:11.849 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:11.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:00:11.874 INFO:teuthology.orchestra.run.smithi006.stdout:4173 writesame 0xc7406d2 thru 0xc7414cc data_size 0x1(0xdfb bytes) 2024-09-14T06:00:11.874 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:11.874 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:11.874 INFO:teuthology.orchestra.run.smithi006.stdout:4178 read 0x99700c3 thru 0x99786a1 (0x85df bytes) 2024-09-14T06:00:11.874 INFO:teuthology.orchestra.run.smithi006.stdout:4180 punch from 0x1b91432 to 0x1b932db, (0x1ea9 bytes) 2024-09-14T06:00:11.874 INFO:teuthology.orchestra.run.smithi006.stdout:4181 write 0x110f173 thru 0x11161bb (0x7049 bytes) 2024-09-14T06:00:11.880 INFO:teuthology.orchestra.run.smithi006.stdout:4182 write 0x730dda8 thru 0x731bde1 (0xe03a bytes) 2024-09-14T06:00:11.888 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:11.883+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:11.890 INFO:teuthology.orchestra.run.smithi006.stdout:4183 read 0x2d99ec8 thru 0x2da2988 (0x8ac1 bytes) 2024-09-14T06:00:11.890 INFO:teuthology.orchestra.run.smithi006.stdout:4184 read 0xc4c61e5 thru 0xc4ce870 (0x868c bytes) 2024-09-14T06:00:11.890 INFO:teuthology.orchestra.run.smithi006.stdout:4185 write 0x26b73ea thru 0x26c40a1 (0xccb8 bytes) 2024-09-14T06:00:11.911 INFO:teuthology.orchestra.run.smithi006.stdout:4186 write 0xd89d81f thru 0xd8a8df5 (0xb5d7 bytes) 2024-09-14T06:00:11.919 INFO:teuthology.orchestra.run.smithi006.stdout:4187 write 0xc1c9419 thru 0xc1d7239 (0xde21 bytes) 2024-09-14T06:00:11.938 INFO:teuthology.orchestra.run.smithi006.stdout:4188 write 0xeaafbf8 thru 0xeab6c23 (0x702c bytes) 2024-09-14T06:00:11.944 INFO:teuthology.orchestra.run.smithi006.stdout:4189 read 0x30ad0bc thru 0x30b71be (0xa103 bytes) 2024-09-14T06:00:11.944 INFO:teuthology.orchestra.run.smithi006.stdout:4191 trunc from 0xeab6c24 to 0xecd47ca 2024-09-14T06:00:11.957 INFO:teuthology.orchestra.run.smithi006.stdout:4192 read 0x314626a thru 0x314fd61 (0x9af8 bytes) 2024-09-14T06:00:11.957 INFO:teuthology.orchestra.run.smithi006.stdout:4195 writesame 0x8fa7536 thru 0x8fb71cf data_size 0x3e(0xfc9a bytes) 2024-09-14T06:00:11.966 INFO:teuthology.orchestra.run.smithi006.stdout:4198 write 0x67d476c thru 0x67d5cbf (0x1554 bytes) 2024-09-14T06:00:11.971 INFO:teuthology.orchestra.run.smithi006.stdout:4199 write 0x6d70a82 thru 0x6d7a8f1 (0x9e70 bytes) 2024-09-14T06:00:11.989 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:11.987+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:11.990 INFO:teuthology.orchestra.run.smithi006.stdout:4205 trunc from 0xecd47ca to 0x5375c5f 2024-09-14T06:00:12.008 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:12.008 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:12.013 INFO:teuthology.orchestra.run.smithi006.stdout:4207 read 0x38d0982 thru 0x38dc92e (0xbfad bytes) 2024-09-14T06:00:12.013 INFO:teuthology.orchestra.run.smithi006.stdout:4208 punch from 0x4401f71 to 0x440ba38, (0x9ac7 bytes) 2024-09-14T06:00:12.013 INFO:teuthology.orchestra.run.smithi006.stdout:4209 read 0x18f07ca thru 0x18f8254 (0x7a8b bytes) 2024-09-14T06:00:12.018 INFO:teuthology.orchestra.run.smithi006.stdout:4210 trunc from 0x5375c5f to 0x19155a6 2024-09-14T06:00:12.020 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:12.020 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:12.028 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:12.028 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:12.038 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:00:12.048 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:12.048 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:12.064 INFO:teuthology.orchestra.run.smithi006.stdout:4211 write 0xaa7ee68 thru 0xaa8af1e (0xc0b7 bytes) 2024-09-14T06:00:12.067 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:12.067 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:12.071 INFO:teuthology.orchestra.run.smithi006.stdout:4212 writesame 0x14bdbac thru 0x14c2160 data_size 0x5(0x45b5 bytes) 2024-09-14T06:00:12.078 INFO:teuthology.orchestra.run.smithi006.stdout:4213 writesame 0x44b1620 thru 0x44b3319 data_size 0x1(0x1cfa bytes) 2024-09-14T06:00:12.084 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:12.089 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:12.085+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:12.093 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:12.093 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:12.096 INFO:teuthology.orchestra.run.smithi006.stdout:4215 writesame 0xb499190 thru 0xb4a1d3a data_size 0x1(0x8bab bytes) 2024-09-14T06:00:12.096 INFO:teuthology.orchestra.run.smithi006.stdout:4216 write 0x410f30c thru 0x4112465 (0x315a bytes) 2024-09-14T06:00:12.116 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:12.116 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:12.118 INFO:teuthology.orchestra.run.smithi006.stdout:4217 write 0xdba51ac thru 0xdbab262 (0x60b7 bytes) 2024-09-14T06:00:12.125 INFO:teuthology.orchestra.run.smithi006.stdout:4219 punch from 0xc267392 to 0xc2703ec, (0x905a bytes) 2024-09-14T06:00:12.125 INFO:teuthology.orchestra.run.smithi006.stdout:4220 write 0x87c98e8 thru 0x87cc9b6 (0x30cf bytes) 2024-09-14T06:00:12.130 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:12.130 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:12.130 INFO:teuthology.orchestra.run.smithi006.stdout:4223 punch from 0xade9382 to 0xadf55ec, (0xc26a bytes) 2024-09-14T06:00:12.130 INFO:teuthology.orchestra.run.smithi006.stdout:4225 punch from 0x1f3f229 to 0x1f4ea00, (0xf7d7 bytes) 2024-09-14T06:00:12.130 INFO:teuthology.orchestra.run.smithi006.stdout:4226 punch from 0xa46cb8e to 0xa47ac48, (0xe0ba bytes) 2024-09-14T06:00:12.134 INFO:teuthology.orchestra.run.smithi006.stdout:4228 trunc from 0xdbab263 to 0xad0e48f 2024-09-14T06:00:12.139 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:12.140 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:12.155 INFO:teuthology.orchestra.run.smithi006.stdout:4230 writesame 0x5bbd68e thru 0x5bcd63b data_size 0x3(0xffae bytes) 2024-09-14T06:00:12.164 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:12.170 INFO:teuthology.orchestra.run.smithi006.stdout:4231 write 0x947a1e5 thru 0x9488d45 (0xeb61 bytes) 2024-09-14T06:00:12.183 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:12.183 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:12.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.183 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:78962 3.15 e70/24 3:ae7df590:::rbd_data.1127113d518e.0000000000000094:head v 70'440, mlcod=70'438)", 2024-09-14T06:00:12.183 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:12.179747+0000", 2024-09-14T06:00:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0039462969999999997, 2024-09-14T06:00:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039652079999999996, 2024-09-14T06:00:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:12.179747+0000", 2024-09-14T06:00:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:12.179747+0000", 2024-09-14T06:00:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:12.179747+0000", 2024-09-14T06:00:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5099999999999999e-07 2024-09-14T06:00:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:12.179755+0000", 2024-09-14T06:00:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6429999999999995e-06 2024-09-14T06:00:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:12.179765+0000", 2024-09-14T06:00:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8109999999999997e-06 2024-09-14T06:00:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:12.179769+0000", 2024-09-14T06:00:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4880000000000001e-06 2024-09-14T06:00:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:12.179821+0000", 2024-09-14T06:00:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1567999999999998e-05 2024-09-14T06:00:12.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:12.179845+0000", 2024-09-14T06:00:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3952e-05 2024-09-14T06:00:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:12.183695+0000", 2024-09-14T06:00:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0038502010000000001 2024-09-14T06:00:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.187 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:00:12.188 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 1 2024-09-14T06:00:12.188 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:12.188 INFO:teuthology.orchestra.run.smithi006.stdout:4232 read 0x5083737 thru 0x508c80f (0x90d9 bytes) 2024-09-14T06:00:12.188 INFO:teuthology.orchestra.run.smithi006.stdout:4233 read 0x956dc5 thru 0x95d4fe (0x673a bytes) 2024-09-14T06:00:12.188 INFO:teuthology.orchestra.run.smithi006.stdout:4236 write 0xa1ed27f thru 0xa1f61ae (0x8f30 bytes) 2024-09-14T06:00:12.190 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:12.187+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:12.192 INFO:teuthology.orchestra.run.smithi006.stdout:4238 punch from 0x3da0311 to 0x3dab300, (0xafef bytes) 2024-09-14T06:00:12.192 INFO:teuthology.orchestra.run.smithi006.stdout:4241 read 0x223f227 thru 0x22462db (0x70b5 bytes) 2024-09-14T06:00:12.192 INFO:teuthology.orchestra.run.smithi006.stdout:4242 read 0x926986d thru 0x9277e4a (0xe5de bytes) 2024-09-14T06:00:12.201 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:00:12.204 INFO:teuthology.orchestra.run.smithi006.stdout:4243 write 0xb8b4a82 thru 0xb8b56b2 (0xc31 bytes) 2024-09-14T06:00:12.208 INFO:teuthology.orchestra.run.smithi006.stdout:4245 write 0x28e83f2 thru 0x28ee063 (0x5c72 bytes) 2024-09-14T06:00:12.213 INFO:teuthology.orchestra.run.smithi006.stdout:4246 write 0x1639a20 thru 0x16491f6 (0xf7d7 bytes) 2024-09-14T06:00:12.219 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:12.219 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:12.219 INFO:teuthology.orchestra.run.smithi006.stdout:4250 writesame 0x6a9c179 thru 0x6aa0c61 data_size 0x1(0x4ae9 bytes) 2024-09-14T06:00:12.246 INFO:teuthology.orchestra.run.smithi006.stdout:4251 write 0x5efab05 thru 0x5f09ff6 (0xf4f2 bytes) 2024-09-14T06:00:12.252 INFO:teuthology.orchestra.run.smithi006.stdout:4253 write 0xb2e3f01 thru 0xb2e3fc8 (0xc8 bytes) 2024-09-14T06:00:12.255 INFO:teuthology.orchestra.run.smithi006.stdout:4254 writesame 0x8cadcc6 thru 0x8cb65d1 data_size 0xe(0x890c bytes) 2024-09-14T06:00:12.261 INFO:teuthology.orchestra.run.smithi006.stdout:4255 write 0x946c807 thru 0x9474556 (0x7d50 bytes) 2024-09-14T06:00:12.266 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:12.266 INFO:teuthology.orchestra.run.smithi006.stdout:4259 writesame 0x561c882 thru 0x56232e3 data_size 0x66(0x6a62 bytes) 2024-09-14T06:00:12.272 INFO:teuthology.orchestra.run.smithi006.stdout:4260 read 0x9f7b46b thru 0x9f80459 (0x4fef bytes) 2024-09-14T06:00:12.273 INFO:teuthology.orchestra.run.smithi006.stdout:4262 writesame 0x7409d60 thru 0x740ff8d data_size 0x3b(0x622e bytes) 2024-09-14T06:00:12.277 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:12.278 INFO:teuthology.orchestra.run.smithi006.stdout:4267 read 0x69a9359 thru 0x69b2911 (0x95b9 bytes) 2024-09-14T06:00:12.291 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:12.287+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:12.294 INFO:teuthology.orchestra.run.smithi006.stdout:4268 trunc from 0xb8b56b3 to 0xf85fa5 2024-09-14T06:00:12.333 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:12.336 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:12.336 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:12.336 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:12.336 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:12.336 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:12.358 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:00:12.371 INFO:teuthology.orchestra.run.smithi006.stdout:4270 write 0xe4efbad thru 0xe4f0129 (0x57d bytes) 2024-09-14T06:00:12.376 INFO:teuthology.orchestra.run.smithi006.stdout:4271 writesame 0x3bf75b3 thru 0x3bfa952 data_size 0x20(0x33a0 bytes) 2024-09-14T06:00:12.382 INFO:teuthology.orchestra.run.smithi006.stdout:4272 punch from 0xc8862f1 to 0xc88b26a, (0x4f79 bytes) 2024-09-14T06:00:12.382 INFO:teuthology.orchestra.run.smithi006.stdout:4273 read 0xaa7e984 thru 0xaa813dc (0x2a59 bytes) 2024-09-14T06:00:12.382 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:12.389 INFO:teuthology.orchestra.run.smithi006.stdout:4276 trunc from 0xe4f012a to 0xa415caf 2024-09-14T06:00:12.392 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:12.387+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:12.407 INFO:teuthology.orchestra.run.smithi006.stdout:4277 write 0x80274b0 thru 0x8034464 (0xcfb5 bytes) 2024-09-14T06:00:12.415 INFO:teuthology.orchestra.run.smithi006.stdout:4278 writesame 0x868aeea thru 0x868b85f data_size 0x2(0x976 bytes) 2024-09-14T06:00:12.419 INFO:teuthology.orchestra.run.smithi006.stdout:4279 writesame 0x4bfb4e9 thru 0x4c00bd6 data_size 0x3(0x56ee bytes) 2024-09-14T06:00:12.427 INFO:teuthology.orchestra.run.smithi006.stdout:4280 trunc from 0xa415caf to 0xa2cefeb 2024-09-14T06:00:12.440 INFO:teuthology.orchestra.run.smithi006.stdout:4281 read 0x75013ea thru 0x750cbdd (0xb7f4 bytes) 2024-09-14T06:00:12.440 INFO:teuthology.orchestra.run.smithi006.stdout:4282 writesame 0x2304296 thru 0x230ac19 data_size 0x6(0x6984 bytes) 2024-09-14T06:00:12.449 INFO:teuthology.orchestra.run.smithi006.stdout:4283 writesame 0x9b7438d thru 0x9b7d1f8 data_size 0xa(0x8e6c bytes) 2024-09-14T06:00:12.459 INFO:teuthology.orchestra.run.smithi006.stdout:4287 writesame 0x64f8ca1 thru 0x64fca7e data_size 0x1(0x3dde bytes) 2024-09-14T06:00:12.492 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:12.489+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:12.501 INFO:teuthology.orchestra.run.smithi006.stdout:4288 write 0xb96369c thru 0xb9639b7 (0x31c bytes) 2024-09-14T06:00:12.512 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:00:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:00:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54658 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 610304~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.370999312999999, 2024-09-14T06:00:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091840061000000001, 2024-09-14T06:00:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.512 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54658 2024-09-14T06:00:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:12.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4700000000000002e-07 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139687+0000", 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7170000000000008e-06 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139694+0000", 2024-09-14T06:00:12.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.063e-06 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139709+0000", 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4324999999999999e-05 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231262+0000", 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091553866999999997 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231375+0000", 2024-09-14T06:00:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000112927 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231519+0000", 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014371499999999999 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54659 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 616448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.370960965999998, 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092177035000000004, 2024-09-14T06:00:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54659 2024-09-14T06:00:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139718+0000", 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9699999999999996e-07 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139731+0000", 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2993000000000001e-05 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139738+0000", 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4610000000000002e-06 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139744+0000", 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6389999999999997e-06 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231570+0000", 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091826216000000002 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.519 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231662+0000", 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2101000000000005e-05 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231894+0000", 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023212800000000001 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54660 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 622592~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:12.520 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.370925631999999, 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092366887999999994, 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54660 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T06:00:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139755+0000", 2024-09-14T06:00:12.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T06:00:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139762+0000", 2024-09-14T06:00:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6719999999999998e-06 2024-09-14T06:00:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139767+0000", 2024-09-14T06:00:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9819999999999999e-06 2024-09-14T06:00:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.523 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231917+0000", 2024-09-14T06:00:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092149872999999993 2024-09-14T06:00:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231969+0000", 2024-09-14T06:00:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2642000000000002e-05 2024-09-14T06:00:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232120+0000", 2024-09-14T06:00:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015011899999999999 2024-09-14T06:00:12.524 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54844 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 0~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.370904141, 2024-09-14T06:00:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092708507999999995, 2024-09-14T06:00:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.525 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54844 2024-09-14T06:00:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:12.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139775+0000", 2024-09-14T06:00:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3500000000000002e-07 2024-09-14T06:00:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139777+0000", 2024-09-14T06:00:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.979e-06 2024-09-14T06:00:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139787+0000", 2024-09-14T06:00:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0779e-05 2024-09-14T06:00:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139799+0000", 2024-09-14T06:00:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1719000000000001e-05 2024-09-14T06:00:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232151+0000", 2024-09-14T06:00:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092351767000000001 2024-09-14T06:00:12.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232217+0000", 2024-09-14T06:00:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6655000000000005e-05 2024-09-14T06:00:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232483+0000", 2024-09-14T06:00:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026517400000000002 2024-09-14T06:00:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54845 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 55296~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.37087047, 2024-09-14T06:00:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093127583999999999, 2024-09-14T06:00:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54845 2024-09-14T06:00:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:12.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4899999999999995e-07 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139811+0000", 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000001e-06 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139821+0000", 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0168e-05 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139826+0000", 2024-09-14T06:00:12.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2780000000000001e-06 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232556+0000", 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092729729999999996 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232652+0000", 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680999999999994e-05 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232935+0000", 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000283758 2024-09-14T06:00:12.533 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54846 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.370844163000001, 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093492079000000006, 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.534 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54846 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139835+0000", 2024-09-14T06:00:12.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139837+0000", 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1059999999999998e-06 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139845+0000", 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4300000000000006e-06 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139851+0000", 2024-09-14T06:00:12.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232987+0000", 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093136073999999999 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233075+0000", 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7318999999999995e-05 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233326+0000", 2024-09-14T06:00:12.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025159 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54847 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 67584~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.370818447000001, 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093777452999999997, 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.538 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54847 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T06:00:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139862+0000", 2024-09-14T06:00:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0200000000000001e-06 2024-09-14T06:00:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139870+0000", 2024-09-14T06:00:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0520000000000002e-06 2024-09-14T06:00:12.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139875+0000", 2024-09-14T06:00:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:00:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233389+0000", 2024-09-14T06:00:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093514054999999999 2024-09-14T06:00:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233443+0000", 2024-09-14T06:00:12.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3913999999999999e-05 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233637+0000", 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019392899999999999 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54848 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 73728~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.370795351000002, 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094064464, 2024-09-14T06:00:12.542 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54848 2024-09-14T06:00:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T06:00:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139885+0000", 2024-09-14T06:00:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9929999999999998e-06 2024-09-14T06:00:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139893+0000", 2024-09-14T06:00:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9759999999999995e-06 2024-09-14T06:00:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139898+0000", 2024-09-14T06:00:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6059999999999996e-06 2024-09-14T06:00:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233681+0000", 2024-09-14T06:00:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093782921000000005 2024-09-14T06:00:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233730+0000", 2024-09-14T06:00:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9410999999999998e-05 2024-09-14T06:00:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233947+0000", 2024-09-14T06:00:12.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021710300000000001 2024-09-14T06:00:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54849 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.370771895000001, 2024-09-14T06:00:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094499257000000003, 2024-09-14T06:00:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.547 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54849 2024-09-14T06:00:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139907+0000", 2024-09-14T06:00:12.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T06:00:12.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139909+0000", 2024-09-14T06:00:12.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T06:00:12.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139916+0000", 2024-09-14T06:00:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T06:00:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139921+0000", 2024-09-14T06:00:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:00:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234032+0000", 2024-09-14T06:00:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094111037999999994 2024-09-14T06:00:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234150+0000", 2024-09-14T06:00:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118408 2024-09-14T06:00:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234406+0000", 2024-09-14T06:00:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025540600000000001 2024-09-14T06:00:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.551 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54850 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 135168~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.370750186999999, 2024-09-14T06:00:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094814605999999996, 2024-09-14T06:00:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54850 2024-09-14T06:00:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139929+0000", 2024-09-14T06:00:12.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T06:00:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139931+0000", 2024-09-14T06:00:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.024e-06 2024-09-14T06:00:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139937+0000", 2024-09-14T06:00:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3770000000000001e-06 2024-09-14T06:00:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139942+0000", 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0289999999999996e-06 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234447+0000", 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094505426000000003 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234539+0000", 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1793999999999996e-05 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234743+0000", 2024-09-14T06:00:12.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020354600000000001 2024-09-14T06:00:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54851 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 141312~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.370728475, 2024-09-14T06:00:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095179749999999994, 2024-09-14T06:00:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.556 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54851 2024-09-14T06:00:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139952+0000", 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0600000000000002e-06 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139959+0000", 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.584e-06 2024-09-14T06:00:12.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139964+0000", 2024-09-14T06:00:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8890000000000001e-06 2024-09-14T06:00:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234786+0000", 2024-09-14T06:00:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094822241000000002 2024-09-14T06:00:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234877+0000", 2024-09-14T06:00:12.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1158999999999999e-05 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235130+0000", 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025235999999999998 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54852 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 147456~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.370707347, 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095437742000000006, 2024-09-14T06:00:12.560 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54852 2024-09-14T06:00:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140125+0000", 2024-09-14T06:00:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154332 2024-09-14T06:00:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140130+0000", 2024-09-14T06:00:12.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.284e-06 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140140+0000", 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0789e-05 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140147+0000", 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9879999999999998e-06 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235174+0000", 2024-09-14T06:00:12.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095026749999999993 2024-09-14T06:00:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235230+0000", 2024-09-14T06:00:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6224000000000002e-05 2024-09-14T06:00:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235409+0000", 2024-09-14T06:00:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017837500000000001 2024-09-14T06:00:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54853 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 202752~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.370518525000001, 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095632919999999996, 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54853 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147748+0000", 2024-09-14T06:00:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075884910000000002 2024-09-14T06:00:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147798+0000", 2024-09-14T06:00:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0152999999999999e-05 2024-09-14T06:00:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147814+0000", 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5866e-05 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147831+0000", 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6991999999999999e-05 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235451+0000", 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087620077000000005 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235539+0000", 2024-09-14T06:00:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7800000000000006e-05 2024-09-14T06:00:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235793+0000", 2024-09-14T06:00:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025354099999999998 2024-09-14T06:00:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54868 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 442368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:12.569 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.362328205000001, 2024-09-14T06:00:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091802783999999998, 2024-09-14T06:00:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54868 2024-09-14T06:00:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:12.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148351+0000", 2024-09-14T06:00:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6800000000000001e-07 2024-09-14T06:00:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148353+0000", 2024-09-14T06:00:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2299999999999998e-06 2024-09-14T06:00:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148362+0000", 2024-09-14T06:00:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9800000000000004e-06 2024-09-14T06:00:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148367+0000", 2024-09-14T06:00:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.327e-06 2024-09-14T06:00:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.239863+0000", 2024-09-14T06:00:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091496018999999998 2024-09-14T06:00:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.239932+0000", 2024-09-14T06:00:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8838999999999996e-05 2024-09-14T06:00:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240153+0000", 2024-09-14T06:00:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00022092100000000001 2024-09-14T06:00:12.573 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54869 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 497664~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.362302307, 2024-09-14T06:00:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092147413999999997, 2024-09-14T06:00:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.574 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54869 2024-09-14T06:00:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148377+0000", 2024-09-14T06:00:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1399999999999997e-07 2024-09-14T06:00:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148379+0000", 2024-09-14T06:00:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.429e-06 2024-09-14T06:00:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148389+0000", 2024-09-14T06:00:12.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9029999999999999e-06 2024-09-14T06:00:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148395+0000", 2024-09-14T06:00:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5080000000000002e-06 2024-09-14T06:00:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240191+0000", 2024-09-14T06:00:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091796066999999995 2024-09-14T06:00:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.577 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240284+0000", 2024-09-14T06:00:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2445e-05 2024-09-14T06:00:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240523+0000", 2024-09-14T06:00:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023954799999999999 2024-09-14T06:00:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.578 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54870 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 503808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.362272978, 2024-09-14T06:00:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092420756000000007, 2024-09-14T06:00:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54870 2024-09-14T06:00:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.579 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148406+0000", 2024-09-14T06:00:12.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T06:00:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148409+0000", 2024-09-14T06:00:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T06:00:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148418+0000", 2024-09-14T06:00:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7329999999999998e-06 2024-09-14T06:00:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148425+0000", 2024-09-14T06:00:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2079999999999997e-06 2024-09-14T06:00:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240591+0000", 2024-09-14T06:00:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092166441000000002 2024-09-14T06:00:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240648+0000", 2024-09-14T06:00:12.582 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6733e-05 2024-09-14T06:00:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240826+0000", 2024-09-14T06:00:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017834700000000001 2024-09-14T06:00:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54871 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 509952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.362243018000001, 2024-09-14T06:00:12.583 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092702341999999993, 2024-09-14T06:00:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54871 2024-09-14T06:00:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:12.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148436+0000", 2024-09-14T06:00:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5499999999999998e-07 2024-09-14T06:00:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.585 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148439+0000", 2024-09-14T06:00:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8090000000000001e-06 2024-09-14T06:00:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148449+0000", 2024-09-14T06:00:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0115000000000001e-05 2024-09-14T06:00:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148466+0000", 2024-09-14T06:00:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6761000000000001e-05 2024-09-14T06:00:12.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240857+0000", 2024-09-14T06:00:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092391089999999995 2024-09-14T06:00:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240939+0000", 2024-09-14T06:00:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2387999999999998e-05 2024-09-14T06:00:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241138+0000", 2024-09-14T06:00:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000198624 2024-09-14T06:00:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54872 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 516096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.362201819999999, 2024-09-14T06:00:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093126020000000004, 2024-09-14T06:00:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.588 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54872 2024-09-14T06:00:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.589 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155484+0000", 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070072429999999998 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155490+0000", 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6379999999999998e-06 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.590 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155504+0000", 2024-09-14T06:00:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4065e-05 2024-09-14T06:00:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155513+0000", 2024-09-14T06:00:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6799999999999999e-06 2024-09-14T06:00:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241216+0000", 2024-09-14T06:00:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085702922000000001 2024-09-14T06:00:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241277+0000", 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0980000000000002e-05 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241602+0000", 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032549199999999998 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54888 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 114688~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.592 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.354757338999999, 2024-09-14T06:00:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091627085999999996, 2024-09-14T06:00:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54888 2024-09-14T06:00:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8299999999999998e-07 2024-09-14T06:00:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155923+0000", 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4720000000000001e-06 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155926+0000", 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.444e-06 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155929+0000", 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247321+0000", 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091391587999999996 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247382+0000", 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1944000000000002e-05 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247548+0000", 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000165558 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54889 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 169984~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.354744739000001, 2024-09-14T06:00:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091908118999999996, 2024-09-14T06:00:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54889 2024-09-14T06:00:12.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163444+0000", 2024-09-14T06:00:12.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00751033 2024-09-14T06:00:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163454+0000", 2024-09-14T06:00:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0579e-05 2024-09-14T06:00:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163468+0000", 2024-09-14T06:00:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3794999999999999e-05 2024-09-14T06:00:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163487+0000", 2024-09-14T06:00:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8907999999999999e-05 2024-09-14T06:00:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247591+0000", 2024-09-14T06:00:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084103333000000002 2024-09-14T06:00:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247651+0000", 2024-09-14T06:00:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0587000000000001e-05 2024-09-14T06:00:12.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247842+0000", 2024-09-14T06:00:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019058700000000001 2024-09-14T06:00:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:12.601 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:12.601 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:12.601 INFO:teuthology.orchestra.run.smithi006.stdout:4289 trunc from 0xb9639b8 to 0x6f06393 2024-09-14T06:00:12.602 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:00:12.603 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:12.603 INFO:teuthology.orchestra.run.smithi006.stdout:4291 write 0xa4e8db7 thru 0xa4f6bc9 (0xde13 bytes) 2024-09-14T06:00:12.603 INFO:teuthology.orchestra.run.smithi006.stdout:4292 read 0x55a7db4 thru 0x55b742a (0xf677 bytes) 2024-09-14T06:00:12.604 INFO:teuthology.orchestra.run.smithi006.stdout:4293 write 0x6b11971 thru 0x6b144af (0x2b3f bytes) 2024-09-14T06:00:12.604 INFO:teuthology.orchestra.run.smithi006.stdout:4295 write 0xb79a4c4 thru 0xb7a4746 (0xa283 bytes) 2024-09-14T06:00:12.605 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:12.603+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:12.608 INFO:teuthology.orchestra.run.smithi006.stdout:4296 clone 25 order 25 su 131072 sc 11 2024-09-14T06:00:12.705 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:12.705+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:12.734 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:12.734 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:12.734 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:12.748 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:00:12.806 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:12.803+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:12.872 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:12.872 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:12.872 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:12.872 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:12.872 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:12.886 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:00:12.933 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:12.931+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:13.008 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:13.005+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:13.060 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:13.060 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:13.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:13.060 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:13.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.060 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23550 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 606208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.060 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:13.060 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.109817927999998, 2024-09-14T06:00:13.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048793072999999999, 2024-09-14T06:00:13.060 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.061 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.061 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.061 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.061 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.061 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.061 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23550 2024-09-14T06:00:13.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.061 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:13.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:13.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:13.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7800000000000002e-07 2024-09-14T06:00:13.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948677+0000", 2024-09-14T06:00:13.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1949999999999997e-06 2024-09-14T06:00:13.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948687+0000", 2024-09-14T06:00:13.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0849000000000001e-05 2024-09-14T06:00:13.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948692+0000", 2024-09-14T06:00:13.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8670000000000002e-06 2024-09-14T06:00:13.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997290+0000", 2024-09-14T06:00:13.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048597596999999999 2024-09-14T06:00:13.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997367+0000", 2024-09-14T06:00:13.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7236000000000004e-05 2024-09-14T06:00:13.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997462+0000", 2024-09-14T06:00:13.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4951000000000006e-05 2024-09-14T06:00:13.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.065 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.065 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.065 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23551 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 620544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.065 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:13.065 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.109787071, 2024-09-14T06:00:13.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048938838999999998, 2024-09-14T06:00:13.065 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.065 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.065 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.066 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.066 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23551 2024-09-14T06:00:13.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.066 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:13.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:13.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1e-07 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948701+0000", 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2950000000000001e-06 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948705+0000", 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7929999999999999e-06 2024-09-14T06:00:13.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948709+0000", 2024-09-14T06:00:13.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T06:00:13.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997535+0000", 2024-09-14T06:00:13.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048826181000000003 2024-09-14T06:00:13.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997580+0000", 2024-09-14T06:00:13.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5355000000000002e-05 2024-09-14T06:00:13.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997639+0000", 2024-09-14T06:00:13.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8479e-05 2024-09-14T06:00:13.069 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.069 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.069 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.069 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.069 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:13.069 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.109771594000001, 2024-09-14T06:00:13.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T06:00:13.070 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.070 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.070 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.070 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.070 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.070 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.070 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T06:00:13.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.070 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:13.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:13.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T06:00:13.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T06:00:13.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.073 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.074 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.074 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:13.074 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.109752319000002, 2024-09-14T06:00:13.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T06:00:13.074 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.074 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.074 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.074 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.074 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.074 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.074 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T06:00:13.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.075 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:13.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:13.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:13.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T06:00:13.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T06:00:13.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T06:00:13.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T06:00:13.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T06:00:13.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T06:00:13.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T06:00:13.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T06:00:13.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T06:00:13.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T06:00:13.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.109732743000002, 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T06:00:13.078 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.079 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.079 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.079 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T06:00:13.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.079 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:13.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:13.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T06:00:13.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T06:00:13.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T06:00:13.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T06:00:13.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T06:00:13.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:13.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T06:00:13.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T06:00:13.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.109713286000002, 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:13.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:13.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:13.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T06:00:13.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T06:00:13.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T06:00:13.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T06:00:13.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T06:00:13.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T06:00:13.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T06:00:13.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T06:00:13.087 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.087 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.087 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.087 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.087 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:13.087 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.109694234999999, 2024-09-14T06:00:13.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T06:00:13.087 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.087 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.087 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.087 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.087 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.088 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.088 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T06:00:13.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.088 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:13.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:13.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:13.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T06:00:13.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T06:00:13.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T06:00:13.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T06:00:13.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T06:00:13.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T06:00:13.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T06:00:13.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T06:00:13.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T06:00:13.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T06:00:13.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T06:00:13.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T06:00:13.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T06:00:13.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.092 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.092 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.092 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:13.092 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.109674554000001, 2024-09-14T06:00:13.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T06:00:13.092 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.092 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.092 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.092 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.093 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T06:00:13.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.093 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:13.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:13.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T06:00:13.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T06:00:13.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T06:00:13.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T06:00:13.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T06:00:13.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:13.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T06:00:13.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T06:00:13.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T06:00:13.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T06:00:13.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T06:00:13.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T06:00:13.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T06:00:13.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T06:00:13.096 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.096 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.096 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.097 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.097 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:13.097 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.109654603000003, 2024-09-14T06:00:13.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T06:00:13.097 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.097 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.097 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.097 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T06:00:13.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.098 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:13.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:13.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T06:00:13.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T06:00:13.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T06:00:13.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T06:00:13.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T06:00:13.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T06:00:13.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T06:00:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T06:00:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.109635290999996, 2024-09-14T06:00:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T06:00:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:13.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:13.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T06:00:13.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T06:00:13.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T06:00:13.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T06:00:13.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T06:00:13.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T06:00:13.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T06:00:13.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T06:00:13.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T06:00:13.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T06:00:13.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T06:00:13.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T06:00:13.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T06:00:13.105 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.105 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.105 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.106 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.106 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:13.106 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.109615529999999, 2024-09-14T06:00:13.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T06:00:13.106 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.106 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.106 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.106 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T06:00:13.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.107 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:13.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:13.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T06:00:13.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:00:13.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T06:00:13.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T06:00:13.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T06:00:13.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T06:00:13.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T06:00:13.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T06:00:13.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T06:00:13.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T06:00:13.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T06:00:13.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T06:00:13.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T06:00:13.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T06:00:13.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.110 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.110 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.110 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:13.110 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.109594608999998, 2024-09-14T06:00:13.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T06:00:13.110 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.111 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.111 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.111 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T06:00:13.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.111 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:13.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:13.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T06:00:13.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T06:00:13.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T06:00:13.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T06:00:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T06:00:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T06:00:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T06:00:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T06:00:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T06:00:13.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T06:00:13.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T06:00:13.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T06:00:13.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T06:00:13.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T06:00:13.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.114 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.115 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.115 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:13.115 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.108435274999998, 2024-09-14T06:00:13.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T06:00:13.115 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.115 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.115 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.115 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T06:00:13.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.116 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:13.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:13.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T06:00:13.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T06:00:13.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T06:00:13.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T06:00:13.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T06:00:13.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T06:00:13.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T06:00:13.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T06:00:13.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T06:00:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T06:00:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T06:00:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T06:00:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T06:00:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T06:00:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.185 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.185 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:13.185 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.108136493000003, 2024-09-14T06:00:13.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T06:00:13.185 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.185 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.185 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.185 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.185 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.185 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.185 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T06:00:13.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.186 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:13.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:13.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T06:00:13.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T06:00:13.189 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.189 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.189 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.189 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.189 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:13.189 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.107985755000001, 2024-09-14T06:00:13.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T06:00:13.189 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.189 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.190 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.190 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.190 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.190 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.190 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T06:00:13.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.190 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:13.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T06:00:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T06:00:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T06:00:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T06:00:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T06:00:13.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T06:00:13.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T06:00:13.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T06:00:13.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T06:00:13.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T06:00:13.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T06:00:13.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T06:00:13.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T06:00:13.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T06:00:13.193 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.193 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.193 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23582 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 911360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.107060367999999, 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048708939999999999, 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23582 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:13.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:13.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:13.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6300000000000005e-07 2024-09-14T06:00:13.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951430+0000", 2024-09-14T06:00:13.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5179999999999999e-06 2024-09-14T06:00:13.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951437+0000", 2024-09-14T06:00:13.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0940000000000002e-06 2024-09-14T06:00:13.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951443+0000", 2024-09-14T06:00:13.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7910000000000001e-06 2024-09-14T06:00:13.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000047+0000", 2024-09-14T06:00:13.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048604550000000003 2024-09-14T06:00:13.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000095+0000", 2024-09-14T06:00:13.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7735999999999998e-05 2024-09-14T06:00:13.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000135+0000", 2024-09-14T06:00:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0587999999999998e-05 2024-09-14T06:00:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23588 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 722944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.107035502999999, 2024-09-14T06:00:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048792653999999998, 2024-09-14T06:00:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.199 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.199 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.199 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23588 2024-09-14T06:00:13.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.199 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:13.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:13.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951665+0000", 2024-09-14T06:00:13.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021337600000000001 2024-09-14T06:00:13.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951669+0000", 2024-09-14T06:00:13.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3460000000000004e-06 2024-09-14T06:00:13.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951688+0000", 2024-09-14T06:00:13.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9042000000000002e-05 2024-09-14T06:00:13.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951696+0000", 2024-09-14T06:00:13.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6660000000000008e-06 2024-09-14T06:00:13.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000162+0000", 2024-09-14T06:00:13.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048465824999999997 2024-09-14T06:00:13.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000199+0000", 2024-09-14T06:00:13.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7143e-05 2024-09-14T06:00:13.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000244+0000", 2024-09-14T06:00:13.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5256000000000002e-05 2024-09-14T06:00:13.202 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.202 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.202 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.203 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23590 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 745472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.203 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:13.203 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.106778048000002, 2024-09-14T06:00:13.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048677684999999998, 2024-09-14T06:00:13.203 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.203 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.203 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.203 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.203 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.203 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.203 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23590 2024-09-14T06:00:13.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.204 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:13.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:13.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951850+0000", 2024-09-14T06:00:13.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014113 2024-09-14T06:00:13.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951855+0000", 2024-09-14T06:00:13.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6349999999999997e-06 2024-09-14T06:00:13.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951863+0000", 2024-09-14T06:00:13.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8189999999999998e-06 2024-09-14T06:00:13.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951871+0000", 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2030000000000003e-06 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000283+0000", 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048412531000000002 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000338+0000", 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4462000000000001e-05 2024-09-14T06:00:13.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000387+0000", 2024-09-14T06:00:13.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8905e-05 2024-09-14T06:00:13.207 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.207 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.207 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.207 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T06:00:13.207 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:13.207 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.482684192000001, 2024-09-14T06:00:13.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T06:00:13.208 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.208 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.208 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:13.208 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:13.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:13.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T06:00:13.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T06:00:13.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T06:00:13.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T06:00:13.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T06:00:13.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T06:00:13.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T06:00:13.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T06:00:13.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:13.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T06:00:13.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T06:00:13.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T06:00:13.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T06:00:13.211 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.212 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.212 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.212 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.212 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:13.212 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 40.959594252999999, 2024-09-14T06:00:13.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T06:00:13.212 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.212 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.212 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:13.212 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.212 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.213 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.213 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T06:00:13.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.213 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:13.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:13.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T06:00:13.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T06:00:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T06:00:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T06:00:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T06:00:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T06:00:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T06:00:13.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T06:00:13.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T06:00:13.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T06:00:13.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T06:00:13.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:13.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T06:00:13.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T06:00:13.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:13.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T06:00:13.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T06:00:13.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:13.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T06:00:13.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T06:00:13.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T06:00:13.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T06:00:13.217 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.218 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.218 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.218 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.218 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.218 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:13.220 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:00:13.220 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:13.219+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:13.320 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:13.315+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:13.389 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:13.390 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:13.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:00:13.445 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:13.443+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:13.510 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T06:00:13.555 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:13.553+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:13.572 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:13.572 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:13.573 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:13.573 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:13.573 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:13.588 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:00:13.637 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:13.635+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:13.714 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:13.714 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:13.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:13.714 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:13.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.714 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:13.714 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:13.714 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.166367428999997, 2024-09-14T06:00:13.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:00:13.714 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.714 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.714 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:13.715 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.715 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.715 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.715 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:00:13.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.715 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:13.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:00:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:00:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:00:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:00:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:00:13.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:00:13.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:00:13.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:00:13.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:00:13.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:00:13.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:00:13.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:00:13.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:00:13.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:00:13.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:00:13.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:13.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:00:13.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:00:13.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:13.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:00:13.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:00:13.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:13.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:00:13.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:00:13.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:00:13.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:00:13.720 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.720 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.720 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.720 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38842 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.720 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:13.720 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.191240707999999, 2024-09-14T06:00:13.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083698121, 2024-09-14T06:00:13.720 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.720 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.721 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.721 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.721 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.721 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.721 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38842 2024-09-14T06:00:13.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.721 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:13.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521563+0000", 2024-09-14T06:00:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:00:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521566+0000", 2024-09-14T06:00:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1140000000000002e-06 2024-09-14T06:00:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521575+0000", 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8769999999999999e-06 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521581+0000", 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2369999999999997e-06 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605076+0000", 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083494992000000004 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605168+0000", 2024-09-14T06:00:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1731999999999995e-05 2024-09-14T06:00:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605260+0000", 2024-09-14T06:00:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2511999999999998e-05 2024-09-14T06:00:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.724 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38844 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9469952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.191213341000001, 2024-09-14T06:00:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084006762999999998, 2024-09-14T06:00:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38844 2024-09-14T06:00:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521590+0000", 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9699999999999996e-07 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521593+0000", 2024-09-14T06:00:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5909999999999998e-06 2024-09-14T06:00:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521603+0000", 2024-09-14T06:00:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0642000000000001e-05 2024-09-14T06:00:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521609+0000", 2024-09-14T06:00:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1020000000000002e-06 2024-09-14T06:00:13.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605318+0000", 2024-09-14T06:00:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083709166000000002 2024-09-14T06:00:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605454+0000", 2024-09-14T06:00:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013557400000000001 2024-09-14T06:00:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605596+0000", 2024-09-14T06:00:13.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014209100000000001 2024-09-14T06:00:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38845 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9650176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.191185041000001, 2024-09-14T06:00:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084212700000000001, 2024-09-14T06:00:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.729 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38845 2024-09-14T06:00:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:13.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1200000000000003e-07 2024-09-14T06:00:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521628+0000", 2024-09-14T06:00:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0196e-05 2024-09-14T06:00:13.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521637+0000", 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6649999999999992e-06 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521643+0000", 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.285e-06 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605652+0000", 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084009025000000001 2024-09-14T06:00:13.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605741+0000", 2024-09-14T06:00:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8473000000000005e-05 2024-09-14T06:00:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605830+0000", 2024-09-14T06:00:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9444000000000006e-05 2024-09-14T06:00:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.734 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38848 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8536064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.734 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:13.734 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.191147032, 2024-09-14T06:00:13.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084375567999999998, 2024-09-14T06:00:13.734 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.734 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.734 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.734 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.734 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.734 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.734 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38848 2024-09-14T06:00:13.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:13.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0200000000000002e-07 2024-09-14T06:00:13.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521659+0000", 2024-09-14T06:00:13.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7800000000000001e-06 2024-09-14T06:00:13.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521667+0000", 2024-09-14T06:00:13.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6599999999999995e-06 2024-09-14T06:00:13.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521674+0000", 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4560000000000003e-06 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605872+0000", 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084198010000000004 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605945+0000", 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2681000000000004e-05 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606031+0000", 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6378999999999994e-05 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38849 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9748480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.191116606000001, 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084581577000000005, 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.738 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.739 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38849 2024-09-14T06:00:13.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.739 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:13.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:13.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521687+0000", 2024-09-14T06:00:13.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9400000000000005e-07 2024-09-14T06:00:13.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521729+0000", 2024-09-14T06:00:13.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2657000000000002e-05 2024-09-14T06:00:13.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521749+0000", 2024-09-14T06:00:13.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9264000000000001e-05 2024-09-14T06:00:13.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521761+0000", 2024-09-14T06:00:13.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2289999999999999e-05 2024-09-14T06:00:13.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606078+0000", 2024-09-14T06:00:13.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084316772999999998 2024-09-14T06:00:13.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606176+0000", 2024-09-14T06:00:13.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7992999999999995e-05 2024-09-14T06:00:13.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606268+0000", 2024-09-14T06:00:13.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2006e-05 2024-09-14T06:00:13.742 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.742 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.742 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.743 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38851 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9928704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.743 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:13.743 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.191021293999999, 2024-09-14T06:00:13.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084695081000000005, 2024-09-14T06:00:13.743 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.743 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.743 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.743 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.743 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.743 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.743 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38851 2024-09-14T06:00:13.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.743 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:13.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:13.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521783+0000", 2024-09-14T06:00:13.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1000000000000001e-06 2024-09-14T06:00:13.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521788+0000", 2024-09-14T06:00:13.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2619999999999998e-06 2024-09-14T06:00:13.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521803+0000", 2024-09-14T06:00:13.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5421999999999999e-05 2024-09-14T06:00:13.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521815+0000", 2024-09-14T06:00:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.171e-05 2024-09-14T06:00:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606320+0000", 2024-09-14T06:00:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084504698000000003 2024-09-14T06:00:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606404+0000", 2024-09-14T06:00:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4379e-05 2024-09-14T06:00:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606476+0000", 2024-09-14T06:00:13.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2509999999999995e-05 2024-09-14T06:00:13.747 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.747 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.747 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.747 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.747 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:13.747 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.190970543999999, 2024-09-14T06:00:13.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:00:13.747 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.748 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.748 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.748 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.748 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.748 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.748 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:00:13.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.748 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:13.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:13.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:00:13.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:00:13.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:00:13.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:00:13.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:00:13.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:00:13.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:00:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:00:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:00:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:00:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:00:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:00:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.190932221000001, 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.752 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:00:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:13.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:00:13.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:00:13.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:00:13.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:13.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:00:13.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:00:13.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:00:13.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:00:13.756 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.756 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.756 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.757 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.757 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:13.757 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.190905528999998, 2024-09-14T06:00:13.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:00:13.757 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.757 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.757 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.757 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.757 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.757 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.757 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:00:13.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.757 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:13.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:13.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:00:13.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:00:13.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:00:13.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:00:13.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:00:13.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:00:13.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:00:13.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:00:13.761 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.761 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.761 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.761 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.761 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:13.761 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.190879663, 2024-09-14T06:00:13.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:00:13.761 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.762 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.762 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.762 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.762 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.762 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.762 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:00:13.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.762 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:13.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:13.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:00:13.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:00:13.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:00:13.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:00:13.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:00:13.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:00:13.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:00:13.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:00:13.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:00:13.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:00:13.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:00:13.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:00:13.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:00:13.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:00:13.765 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.766 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.766 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.766 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.766 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:13.766 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.189779294000001, 2024-09-14T06:00:13.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:00:13.766 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.766 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.766 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.766 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.766 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.767 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:00:13.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.767 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:13.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:13.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:00:13.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:00:13.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:00:13.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:00:13.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:00:13.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:00:13.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:00:13.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:00:13.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:00:13.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:00:13.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:00:13.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:00:13.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:00:13.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:00:13.770 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.770 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.770 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.770 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.771 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:13.771 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.189735315, 2024-09-14T06:00:13.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:00:13.771 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.771 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.771 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.771 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.771 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.771 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.771 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:00:13.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.771 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:13.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:13.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:00:13.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:00:13.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:00:13.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:00:13.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:00:13.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:00:13.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:00:13.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:00:13.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:00:13.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:00:13.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:00:13.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:00:13.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38865 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1392640~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.188756937000001, 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084340500999999998, 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.775 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.776 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.776 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.776 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.776 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.776 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38865 2024-09-14T06:00:13.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.776 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:13.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:13.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524047+0000", 2024-09-14T06:00:13.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5290000000000001e-06 2024-09-14T06:00:13.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524054+0000", 2024-09-14T06:00:13.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1910000000000003e-06 2024-09-14T06:00:13.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524074+0000", 2024-09-14T06:00:13.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9383999999999999e-05 2024-09-14T06:00:13.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524089+0000", 2024-09-14T06:00:13.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4647000000000001e-05 2024-09-14T06:00:13.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608123+0000", 2024-09-14T06:00:13.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084034837000000001 2024-09-14T06:00:13.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608224+0000", 2024-09-14T06:00:13.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100182 2024-09-14T06:00:13.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608386+0000", 2024-09-14T06:00:13.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162731 2024-09-14T06:00:13.779 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.779 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.780 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.780 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.780 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:13.780 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.188673555000001, 2024-09-14T06:00:13.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:00:13.780 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.780 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.780 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.780 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.780 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.781 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:00:13.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.781 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:13.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:13.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:00:13.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:00:13.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:00:13.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:00:13.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:00:13.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:00:13.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:00:13.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:00:13.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:00:13.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:00:13.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:00:13.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:00:13.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:00:13.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:00:13.784 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.784 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.784 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.785 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38869 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.785 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:13.785 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.188268085000001, 2024-09-14T06:00:13.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084608905999999998, 2024-09-14T06:00:13.785 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.785 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.785 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.785 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.785 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.785 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.785 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38869 2024-09-14T06:00:13.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.785 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:13.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:13.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525138+0000", 2024-09-14T06:00:13.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00060367999999999999 2024-09-14T06:00:13.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525160+0000", 2024-09-14T06:00:13.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1875999999999999e-05 2024-09-14T06:00:13.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525182+0000", 2024-09-14T06:00:13.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1427e-05 2024-09-14T06:00:13.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525198+0000", 2024-09-14T06:00:13.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507e-05 2024-09-14T06:00:13.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608907+0000", 2024-09-14T06:00:13.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083708535000000001 2024-09-14T06:00:13.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609011+0000", 2024-09-14T06:00:13.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010461199999999999 2024-09-14T06:00:13.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609144+0000", 2024-09-14T06:00:13.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013226899999999999 2024-09-14T06:00:13.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.789 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.789 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38871 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1671168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.789 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:13.789 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.187576875000001, 2024-09-14T06:00:13.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084308214000000006, 2024-09-14T06:00:13.790 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.790 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.790 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.790 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38871 2024-09-14T06:00:13.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.790 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:13.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:13.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525487+0000", 2024-09-14T06:00:13.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026091100000000001 2024-09-14T06:00:13.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525493+0000", 2024-09-14T06:00:13.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.742e-06 2024-09-14T06:00:13.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525508+0000", 2024-09-14T06:00:13.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:13.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525518+0000", 2024-09-14T06:00:13.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8500000000000006e-06 2024-09-14T06:00:13.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609229+0000", 2024-09-14T06:00:13.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083711775000000002 2024-09-14T06:00:13.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609388+0000", 2024-09-14T06:00:13.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158286 2024-09-14T06:00:13.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609534+0000", 2024-09-14T06:00:13.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000146308 2024-09-14T06:00:13.794 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.794 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.794 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.794 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38873 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 737280~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.794 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:13.794 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.187265303, 2024-09-14T06:00:13.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084288875999999999, 2024-09-14T06:00:13.794 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.794 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.794 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.794 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.795 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.795 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.795 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38873 2024-09-14T06:00:13.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.795 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:13.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:13.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526372+0000", 2024-09-14T06:00:13.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00083508200000000001 2024-09-14T06:00:13.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526383+0000", 2024-09-14T06:00:13.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0282000000000001e-05 2024-09-14T06:00:13.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526445+0000", 2024-09-14T06:00:13.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1975000000000002e-05 2024-09-14T06:00:13.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526460+0000", 2024-09-14T06:00:13.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5233e-05 2024-09-14T06:00:13.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609585+0000", 2024-09-14T06:00:13.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083125216000000002 2024-09-14T06:00:13.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609689+0000", 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104126 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609826+0000", 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013696199999999999 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38874 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:13.798 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.186298368999999, 2024-09-14T06:00:13.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083631987000000005, 2024-09-14T06:00:13.799 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.799 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.799 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.799 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.799 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.799 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.799 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38874 2024-09-14T06:00:13.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.799 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:13.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:13.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526505+0000", 2024-09-14T06:00:13.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7699999999999992e-07 2024-09-14T06:00:13.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526511+0000", 2024-09-14T06:00:13.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9139999999999996e-06 2024-09-14T06:00:13.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526525+0000", 2024-09-14T06:00:13.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3644e-05 2024-09-14T06:00:13.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526533+0000", 2024-09-14T06:00:13.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6510000000000001e-06 2024-09-14T06:00:13.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609897+0000", 2024-09-14T06:00:13.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083364173 2024-09-14T06:00:13.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610007+0000", 2024-09-14T06:00:13.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110707 2024-09-14T06:00:13.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610136+0000", 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012892099999999999 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38877 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1949696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.186253676, 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083886717, 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:13.803 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38877 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:13.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529354+0000", 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028049170000000001 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529373+0000", 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.933e-05 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529399+0000", 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6129e-05 2024-09-14T06:00:13.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:13.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529418+0000", 2024-09-14T06:00:13.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8944e-05 2024-09-14T06:00:13.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:13.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610197+0000", 2024-09-14T06:00:13.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080778271999999998 2024-09-14T06:00:13.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:13.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610300+0000", 2024-09-14T06:00:13.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103868 2024-09-14T06:00:13.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:13.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:13.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:13.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610436+0000", 2024-09-14T06:00:13.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013525700000000001 2024-09-14T06:00:13.807 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.807 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.807 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.807 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:13.807 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:13.807 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:13.808 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:00:13.809 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:13.803+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:13.827 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-14T06:00:13.910 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:13.905+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:14.010 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:14.009+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:14.015 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:14.015 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:14.015 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:14.015 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:14.029 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:00:14.111 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:14.109+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:14.143 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:14.143 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:14.143 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:14.143 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:14.143 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:14.159 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:00:14.190 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:00:14.235 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:14.233+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:14.310 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:14.311 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:14.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:14.311 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:14.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.311 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59148 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 419840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.311 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:14.311 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.042686361000001, 2024-09-14T06:00:14.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072974285999999999, 2024-09-14T06:00:14.311 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.311 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.311 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.311 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.312 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.312 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.312 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59148 2024-09-14T06:00:14.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.312 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:14.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:14.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268521+0000", 2024-09-14T06:00:14.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4199999999999995e-07 2024-09-14T06:00:14.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268524+0000", 2024-09-14T06:00:14.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.05e-06 2024-09-14T06:00:14.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268534+0000", 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8719999999999997e-06 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268541+0000", 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5349999999999999e-06 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341108+0000", 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072566624999999996 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341169+0000", 2024-09-14T06:00:14.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1251e-05 2024-09-14T06:00:14.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341494+0000", 2024-09-14T06:00:14.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325311 2024-09-14T06:00:14.315 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.315 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.315 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.315 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59149 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 436224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.315 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:14.315 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.042647136999999, 2024-09-14T06:00:14.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073405053999999997, 2024-09-14T06:00:14.316 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.316 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.316 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.316 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.316 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.316 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.316 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59149 2024-09-14T06:00:14.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.316 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:14.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:14.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268560+0000", 2024-09-14T06:00:14.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9999999999999997e-07 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268563+0000", 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.292e-06 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268573+0000", 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3260000000000002e-06 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268581+0000", 2024-09-14T06:00:14.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1960000000000008e-06 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341537+0000", 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072955916999999995 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341641+0000", 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104341 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341964+0000", 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032328199999999999 2024-09-14T06:00:14.319 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.320 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.320 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.320 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59150 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 452608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.320 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:14.320 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.042613896999999, 2024-09-14T06:00:14.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073829748000000001, 2024-09-14T06:00:14.320 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.320 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.321 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.321 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.321 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.321 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.321 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59150 2024-09-14T06:00:14.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.321 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:14.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0399999999999995e-07 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268596+0000", 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9859999999999999e-06 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268606+0000", 2024-09-14T06:00:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0088000000000001e-05 2024-09-14T06:00:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268614+0000", 2024-09-14T06:00:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T06:00:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341999+0000", 2024-09-14T06:00:14.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073385011999999999 2024-09-14T06:00:14.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342093+0000", 2024-09-14T06:00:14.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3793000000000001e-05 2024-09-14T06:00:14.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342422+0000", 2024-09-14T06:00:14.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000329129 2024-09-14T06:00:14.325 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.325 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.325 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.325 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59151 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.325 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:14.325 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.042581529, 2024-09-14T06:00:14.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074207289999999995, 2024-09-14T06:00:14.325 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.325 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.325 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59151 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:14.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268626+0000", 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268629+0000", 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.038e-06 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268638+0000", 2024-09-14T06:00:14.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8139999999999995e-06 2024-09-14T06:00:14.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268647+0000", 2024-09-14T06:00:14.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4889999999999995e-06 2024-09-14T06:00:14.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342457+0000", 2024-09-14T06:00:14.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073809890000000003 2024-09-14T06:00:14.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342545+0000", 2024-09-14T06:00:14.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8697999999999997e-05 2024-09-14T06:00:14.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342832+0000", 2024-09-14T06:00:14.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028681799999999999 2024-09-14T06:00:14.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.329 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.330 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59152 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.330 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:14.330 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.042548887999999, 2024-09-14T06:00:14.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074695176000000002, 2024-09-14T06:00:14.330 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.330 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.330 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.330 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59152 2024-09-14T06:00:14.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.330 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2900000000000003e-07 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268661+0000", 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0230000000000001e-06 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268670+0000", 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2129999999999997e-06 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268679+0000", 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342937+0000", 2024-09-14T06:00:14.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074258781999999995 2024-09-14T06:00:14.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343044+0000", 2024-09-14T06:00:14.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-09-14T06:00:14.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343353+0000", 2024-09-14T06:00:14.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030911099999999999 2024-09-14T06:00:14.333 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59153 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 501760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.042516118000002, 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074997241000000006, 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.334 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59153 2024-09-14T06:00:14.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.335 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:14.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:14.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268691+0000", 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268693+0000", 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3599999999999999e-06 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268699+0000", 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268704+0000", 2024-09-14T06:00:14.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5759999999999999e-06 2024-09-14T06:00:14.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343398+0000", 2024-09-14T06:00:14.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074694522999999999 2024-09-14T06:00:14.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343450+0000", 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1350999999999997e-05 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343688+0000", 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023806500000000001 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.338 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59154 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 518144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.042497052000002, 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075389938000000004, 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59154 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268710+0000", 2024-09-14T06:00:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8000000000000001e-07 2024-09-14T06:00:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268712+0000", 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268717+0000", 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8570000000000003e-06 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268721+0000", 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2039999999999999e-06 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343721+0000", 2024-09-14T06:00:14.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074999748000000005 2024-09-14T06:00:14.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343784+0000", 2024-09-14T06:00:14.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3174000000000002e-05 2024-09-14T06:00:14.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.344099+0000", 2024-09-14T06:00:14.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000315299 2024-09-14T06:00:14.342 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.342 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.342 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.343 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59398 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 323584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.343 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:14.343 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.031532804000001, 2024-09-14T06:00:14.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073326565999999996, 2024-09-14T06:00:14.343 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.343 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.343 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59398 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279675+0000", 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279681+0000", 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279702+0000", 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1259000000000001e-05 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279718+0000", 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5475999999999999e-05 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352360+0000", 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.07264226 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352447+0000", 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7381999999999998e-05 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353000+0000", 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055309200000000004 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59399 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.031468441000001, 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073824446000000002, 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.347 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59399 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279739+0000", 2024-09-14T06:00:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T06:00:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279745+0000", 2024-09-14T06:00:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T06:00:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279767+0000", 2024-09-14T06:00:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639000000000001e-05 2024-09-14T06:00:14.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279781+0000", 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4511999999999999e-05 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353045+0000", 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073263718000000005 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353168+0000", 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012314499999999999 2024-09-14T06:00:14.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353562+0000", 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039435199999999999 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59400 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.031404681000001, 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074271465999999994, 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.351 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.352 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.352 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.352 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.352 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59400 2024-09-14T06:00:14.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.352 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:14.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:14.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279803+0000", 2024-09-14T06:00:14.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2100000000000001e-06 2024-09-14T06:00:14.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279819+0000", 2024-09-14T06:00:14.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6409000000000002e-05 2024-09-14T06:00:14.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279841+0000", 2024-09-14T06:00:14.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1878e-05 2024-09-14T06:00:14.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279856+0000", 2024-09-14T06:00:14.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4392999999999999e-05 2024-09-14T06:00:14.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353650+0000", 2024-09-14T06:00:14.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073794144000000006 2024-09-14T06:00:14.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353757+0000", 2024-09-14T06:00:14.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010687 2024-09-14T06:00:14.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354073+0000", 2024-09-14T06:00:14.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000316562 2024-09-14T06:00:14.355 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.355 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.356 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.356 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59401 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 372736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.356 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:14.356 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.031329855999999, 2024-09-14T06:00:14.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074643900999999999, 2024-09-14T06:00:14.356 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.356 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.356 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.356 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.356 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59401 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279878+0000", 2024-09-14T06:00:14.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.31e-06 2024-09-14T06:00:14.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279883+0000", 2024-09-14T06:00:14.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3770000000000004e-06 2024-09-14T06:00:14.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279906+0000", 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2398000000000001e-05 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279920+0000", 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.402e-05 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354125+0000", 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074205750000000001 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354227+0000", 2024-09-14T06:00:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101612 2024-09-14T06:00:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354521+0000", 2024-09-14T06:00:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029343400000000002 2024-09-14T06:00:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.360 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59402 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 389120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.361 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:14.361 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.031268272999998, 2024-09-14T06:00:14.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075017027999999999, 2024-09-14T06:00:14.361 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.361 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.361 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.361 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59402 2024-09-14T06:00:14.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.361 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:14.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:14.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279939+0000", 2024-09-14T06:00:14.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2470000000000001e-06 2024-09-14T06:00:14.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279945+0000", 2024-09-14T06:00:14.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-09-14T06:00:14.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279966+0000", 2024-09-14T06:00:14.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1801999999999999e-05 2024-09-14T06:00:14.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279980+0000", 2024-09-14T06:00:14.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3589e-05 2024-09-14T06:00:14.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354569+0000", 2024-09-14T06:00:14.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074588707000000004 2024-09-14T06:00:14.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354671+0000", 2024-09-14T06:00:14.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102398 2024-09-14T06:00:14.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354955+0000", 2024-09-14T06:00:14.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028406500000000001 2024-09-14T06:00:14.366 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.366 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.366 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.366 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59403 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 405504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.366 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:14.366 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.031206485999999, 2024-09-14T06:00:14.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075434395000000001, 2024-09-14T06:00:14.367 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.367 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.367 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.367 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59403 2024-09-14T06:00:14.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.367 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:14.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:14.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280001+0000", 2024-09-14T06:00:14.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2669999999999999e-06 2024-09-14T06:00:14.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280008+0000", 2024-09-14T06:00:14.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5849999999999996e-06 2024-09-14T06:00:14.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280030+0000", 2024-09-14T06:00:14.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2293000000000002e-05 2024-09-14T06:00:14.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280044+0000", 2024-09-14T06:00:14.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3974999999999999e-05 2024-09-14T06:00:14.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355013+0000", 2024-09-14T06:00:14.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074969039000000001 2024-09-14T06:00:14.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355144+0000", 2024-09-14T06:00:14.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000131333 2024-09-14T06:00:14.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355434+0000", 2024-09-14T06:00:14.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028990299999999999 2024-09-14T06:00:14.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.371 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.371 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59404 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.371 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:14.371 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.031141367, 2024-09-14T06:00:14.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075696103000000001, 2024-09-14T06:00:14.371 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.371 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.371 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.372 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.372 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.372 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.372 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59404 2024-09-14T06:00:14.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.372 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:14.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:14.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280066+0000", 2024-09-14T06:00:14.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2640000000000001e-06 2024-09-14T06:00:14.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280072+0000", 2024-09-14T06:00:14.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129999999999997e-06 2024-09-14T06:00:14.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280094+0000", 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2608000000000001e-05 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280109+0000", 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355479+0000", 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075370699999999999 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355554+0000", 2024-09-14T06:00:14.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4674999999999999e-05 2024-09-14T06:00:14.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355761+0000", 2024-09-14T06:00:14.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-14T06:00:14.375 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.375 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.375 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.376 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59405 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.376 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:14.376 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.031077456999999, 2024-09-14T06:00:14.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076008867999999993, 2024-09-14T06:00:14.376 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.376 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.376 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.376 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59405 2024-09-14T06:00:14.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.376 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280130+0000", 2024-09-14T06:00:14.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2500000000000001e-06 2024-09-14T06:00:14.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280136+0000", 2024-09-14T06:00:14.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-09-14T06:00:14.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280158+0000", 2024-09-14T06:00:14.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1795000000000001e-05 2024-09-14T06:00:14.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280172+0000", 2024-09-14T06:00:14.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4303e-05 2024-09-14T06:00:14.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355797+0000", 2024-09-14T06:00:14.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075624835000000001 2024-09-14T06:00:14.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355866+0000", 2024-09-14T06:00:14.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9043999999999998e-05 2024-09-14T06:00:14.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356138+0000", 2024-09-14T06:00:14.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027207799999999998 2024-09-14T06:00:14.380 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.380 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.380 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.380 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59406 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.381 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:14.381 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.031013515000001, 2024-09-14T06:00:14.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076435642999999998, 2024-09-14T06:00:14.381 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.381 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.381 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.381 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.381 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.381 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.381 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59406 2024-09-14T06:00:14.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.381 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:14.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:14.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280194+0000", 2024-09-14T06:00:14.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-14T06:00:14.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280200+0000", 2024-09-14T06:00:14.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6359999999999999e-06 2024-09-14T06:00:14.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280222+0000", 2024-09-14T06:00:14.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1628999999999999e-05 2024-09-14T06:00:14.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280236+0000", 2024-09-14T06:00:14.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4413000000000001e-05 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356172+0000", 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075936466999999994 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356260+0000", 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7437999999999999e-05 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356629+0000", 2024-09-14T06:00:14.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036877600000000002 2024-09-14T06:00:14.385 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.385 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.385 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.385 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59407 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 471040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.385 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:14.385 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.030949282000002, 2024-09-14T06:00:14.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076820083999999997, 2024-09-14T06:00:14.385 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.385 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.385 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.386 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.386 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59407 2024-09-14T06:00:14.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.386 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:14.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280258+0000", 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1370000000000001e-06 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280264+0000", 2024-09-14T06:00:14.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6930000000000004e-06 2024-09-14T06:00:14.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280285+0000", 2024-09-14T06:00:14.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1455999999999999e-05 2024-09-14T06:00:14.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280300+0000", 2024-09-14T06:00:14.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4319e-05 2024-09-14T06:00:14.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356676+0000", 2024-09-14T06:00:14.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076376615999999994 2024-09-14T06:00:14.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356768+0000", 2024-09-14T06:00:14.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1234000000000001e-05 2024-09-14T06:00:14.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357077+0000", 2024-09-14T06:00:14.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030962900000000001 2024-09-14T06:00:14.389 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.390 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.390 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.390 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59408 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 487424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.390 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:14.390 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.030884281999999, 2024-09-14T06:00:14.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077185511999999998, 2024-09-14T06:00:14.390 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.390 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.390 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.390 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.390 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.391 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.391 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59408 2024-09-14T06:00:14.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.391 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:14.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:14.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280323+0000", 2024-09-14T06:00:14.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2860000000000001e-06 2024-09-14T06:00:14.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280329+0000", 2024-09-14T06:00:14.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.553e-06 2024-09-14T06:00:14.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280352+0000", 2024-09-14T06:00:14.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-14T06:00:14.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280366+0000", 2024-09-14T06:00:14.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-14T06:00:14.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357126+0000", 2024-09-14T06:00:14.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076760326000000004 2024-09-14T06:00:14.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357223+0000", 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6490000000000006e-05 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357508+0000", 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028479900000000002 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.394 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59409 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.395 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:14.395 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.030820051999999, 2024-09-14T06:00:14.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077536090000000002, 2024-09-14T06:00:14.395 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.395 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.395 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.395 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.395 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.395 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.395 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59409 2024-09-14T06:00:14.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.395 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:14.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:14.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280388+0000", 2024-09-14T06:00:14.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.096e-06 2024-09-14T06:00:14.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280393+0000", 2024-09-14T06:00:14.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T06:00:14.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280414+0000", 2024-09-14T06:00:14.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1175999999999999e-05 2024-09-14T06:00:14.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280427+0000", 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3032e-05 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357553+0000", 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077125845999999998 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357624+0000", 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1062000000000005e-05 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357923+0000", 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029891199999999997 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59410 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.030760740000002, 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077854494999999996, 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:14.399 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59410 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:14.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:14.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280447+0000", 2024-09-14T06:00:14.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069999999999999e-06 2024-09-14T06:00:14.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:14.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280453+0000", 2024-09-14T06:00:14.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-06 2024-09-14T06:00:14.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:14.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280471+0000", 2024-09-14T06:00:14.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8295999999999999e-05 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280484+0000", 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2609000000000001e-05 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357954+0000", 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077470405000000006 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358040+0000", 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.551e-05 2024-09-14T06:00:14.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:14.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:14.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:14.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358300+0000", 2024-09-14T06:00:14.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026036800000000003 2024-09-14T06:00:14.403 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.403 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.403 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.403 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:14.403 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:14.403 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:14.404 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:14.405 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:14.405 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:14.401+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:14.405 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:00:14.415 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:14.416 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:14.433 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:14.451 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:14.451 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:14.470 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:14.470 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:14.490 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:14.490 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:14.506 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:14.503+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:14.510 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:14.510 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:14.511 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2024-09-14T06:00:14.521 INFO:teuthology.orchestra.run.smithi006.stdout:4298 trunc from 0xb7a4747 to 0x9bd1e74 2024-09-14T06:00:14.531 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:14.539 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:14.539 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:14.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:00:14.589 INFO:teuthology.orchestra.run.smithi006.stdout:4299 read 0x808c6a4 thru 0x809172f (0x508c bytes) 2024-09-14T06:00:14.590 INFO:teuthology.orchestra.run.smithi006.stdout:4300 punch from 0x50d0d73 to 0x50dae21, (0xa0ae bytes) 2024-09-14T06:00:14.594 INFO:teuthology.orchestra.run.smithi006.stdout:4301 trunc from 0x9bd1e74 to 0x6accde1 2024-09-14T06:00:14.606 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:14.601+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:14.623 INFO:teuthology.orchestra.run.smithi006.stdout:4302 write 0xbb8c771 thru 0xbb9544e (0x8cde bytes) 2024-09-14T06:00:14.625 INFO:teuthology.orchestra.run.smithi006.stdout:4303 read 0x60a9299 thru 0x60b2f9d (0x9d05 bytes) 2024-09-14T06:00:14.626 INFO:teuthology.orchestra.run.smithi006.stdout:4304 punch from 0x19c3701 to 0x19c7e1d, (0x471c bytes) 2024-09-14T06:00:14.626 INFO:teuthology.orchestra.run.smithi006.stdout:4307 punch from 0x28e8d2a to 0x28f0425, (0x76fb bytes) 2024-09-14T06:00:14.626 INFO:teuthology.orchestra.run.smithi006.stdout:4308 read 0x3778518 thru 0x3784bc2 (0xc6ab bytes) 2024-09-14T06:00:14.626 INFO:teuthology.orchestra.run.smithi006.stdout:4310 writesame 0x6b44627 thru 0x6b4d077 data_size 0x57(0x8a51 bytes) 2024-09-14T06:00:14.629 INFO:teuthology.orchestra.run.smithi006.stdout:4311 read 0x398c6c7 thru 0x398df47 (0x1881 bytes) 2024-09-14T06:00:14.629 INFO:teuthology.orchestra.run.smithi006.stdout:4312 read 0x26e7170 thru 0x26f069c (0x952d bytes) 2024-09-14T06:00:14.630 INFO:teuthology.orchestra.run.smithi006.stdout:4313 write 0x584ad16 thru 0x584efcb (0x42b6 bytes) 2024-09-14T06:00:14.640 INFO:teuthology.orchestra.run.smithi006.stdout:4314 trunc from 0xbb9544f to 0x6a42080 2024-09-14T06:00:14.651 INFO:teuthology.orchestra.run.smithi006.stdout:4315 writesame 0x4967d57 thru 0x496870b data_size 0x7(0x9b5 bytes) 2024-09-14T06:00:14.673 INFO:teuthology.orchestra.run.smithi006.stdout:4316 writesame 0xe10bb97 thru 0xe115b01 data_size 0x1(0x9f6b bytes) 2024-09-14T06:00:14.675 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:14.680 INFO:teuthology.orchestra.run.smithi006.stdout:4320 trunc from 0xe115b02 to 0xa82f42d 2024-09-14T06:00:14.690 INFO:teuthology.orchestra.run.smithi006.stdout:4322 punch from 0x907e8df to 0x908233d, (0x3a5e bytes) 2024-09-14T06:00:14.690 INFO:teuthology.orchestra.run.smithi006.stdout:4323 read 0x99aa2df thru 0x99ac8b3 (0x25d5 bytes) 2024-09-14T06:00:14.691 INFO:teuthology.orchestra.run.smithi006.stdout:4324 punch from 0x7913a52 to 0x791dea3, (0xa451 bytes) 2024-09-14T06:00:14.701 INFO:teuthology.orchestra.run.smithi006.stdout:4327 writesame 0xae77b1b thru 0xae7ee4b data_size 0x1(0x7331 bytes) 2024-09-14T06:00:14.701 INFO:teuthology.orchestra.run.smithi006.stdout:4328 read 0x58079df thru 0x580b08a (0x36ac bytes) 2024-09-14T06:00:14.701 INFO:teuthology.orchestra.run.smithi006.stdout:4329 write 0x9e06942 thru 0x9e122d9 (0xb998 bytes) 2024-09-14T06:00:14.704 INFO:teuthology.orchestra.run.smithi006.stdout:4331 flatten 2024-09-14T06:00:14.707 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:14.705+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:14.712 INFO:teuthology.orchestra.run.smithi006.stdout:4332 read 0x8ca6883 thru 0x8cabc73 (0x53f1 bytes) 2024-09-14T06:00:14.713 INFO:teuthology.orchestra.run.smithi006.stdout:4334 write 0x91d2bb2 thru 0x91e0901 (0xdd50 bytes) 2024-09-14T06:00:14.716 INFO:teuthology.orchestra.run.smithi006.stdout:4337 write 0x7825f7b thru 0x782924f (0x32d5 bytes) 2024-09-14T06:00:14.719 INFO:teuthology.orchestra.run.smithi006.stdout:4338 writesame 0x5c580aa thru 0x5c66d19 data_size 0x68(0xec70 bytes) 2024-09-14T06:00:14.721 INFO:teuthology.orchestra.run.smithi006.stdout:4339 read 0x2369b16 thru 0x236dc86 (0x4171 bytes) 2024-09-14T06:00:14.722 INFO:teuthology.orchestra.run.smithi006.stdout:4341 read 0x62ff837 thru 0x6302cea (0x34b4 bytes) 2024-09-14T06:00:14.727 INFO:teuthology.orchestra.run.smithi006.stdout:4343 trunc from 0xae7ee4c to 0xd781576 2024-09-14T06:00:14.738 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:14.738 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:14.738 INFO:teuthology.orchestra.run.smithi006.stdout:4344 read 0x975fd7d thru 0x976b843 (0xbac7 bytes) 2024-09-14T06:00:14.739 INFO:teuthology.orchestra.run.smithi006.stdout:4345 punch from 0xa6a15c4 to 0xa6b0b10, (0xf54c bytes) 2024-09-14T06:00:14.739 INFO:teuthology.orchestra.run.smithi006.stdout:4346 write 0x1ef75a5 thru 0x1ef7df6 (0x852 bytes) 2024-09-14T06:00:14.742 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:14.742 INFO:teuthology.orchestra.run.smithi006.stdout:4349 read 0xd21b7b9 thru 0xd21d4c3 (0x1d0b bytes) 2024-09-14T06:00:14.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:00:14.754 INFO:teuthology.orchestra.run.smithi006.stdout:4350 trunc from 0xd781576 to 0x628b2dc 2024-09-14T06:00:14.772 INFO:teuthology.orchestra.run.smithi006.stdout:4354 write 0x516f62b thru 0x516f875 (0x24b bytes) 2024-09-14T06:00:14.774 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:14.774 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:14.774 INFO:teuthology.orchestra.run.smithi006.stdout:4357 writesame 0xec9a2a thru 0xed31b7 data_size 0x13(0x978e bytes) 2024-09-14T06:00:14.786 INFO:teuthology.orchestra.run.smithi006.stdout:4358 trunc from 0x628b2dc to 0x1a6ba72 2024-09-14T06:00:14.802 INFO:teuthology.orchestra.run.smithi006.stdout:4360 punch from 0x11d150c to 0x11daca1, (0x9795 bytes) 2024-09-14T06:00:14.809 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:14.805+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:14.814 INFO:teuthology.orchestra.run.smithi006.stdout:4361 write 0x23a16d8 thru 0x23b0fb9 (0xf8e2 bytes) 2024-09-14T06:00:14.857 INFO:teuthology.orchestra.run.smithi006.stdout:4363 writesame 0xde4d2ea thru 0xde59e8d data_size 0x2(0xcba4 bytes) 2024-09-14T06:00:14.860 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:14.860 INFO:teuthology.orchestra.run.smithi006.stdout:4365 read 0x2582242 thru 0x259110b (0xeeca bytes) 2024-09-14T06:00:14.861 INFO:teuthology.orchestra.run.smithi006.stdout:4366 read 0x87f3a2a thru 0x87f6d7d (0x3354 bytes) 2024-09-14T06:00:14.862 INFO:teuthology.orchestra.run.smithi006.stdout:4367 write 0x33dffab thru 0x33e1bb1 (0x1c07 bytes) 2024-09-14T06:00:14.865 INFO:teuthology.orchestra.run.smithi006.stdout:4368 writesame 0xb63e0bb thru 0xb64bf3c data_size 0x13(0xde82 bytes) 2024-09-14T06:00:14.871 INFO:teuthology.orchestra.run.smithi006.stdout:4370 writesame 0x34f673c thru 0x3505211 data_size 0x1(0xead6 bytes) 2024-09-14T06:00:14.880 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:14.880 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:14.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:00:14.928 INFO:teuthology.orchestra.run.smithi006.stdout:4371 read 0x63b4851 thru 0x63bebea (0xa39a bytes) 2024-09-14T06:00:14.929 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:14.925+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:14.943 INFO:teuthology.orchestra.run.smithi006.stdout:4372 trunc from 0xde59e8e to 0x8a314af 2024-09-14T06:00:14.957 INFO:teuthology.orchestra.run.smithi006.stdout:4373 punch from 0x6312a4d to 0x63156c6, (0x2c79 bytes) 2024-09-14T06:00:14.972 INFO:teuthology.orchestra.run.smithi006.stdout:4374 write 0xa770423 thru 0xa771a66 (0x1644 bytes) 2024-09-14T06:00:14.975 INFO:teuthology.orchestra.run.smithi006.stdout:4375 write 0x5bcbfa4 thru 0x5bd6f75 (0xafd2 bytes) 2024-09-14T06:00:14.987 INFO:teuthology.orchestra.run.smithi006.stdout:4376 trunc from 0xa771a67 to 0x50c505a 2024-09-14T06:00:15.004 INFO:teuthology.orchestra.run.smithi006.stdout:4377 write 0xf134da thru 0xf19177 (0x5c9e bytes) 2024-09-14T06:00:15.008 INFO:teuthology.orchestra.run.smithi006.stdout:4378 trunc from 0x50c505a to 0x407d5ef 2024-09-14T06:00:15.011 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:15.009+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:15.042 INFO:teuthology.orchestra.run.smithi006.stdout:4381 write 0x696e8be thru 0x6972d6b (0x44ae bytes) 2024-09-14T06:00:15.045 INFO:teuthology.orchestra.run.smithi006.stdout:4382 read 0x2dceb5b thru 0x2dd73f8 (0x889e bytes) 2024-09-14T06:00:15.046 INFO:teuthology.orchestra.run.smithi006.stdout:4384 read 0xe0fa23 thru 0xe1afac (0xb58a bytes) 2024-09-14T06:00:15.053 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:15.053 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:15.062 INFO:teuthology.orchestra.run.smithi006.stdout:4385 write 0x7fca019 thru 0x7fd8bf7 (0xebdf bytes) 2024-09-14T06:00:15.072 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:00:15.082 INFO:teuthology.orchestra.run.smithi006.stdout:4386 writesame 0xa953b07 thru 0xa9571e7 data_size 0x3(0x36e1 bytes) 2024-09-14T06:00:15.085 INFO:teuthology.orchestra.run.smithi006.stdout:4387 writesame 0x2353992 thru 0x2361415 data_size 0xa(0xda84 bytes) 2024-09-14T06:00:15.091 INFO:teuthology.orchestra.run.smithi006.stdout:4388 write 0x890012b thru 0x8908425 (0x82fb bytes) 2024-09-14T06:00:15.094 INFO:teuthology.orchestra.run.smithi006.stdout:4389 trunc from 0xa9571e8 to 0xaf29b01 2024-09-14T06:00:15.108 INFO:teuthology.orchestra.run.smithi006.stdout:4390 punch from 0x7cf6354 to 0x7cfa6f7, (0x43a3 bytes) 2024-09-14T06:00:15.108 INFO:teuthology.orchestra.run.smithi006.stdout:4391 read 0x691eca7 thru 0x692975b (0xaab5 bytes) 2024-09-14T06:00:15.109 INFO:teuthology.orchestra.run.smithi006.stdout:4392 punch from 0x5ebce8a to 0x5ec473a, (0x78b0 bytes) 2024-09-14T06:00:15.109 INFO:teuthology.orchestra.run.smithi006.stdout:4394 read 0x215815e thru 0x2161b58 (0x99fb bytes) 2024-09-14T06:00:15.111 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:15.107+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:15.121 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-14T06:00:15.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T06:00:15.123 INFO:teuthology.orchestra.run.smithi006.stdout:4396 trunc from 0xaf29b01 to 0x33b5339 2024-09-14T06:00:15.156 INFO:teuthology.orchestra.run.smithi006.stdout:4397 writesame 0x657f71c thru 0x6583dfc data_size 0x13(0x46e1 bytes) 2024-09-14T06:00:15.160 INFO:teuthology.orchestra.run.smithi006.stdout:4398 read 0x1bf5024 thru 0x1bf7d62 (0x2d3f bytes) 2024-09-14T06:00:15.160 INFO:teuthology.orchestra.run.smithi006.stdout:4399 read 0x2a0f3da thru 0x2a15516 (0x613d bytes) 2024-09-14T06:00:15.162 INFO:teuthology.orchestra.run.smithi006.stdout:4400 read 0x27c4c38 thru 0x27d2920 (0xdce9 bytes) 2024-09-14T06:00:15.162 INFO:teuthology.orchestra.run.smithi006.stdout:4403 write 0x54976a thru 0x5571ae (0xda45 bytes) 2024-09-14T06:00:15.186 INFO:teuthology.orchestra.run.smithi006.stdout:4404 write 0xb1f202a thru 0xb1f2801 (0x7d8 bytes) 2024-09-14T06:00:15.189 INFO:teuthology.orchestra.run.smithi006.stdout:4405 write 0x2dd6a93 thru 0x2ddbb53 (0x50c1 bytes) 2024-09-14T06:00:15.192 INFO:teuthology.orchestra.run.smithi006.stdout:4409 read 0x2c98952 thru 0x2c9be54 (0x3503 bytes) 2024-09-14T06:00:15.193 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:15.193 INFO:teuthology.orchestra.run.smithi006.stdout:4413 punch from 0x8fd0a1 to 0x900a34, (0x3993 bytes) 2024-09-14T06:00:15.193 INFO:teuthology.orchestra.run.smithi006.stdout:4414 read 0x27a260c thru 0x27b216a (0xfb5f bytes) 2024-09-14T06:00:15.194 INFO:teuthology.orchestra.run.smithi006.stdout:4415 read 0x6736152 thru 0x6737122 (0xfd1 bytes) 2024-09-14T06:00:15.194 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:15.196 INFO:teuthology.orchestra.run.smithi006.stdout:4418 trunc from 0xb1f2802 to 0xbf543b2 2024-09-14T06:00:15.209 INFO:teuthology.orchestra.run.smithi006.stdout:4419 read 0x1cf73d1 thru 0x1cf7f06 (0xb36 bytes) 2024-09-14T06:00:15.210 INFO:teuthology.orchestra.run.smithi006.stdout:4420 write 0x7236235 thru 0x72407b5 (0xa581 bytes) 2024-09-14T06:00:15.212 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:15.207+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:15.213 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:15.213 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:15.226 INFO:teuthology.orchestra.run.smithi006.stdout:4421 writesame 0xbfafb24 thru 0xbfb7d3b data_size 0x5c(0x8218 bytes) 2024-09-14T06:00:15.228 INFO:teuthology.orchestra.run.smithi006.stdout:4422 write 0x2fd64d3 thru 0x2fe102e (0xab5c bytes) 2024-09-14T06:00:15.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:00:15.232 INFO:teuthology.orchestra.run.smithi006.stdout:4424 read 0x9f66bcb thru 0x9f6f611 (0x8a47 bytes) 2024-09-14T06:00:15.233 INFO:teuthology.orchestra.run.smithi006.stdout:4425 write 0x10a9f46 thru 0x10b2568 (0x8623 bytes) 2024-09-14T06:00:15.237 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:15.252 INFO:teuthology.orchestra.run.smithi006.stdout:4429 write 0xd304e2e thru 0xd30e710 (0x98e3 bytes) 2024-09-14T06:00:15.255 INFO:teuthology.orchestra.run.smithi006.stdout:4430 punch from 0x4ae9ecf to 0x4aef37a, (0x54ab bytes) 2024-09-14T06:00:15.255 INFO:teuthology.orchestra.run.smithi006.stdout:4432 read 0x7fdc75a thru 0x7fe27d1 (0x6078 bytes) 2024-09-14T06:00:15.256 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:15.256 INFO:teuthology.orchestra.run.smithi006.stdout:4434 punch from 0x494a76d to 0x494d9c9, (0x325c bytes) 2024-09-14T06:00:15.256 INFO:teuthology.orchestra.run.smithi006.stdout:4435 read 0x55c1373 thru 0x55c4ecd (0x3b5b bytes) 2024-09-14T06:00:15.271 INFO:teuthology.orchestra.run.smithi006.stdout:4436 writesame 0xe013975 thru 0xe01ff31 data_size 0x1(0xc5bd bytes) 2024-09-14T06:00:15.274 INFO:teuthology.orchestra.run.smithi006.stdout:4437 read 0x21bb727 thru 0x21bce09 (0x16e3 bytes) 2024-09-14T06:00:15.274 INFO:teuthology.orchestra.run.smithi006.stdout:4438 read 0x63c42e1 thru 0x63cae5a (0x6b7a bytes) 2024-09-14T06:00:15.275 INFO:teuthology.orchestra.run.smithi006.stdout:4439 read 0x3601ca8 thru 0x360fca6 (0xdfff bytes) 2024-09-14T06:00:15.276 INFO:teuthology.orchestra.run.smithi006.stdout:4440 read 0x3382978 thru 0x3384a66 (0x20ef bytes) 2024-09-14T06:00:15.277 INFO:teuthology.orchestra.run.smithi006.stdout:4441 read 0x993baac thru 0x9949fd4 (0xe529 bytes) 2024-09-14T06:00:15.277 INFO:teuthology.orchestra.run.smithi006.stdout:4442 punch from 0x39c77d1 to 0x39d35a9, (0xbdd8 bytes) 2024-09-14T06:00:15.288 INFO:teuthology.orchestra.run.smithi006.stdout:4443 trunc from 0xe01ff32 to 0x66a869e 2024-09-14T06:00:15.312 INFO:teuthology.orchestra.run.smithi006.stdout:4444 trunc from 0x66a869e to 0x227e934 2024-09-14T06:00:15.313 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:15.309+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:15.329 INFO:teuthology.orchestra.run.smithi006.stdout:4445 read 0x1896432 thru 0x18983bd (0x1f8c bytes) 2024-09-14T06:00:15.329 INFO:teuthology.orchestra.run.smithi006.stdout:4446 punch from 0x21326e2 to 0x213e673, (0xbf91 bytes) 2024-09-14T06:00:15.329 INFO:teuthology.orchestra.run.smithi006.stdout:4447 read 0x520245 thru 0x527082 (0x6e3e bytes) 2024-09-14T06:00:15.330 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:15.330 INFO:teuthology.orchestra.run.smithi006.stdout:4449 read 0x1ff4336 thru 0x1ffea91 (0xa75c bytes) 2024-09-14T06:00:15.331 INFO:teuthology.orchestra.run.smithi006.stdout:4451 read 0x1f436c0 thru 0x1f481fd (0x4b3e bytes) 2024-09-14T06:00:15.346 INFO:teuthology.orchestra.run.smithi006.stdout:4452 writesame 0x44cde20 thru 0x44dbabc data_size 0x1(0xdc9d bytes) 2024-09-14T06:00:15.367 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:15.367 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:15.370 INFO:teuthology.orchestra.run.smithi006.stdout:4454 write 0xbf40d02 thru 0xbf4f687 (0xe986 bytes) 2024-09-14T06:00:15.375 INFO:teuthology.orchestra.run.smithi006.stdout:4455 punch from 0x10e07c9 to 0x10e0a67, (0x29e bytes) 2024-09-14T06:00:15.375 INFO:teuthology.orchestra.run.smithi006.stdout:4456 write 0x7e23dbd thru 0x7e3307a (0xf2be bytes) 2024-09-14T06:00:15.379 INFO:teuthology.orchestra.run.smithi006.stdout:4457 write 0x15a5b58 thru 0x15b2e70 (0xd319 bytes) 2024-09-14T06:00:15.382 INFO:teuthology.orchestra.run.smithi006.stdout:4459 write 0x50c1c5d thru 0x50d0c27 (0xefcb bytes) 2024-09-14T06:00:15.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:00:15.386 INFO:teuthology.orchestra.run.smithi006.stdout:4460 punch from 0x466aec1 to 0x466ccbb, (0x1dfa bytes) 2024-09-14T06:00:15.386 INFO:teuthology.orchestra.run.smithi006.stdout:4463 read 0x1101721 thru 0x110faf3 (0xe3d3 bytes) 2024-09-14T06:00:15.388 INFO:teuthology.orchestra.run.smithi006.stdout:4465 writesame 0x64da36 thru 0x65427b data_size 0x9(0x6846 bytes) 2024-09-14T06:00:15.404 INFO:teuthology.orchestra.run.smithi006.stdout:4467 trunc from 0xbf4f688 to 0x42fac70 2024-09-14T06:00:15.414 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:15.409+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:15.434 INFO:teuthology.orchestra.run.smithi006.stdout:4468 trunc from 0x42fac70 to 0xcc57a7d 2024-09-14T06:00:15.447 INFO:teuthology.orchestra.run.smithi006.stdout:4469 read 0x6d83ac2 thru 0x6d8ef0d (0xb44c bytes) 2024-09-14T06:00:15.447 INFO:teuthology.orchestra.run.smithi006.stdout:4470 read 0xb7a4ad2 thru 0xb7a6de7 (0x2316 bytes) 2024-09-14T06:00:15.448 INFO:teuthology.orchestra.run.smithi006.stdout:4476 trunc from 0xcc57a7d to 0xcafedb2 2024-09-14T06:00:15.465 INFO:teuthology.orchestra.run.smithi006.stdout:4477 read 0x34aa6b7 thru 0x34b0133 (0x5a7d bytes) 2024-09-14T06:00:15.466 INFO:teuthology.orchestra.run.smithi006.stdout:4478 read 0x8e49dfa thru 0x8e4d4b4 (0x36bb bytes) 2024-09-14T06:00:15.467 INFO:teuthology.orchestra.run.smithi006.stdout:4479 read 0x1ce7d66 thru 0x1cf0850 (0x8aeb bytes) 2024-09-14T06:00:15.468 INFO:teuthology.orchestra.run.smithi006.stdout:4480 trunc from 0xcafedb2 to 0xcd63a12 2024-09-14T06:00:15.481 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:15.481 INFO:teuthology.orchestra.run.smithi006.stdout:4482 read 0x5de8c30 thru 0x5deef92 (0x6363 bytes) 2024-09-14T06:00:15.481 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:15.482 INFO:teuthology.orchestra.run.smithi006.stdout:4484 writesame 0xad61b34 thru 0xad6af15 data_size 0x17(0x93e2 bytes) 2024-09-14T06:00:15.486 INFO:teuthology.orchestra.run.smithi006.stdout:4485 writesame 0x2e1d743 thru 0x2e20176 data_size 0x25(0x2a34 bytes) 2024-09-14T06:00:15.490 INFO:teuthology.orchestra.run.smithi006.stdout:4486 writesame 0x88050c8 thru 0x8807fdd data_size 0x15(0x2f16 bytes) 2024-09-14T06:00:15.502 INFO:teuthology.orchestra.run.smithi006.stdout:4487 trunc from 0xcd63a12 to 0x64f7ede 2024-09-14T06:00:15.508 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T06:00:15.517 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:15.515+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:15.520 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:15.520 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:15.533 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T06:00:15.538 INFO:teuthology.orchestra.run.smithi006.stdout:4489 trunc from 0x64f7ede to 0xb68081f 2024-09-14T06:00:15.540 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:00:15.549 INFO:teuthology.orchestra.run.smithi006.stdout:4490 write 0x4ff774b thru 0x4ffbc9f (0x4555 bytes) 2024-09-14T06:00:15.556 INFO:teuthology.orchestra.run.smithi006.stdout:4491 read 0x5a122f3 thru 0x5a2055d (0xe26b bytes) 2024-09-14T06:00:15.557 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:15.557 INFO:teuthology.orchestra.run.smithi006.stdout:4494 punch from 0x5a669c7 to 0x5a6a2f6, (0x392f bytes) 2024-09-14T06:00:15.557 INFO:teuthology.orchestra.run.smithi006.stdout:4495 writesame 0x235c33d thru 0x2368cd1 data_size 0x1(0xc995 bytes) 2024-09-14T06:00:15.601 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:15.601 INFO:teuthology.orchestra.run.smithi006.stdout:4500 read 0x2252694 thru 0x225a26b (0x7bd8 bytes) 2024-09-14T06:00:15.601 INFO:teuthology.orchestra.run.smithi006.stdout:4501 read 0x66c5480 thru 0x66c8a78 (0x35f9 bytes) 2024-09-14T06:00:15.618 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:15.615+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:15.620 INFO:teuthology.orchestra.run.smithi006.stdout:4503 write 0xeb9d46a thru 0xeba50ad (0x7c44 bytes) 2024-09-14T06:00:15.623 INFO:teuthology.orchestra.run.smithi006.stdout:4504 clone 26 order 21 su 1048576 sc 7 2024-09-14T06:00:15.673 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:15.673 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:15.692 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:00:15.719 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:15.715+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:15.820 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:15.817+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:15.856 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:15.856 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:15.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:00:15.959 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:15.957+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:16.021 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:16.019+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:16.041 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:16.041 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:16.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:00:16.122 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:16.119+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:16.223 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:16.221+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:16.226 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:16.226 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:16.241 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:00:16.323 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:16.323+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:16.415 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:16.415 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:16.425 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:16.421+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:16.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:00:16.519 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T06:00:16.526 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:16.523+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:16.539 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T06:00:16.545 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T06:00:16.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:00:16.609 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:16.609 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:16.626 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:16.623+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:16.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:00:16.727 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:16.725+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:16.740 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:16.740 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:16.759 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:16.759 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:16.779 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:16.779 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:16.797 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:16.797 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:16.819 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:16.819 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:16.827 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:16.825+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:16.841 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:16.842 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:16.842 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:16.843 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:16.845 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-14T06:00:16.860 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:00:16.864 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:16.865 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:16.886 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:16.928 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:16.923+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:16.987 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:00:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:00:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54658 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 610304~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:16.987 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.845725449, 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091840061000000001, 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54658 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:16.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4700000000000002e-07 2024-09-14T06:00:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139687+0000", 2024-09-14T06:00:16.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7170000000000008e-06 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139694+0000", 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.063e-06 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139709+0000", 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4324999999999999e-05 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231262+0000", 2024-09-14T06:00:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091553866999999997 2024-09-14T06:00:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231375+0000", 2024-09-14T06:00:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000112927 2024-09-14T06:00:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231519+0000", 2024-09-14T06:00:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014371499999999999 2024-09-14T06:00:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54659 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 616448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.845687101999999, 2024-09-14T06:00:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092177035000000004, 2024-09-14T06:00:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54659 2024-09-14T06:00:16.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139718+0000", 2024-09-14T06:00:16.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9699999999999996e-07 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139731+0000", 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2993000000000001e-05 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139738+0000", 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4610000000000002e-06 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139744+0000", 2024-09-14T06:00:16.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6389999999999997e-06 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231570+0000", 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091826216000000002 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231662+0000", 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2101000000000005e-05 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231894+0000", 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023212800000000001 2024-09-14T06:00:16.995 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54660 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 622592~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.845651768, 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092366887999999994, 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:16.996 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54660 2024-09-14T06:00:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139755+0000", 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139762+0000", 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6719999999999998e-06 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139767+0000", 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9819999999999999e-06 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231917+0000", 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092149872999999993 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231969+0000", 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2642000000000002e-05 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:16.999 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232120+0000", 2024-09-14T06:00:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015011899999999999 2024-09-14T06:00:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54844 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 0~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.845630277000001, 2024-09-14T06:00:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092708507999999995, 2024-09-14T06:00:17.000 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54844 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.001 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139775+0000", 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3500000000000002e-07 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139777+0000", 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.979e-06 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.002 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139787+0000", 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0779e-05 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139799+0000", 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1719000000000001e-05 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232151+0000", 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092351767000000001 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232217+0000", 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6655000000000005e-05 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232483+0000", 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026517400000000002 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54845 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 55296~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:17.004 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.845596606000001, 2024-09-14T06:00:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093127583999999999, 2024-09-14T06:00:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54845 2024-09-14T06:00:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.005 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4899999999999995e-07 2024-09-14T06:00:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139811+0000", 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000001e-06 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139821+0000", 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0168e-05 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139826+0000", 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2780000000000001e-06 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232556+0000", 2024-09-14T06:00:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092729729999999996 2024-09-14T06:00:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232652+0000", 2024-09-14T06:00:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680999999999994e-05 2024-09-14T06:00:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232935+0000", 2024-09-14T06:00:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000283758 2024-09-14T06:00:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54846 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.845570298999998, 2024-09-14T06:00:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093492079000000006, 2024-09-14T06:00:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.009 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54846 2024-09-14T06:00:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139835+0000", 2024-09-14T06:00:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T06:00:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139837+0000", 2024-09-14T06:00:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1059999999999998e-06 2024-09-14T06:00:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139845+0000", 2024-09-14T06:00:17.011 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4300000000000006e-06 2024-09-14T06:00:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139851+0000", 2024-09-14T06:00:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T06:00:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232987+0000", 2024-09-14T06:00:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093136073999999999 2024-09-14T06:00:17.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233075+0000", 2024-09-14T06:00:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7318999999999995e-05 2024-09-14T06:00:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233326+0000", 2024-09-14T06:00:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025159 2024-09-14T06:00:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54847 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 67584~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.845544582999999, 2024-09-14T06:00:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093777452999999997, 2024-09-14T06:00:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.014 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54847 2024-09-14T06:00:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T06:00:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139862+0000", 2024-09-14T06:00:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0200000000000001e-06 2024-09-14T06:00:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139870+0000", 2024-09-14T06:00:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0520000000000002e-06 2024-09-14T06:00:17.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139875+0000", 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233389+0000", 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093514054999999999 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233443+0000", 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3913999999999999e-05 2024-09-14T06:00:17.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233637+0000", 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019392899999999999 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54848 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 73728~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.845521486999999, 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094064464, 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.018 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54848 2024-09-14T06:00:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.019 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T06:00:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139885+0000", 2024-09-14T06:00:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9929999999999998e-06 2024-09-14T06:00:17.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139893+0000", 2024-09-14T06:00:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9759999999999995e-06 2024-09-14T06:00:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139898+0000", 2024-09-14T06:00:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6059999999999996e-06 2024-09-14T06:00:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233681+0000", 2024-09-14T06:00:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093782921000000005 2024-09-14T06:00:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233730+0000", 2024-09-14T06:00:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9410999999999998e-05 2024-09-14T06:00:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233947+0000", 2024-09-14T06:00:17.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021710300000000001 2024-09-14T06:00:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54849 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.845498030999998, 2024-09-14T06:00:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094499257000000003, 2024-09-14T06:00:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.023 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54849 2024-09-14T06:00:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139907+0000", 2024-09-14T06:00:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T06:00:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139909+0000", 2024-09-14T06:00:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T06:00:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139916+0000", 2024-09-14T06:00:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T06:00:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139921+0000", 2024-09-14T06:00:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:00:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234032+0000", 2024-09-14T06:00:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094111037999999994 2024-09-14T06:00:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234150+0000", 2024-09-14T06:00:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118408 2024-09-14T06:00:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234406+0000", 2024-09-14T06:00:17.027 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025540600000000001 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54850 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 135168~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.845476323, 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094814605999999996, 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.028 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54850 2024-09-14T06:00:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:17.029 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139929+0000", 2024-09-14T06:00:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T06:00:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139931+0000", 2024-09-14T06:00:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.024e-06 2024-09-14T06:00:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.030 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139937+0000", 2024-09-14T06:00:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3770000000000001e-06 2024-09-14T06:00:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139942+0000", 2024-09-14T06:00:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0289999999999996e-06 2024-09-14T06:00:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234447+0000", 2024-09-14T06:00:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094505426000000003 2024-09-14T06:00:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.031 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234539+0000", 2024-09-14T06:00:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1793999999999996e-05 2024-09-14T06:00:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234743+0000", 2024-09-14T06:00:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020354600000000001 2024-09-14T06:00:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.032 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54851 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 141312~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.845454611000001, 2024-09-14T06:00:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095179749999999994, 2024-09-14T06:00:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54851 2024-09-14T06:00:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.033 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:00:17.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139952+0000", 2024-09-14T06:00:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0600000000000002e-06 2024-09-14T06:00:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139959+0000", 2024-09-14T06:00:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.584e-06 2024-09-14T06:00:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139964+0000", 2024-09-14T06:00:17.035 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8890000000000001e-06 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234786+0000", 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094822241000000002 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234877+0000", 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1158999999999999e-05 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235130+0000", 2024-09-14T06:00:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025235999999999998 2024-09-14T06:00:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54852 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 147456~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.845433483000001, 2024-09-14T06:00:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095437742000000006, 2024-09-14T06:00:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.037 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54852 2024-09-14T06:00:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140125+0000", 2024-09-14T06:00:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154332 2024-09-14T06:00:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140130+0000", 2024-09-14T06:00:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.284e-06 2024-09-14T06:00:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.039 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140140+0000", 2024-09-14T06:00:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0789e-05 2024-09-14T06:00:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140147+0000", 2024-09-14T06:00:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9879999999999998e-06 2024-09-14T06:00:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235174+0000", 2024-09-14T06:00:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095026749999999993 2024-09-14T06:00:17.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235230+0000", 2024-09-14T06:00:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6224000000000002e-05 2024-09-14T06:00:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235409+0000", 2024-09-14T06:00:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017837500000000001 2024-09-14T06:00:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.041 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54853 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 202752~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.845244660999999, 2024-09-14T06:00:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095632919999999996, 2024-09-14T06:00:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.042 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54853 2024-09-14T06:00:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147748+0000", 2024-09-14T06:00:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075884910000000002 2024-09-14T06:00:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147798+0000", 2024-09-14T06:00:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0152999999999999e-05 2024-09-14T06:00:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.044 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147814+0000", 2024-09-14T06:00:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5866e-05 2024-09-14T06:00:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147831+0000", 2024-09-14T06:00:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6991999999999999e-05 2024-09-14T06:00:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235451+0000", 2024-09-14T06:00:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087620077000000005 2024-09-14T06:00:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.045 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235539+0000", 2024-09-14T06:00:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7800000000000006e-05 2024-09-14T06:00:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235793+0000", 2024-09-14T06:00:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025354099999999998 2024-09-14T06:00:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54868 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 442368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.046 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.837054340999998, 2024-09-14T06:00:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091802783999999998, 2024-09-14T06:00:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54868 2024-09-14T06:00:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.047 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148351+0000", 2024-09-14T06:00:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6800000000000001e-07 2024-09-14T06:00:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.048 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148353+0000", 2024-09-14T06:00:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2299999999999998e-06 2024-09-14T06:00:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148362+0000", 2024-09-14T06:00:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9800000000000004e-06 2024-09-14T06:00:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.049 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148367+0000", 2024-09-14T06:00:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.327e-06 2024-09-14T06:00:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.239863+0000", 2024-09-14T06:00:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091496018999999998 2024-09-14T06:00:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.239932+0000", 2024-09-14T06:00:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8838999999999996e-05 2024-09-14T06:00:17.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240153+0000", 2024-09-14T06:00:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00022092100000000001 2024-09-14T06:00:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54869 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 497664~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.837028443000001, 2024-09-14T06:00:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092147413999999997, 2024-09-14T06:00:17.051 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54869 2024-09-14T06:00:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148377+0000", 2024-09-14T06:00:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1399999999999997e-07 2024-09-14T06:00:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148379+0000", 2024-09-14T06:00:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.429e-06 2024-09-14T06:00:17.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148389+0000", 2024-09-14T06:00:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9029999999999999e-06 2024-09-14T06:00:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148395+0000", 2024-09-14T06:00:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5080000000000002e-06 2024-09-14T06:00:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240191+0000", 2024-09-14T06:00:17.054 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091796066999999995 2024-09-14T06:00:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240284+0000", 2024-09-14T06:00:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2445e-05 2024-09-14T06:00:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240523+0000", 2024-09-14T06:00:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023954799999999999 2024-09-14T06:00:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54870 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 503808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.836999114000001, 2024-09-14T06:00:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092420756000000007, 2024-09-14T06:00:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54870 2024-09-14T06:00:17.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.057 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148406+0000", 2024-09-14T06:00:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T06:00:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148409+0000", 2024-09-14T06:00:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T06:00:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148418+0000", 2024-09-14T06:00:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7329999999999998e-06 2024-09-14T06:00:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.058 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148425+0000", 2024-09-14T06:00:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2079999999999997e-06 2024-09-14T06:00:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240591+0000", 2024-09-14T06:00:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092166441000000002 2024-09-14T06:00:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.059 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240648+0000", 2024-09-14T06:00:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6733e-05 2024-09-14T06:00:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240826+0000", 2024-09-14T06:00:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017834700000000001 2024-09-14T06:00:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.060 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54871 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 509952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.836969153999998, 2024-09-14T06:00:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092702341999999993, 2024-09-14T06:00:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54871 2024-09-14T06:00:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.061 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148436+0000", 2024-09-14T06:00:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5499999999999998e-07 2024-09-14T06:00:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.062 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148439+0000", 2024-09-14T06:00:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8090000000000001e-06 2024-09-14T06:00:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148449+0000", 2024-09-14T06:00:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0115000000000001e-05 2024-09-14T06:00:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148466+0000", 2024-09-14T06:00:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6761000000000001e-05 2024-09-14T06:00:17.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240857+0000", 2024-09-14T06:00:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092391089999999995 2024-09-14T06:00:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240939+0000", 2024-09-14T06:00:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2387999999999998e-05 2024-09-14T06:00:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241138+0000", 2024-09-14T06:00:17.064 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000198624 2024-09-14T06:00:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54872 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 516096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.836927956, 2024-09-14T06:00:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093126020000000004, 2024-09-14T06:00:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.065 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54872 2024-09-14T06:00:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.066 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155484+0000", 2024-09-14T06:00:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070072429999999998 2024-09-14T06:00:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155490+0000", 2024-09-14T06:00:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6379999999999998e-06 2024-09-14T06:00:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.067 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155504+0000", 2024-09-14T06:00:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4065e-05 2024-09-14T06:00:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155513+0000", 2024-09-14T06:00:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6799999999999999e-06 2024-09-14T06:00:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241216+0000", 2024-09-14T06:00:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085702922000000001 2024-09-14T06:00:17.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241277+0000", 2024-09-14T06:00:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0980000000000002e-05 2024-09-14T06:00:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241602+0000", 2024-09-14T06:00:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032549199999999998 2024-09-14T06:00:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54888 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 114688~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.829483475, 2024-09-14T06:00:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091627085999999996, 2024-09-14T06:00:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54888 2024-09-14T06:00:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.070 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.071 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8299999999999998e-07 2024-09-14T06:00:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155923+0000", 2024-09-14T06:00:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4720000000000001e-06 2024-09-14T06:00:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.072 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155926+0000", 2024-09-14T06:00:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.444e-06 2024-09-14T06:00:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155929+0000", 2024-09-14T06:00:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247321+0000", 2024-09-14T06:00:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091391587999999996 2024-09-14T06:00:17.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247382+0000", 2024-09-14T06:00:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1944000000000002e-05 2024-09-14T06:00:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247548+0000", 2024-09-14T06:00:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000165558 2024-09-14T06:00:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54889 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 169984~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.829470874999998, 2024-09-14T06:00:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091908118999999996, 2024-09-14T06:00:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54889 2024-09-14T06:00:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.075 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163444+0000", 2024-09-14T06:00:17.076 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00751033 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163454+0000", 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0579e-05 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163468+0000", 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3794999999999999e-05 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163487+0000", 2024-09-14T06:00:17.077 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8907999999999999e-05 2024-09-14T06:00:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247591+0000", 2024-09-14T06:00:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084103333000000002 2024-09-14T06:00:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247651+0000", 2024-09-14T06:00:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0587000000000001e-05 2024-09-14T06:00:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:17.078 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247842+0000", 2024-09-14T06:00:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019058700000000001 2024-09-14T06:00:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:17.079 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:17.079 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:17.081 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:00:17.081 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:17.077+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:17.176 INFO:teuthology.orchestra.run.smithi006.stdout:4505 writesame 0xa7d22ab thru 0xa7d2535 data_size 0x3(0x28b bytes) 2024-09-14T06:00:17.181 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:17.179+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:17.193 INFO:teuthology.orchestra.run.smithi006.stdout:4507 write 0x2a52841 thru 0x2a5bc02 (0x93c2 bytes) 2024-09-14T06:00:17.201 INFO:teuthology.orchestra.run.smithi006.stdout:4508 punch from 0x61f4253 to 0x61fb2e1, (0x708e bytes) 2024-09-14T06:00:17.201 INFO:teuthology.orchestra.run.smithi006.stdout:4511 write 0x3b44cc4 thru 0x3b48b1b (0x3e58 bytes) 2024-09-14T06:00:17.210 INFO:teuthology.orchestra.run.smithi006.stdout:4512 write 0x88f0af thru 0x890d88 (0x1cda bytes) 2024-09-14T06:00:17.218 INFO:teuthology.orchestra.run.smithi006.stdout:4513 read 0xe69f2f thru 0xe6d72b (0x37fd bytes) 2024-09-14T06:00:17.218 INFO:teuthology.orchestra.run.smithi006.stdout:4514 punch from 0x4f8cdf0 to 0x4f93c0a, (0x6e1a bytes) 2024-09-14T06:00:17.218 INFO:teuthology.orchestra.run.smithi006.stdout:4515 read 0xc4135a0 thru 0xc41ef39 (0xb99a bytes) 2024-09-14T06:00:17.219 INFO:teuthology.orchestra.run.smithi006.stdout:4516 write 0x9cb7032 thru 0x9cc35ab (0xc57a bytes) 2024-09-14T06:00:17.220 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:17.220 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:17.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.221 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:85193 3.1a 3:5cf2870f:::rbd_data.112763f1be8c.0000000000000000:1c [sparse-read 15597568~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-14T06:00:17.221 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:17.221392+0000", 2024-09-14T06:00:17.221 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00082359900000000005, 2024-09-14T06:00:17.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00084344200000000002, 2024-09-14T06:00:17.221 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.221 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.221 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T06:00:17.221 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.221 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.221 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.221 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 85193 2024-09-14T06:00:17.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:17.221392+0000", 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:17.221392+0000", 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:17.221392+0000", 2024-09-14T06:00:17.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5499999999999997e-07 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:17.221399+0000", 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5950000000000004e-06 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:17.221424+0000", 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4932000000000001e-05 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:17.221431+0000", 2024-09-14T06:00:17.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3669999999999999e-06 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:17.222047+0000", 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00061566400000000003 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:17.222249+0000", 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020209399999999999 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.224 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-09-14T06:00:17.225 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 1 2024-09-14T06:00:17.225 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:17.227 INFO:teuthology.orchestra.run.smithi006.stdout:4518 writesame 0x406affb thru 0x40747f3 data_size 0x1f(0x97f9 bytes) 2024-09-14T06:00:17.235 INFO:teuthology.orchestra.run.smithi006.stdout:4519 read 0xb2069d5 thru 0xb2095bf (0x2beb bytes) 2024-09-14T06:00:17.237 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:00:17.249 INFO:teuthology.orchestra.run.smithi006.stdout:4521 trunc from 0xeba50ae to 0x39dd677 2024-09-14T06:00:17.281 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:17.277+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:17.283 INFO:teuthology.orchestra.run.smithi006.stdout:4522 read 0x31f674e thru 0x31f73ab (0xc5e bytes) 2024-09-14T06:00:17.306 INFO:teuthology.orchestra.run.smithi006.stdout:4523 write 0xa483d29 thru 0xa483ed2 (0x1aa bytes) 2024-09-14T06:00:17.311 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:17.311 INFO:teuthology.orchestra.run.smithi006.stdout:4525 read 0x4805ef8 thru 0x480a186 (0x428f bytes) 2024-09-14T06:00:17.320 INFO:teuthology.orchestra.run.smithi006.stdout:4528 write 0xa56bfe0 thru 0xa57a619 (0xe63a bytes) 2024-09-14T06:00:17.326 INFO:teuthology.orchestra.run.smithi006.stdout:4529 read 0x805013c thru 0x8051f65 (0x1e2a bytes) 2024-09-14T06:00:17.327 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:17.327 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:17.327 INFO:teuthology.orchestra.run.smithi006.stdout:4532 read 0x23022f0 thru 0x230b68d (0x939e bytes) 2024-09-14T06:00:17.345 INFO:teuthology.orchestra.run.smithi006.stdout:4533 write 0xeab20a9 thru 0xeab9b67 (0x7abf bytes) 2024-09-14T06:00:17.351 INFO:teuthology.orchestra.run.smithi006.stdout:4535 write 0xbbcf18e thru 0xbbd4831 (0x56a4 bytes) 2024-09-14T06:00:17.357 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:17.357 INFO:teuthology.orchestra.run.smithi006.stdout:4537 write 0xb587401 thru 0xb588160 (0xd60 bytes) 2024-09-14T06:00:17.363 INFO:teuthology.orchestra.run.smithi006.stdout:4538 write 0xdd36780 thru 0xdd3bfa5 (0x5826 bytes) 2024-09-14T06:00:17.368 INFO:teuthology.orchestra.run.smithi006.stdout:4539 read 0x23c04d6 thru 0x23c22ac (0x1dd7 bytes) 2024-09-14T06:00:17.369 INFO:teuthology.orchestra.run.smithi006.stdout:4540 punch from 0x79aa6d4 to 0x79b575e, (0xb08a bytes) 2024-09-14T06:00:17.369 INFO:teuthology.orchestra.run.smithi006.stdout:4542 write 0xcc78592 thru 0xcc79109 (0xb78 bytes) 2024-09-14T06:00:17.375 INFO:teuthology.orchestra.run.smithi006.stdout:4544 write 0x5c75e9d thru 0x5c7a485 (0x45e9 bytes) 2024-09-14T06:00:17.380 INFO:teuthology.orchestra.run.smithi006.stdout:4545 read 0x5dfcaf thru 0x5e5606 (0x5958 bytes) 2024-09-14T06:00:17.381 INFO:teuthology.orchestra.run.smithi006.stdout:4548 write 0x8642e88 thru 0x8649721 (0x689a bytes) 2024-09-14T06:00:17.381 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:17.379+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:17.387 INFO:teuthology.orchestra.run.smithi006.stdout:4549 read 0x85f9147 thru 0x85fb983 (0x283d bytes) 2024-09-14T06:00:17.387 INFO:teuthology.orchestra.run.smithi006.stdout:4550 read 0xa88b2b6 thru 0xa891cdd (0x6a28 bytes) 2024-09-14T06:00:17.387 INFO:teuthology.orchestra.run.smithi006.stdout:4551 write 0xcda61c2 thru 0xcdb1a82 (0xb8c1 bytes) 2024-09-14T06:00:17.394 INFO:teuthology.orchestra.run.smithi006.stdout:4552 punch from 0x1a66182 to 0x1a6942f, (0x32ad bytes) 2024-09-14T06:00:17.394 INFO:teuthology.orchestra.run.smithi006.stdout:4553 read 0x4c9b20 thru 0x4cd124 (0x3605 bytes) 2024-09-14T06:00:17.394 INFO:teuthology.orchestra.run.smithi006.stdout:4555 writesame 0x2eb20c7 thru 0x2eb4007 data_size 0x15(0x1f41 bytes) 2024-09-14T06:00:17.402 INFO:teuthology.orchestra.run.smithi006.stdout:4556 read 0xd9255e9 thru 0xd930fef (0xba07 bytes) 2024-09-14T06:00:17.402 INFO:teuthology.orchestra.run.smithi006.stdout:4557 writesame 0x3fa8c21 thru 0x3fb16eb data_size 0x1(0x8acb bytes) 2024-09-14T06:00:17.418 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:17.418 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:17.418 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:17.418 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:17.418 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:17.432 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:00:17.463 INFO:teuthology.orchestra.run.smithi006.stdout:4558 trunc from 0xeab9b68 to 0x4f8eea6 2024-09-14T06:00:17.486 INFO:teuthology.orchestra.run.smithi006.stdout:4559 punch from 0xc7792a to 0xc7d73f, (0x5e15 bytes) 2024-09-14T06:00:17.503 INFO:teuthology.orchestra.run.smithi006.stdout:4561 writesame 0x705e5ea thru 0x7063067 data_size 0x5(0x4a7e bytes) 2024-09-14T06:00:17.503 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:17.503 INFO:teuthology.orchestra.run.smithi006.stdout:4564 read 0x216b6c thru 0x223f68 (0xd3fd bytes) 2024-09-14T06:00:17.504 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:17.504 INFO:teuthology.orchestra.run.smithi006.stdout:4566 punch from 0x1f751ad to 0x1f7f807, (0xa65a bytes) 2024-09-14T06:00:17.515 INFO:teuthology.orchestra.run.smithi006.stdout:4567 trunc from 0x7063068 to 0xb10b9ca 2024-09-14T06:00:17.521 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:17.519+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2024-09-14T06:00:17.527 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T06:00:17.539 INFO:teuthology.orchestra.run.smithi006.stdout:4568 trunc from 0xb10b9ca to 0x6aa37ec 2024-09-14T06:00:17.550 INFO:teuthology.orchestra.run.smithi006.stdout:4569 read 0x246b8a thru 0x2496fc (0x2b73 bytes) 2024-09-14T06:00:17.555 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-14T06:00:17.565 INFO:teuthology.orchestra.run.smithi006.stdout:4570 trunc from 0x6aa37ec to 0xe649707 2024-09-14T06:00:17.572 INFO:teuthology.orchestra.run.smithi006.stdout:4572 read 0x164800 thru 0x16c055 (0x7856 bytes) 2024-09-14T06:00:17.576 INFO:teuthology.orchestra.run.smithi006.stdout:4575 punch from 0x6f80031 to 0x6f8cebe, (0xce8d bytes) 2024-09-14T06:00:17.576 INFO:teuthology.orchestra.run.smithi006.stdout:4576 writesame 0xb44c961 thru 0xb44fa55 data_size 0x1(0x30f5 bytes) 2024-09-14T06:00:17.583 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:17.581+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:17.587 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:17.587 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:17.606 INFO:teuthology.orchestra.run.smithi006.stdout:4580 trunc from 0xe649707 to 0x2126c98 2024-09-14T06:00:17.609 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:17.609 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:17.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:17.609 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:17.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.609 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23550 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 606208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.609 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:17.609 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.659091641000003, 2024-09-14T06:00:17.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048793072999999999, 2024-09-14T06:00:17.609 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23550 2024-09-14T06:00:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7800000000000002e-07 2024-09-14T06:00:17.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948677+0000", 2024-09-14T06:00:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1949999999999997e-06 2024-09-14T06:00:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948687+0000", 2024-09-14T06:00:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0849000000000001e-05 2024-09-14T06:00:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948692+0000", 2024-09-14T06:00:17.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8670000000000002e-06 2024-09-14T06:00:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997290+0000", 2024-09-14T06:00:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048597596999999999 2024-09-14T06:00:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997367+0000", 2024-09-14T06:00:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7236000000000004e-05 2024-09-14T06:00:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997462+0000", 2024-09-14T06:00:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4951000000000006e-05 2024-09-14T06:00:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23551 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 620544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.659060783999998, 2024-09-14T06:00:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048938838999999998, 2024-09-14T06:00:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.614 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23551 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:17.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:17.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1e-07 2024-09-14T06:00:17.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948701+0000", 2024-09-14T06:00:17.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2950000000000001e-06 2024-09-14T06:00:17.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948705+0000", 2024-09-14T06:00:17.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7929999999999999e-06 2024-09-14T06:00:17.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948709+0000", 2024-09-14T06:00:17.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T06:00:17.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997535+0000", 2024-09-14T06:00:17.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048826181000000003 2024-09-14T06:00:17.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997580+0000", 2024-09-14T06:00:17.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5355000000000002e-05 2024-09-14T06:00:17.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997639+0000", 2024-09-14T06:00:17.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8479e-05 2024-09-14T06:00:17.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.619 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.619 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.619 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:17.619 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.659045307, 2024-09-14T06:00:17.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T06:00:17.620 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.620 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.620 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.620 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.620 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.620 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.620 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T06:00:17.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.620 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:17.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:17.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T06:00:17.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T06:00:17.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T06:00:17.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T06:00:17.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T06:00:17.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T06:00:17.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T06:00:17.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T06:00:17.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T06:00:17.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T06:00:17.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T06:00:17.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T06:00:17.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T06:00:17.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T06:00:17.624 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.624 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.624 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.624 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.624 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:17.624 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.659026032, 2024-09-14T06:00:17.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T06:00:17.624 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.624 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.624 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.625 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.625 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.625 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.625 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T06:00:17.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.625 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:17.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:17.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:17.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T06:00:17.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T06:00:17.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T06:00:17.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T06:00:17.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T06:00:17.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T06:00:17.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T06:00:17.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T06:00:17.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T06:00:17.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T06:00:17.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T06:00:17.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T06:00:17.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T06:00:17.629 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.629 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.629 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.629 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.629 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:17.629 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.659006456, 2024-09-14T06:00:17.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T06:00:17.629 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.629 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:17.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T06:00:17.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T06:00:17.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T06:00:17.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T06:00:17.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T06:00:17.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:17.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T06:00:17.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T06:00:17.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T06:00:17.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T06:00:17.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T06:00:17.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T06:00:17.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T06:00:17.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T06:00:17.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.634 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.634 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.634 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.634 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:17.634 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.658986999, 2024-09-14T06:00:17.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T06:00:17.634 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.634 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.634 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T06:00:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:17.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T06:00:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T06:00:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T06:00:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T06:00:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T06:00:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T06:00:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T06:00:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T06:00:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T06:00:17.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.638 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.658967947999997, 2024-09-14T06:00:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T06:00:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T06:00:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:17.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T06:00:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T06:00:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T06:00:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T06:00:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T06:00:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T06:00:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T06:00:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T06:00:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T06:00:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T06:00:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T06:00:17.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T06:00:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T06:00:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.658948267, 2024-09-14T06:00:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T06:00:17.643 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T06:00:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T06:00:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T06:00:17.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T06:00:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T06:00:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T06:00:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T06:00:17.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T06:00:17.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T06:00:17.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T06:00:17.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T06:00:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T06:00:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T06:00:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T06:00:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.648 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.658928316000001, 2024-09-14T06:00:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T06:00:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T06:00:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.649 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T06:00:17.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T06:00:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T06:00:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:00:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T06:00:17.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T06:00:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T06:00:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T06:00:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T06:00:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T06:00:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:17.653 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.658909004000002, 2024-09-14T06:00:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T06:00:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T06:00:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:17.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T06:00:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.658889242999997, 2024-09-14T06:00:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T06:00:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T06:00:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.658 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T06:00:17.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:00:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T06:00:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T06:00:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T06:00:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T06:00:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T06:00:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T06:00:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T06:00:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T06:00:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T06:00:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T06:00:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T06:00:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T06:00:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.658868322000004, 2024-09-14T06:00:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T06:00:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T06:00:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.663 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T06:00:17.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T06:00:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T06:00:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T06:00:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T06:00:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T06:00:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T06:00:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T06:00:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T06:00:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T06:00:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T06:00:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T06:00:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T06:00:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T06:00:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.657708988000003, 2024-09-14T06:00:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T06:00:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.667 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T06:00:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T06:00:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T06:00:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T06:00:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T06:00:17.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T06:00:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T06:00:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T06:00:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T06:00:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T06:00:17.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.672 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.672 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:17.672 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.657410206000002, 2024-09-14T06:00:17.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T06:00:17.672 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.672 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.672 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.672 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.672 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.672 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.672 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T06:00:17.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.672 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:17.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:17.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T06:00:17.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T06:00:17.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T06:00:17.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T06:00:17.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T06:00:17.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T06:00:17.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T06:00:17.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T06:00:17.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T06:00:17.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T06:00:17.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T06:00:17.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T06:00:17.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T06:00:17.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T06:00:17.676 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.676 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.676 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.677 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.677 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:17.677 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.657259467999999, 2024-09-14T06:00:17.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T06:00:17.677 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.677 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.677 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.678 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.678 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T06:00:17.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.678 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:17.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:17.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T06:00:17.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T06:00:17.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T06:00:17.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T06:00:17.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T06:00:17.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T06:00:17.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T06:00:17.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T06:00:17.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T06:00:17.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T06:00:17.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T06:00:17.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T06:00:17.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T06:00:17.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T06:00:17.681 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.681 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.681 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.682 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23582 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 911360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.682 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:17.682 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.656334080999997, 2024-09-14T06:00:17.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048708939999999999, 2024-09-14T06:00:17.682 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.682 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.682 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.682 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23582 2024-09-14T06:00:17.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6300000000000005e-07 2024-09-14T06:00:17.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951430+0000", 2024-09-14T06:00:17.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5179999999999999e-06 2024-09-14T06:00:17.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951437+0000", 2024-09-14T06:00:17.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0940000000000002e-06 2024-09-14T06:00:17.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951443+0000", 2024-09-14T06:00:17.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7910000000000001e-06 2024-09-14T06:00:17.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000047+0000", 2024-09-14T06:00:17.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048604550000000003 2024-09-14T06:00:17.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000095+0000", 2024-09-14T06:00:17.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7735999999999998e-05 2024-09-14T06:00:17.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000135+0000", 2024-09-14T06:00:17.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0587999999999998e-05 2024-09-14T06:00:17.686 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.686 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.686 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.686 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23588 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 722944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.686 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:17.686 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.656309215999997, 2024-09-14T06:00:17.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048792653999999998, 2024-09-14T06:00:17.686 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.686 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.687 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.687 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23588 2024-09-14T06:00:17.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.687 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:17.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951665+0000", 2024-09-14T06:00:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021337600000000001 2024-09-14T06:00:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951669+0000", 2024-09-14T06:00:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3460000000000004e-06 2024-09-14T06:00:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951688+0000", 2024-09-14T06:00:17.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9042000000000002e-05 2024-09-14T06:00:17.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951696+0000", 2024-09-14T06:00:17.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6660000000000008e-06 2024-09-14T06:00:17.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000162+0000", 2024-09-14T06:00:17.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048465824999999997 2024-09-14T06:00:17.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000199+0000", 2024-09-14T06:00:17.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7143e-05 2024-09-14T06:00:17.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000244+0000", 2024-09-14T06:00:17.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5256000000000002e-05 2024-09-14T06:00:17.690 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.690 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.690 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.691 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23590 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 745472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.691 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:17.691 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.656051761000001, 2024-09-14T06:00:17.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048677684999999998, 2024-09-14T06:00:17.691 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.691 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.691 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:17.691 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.691 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.691 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.691 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23590 2024-09-14T06:00:17.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.692 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:17.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:17.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951850+0000", 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014113 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951855+0000", 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6349999999999997e-06 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951863+0000", 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8189999999999998e-06 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951871+0000", 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2030000000000003e-06 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000283+0000", 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048412531000000002 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000338+0000", 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4462000000000001e-05 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000387+0000", 2024-09-14T06:00:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8905e-05 2024-09-14T06:00:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T06:00:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.031957904999999, 2024-09-14T06:00:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T06:00:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:17.695 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T06:00:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T06:00:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T06:00:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T06:00:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T06:00:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T06:00:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:17.699 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.508867965999997, 2024-09-14T06:00:17.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T06:00:17.700 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:17.700 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:17.700 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:17.700 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:17.700 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:17.700 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:17.700 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T06:00:17.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.700 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:17.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:17.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:17.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:17.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:17.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:17.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:17.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T06:00:17.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T06:00:17.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T06:00:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T06:00:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T06:00:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T06:00:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T06:00:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T06:00:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:17.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T06:00:17.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T06:00:17.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:17.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T06:00:17.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T06:00:17.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:17.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T06:00:17.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T06:00:17.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:17.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:17.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:17.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T06:00:17.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T06:00:17.705 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.705 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.705 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.705 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:17.705 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:17.705 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:17.706 INFO:teuthology.orchestra.run.smithi006.stdout:4581 writesame 0x440771d thru 0x441609b data_size 0x19(0xe97f bytes) 2024-09-14T06:00:17.706 INFO:teuthology.orchestra.run.smithi006.stdout:4582 write 0xb5e2a8a thru 0xb5e4730 (0x1ca7 bytes) 2024-09-14T06:00:17.707 INFO:teuthology.orchestra.run.smithi006.stdout:4584 write 0xd8250c3 thru 0xd827fb6 (0x2ef4 bytes) 2024-09-14T06:00:17.707 INFO:teuthology.orchestra.run.smithi006.stdout:4585 read 0x176bc31 thru 0x1778f0e (0xd2de bytes) 2024-09-14T06:00:17.707 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:17.701+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:17.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:00:17.708 INFO:teuthology.orchestra.run.smithi006.stdout:4588 trunc from 0xd827fb7 to 0x6a17092 2024-09-14T06:00:17.727 INFO:teuthology.orchestra.run.smithi006.stdout:4589 trunc from 0x6a17092 to 0xa52d6a4 2024-09-14T06:00:17.747 INFO:teuthology.orchestra.run.smithi006.stdout:4591 writesame 0xb7a7648 thru 0xb7b4793 data_size 0x2f(0xd14c bytes) 2024-09-14T06:00:17.761 INFO:teuthology.orchestra.run.smithi006.stdout:4592 writesame 0xe01232d thru 0xe012b35 data_size 0x1(0x809 bytes) 2024-09-14T06:00:17.761 INFO:teuthology.orchestra.run.smithi006.stdout:4594 writesame 0xcb5d3b9 thru 0xcb5e750 data_size 0x26(0x1398 bytes) 2024-09-14T06:00:17.768 INFO:teuthology.orchestra.run.smithi006.stdout:4596 writesame 0xd4c7881 thru 0xd4cf280 data_size 0x4(0x7a00 bytes) 2024-09-14T06:00:17.778 INFO:teuthology.orchestra.run.smithi006.stdout:4597 read 0x9ddd707 thru 0x9de2234 (0x4b2e bytes) 2024-09-14T06:00:17.778 INFO:teuthology.orchestra.run.smithi006.stdout:4598 write 0x95e7f1e thru 0x95ec0bb (0x419e bytes) 2024-09-14T06:00:17.783 INFO:teuthology.orchestra.run.smithi006.stdout:4599 writesame 0x60cb9c0 thru 0x60d05e8 data_size 0x3(0x4c29 bytes) 2024-09-14T06:00:17.791 INFO:teuthology.orchestra.run.smithi006.stdout:4600 read 0x5bbe7ce thru 0x5bc8bbe (0xa3f1 bytes) 2024-09-14T06:00:17.792 INFO:teuthology.orchestra.run.smithi006.stdout:4601 clone 27 order 24 su 4194304 sc 11 2024-09-14T06:00:17.807 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:17.805+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:17.879 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:17.879 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:17.879 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:17.879 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:17.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:00:17.941 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:17.939+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:18.009 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:18.005+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:18.014 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:18.014 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:18.014 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:18.014 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:18.014 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:18.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:00:18.121 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:18.119+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:18.207 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:18.207 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:18.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:18.207 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:18.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.207 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:18.207 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:18.207 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.659399440000001, 2024-09-14T06:00:18.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:00:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:00:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:18.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:00:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:00:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:00:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:00:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:00:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:00:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:00:18.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:00:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:00:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:00:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:00:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:00:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:00:18.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:00:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:00:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:00:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:00:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:00:18.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:00:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:00:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:00:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:00:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:00:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.213 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38842 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.684272718999999, 2024-09-14T06:00:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083698121, 2024-09-14T06:00:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.214 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38842 2024-09-14T06:00:18.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.215 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:18.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:18.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521563+0000", 2024-09-14T06:00:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:00:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521566+0000", 2024-09-14T06:00:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1140000000000002e-06 2024-09-14T06:00:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521575+0000", 2024-09-14T06:00:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8769999999999999e-06 2024-09-14T06:00:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521581+0000", 2024-09-14T06:00:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2369999999999997e-06 2024-09-14T06:00:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605076+0000", 2024-09-14T06:00:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083494992000000004 2024-09-14T06:00:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605168+0000", 2024-09-14T06:00:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1731999999999995e-05 2024-09-14T06:00:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605260+0000", 2024-09-14T06:00:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2511999999999998e-05 2024-09-14T06:00:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.218 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38844 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9469952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.684245351999998, 2024-09-14T06:00:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084006762999999998, 2024-09-14T06:00:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.219 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38844 2024-09-14T06:00:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521590+0000", 2024-09-14T06:00:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9699999999999996e-07 2024-09-14T06:00:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521593+0000", 2024-09-14T06:00:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5909999999999998e-06 2024-09-14T06:00:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521603+0000", 2024-09-14T06:00:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0642000000000001e-05 2024-09-14T06:00:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521609+0000", 2024-09-14T06:00:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1020000000000002e-06 2024-09-14T06:00:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605318+0000", 2024-09-14T06:00:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083709166000000002 2024-09-14T06:00:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605454+0000", 2024-09-14T06:00:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013557400000000001 2024-09-14T06:00:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605596+0000", 2024-09-14T06:00:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014209100000000001 2024-09-14T06:00:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38845 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9650176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.223 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.684217052000001, 2024-09-14T06:00:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084212700000000001, 2024-09-14T06:00:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38845 2024-09-14T06:00:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.224 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:18.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:18.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:18.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1200000000000003e-07 2024-09-14T06:00:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521628+0000", 2024-09-14T06:00:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0196e-05 2024-09-14T06:00:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521637+0000", 2024-09-14T06:00:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6649999999999992e-06 2024-09-14T06:00:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521643+0000", 2024-09-14T06:00:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.285e-06 2024-09-14T06:00:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605652+0000", 2024-09-14T06:00:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084009025000000001 2024-09-14T06:00:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605741+0000", 2024-09-14T06:00:18.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8473000000000005e-05 2024-09-14T06:00:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605830+0000", 2024-09-14T06:00:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9444000000000006e-05 2024-09-14T06:00:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38848 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8536064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.684179043, 2024-09-14T06:00:18.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084375567999999998, 2024-09-14T06:00:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38848 2024-09-14T06:00:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:18.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0200000000000002e-07 2024-09-14T06:00:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521659+0000", 2024-09-14T06:00:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7800000000000001e-06 2024-09-14T06:00:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521667+0000", 2024-09-14T06:00:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6599999999999995e-06 2024-09-14T06:00:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521674+0000", 2024-09-14T06:00:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4560000000000003e-06 2024-09-14T06:00:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605872+0000", 2024-09-14T06:00:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084198010000000004 2024-09-14T06:00:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605945+0000", 2024-09-14T06:00:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2681000000000004e-05 2024-09-14T06:00:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606031+0000", 2024-09-14T06:00:18.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6378999999999994e-05 2024-09-14T06:00:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38849 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9748480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.684148616999998, 2024-09-14T06:00:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084581577000000005, 2024-09-14T06:00:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.234 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38849 2024-09-14T06:00:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521687+0000", 2024-09-14T06:00:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9400000000000005e-07 2024-09-14T06:00:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521729+0000", 2024-09-14T06:00:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2657000000000002e-05 2024-09-14T06:00:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521749+0000", 2024-09-14T06:00:18.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9264000000000001e-05 2024-09-14T06:00:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521761+0000", 2024-09-14T06:00:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2289999999999999e-05 2024-09-14T06:00:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606078+0000", 2024-09-14T06:00:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084316772999999998 2024-09-14T06:00:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606176+0000", 2024-09-14T06:00:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7992999999999995e-05 2024-09-14T06:00:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606268+0000", 2024-09-14T06:00:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2006e-05 2024-09-14T06:00:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38851 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9928704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:18.238 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.684053304999999, 2024-09-14T06:00:18.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084695081000000005, 2024-09-14T06:00:18.239 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.239 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.239 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.239 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.239 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.239 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.239 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38851 2024-09-14T06:00:18.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.239 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:18.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:18.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521783+0000", 2024-09-14T06:00:18.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1000000000000001e-06 2024-09-14T06:00:18.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521788+0000", 2024-09-14T06:00:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2619999999999998e-06 2024-09-14T06:00:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521803+0000", 2024-09-14T06:00:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5421999999999999e-05 2024-09-14T06:00:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521815+0000", 2024-09-14T06:00:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.171e-05 2024-09-14T06:00:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606320+0000", 2024-09-14T06:00:18.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084504698000000003 2024-09-14T06:00:18.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606404+0000", 2024-09-14T06:00:18.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4379e-05 2024-09-14T06:00:18.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606476+0000", 2024-09-14T06:00:18.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2509999999999995e-05 2024-09-14T06:00:18.243 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.243 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.243 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.243 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.243 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:18.243 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.684002554999999, 2024-09-14T06:00:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:00:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:00:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:00:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:00:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:00:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:00:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:00:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:00:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:00:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:00:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:00:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:00:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:00:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:00:18.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:00:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:00:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.683964232000001, 2024-09-14T06:00:18.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:00:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:00:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:00:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:00:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:00:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:00:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:00:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:00:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:00:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:00:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:00:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:00:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:00:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:00:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:00:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.253 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.683937540000002, 2024-09-14T06:00:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:00:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:00:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:00:18.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:00:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:00:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:00:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:00:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:00:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:00:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:00:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:00:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:00:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:00:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:00:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:00:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:00:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.683911674000001, 2024-09-14T06:00:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:00:18.258 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:00:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:00:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:00:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:00:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:00:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:00:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:00:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:00:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:00:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:00:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:00:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:00:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:00:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:00:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:00:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.682811305000001, 2024-09-14T06:00:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:00:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.263 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:00:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:00:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:00:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:00:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:00:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:00:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:00:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:00:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:00:18.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:00:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:00:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:00:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:00:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:00:18.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:00:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.682767325999997, 2024-09-14T06:00:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:00:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.268 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:00:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:00:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:00:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:00:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:00:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:00:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:00:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:00:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:00:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:00:18.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:00:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:00:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:00:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:00:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:00:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38865 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1392640~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.681788947999998, 2024-09-14T06:00:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084340500999999998, 2024-09-14T06:00:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38865 2024-09-14T06:00:18.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524047+0000", 2024-09-14T06:00:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5290000000000001e-06 2024-09-14T06:00:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524054+0000", 2024-09-14T06:00:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1910000000000003e-06 2024-09-14T06:00:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524074+0000", 2024-09-14T06:00:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9383999999999999e-05 2024-09-14T06:00:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524089+0000", 2024-09-14T06:00:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4647000000000001e-05 2024-09-14T06:00:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608123+0000", 2024-09-14T06:00:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084034837000000001 2024-09-14T06:00:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608224+0000", 2024-09-14T06:00:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100182 2024-09-14T06:00:18.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608386+0000", 2024-09-14T06:00:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162731 2024-09-14T06:00:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.681705565999998, 2024-09-14T06:00:18.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:00:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:00:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:00:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:00:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:00:18.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:00:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:00:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:00:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:00:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:00:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:00:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:00:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:00:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:00:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:00:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:00:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.281 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38869 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.681300096000001, 2024-09-14T06:00:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084608905999999998, 2024-09-14T06:00:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.282 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38869 2024-09-14T06:00:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525138+0000", 2024-09-14T06:00:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00060367999999999999 2024-09-14T06:00:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525160+0000", 2024-09-14T06:00:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1875999999999999e-05 2024-09-14T06:00:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525182+0000", 2024-09-14T06:00:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1427e-05 2024-09-14T06:00:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525198+0000", 2024-09-14T06:00:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507e-05 2024-09-14T06:00:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608907+0000", 2024-09-14T06:00:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083708535000000001 2024-09-14T06:00:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609011+0000", 2024-09-14T06:00:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010461199999999999 2024-09-14T06:00:18.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609144+0000", 2024-09-14T06:00:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013226899999999999 2024-09-14T06:00:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38871 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1671168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.680608886000002, 2024-09-14T06:00:18.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084308214000000006, 2024-09-14T06:00:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38871 2024-09-14T06:00:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525487+0000", 2024-09-14T06:00:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026091100000000001 2024-09-14T06:00:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525493+0000", 2024-09-14T06:00:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.742e-06 2024-09-14T06:00:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525508+0000", 2024-09-14T06:00:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525518+0000", 2024-09-14T06:00:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8500000000000006e-06 2024-09-14T06:00:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609229+0000", 2024-09-14T06:00:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083711775000000002 2024-09-14T06:00:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609388+0000", 2024-09-14T06:00:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158286 2024-09-14T06:00:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609534+0000", 2024-09-14T06:00:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000146308 2024-09-14T06:00:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.290 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38873 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 737280~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.680297314000001, 2024-09-14T06:00:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084288875999999999, 2024-09-14T06:00:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.291 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38873 2024-09-14T06:00:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526372+0000", 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00083508200000000001 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526383+0000", 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0282000000000001e-05 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526445+0000", 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1975000000000002e-05 2024-09-14T06:00:18.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526460+0000", 2024-09-14T06:00:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5233e-05 2024-09-14T06:00:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609585+0000", 2024-09-14T06:00:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083125216000000002 2024-09-14T06:00:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609689+0000", 2024-09-14T06:00:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104126 2024-09-14T06:00:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609826+0000", 2024-09-14T06:00:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013696199999999999 2024-09-14T06:00:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38874 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:18.295 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.679330380000003, 2024-09-14T06:00:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083631987000000005, 2024-09-14T06:00:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38874 2024-09-14T06:00:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526505+0000", 2024-09-14T06:00:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7699999999999992e-07 2024-09-14T06:00:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526511+0000", 2024-09-14T06:00:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9139999999999996e-06 2024-09-14T06:00:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526525+0000", 2024-09-14T06:00:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3644e-05 2024-09-14T06:00:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526533+0000", 2024-09-14T06:00:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6510000000000001e-06 2024-09-14T06:00:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609897+0000", 2024-09-14T06:00:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083364173 2024-09-14T06:00:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610007+0000", 2024-09-14T06:00:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110707 2024-09-14T06:00:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610136+0000", 2024-09-14T06:00:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012892099999999999 2024-09-14T06:00:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38877 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1949696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:18.300 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.679285686999997, 2024-09-14T06:00:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083886717, 2024-09-14T06:00:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38877 2024-09-14T06:00:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:18.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529354+0000", 2024-09-14T06:00:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028049170000000001 2024-09-14T06:00:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529373+0000", 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.933e-05 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529399+0000", 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6129e-05 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529418+0000", 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8944e-05 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610197+0000", 2024-09-14T06:00:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080778271999999998 2024-09-14T06:00:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610300+0000", 2024-09-14T06:00:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103868 2024-09-14T06:00:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610436+0000", 2024-09-14T06:00:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013525700000000001 2024-09-14T06:00:18.304 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.305 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.305 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:18.306 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:00:18.307 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:18.301+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:18.407 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:18.403+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:18.481 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:18.481 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:18.495 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:00:18.508 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:18.505+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:18.535 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.3 to 1 (10000) 2024-09-14T06:00:18.563 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T06:00:18.608 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:18.605+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:18.654 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone26 from 0xe012b36 (overlap 0x2126c98) to 0x1734c04 2024-09-14T06:00:18.674 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:18.675 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:18.675 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:18.675 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:18.675 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:18.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:00:18.709 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:18.705+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:18.769 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-14T06:00:18.810 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:18.805+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:18.823 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:18.823 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:18.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:18.823 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:18.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.823 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59148 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 419840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.823 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:18.824 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.553742489000001, 2024-09-14T06:00:18.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072974285999999999, 2024-09-14T06:00:18.824 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.824 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.824 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.824 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.824 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.824 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.824 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59148 2024-09-14T06:00:18.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.824 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:18.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:18.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268521+0000", 2024-09-14T06:00:18.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4199999999999995e-07 2024-09-14T06:00:18.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268524+0000", 2024-09-14T06:00:18.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.05e-06 2024-09-14T06:00:18.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268534+0000", 2024-09-14T06:00:18.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8719999999999997e-06 2024-09-14T06:00:18.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268541+0000", 2024-09-14T06:00:18.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5349999999999999e-06 2024-09-14T06:00:18.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341108+0000", 2024-09-14T06:00:18.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072566624999999996 2024-09-14T06:00:18.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341169+0000", 2024-09-14T06:00:18.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1251e-05 2024-09-14T06:00:18.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341494+0000", 2024-09-14T06:00:18.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325311 2024-09-14T06:00:18.828 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.828 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.828 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.828 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59149 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 436224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.828 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:18.828 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.553703264999999, 2024-09-14T06:00:18.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073405053999999997, 2024-09-14T06:00:18.829 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.829 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.829 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.829 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.829 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.829 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.829 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59149 2024-09-14T06:00:18.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.829 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:18.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:18.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268560+0000", 2024-09-14T06:00:18.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9999999999999997e-07 2024-09-14T06:00:18.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268563+0000", 2024-09-14T06:00:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.292e-06 2024-09-14T06:00:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268573+0000", 2024-09-14T06:00:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3260000000000002e-06 2024-09-14T06:00:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268581+0000", 2024-09-14T06:00:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1960000000000008e-06 2024-09-14T06:00:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341537+0000", 2024-09-14T06:00:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072955916999999995 2024-09-14T06:00:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341641+0000", 2024-09-14T06:00:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104341 2024-09-14T06:00:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341964+0000", 2024-09-14T06:00:18.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032328199999999999 2024-09-14T06:00:18.833 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.833 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.833 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.833 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59150 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 452608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.833 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:18.833 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.553670024999999, 2024-09-14T06:00:18.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073829748000000001, 2024-09-14T06:00:18.833 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.834 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.834 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.834 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.834 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.834 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.834 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59150 2024-09-14T06:00:18.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.834 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:18.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:18.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:18.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0399999999999995e-07 2024-09-14T06:00:18.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268596+0000", 2024-09-14T06:00:18.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9859999999999999e-06 2024-09-14T06:00:18.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268606+0000", 2024-09-14T06:00:18.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0088000000000001e-05 2024-09-14T06:00:18.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268614+0000", 2024-09-14T06:00:18.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T06:00:18.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341999+0000", 2024-09-14T06:00:18.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073385011999999999 2024-09-14T06:00:18.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342093+0000", 2024-09-14T06:00:18.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3793000000000001e-05 2024-09-14T06:00:18.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342422+0000", 2024-09-14T06:00:18.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000329129 2024-09-14T06:00:18.837 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.837 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.838 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.838 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59151 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.838 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:18.838 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.553637656999999, 2024-09-14T06:00:18.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074207289999999995, 2024-09-14T06:00:18.838 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.838 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.838 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.838 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.838 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.838 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.838 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59151 2024-09-14T06:00:18.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.839 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:18.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:18.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268626+0000", 2024-09-14T06:00:18.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T06:00:18.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268629+0000", 2024-09-14T06:00:18.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.038e-06 2024-09-14T06:00:18.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268638+0000", 2024-09-14T06:00:18.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8139999999999995e-06 2024-09-14T06:00:18.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268647+0000", 2024-09-14T06:00:18.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4889999999999995e-06 2024-09-14T06:00:18.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342457+0000", 2024-09-14T06:00:18.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073809890000000003 2024-09-14T06:00:18.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342545+0000", 2024-09-14T06:00:18.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8697999999999997e-05 2024-09-14T06:00:18.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342832+0000", 2024-09-14T06:00:18.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028681799999999999 2024-09-14T06:00:18.842 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.842 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.842 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.842 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59152 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.842 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:18.842 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.553605015999999, 2024-09-14T06:00:18.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074695176000000002, 2024-09-14T06:00:18.843 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.843 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.843 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.843 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.843 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.843 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.843 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59152 2024-09-14T06:00:18.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.843 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:18.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2900000000000003e-07 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268661+0000", 2024-09-14T06:00:18.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0230000000000001e-06 2024-09-14T06:00:18.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268670+0000", 2024-09-14T06:00:18.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2129999999999997e-06 2024-09-14T06:00:18.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268679+0000", 2024-09-14T06:00:18.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-09-14T06:00:18.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342937+0000", 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074258781999999995 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343044+0000", 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343353+0000", 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030911099999999999 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59153 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 501760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.553572246000002, 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074997241000000006, 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59153 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:18.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:18.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268691+0000", 2024-09-14T06:00:18.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:00:18.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268693+0000", 2024-09-14T06:00:18.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3599999999999999e-06 2024-09-14T06:00:18.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268699+0000", 2024-09-14T06:00:18.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-09-14T06:00:18.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268704+0000", 2024-09-14T06:00:18.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5759999999999999e-06 2024-09-14T06:00:18.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343398+0000", 2024-09-14T06:00:18.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074694522999999999 2024-09-14T06:00:18.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343450+0000", 2024-09-14T06:00:18.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1350999999999997e-05 2024-09-14T06:00:18.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343688+0000", 2024-09-14T06:00:18.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023806500000000001 2024-09-14T06:00:18.851 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.851 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.851 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.851 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59154 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 518144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.851 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:18.851 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.553553180000002, 2024-09-14T06:00:18.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075389938000000004, 2024-09-14T06:00:18.851 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.852 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.852 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.852 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.852 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.852 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.852 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59154 2024-09-14T06:00:18.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.852 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:18.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268710+0000", 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8000000000000001e-07 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268712+0000", 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268717+0000", 2024-09-14T06:00:18.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8570000000000003e-06 2024-09-14T06:00:18.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268721+0000", 2024-09-14T06:00:18.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2039999999999999e-06 2024-09-14T06:00:18.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343721+0000", 2024-09-14T06:00:18.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074999748000000005 2024-09-14T06:00:18.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343784+0000", 2024-09-14T06:00:18.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3174000000000002e-05 2024-09-14T06:00:18.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.344099+0000", 2024-09-14T06:00:18.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000315299 2024-09-14T06:00:18.856 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.856 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.856 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.856 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59398 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 323584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.856 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:18.856 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.542588932000001, 2024-09-14T06:00:18.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073326565999999996, 2024-09-14T06:00:18.857 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.857 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.857 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.857 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.857 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.857 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.857 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59398 2024-09-14T06:00:18.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.857 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:18.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:18.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279675+0000", 2024-09-14T06:00:18.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-14T06:00:18.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279681+0000", 2024-09-14T06:00:18.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-09-14T06:00:18.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279702+0000", 2024-09-14T06:00:18.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1259000000000001e-05 2024-09-14T06:00:18.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279718+0000", 2024-09-14T06:00:18.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5475999999999999e-05 2024-09-14T06:00:18.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352360+0000", 2024-09-14T06:00:18.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.07264226 2024-09-14T06:00:18.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352447+0000", 2024-09-14T06:00:18.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7381999999999998e-05 2024-09-14T06:00:18.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353000+0000", 2024-09-14T06:00:18.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055309200000000004 2024-09-14T06:00:18.861 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.862 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.862 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.862 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59399 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.862 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:18.862 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.542524569000001, 2024-09-14T06:00:18.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073824446000000002, 2024-09-14T06:00:18.862 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.862 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.862 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.863 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.863 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.863 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.863 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59399 2024-09-14T06:00:18.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.863 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:18.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:18.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279739+0000", 2024-09-14T06:00:18.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T06:00:18.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279745+0000", 2024-09-14T06:00:18.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T06:00:18.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279767+0000", 2024-09-14T06:00:18.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639000000000001e-05 2024-09-14T06:00:18.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279781+0000", 2024-09-14T06:00:18.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4511999999999999e-05 2024-09-14T06:00:18.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353045+0000", 2024-09-14T06:00:18.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073263718000000005 2024-09-14T06:00:18.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353168+0000", 2024-09-14T06:00:18.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012314499999999999 2024-09-14T06:00:18.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353562+0000", 2024-09-14T06:00:18.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039435199999999999 2024-09-14T06:00:18.867 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59400 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.542460809000001, 2024-09-14T06:00:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074271465999999994, 2024-09-14T06:00:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.868 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.869 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59400 2024-09-14T06:00:18.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.869 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:18.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:18.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279803+0000", 2024-09-14T06:00:18.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2100000000000001e-06 2024-09-14T06:00:18.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279819+0000", 2024-09-14T06:00:18.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6409000000000002e-05 2024-09-14T06:00:18.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279841+0000", 2024-09-14T06:00:18.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1878e-05 2024-09-14T06:00:18.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279856+0000", 2024-09-14T06:00:18.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4392999999999999e-05 2024-09-14T06:00:18.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353650+0000", 2024-09-14T06:00:18.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073794144000000006 2024-09-14T06:00:18.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353757+0000", 2024-09-14T06:00:18.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010687 2024-09-14T06:00:18.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354073+0000", 2024-09-14T06:00:18.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000316562 2024-09-14T06:00:18.873 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.873 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.873 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.873 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59401 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 372736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.873 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:18.873 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.542385983999999, 2024-09-14T06:00:18.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074643900999999999, 2024-09-14T06:00:18.873 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.873 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.874 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.874 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.874 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.874 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.874 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59401 2024-09-14T06:00:18.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.874 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:18.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:18.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279878+0000", 2024-09-14T06:00:18.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.31e-06 2024-09-14T06:00:18.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279883+0000", 2024-09-14T06:00:18.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3770000000000004e-06 2024-09-14T06:00:18.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279906+0000", 2024-09-14T06:00:18.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2398000000000001e-05 2024-09-14T06:00:18.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279920+0000", 2024-09-14T06:00:18.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.402e-05 2024-09-14T06:00:18.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354125+0000", 2024-09-14T06:00:18.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074205750000000001 2024-09-14T06:00:18.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354227+0000", 2024-09-14T06:00:18.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101612 2024-09-14T06:00:18.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354521+0000", 2024-09-14T06:00:18.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029343400000000002 2024-09-14T06:00:18.877 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.877 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.878 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.878 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59402 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 389120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.878 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:18.878 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.542324400999998, 2024-09-14T06:00:18.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075017027999999999, 2024-09-14T06:00:18.878 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.878 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.878 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.878 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.878 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.878 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.878 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59402 2024-09-14T06:00:18.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.879 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:18.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:18.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279939+0000", 2024-09-14T06:00:18.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2470000000000001e-06 2024-09-14T06:00:18.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279945+0000", 2024-09-14T06:00:18.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-09-14T06:00:18.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279966+0000", 2024-09-14T06:00:18.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1801999999999999e-05 2024-09-14T06:00:18.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279980+0000", 2024-09-14T06:00:18.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3589e-05 2024-09-14T06:00:18.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354569+0000", 2024-09-14T06:00:18.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074588707000000004 2024-09-14T06:00:18.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354671+0000", 2024-09-14T06:00:18.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102398 2024-09-14T06:00:18.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354955+0000", 2024-09-14T06:00:18.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028406500000000001 2024-09-14T06:00:18.882 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.882 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.882 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.883 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59403 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 405504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.883 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:18.883 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.542262613999998, 2024-09-14T06:00:18.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075434395000000001, 2024-09-14T06:00:18.883 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.883 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.883 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.883 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.883 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.883 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.883 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59403 2024-09-14T06:00:18.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.884 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:18.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:18.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280001+0000", 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2669999999999999e-06 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280008+0000", 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5849999999999996e-06 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280030+0000", 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2293000000000002e-05 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280044+0000", 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3974999999999999e-05 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355013+0000", 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074969039000000001 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355144+0000", 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000131333 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355434+0000", 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028990299999999999 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59404 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.542197495, 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075696103000000001, 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.887 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59404 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280066+0000", 2024-09-14T06:00:18.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2640000000000001e-06 2024-09-14T06:00:18.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280072+0000", 2024-09-14T06:00:18.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129999999999997e-06 2024-09-14T06:00:18.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280094+0000", 2024-09-14T06:00:18.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2608000000000001e-05 2024-09-14T06:00:18.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280109+0000", 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355479+0000", 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075370699999999999 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355554+0000", 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4674999999999999e-05 2024-09-14T06:00:18.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355761+0000", 2024-09-14T06:00:18.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-14T06:00:18.891 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.891 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.891 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.891 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59405 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.891 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:18.891 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.542133584999998, 2024-09-14T06:00:18.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076008867999999993, 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59405 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:18.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280130+0000", 2024-09-14T06:00:18.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2500000000000001e-06 2024-09-14T06:00:18.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280136+0000", 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280158+0000", 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1795000000000001e-05 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280172+0000", 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4303e-05 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355797+0000", 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075624835000000001 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355866+0000", 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9043999999999998e-05 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356138+0000", 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027207799999999998 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.895 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59406 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.542069643000001, 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076435642999999998, 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59406 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280194+0000", 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-14T06:00:18.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280200+0000", 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6359999999999999e-06 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280222+0000", 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1628999999999999e-05 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280236+0000", 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4413000000000001e-05 2024-09-14T06:00:18.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356172+0000", 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075936466999999994 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356260+0000", 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7437999999999999e-05 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356629+0000", 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036877600000000002 2024-09-14T06:00:18.899 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59407 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 471040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.542005410000002, 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076820083999999997, 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.900 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59407 2024-09-14T06:00:18.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.901 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:18.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:18.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280258+0000", 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1370000000000001e-06 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280264+0000", 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6930000000000004e-06 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280285+0000", 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1455999999999999e-05 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280300+0000", 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4319e-05 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356676+0000", 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076376615999999994 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356768+0000", 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1234000000000001e-05 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357077+0000", 2024-09-14T06:00:18.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030962900000000001 2024-09-14T06:00:18.904 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.904 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.904 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.904 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59408 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 487424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.904 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:18.904 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.541940409999999, 2024-09-14T06:00:18.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077185511999999998, 2024-09-14T06:00:18.904 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.904 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59408 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:18.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280323+0000", 2024-09-14T06:00:18.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2860000000000001e-06 2024-09-14T06:00:18.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280329+0000", 2024-09-14T06:00:18.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.553e-06 2024-09-14T06:00:18.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280352+0000", 2024-09-14T06:00:18.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-14T06:00:18.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280366+0000", 2024-09-14T06:00:18.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-14T06:00:18.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357126+0000", 2024-09-14T06:00:18.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076760326000000004 2024-09-14T06:00:18.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357223+0000", 2024-09-14T06:00:18.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6490000000000006e-05 2024-09-14T06:00:18.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357508+0000", 2024-09-14T06:00:18.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028479900000000002 2024-09-14T06:00:18.908 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.908 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.908 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59409 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.541876179999999, 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077536090000000002, 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59409 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280388+0000", 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.096e-06 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280393+0000", 2024-09-14T06:00:18.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T06:00:18.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280414+0000", 2024-09-14T06:00:18.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1175999999999999e-05 2024-09-14T06:00:18.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280427+0000", 2024-09-14T06:00:18.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3032e-05 2024-09-14T06:00:18.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357553+0000", 2024-09-14T06:00:18.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077125845999999998 2024-09-14T06:00:18.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357624+0000", 2024-09-14T06:00:18.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1062000000000005e-05 2024-09-14T06:00:18.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357923+0000", 2024-09-14T06:00:18.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029891199999999997 2024-09-14T06:00:18.913 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.913 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.913 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.913 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59410 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:18.913 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:18.913 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.541816868000002, 2024-09-14T06:00:18.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077854494999999996, 2024-09-14T06:00:18.913 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:18.913 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:18.913 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59410 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:18.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280447+0000", 2024-09-14T06:00:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069999999999999e-06 2024-09-14T06:00:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280453+0000", 2024-09-14T06:00:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-06 2024-09-14T06:00:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280471+0000", 2024-09-14T06:00:18.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8295999999999999e-05 2024-09-14T06:00:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280484+0000", 2024-09-14T06:00:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2609000000000001e-05 2024-09-14T06:00:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357954+0000", 2024-09-14T06:00:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077470405000000006 2024-09-14T06:00:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:18.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358040+0000", 2024-09-14T06:00:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.551e-05 2024-09-14T06:00:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358300+0000", 2024-09-14T06:00:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026036800000000003 2024-09-14T06:00:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:18.917 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:18.917 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:18.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:00:18.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:00:18.920 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:18.917+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:19.020 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:19.015+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:19.048 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:19.048 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:19.048 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:19.048 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:19.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:00:19.067 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:19.067 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:19.085 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:19.085 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:19.112 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:19.141 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:19.142 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:19.153 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:19.151+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:19.172 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:19.204 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:19.222 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:19.219+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:19.232 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:19.232 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:19.232 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:19.232 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:19.232 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:19.237 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:19.237 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:19.237 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:19.238 INFO:teuthology.orchestra.run.smithi006.stdout:4604 write 0x4bf43b0 thru 0x4bf4a7d (0x6ce bytes) 2024-09-14T06:00:19.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:00:19.252 INFO:teuthology.orchestra.run.smithi006.stdout:4605 trunc from 0xe012b36 to 0xeb7a98d 2024-09-14T06:00:19.257 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:19.257 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:19.259 INFO:teuthology.orchestra.run.smithi006.stdout:4607 write 0x857f1e9 thru 0x85876c8 (0x84e0 bytes) 2024-09-14T06:00:19.278 INFO:teuthology.orchestra.run.smithi006.stdout:4608 writesame 0xb54db7d thru 0xb5535dc data_size 0x30(0x5a60 bytes) 2024-09-14T06:00:19.301 INFO:teuthology.orchestra.run.smithi006.stdout:4609 trunc from 0xeb7a98d to 0x182457 2024-09-14T06:00:19.323 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:19.328 INFO:teuthology.orchestra.run.smithi006.stdout:4611 trunc from 0x182457 to 0x414ab8b 2024-09-14T06:00:19.337 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:19.335+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:19.339 INFO:teuthology.orchestra.run.smithi006.stdout:4612 trunc from 0x414ab8b to 0x693872b 2024-09-14T06:00:19.355 INFO:teuthology.orchestra.run.smithi006.stdout:4613 write 0x7473b68 thru 0x747ce4e (0x92e7 bytes) 2024-09-14T06:00:19.361 INFO:teuthology.orchestra.run.smithi006.stdout:4616 punch from 0x2124e92 to 0x212e4f2, (0x9660 bytes) 2024-09-14T06:00:19.361 INFO:teuthology.orchestra.run.smithi006.stdout:4617 trunc from 0x747ce4f to 0x6cba0b9 2024-09-14T06:00:19.374 INFO:teuthology.orchestra.run.smithi006.stdout:4618 read 0x36263e3 thru 0x3629a31 (0x364f bytes) 2024-09-14T06:00:19.377 INFO:teuthology.orchestra.run.smithi006.stdout:4620 trunc from 0x6cba0b9 to 0x4b7301d 2024-09-14T06:00:19.423 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:19.421+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:19.424 INFO:teuthology.orchestra.run.smithi006.stdout:4621 writesame 0xe59350b thru 0xe594478 data_size 0x19(0xf6e bytes) 2024-09-14T06:00:19.424 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:19.424 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:19.424 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:19.437 INFO:teuthology.orchestra.run.smithi006.stdout:4623 write 0xe6d9928 thru 0xe6dcfd1 (0x36aa bytes) 2024-09-14T06:00:19.439 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:00:19.454 INFO:teuthology.orchestra.run.smithi006.stdout:4624 write 0xe7d8cb6 thru 0xe7e71ce (0xe519 bytes) 2024-09-14T06:00:19.457 INFO:teuthology.orchestra.run.smithi006.stdout:4626 writesame 0x986baf4 thru 0x98787f5 data_size 0x3(0xcd02 bytes) 2024-09-14T06:00:19.481 INFO:teuthology.orchestra.run.smithi006.stdout:4628 write 0x544a184 thru 0x5453813 (0x9690 bytes) 2024-09-14T06:00:19.487 INFO:teuthology.orchestra.run.smithi006.stdout:4630 clone 28 order 23 su 524288 sc 2 2024-09-14T06:00:19.524 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:19.521+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:19.554 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T06:00:19.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T06:00:19.578 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T06:00:19.581 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:19.581 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:19.600 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:00:19.643 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:19.641+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:19.676 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone27 from 0xe7e71cf (overlap 0x182457) to 0x26a08 2024-09-14T06:00:19.725 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:19.723+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:19.771 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:19.771 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:19.788 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:00:19.811 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-14T06:00:19.859 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:19.857+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:19.864 INFO:teuthology.orchestra.run.smithi006.stdout:4631 read 0x1ff52bb thru 0x1ff9677 (0x43bd bytes) 2024-09-14T06:00:19.866 INFO:teuthology.orchestra.run.smithi006.stdout:4632 read 0x672f1df thru 0x67320ba (0x2edc bytes) 2024-09-14T06:00:19.874 INFO:teuthology.orchestra.run.smithi006.stdout:4634 trunc from 0xe7e71cf to 0x9e41bf4 2024-09-14T06:00:19.902 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:19.912 INFO:teuthology.orchestra.run.smithi006.stdout:4636 write 0xa280f89 thru 0xa287750 (0x67c8 bytes) 2024-09-14T06:00:19.926 INFO:teuthology.orchestra.run.smithi006.stdout:4637 write 0xaaec9d4 thru 0xaafb1c3 (0xe7f0 bytes) 2024-09-14T06:00:19.926 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:19.923+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:19.928 INFO:teuthology.orchestra.run.smithi006.stdout:4639 writesame 0x48fd577 thru 0x490b852 data_size 0x2(0xe2dc bytes) 2024-09-14T06:00:19.948 INFO:teuthology.orchestra.run.smithi006.stdout:4640 writesame 0x31a025 thru 0x320c8d data_size 0x21(0x6c69 bytes) 2024-09-14T06:00:19.950 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:19.950 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:19.964 INFO:teuthology.orchestra.run.smithi006.stdout:4642 write 0x1024501 thru 0x103365d (0xf15d bytes) 2024-09-14T06:00:19.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:00:19.973 INFO:teuthology.orchestra.run.smithi006.stdout:4643 read 0xa10dddf thru 0xa114648 (0x686a bytes) 2024-09-14T06:00:19.973 INFO:teuthology.orchestra.run.smithi006.stdout:4644 read 0x10c3006 thru 0x10d1b0b (0xeb06 bytes) 2024-09-14T06:00:19.973 INFO:teuthology.orchestra.run.smithi006.stdout:4645 read 0x5a9efe4 thru 0x5aa3098 (0x40b5 bytes) 2024-09-14T06:00:19.974 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:19.974 INFO:teuthology.orchestra.run.smithi006.stdout:4649 write 0x7a02e36 thru 0x7a02f15 (0xe0 bytes) 2024-09-14T06:00:19.983 INFO:teuthology.orchestra.run.smithi006.stdout:4650 write 0x1404e4c thru 0x1413815 (0xe9ca bytes) 2024-09-14T06:00:19.986 INFO:teuthology.orchestra.run.smithi006.stdout:4651 read 0x951b9c0 thru 0x95281f6 (0xc837 bytes) 2024-09-14T06:00:19.987 INFO:teuthology.orchestra.run.smithi006.stdout:4652 punch from 0x992b8dd to 0x992f0ab, (0x37ce bytes) 2024-09-14T06:00:19.987 INFO:teuthology.orchestra.run.smithi006.stdout:4654 read 0x4a4e4aa thru 0x4a50762 (0x22b9 bytes) 2024-09-14T06:00:19.997 INFO:teuthology.orchestra.run.smithi006.stdout:4655 trunc from 0xaafb1c4 to 0x476f041 2024-09-14T06:00:20.028 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:20.025+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:20.033 INFO:teuthology.orchestra.run.smithi006.stdout:4656 trunc from 0x476f041 to 0xc2a37f9 2024-09-14T06:00:20.041 INFO:teuthology.orchestra.run.smithi006.stdout:4657 write 0xa9ef722 thru 0xa9f872a (0x9009 bytes) 2024-09-14T06:00:20.046 INFO:teuthology.orchestra.run.smithi006.stdout:4658 read 0x8cc76d1 thru 0x8ccd83a (0x616a bytes) 2024-09-14T06:00:20.046 INFO:teuthology.orchestra.run.smithi006.stdout:4660 punch from 0x7216cc7 to 0x721e117, (0x7450 bytes) 2024-09-14T06:00:20.046 INFO:teuthology.orchestra.run.smithi006.stdout:4661 write 0x79adcd3 thru 0x79b7550 (0x987e bytes) 2024-09-14T06:00:20.052 INFO:teuthology.orchestra.run.smithi006.stdout:4662 write 0x854ee87 thru 0x85535c4 (0x473e bytes) 2024-09-14T06:00:20.059 INFO:teuthology.orchestra.run.smithi006.stdout:4664 write 0x730cdb6 thru 0x731ac2e (0xde79 bytes) 2024-09-14T06:00:20.065 INFO:teuthology.orchestra.run.smithi006.stdout:4666 write 0x73c971 thru 0x740e09 (0x4499 bytes) 2024-09-14T06:00:20.070 INFO:teuthology.orchestra.run.smithi006.stdout:4667 read 0x5040037 thru 0x504dcfc (0xdcc6 bytes) 2024-09-14T06:00:20.070 INFO:teuthology.orchestra.run.smithi006.stdout:4668 write 0x3772cef thru 0x37820fa (0xf40c bytes) 2024-09-14T06:00:20.078 INFO:teuthology.orchestra.run.smithi006.stdout:4670 read 0x4ce5afa thru 0x4cee6e1 (0x8be8 bytes) 2024-09-14T06:00:20.079 INFO:teuthology.orchestra.run.smithi006.stdout:4671 writesame 0xb01c238 thru 0xb02aafe data_size 0x1(0xe8c7 bytes) 2024-09-14T06:00:20.098 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:20.098 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:20.113 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:00:20.155 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:20.153+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:20.157 INFO:teuthology.orchestra.run.smithi006.stdout:4672 read 0xa3144cf thru 0xa31fcb9 (0xb7eb bytes) 2024-09-14T06:00:20.157 INFO:teuthology.orchestra.run.smithi006.stdout:4675 write 0x53126c6 thru 0x53205cd (0xdf08 bytes) 2024-09-14T06:00:20.166 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.166 INFO:teuthology.orchestra.run.smithi006.stdout:4679 write 0x8a003ec thru 0x8a06981 (0x6596 bytes) 2024-09-14T06:00:20.170 INFO:teuthology.orchestra.run.smithi006.stdout:4681 trunc from 0xc2a37f9 to 0xc2e2af1 2024-09-14T06:00:20.180 INFO:teuthology.orchestra.run.smithi006.stdout:4682 write 0x3055c36 thru 0x30615d3 (0xb99e bytes) 2024-09-14T06:00:20.183 INFO:teuthology.orchestra.run.smithi006.stdout:4683 writesame 0xae689f7 thru 0xae69d4f data_size 0xd(0x1359 bytes) 2024-09-14T06:00:20.190 INFO:teuthology.orchestra.run.smithi006.stdout:4684 read 0x6e768e7 thru 0x6e7b5cc (0x4ce6 bytes) 2024-09-14T06:00:20.202 INFO:teuthology.orchestra.run.smithi006.stdout:4685 write 0xc545372 thru 0xc5537ac (0xe43b bytes) 2024-09-14T06:00:20.210 INFO:teuthology.orchestra.run.smithi006.stdout:4686 read 0x3887423 thru 0x3892513 (0xb0f1 bytes) 2024-09-14T06:00:20.211 INFO:teuthology.orchestra.run.smithi006.stdout:4687 writesame 0x5e33725 thru 0x5e39a7a data_size 0x5(0x6356 bytes) 2024-09-14T06:00:20.220 INFO:teuthology.orchestra.run.smithi006.stdout:4688 writesame 0x13ec4a7 thru 0x13f62aa data_size 0x6(0x9e04 bytes) 2024-09-14T06:00:20.230 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:20.225+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:4690 punch from 0x372f9e1 to 0x3737ecb, (0x84ea bytes) 2024-09-14T06:00:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:4692 punch from 0x4074ac1 to 0x4081a57, (0xcf96 bytes) 2024-09-14T06:00:20.236 INFO:teuthology.orchestra.run.smithi006.stdout:4694 write 0x1be1eb4 thru 0x1bedfcf (0xc11c bytes) 2024-09-14T06:00:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.240 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.245 INFO:teuthology.orchestra.run.smithi006.stdout:4699 trunc from 0xc5537ad to 0xeada7b1 2024-09-14T06:00:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.256 INFO:teuthology.orchestra.run.smithi006.stdout:4702 write 0x550a58c thru 0x550adb2 (0x827 bytes) 2024-09-14T06:00:20.260 INFO:teuthology.orchestra.run.smithi006.stdout:4703 write 0x243e99a thru 0x244a52a (0xbb91 bytes) 2024-09-14T06:00:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:4705 punch from 0xa484d2 to 0xa49974, (0x14a2 bytes) 2024-09-14T06:00:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.270 INFO:teuthology.orchestra.run.smithi006.stdout:4707 read 0x8aa584b thru 0x8aac3f9 (0x6baf bytes) 2024-09-14T06:00:20.271 INFO:teuthology.orchestra.run.smithi006.stdout:4710 writesame 0x8841720 thru 0x884e2f0 data_size 0x1(0xcbd1 bytes) 2024-09-14T06:00:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:20.302 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:20.321 INFO:teuthology.orchestra.run.smithi006.stdout:4711 flatten 2024-09-14T06:00:20.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:00:20.331 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:20.327+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:4714 punch from 0x8ca53a6 to 0x8cb315f, (0xddb9 bytes) 2024-09-14T06:00:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:4715 read 0x5ce5899 thru 0x5cedae5 (0x824d bytes) 2024-09-14T06:00:20.342 INFO:teuthology.orchestra.run.smithi006.stdout:4716 write 0x44f191e thru 0x44fd38a (0xba6d bytes) 2024-09-14T06:00:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:4717 read 0x7cd0098 thru 0x7cdec71 (0xebda bytes) 2024-09-14T06:00:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:4718 punch from 0x3b4c0e to 0x3bec75, (0xa067 bytes) 2024-09-14T06:00:20.346 INFO:teuthology.orchestra.run.smithi006.stdout:4719 read 0xc60714e thru 0xc60fb4f (0x8a02 bytes) 2024-09-14T06:00:20.347 INFO:teuthology.orchestra.run.smithi006.stdout:4720 write 0x941ad1d thru 0x9422b8b (0x7e6f bytes) 2024-09-14T06:00:20.354 INFO:teuthology.orchestra.run.smithi006.stdout:4721 writesame 0x86a7477 thru 0x86aabee data_size 0x19(0x3778 bytes) 2024-09-14T06:00:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:4722 write 0x3a072cb thru 0x3a16efd (0xfc33 bytes) 2024-09-14T06:00:20.366 INFO:teuthology.orchestra.run.smithi006.stdout:4723 trunc from 0xeada7b1 to 0xdb3678a 2024-09-14T06:00:20.376 INFO:teuthology.orchestra.run.smithi006.stdout:4724 write 0x76ed61f thru 0x76fc482 (0xee64 bytes) 2024-09-14T06:00:20.378 INFO:teuthology.orchestra.run.smithi006.stdout:4725 read 0x30c403d thru 0x30c8156 (0x411a bytes) 2024-09-14T06:00:20.379 INFO:teuthology.orchestra.run.smithi006.stdout:4726 read 0xb0ea082 thru 0xb0eca95 (0x2a14 bytes) 2024-09-14T06:00:20.379 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.380 INFO:teuthology.orchestra.run.smithi006.stdout:4728 punch from 0xa4c2211 to 0xa4c6597, (0x4386 bytes) 2024-09-14T06:00:20.392 INFO:teuthology.orchestra.run.smithi006.stdout:4729 write 0xe2ed9d5 thru 0xe2f27ee (0x4e1a bytes) 2024-09-14T06:00:20.399 INFO:teuthology.orchestra.run.smithi006.stdout:4730 read 0xb4a6a2b thru 0xb4aa50e (0x3ae4 bytes) 2024-09-14T06:00:20.399 INFO:teuthology.orchestra.run.smithi006.stdout:4731 punch from 0x30a44d6 to 0x30a461b, (0x145 bytes) 2024-09-14T06:00:20.399 INFO:teuthology.orchestra.run.smithi006.stdout:4732 read 0x8c77d85 thru 0x8c79e9a (0x2116 bytes) 2024-09-14T06:00:20.399 INFO:teuthology.orchestra.run.smithi006.stdout:4733 read 0xca78f55 thru 0xca81e3a (0x8ee6 bytes) 2024-09-14T06:00:20.400 INFO:teuthology.orchestra.run.smithi006.stdout:4734 punch from 0xacab986 to 0xacae801, (0x2e7b bytes) 2024-09-14T06:00:20.400 INFO:teuthology.orchestra.run.smithi006.stdout:4735 read 0x69b7861 thru 0x69c742f (0xfbcf bytes) 2024-09-14T06:00:20.400 INFO:teuthology.orchestra.run.smithi006.stdout:4736 punch from 0xb70c2d0 to 0xb710718, (0x4448 bytes) 2024-09-14T06:00:20.400 INFO:teuthology.orchestra.run.smithi006.stdout:4737 read 0xbb77dcf thru 0xbb859d6 (0xdc08 bytes) 2024-09-14T06:00:20.401 INFO:teuthology.orchestra.run.smithi006.stdout:4739 writesame 0x7cbc372 thru 0x7ccb656 data_size 0x93(0xf2e5 bytes) 2024-09-14T06:00:20.403 INFO:teuthology.orchestra.run.smithi006.stdout:4740 read 0x611e253 thru 0x612a6b7 (0xc465 bytes) 2024-09-14T06:00:20.404 INFO:teuthology.orchestra.run.smithi006.stdout:4741 read 0x8b19e01 thru 0x8b21b8e (0x7d8e bytes) 2024-09-14T06:00:20.404 INFO:teuthology.orchestra.run.smithi006.stdout:4742 read 0x418175f thru 0x418e452 (0xccf4 bytes) 2024-09-14T06:00:20.405 INFO:teuthology.orchestra.run.smithi006.stdout:4744 write 0xe22baa4 thru 0xe238373 (0xc8d0 bytes) 2024-09-14T06:00:20.412 INFO:teuthology.orchestra.run.smithi006.stdout:4745 punch from 0x1d92bc4 to 0x1d94ec9, (0x2305 bytes) 2024-09-14T06:00:20.412 INFO:teuthology.orchestra.run.smithi006.stdout:4746 write 0xa7f75c2 thru 0xa7f870b (0x114a bytes) 2024-09-14T06:00:20.414 INFO:teuthology.orchestra.run.smithi006.stdout:4747 writesame 0x3568a91 thru 0x3574d5e data_size 0x5(0xc2ce bytes) 2024-09-14T06:00:20.420 INFO:teuthology.orchestra.run.smithi006.stdout:4749 writesame 0xa227859 thru 0xa23437d data_size 0x5(0xcb25 bytes) 2024-09-14T06:00:20.432 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:20.427+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:20.437 INFO:teuthology.orchestra.run.smithi006.stdout:4750 write 0x3d2e763 thru 0x3d2fc0a (0x14a8 bytes) 2024-09-14T06:00:20.440 INFO:teuthology.orchestra.run.smithi006.stdout:4752 read 0x7499d66 thru 0x749b09e (0x1339 bytes) 2024-09-14T06:00:20.441 INFO:teuthology.orchestra.run.smithi006.stdout:4753 read 0xd51b02b thru 0xd5229ef (0x79c5 bytes) 2024-09-14T06:00:20.441 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.441 INFO:teuthology.orchestra.run.smithi006.stdout:4755 writesame 0xa99379e thru 0xa999c64 data_size 0x1(0x64c7 bytes) 2024-09-14T06:00:20.486 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:20.486 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:20.493 INFO:teuthology.orchestra.run.smithi006.stdout:4757 trunc from 0xe2f27ef to 0x259d03d 2024-09-14T06:00:20.510 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:00:20.551 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:20.549+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:20.556 INFO:teuthology.orchestra.run.smithi006.stdout:4759 write 0xe016c04 thru 0xe02400a (0xd407 bytes) 2024-09-14T06:00:20.567 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T06:00:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2024-09-14T06:00:20.576 INFO:teuthology.orchestra.run.smithi006.stdout:4762 writesame 0xeca4e86 thru 0xecb1449 data_size 0x6(0xc5c4 bytes) 2024-09-14T06:00:20.576 INFO:teuthology.orchestra.run.smithi006.stdout:4763 write 0xd282315 thru 0xd2829dc (0x6c8 bytes) 2024-09-14T06:00:20.586 INFO:teuthology.orchestra.run.smithi006.stdout:4765 write 0xbeb2bc thru 0xbf3827 (0x856c bytes) 2024-09-14T06:00:20.591 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.591 INFO:teuthology.orchestra.run.smithi006.stdout:4768 read 0xb8f5683 thru 0xb8fe006 (0x8984 bytes) 2024-09-14T06:00:20.591 INFO:teuthology.orchestra.run.smithi006.stdout:4769 read 0x8cf13a thru 0x8de7ad (0xf674 bytes) 2024-09-14T06:00:20.591 INFO:teuthology.orchestra.run.smithi006.stdout:4770 write 0xbb9fa08 thru 0xbba9e12 (0xa40b bytes) 2024-09-14T06:00:20.599 INFO:teuthology.orchestra.run.smithi006.stdout:4771 punch from 0x1f3f2b4 to 0x1f4d7ea, (0xe536 bytes) 2024-09-14T06:00:20.601 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-14T06:00:20.605 INFO:teuthology.orchestra.run.smithi006.stdout:4772 trunc from 0xecb144a to 0xae16e42 2024-09-14T06:00:20.623 INFO:teuthology.orchestra.run.smithi006.stdout:4773 read 0xa3a0aa1 thru 0xa3ae0e4 (0xd644 bytes) 2024-09-14T06:00:20.623 INFO:teuthology.orchestra.run.smithi006.stdout:4774 write 0x9489c9f thru 0x948df62 (0x42c4 bytes) 2024-09-14T06:00:20.629 INFO:teuthology.orchestra.run.smithi006.stdout:4775 read 0x632d942 thru 0x6333655 (0x5d14 bytes) 2024-09-14T06:00:20.633 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:20.631+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:20.641 INFO:teuthology.orchestra.run.smithi006.stdout:4776 write 0xdcb57e7 thru 0xdcc4b68 (0xf382 bytes) 2024-09-14T06:00:20.648 INFO:teuthology.orchestra.run.smithi006.stdout:4777 read 0x73d6a41 thru 0x73dd229 (0x67e9 bytes) 2024-09-14T06:00:20.648 INFO:teuthology.orchestra.run.smithi006.stdout:4778 write 0xcc898f1 thru 0xcc96482 (0xcb92 bytes) 2024-09-14T06:00:20.654 INFO:teuthology.orchestra.run.smithi006.stdout:4779 read 0x96d485b thru 0x96d8df7 (0x459d bytes) 2024-09-14T06:00:20.655 INFO:teuthology.orchestra.run.smithi006.stdout:4780 write 0xa6013d6 thru 0xa6081d8 (0x6e03 bytes) 2024-09-14T06:00:20.662 INFO:teuthology.orchestra.run.smithi006.stdout:4783 read 0x336d54a thru 0x337ae81 (0xd938 bytes) 2024-09-14T06:00:20.663 INFO:teuthology.orchestra.run.smithi006.stdout:4784 read 0x6f87c56 thru 0x6f945dd (0xc988 bytes) 2024-09-14T06:00:20.663 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.663 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.663 INFO:teuthology.orchestra.run.smithi006.stdout:4788 punch from 0x780a520 to 0x780ba63, (0x1543 bytes) 2024-09-14T06:00:20.663 INFO:teuthology.orchestra.run.smithi006.stdout:4789 read 0xad3e3f3 thru 0xad45b00 (0x770e bytes) 2024-09-14T06:00:20.663 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.663 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.663 INFO:teuthology.orchestra.run.smithi006.stdout:4793 read 0xe0e87b thru 0xe13d3c (0x54c2 bytes) 2024-09-14T06:00:20.664 INFO:teuthology.orchestra.run.smithi006.stdout:4794 punch from 0x4782f3f to 0x478781d, (0x48de bytes) 2024-09-14T06:00:20.664 INFO:teuthology.orchestra.run.smithi006.stdout:4796 writesame 0xcbd8c9b thru 0xcbd90ae data_size 0x1(0x414 bytes) 2024-09-14T06:00:20.676 INFO:teuthology.orchestra.run.smithi006.stdout:4800 writesame 0xe7975df thru 0xe79e66c data_size 0x1(0x708e bytes) 2024-09-14T06:00:20.683 INFO:teuthology.orchestra.run.smithi006.stdout:4801 trunc from 0xe79e66d to 0x9c6740c 2024-09-14T06:00:20.698 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:20.698 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:20.716 INFO:teuthology.orchestra.run.smithi006.stdout:4802 writesame 0xc91f1ba thru 0xc91f7df data_size 0x1(0x626 bytes) 2024-09-14T06:00:20.716 INFO:teuthology.orchestra.run.smithi006.stdout:4803 read 0x2af8deb thru 0x2afce51 (0x4067 bytes) 2024-09-14T06:00:20.716 INFO:teuthology.orchestra.run.smithi006.stdout:4804 punch from 0x966372a to 0x967275e, (0xf034 bytes) 2024-09-14T06:00:20.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:00:20.727 INFO:teuthology.orchestra.run.smithi006.stdout:4807 writesame 0xecd0f6b thru 0xecdab4a data_size 0x74(0x9be0 bytes) 2024-09-14T06:00:20.742 INFO:teuthology.orchestra.run.smithi006.stdout:4808 trunc from 0xecdab4b to 0x4864e4c 2024-09-14T06:00:20.743 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:20.741+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:20.758 INFO:teuthology.orchestra.run.smithi006.stdout:4809 read 0x2db4c01 thru 0x2dc272b (0xdb2b bytes) 2024-09-14T06:00:20.771 INFO:teuthology.orchestra.run.smithi006.stdout:4810 writesame 0x8479437 thru 0x8483132 data_size 0x66(0x9cfc bytes) 2024-09-14T06:00:20.771 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.772 INFO:teuthology.orchestra.run.smithi006.stdout:4813 write 0xacc9f0 thru 0xad1513 (0x4b24 bytes) 2024-09-14T06:00:20.790 INFO:teuthology.orchestra.run.smithi006.stdout:4814 write 0xd90f73f thru 0xd91a790 (0xb052 bytes) 2024-09-14T06:00:20.797 INFO:teuthology.orchestra.run.smithi006.stdout:4815 write 0x2d72e3e thru 0x2d80476 (0xd639 bytes) 2024-09-14T06:00:20.805 INFO:teuthology.orchestra.run.smithi006.stdout:4816 write 0x91cd3ed thru 0x91d7d59 (0xa96d bytes) 2024-09-14T06:00:20.811 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.811 INFO:teuthology.orchestra.run.smithi006.stdout:4818 read 0xc2c77b8 thru 0xc2cf382 (0x7bcb bytes) 2024-09-14T06:00:20.811 INFO:teuthology.orchestra.run.smithi006.stdout:4819 read 0x7f99709 thru 0x7f99990 (0x288 bytes) 2024-09-14T06:00:20.811 INFO:teuthology.orchestra.run.smithi006.stdout:4820 punch from 0x19d13b8 to 0x19dfc6e, (0xe8b6 bytes) 2024-09-14T06:00:20.813 INFO:teuthology.orchestra.run.smithi006.stdout:4821 trunc from 0xd91a791 to 0xc77b734 2024-09-14T06:00:20.835 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:20.833+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:20.850 INFO:teuthology.orchestra.run.smithi006.stdout:4822 trunc from 0xc77b734 to 0x1fd0e6e 2024-09-14T06:00:20.859 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:20.859 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:20.875 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:00:20.880 INFO:teuthology.orchestra.run.smithi006.stdout:4823 trunc from 0x1fd0e6e to 0x563e1e1 2024-09-14T06:00:20.891 INFO:teuthology.orchestra.run.smithi006.stdout:4825 punch from 0x384dc16 to 0x385bf1d, (0xe307 bytes) 2024-09-14T06:00:20.891 INFO:teuthology.orchestra.run.smithi006.stdout:4826 punch from 0x33dcffa to 0x33e0bb9, (0x3bbf bytes) 2024-09-14T06:00:20.894 INFO:teuthology.orchestra.run.smithi006.stdout:4827 trunc from 0x563e1e1 to 0x3eb2584 2024-09-14T06:00:20.904 INFO:teuthology.orchestra.run.smithi006.stdout:4828 read 0x3869138 thru 0x387058b (0x7454 bytes) 2024-09-14T06:00:20.904 INFO:teuthology.orchestra.run.smithi006.stdout:4829 read 0x1e6ee2a thru 0x1e6f2dd (0x4b4 bytes) 2024-09-14T06:00:20.905 INFO:teuthology.orchestra.run.smithi006.stdout:4830 read 0xce56a5 thru 0xcecc4a (0x75a6 bytes) 2024-09-14T06:00:20.916 INFO:teuthology.orchestra.run.smithi006.stdout:4831 trunc from 0x3eb2584 to 0xa649084 2024-09-14T06:00:20.925 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.925 INFO:teuthology.orchestra.run.smithi006.stdout:4834 read 0x986d296 thru 0x987b94e (0xe6b9 bytes) 2024-09-14T06:00:20.926 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.936 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:20.931+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:20.936 INFO:teuthology.orchestra.run.smithi006.stdout:4838 write 0xafa53d4 thru 0xafaafb7 (0x5be4 bytes) 2024-09-14T06:00:20.942 INFO:teuthology.orchestra.run.smithi006.stdout:4839 read 0x93b7774 thru 0x93be081 (0x690e bytes) 2024-09-14T06:00:20.958 INFO:teuthology.orchestra.run.smithi006.stdout:4840 writesame 0xe587500 thru 0xe58f761 data_size 0x3(0x8262 bytes) 2024-09-14T06:00:20.958 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:20.958 INFO:teuthology.orchestra.run.smithi006.stdout:4842 read 0x645db08 thru 0x64643a2 (0x689b bytes) 2024-09-14T06:00:20.958 INFO:teuthology.orchestra.run.smithi006.stdout:4843 write 0xfcc0b1 thru 0xfceb3d (0x2a8d bytes) 2024-09-14T06:00:20.961 INFO:teuthology.orchestra.run.smithi006.stdout:4844 write 0xc6b65ba thru 0xc6ba5aa (0x3ff1 bytes) 2024-09-14T06:00:20.968 INFO:teuthology.orchestra.run.smithi006.stdout:4846 read 0x9f94781 thru 0x9fa2bcb (0xe44b bytes) 2024-09-14T06:00:20.968 INFO:teuthology.orchestra.run.smithi006.stdout:4847 read 0x2b3ae1 thru 0x2b990b (0x5e2b bytes) 2024-09-14T06:00:20.969 INFO:teuthology.orchestra.run.smithi006.stdout:4850 write 0xb7b1896 thru 0xb7c05d7 (0xed42 bytes) 2024-09-14T06:00:21.004 INFO:teuthology.orchestra.run.smithi006.stdout:4851 trunc from 0xe58f762 to 0x8977f4 2024-09-14T06:00:21.012 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:21.012 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:21.029 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:00:21.041 INFO:teuthology.orchestra.run.smithi006.stdout:4852 write 0x3de3ea3 thru 0x3de9115 (0x5273 bytes) 2024-09-14T06:00:21.042 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:21.037+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:21.048 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:21.064 INFO:teuthology.orchestra.run.smithi006.stdout:4854 write 0x6b09056 thru 0x6b0e1fd (0x51a8 bytes) 2024-09-14T06:00:21.070 INFO:teuthology.orchestra.run.smithi006.stdout:4857 punch from 0x2c5e6db to 0x2c64529, (0x5e4e bytes) 2024-09-14T06:00:21.088 INFO:teuthology.orchestra.run.smithi006.stdout:4858 writesame 0xcb82f2c thru 0xcb8f3ce data_size 0x1(0xc4a3 bytes) 2024-09-14T06:00:21.088 INFO:teuthology.orchestra.run.smithi006.stdout:4859 write 0x8814327 thru 0x881515d (0xe37 bytes) 2024-09-14T06:00:21.095 INFO:teuthology.orchestra.run.smithi006.stdout:4860 read 0x83bf545 thru 0x83c9fc1 (0xaa7d bytes) 2024-09-14T06:00:21.095 INFO:teuthology.orchestra.run.smithi006.stdout:4862 read 0x23597ce thru 0x236593d (0xc170 bytes) 2024-09-14T06:00:21.106 INFO:teuthology.orchestra.run.smithi006.stdout:4863 write 0xd6d7cbf thru 0xd6da3b0 (0x26f2 bytes) 2024-09-14T06:00:21.113 INFO:teuthology.orchestra.run.smithi006.stdout:4865 writesame 0xad892a4 thru 0xad8dbad data_size 0x1(0x490a bytes) 2024-09-14T06:00:21.132 INFO:teuthology.orchestra.run.smithi006.stdout:4866 punch from 0x7299d90 to 0x72a9bc1, (0xfe31 bytes) 2024-09-14T06:00:21.135 INFO:teuthology.orchestra.run.smithi006.stdout:4867 trunc from 0xd6da3b1 to 0xbda7548 2024-09-14T06:00:21.137 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:21.133+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:21.157 INFO:teuthology.orchestra.run.smithi006.stdout:4868 writesame 0x9f1b7fd thru 0x9f2b0e4 data_size 0xd8(0xf8e8 bytes) 2024-09-14T06:00:21.165 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:21.165 INFO:teuthology.orchestra.run.smithi006.stdout:4871 clone 29 order 20 su 524288 sc 14 2024-09-14T06:00:21.166 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:21.166 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:21.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:00:21.267 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:21.265+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:21.276 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:00:21.339 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:21.337+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:21.351 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:21.351 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:21.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:00:21.418 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:21.418 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:21.435 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:21.439 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:21.437+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:21.452 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:21.452 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:21.469 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:21.490 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:21.491 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:21.511 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:21.532 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:00:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:00:21.532 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54658 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 610304~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.390042898000001, 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091840061000000001, 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54658 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139679+0000", 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4700000000000002e-07 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139687+0000", 2024-09-14T06:00:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7170000000000008e-06 2024-09-14T06:00:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139694+0000", 2024-09-14T06:00:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.063e-06 2024-09-14T06:00:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139709+0000", 2024-09-14T06:00:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4324999999999999e-05 2024-09-14T06:00:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231262+0000", 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091553866999999997 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231375+0000", 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000112927 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231519+0000", 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014371499999999999 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.536 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54659 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 616448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.390004551000001, 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092177035000000004, 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54659 2024-09-14T06:00:21.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139718+0000", 2024-09-14T06:00:21.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9699999999999996e-07 2024-09-14T06:00:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139731+0000", 2024-09-14T06:00:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2993000000000001e-05 2024-09-14T06:00:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139738+0000", 2024-09-14T06:00:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4610000000000002e-06 2024-09-14T06:00:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139744+0000", 2024-09-14T06:00:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6389999999999997e-06 2024-09-14T06:00:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231570+0000", 2024-09-14T06:00:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091826216000000002 2024-09-14T06:00:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231662+0000", 2024-09-14T06:00:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2101000000000005e-05 2024-09-14T06:00:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231894+0000", 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023212800000000001 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54660 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 622592~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.389969217000001, 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092366887999999994, 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.541 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54660 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139755+0000", 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139762+0000", 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6719999999999998e-06 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139767+0000", 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9819999999999999e-06 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231917+0000", 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092149872999999993 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231969+0000", 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2642000000000002e-05 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232120+0000", 2024-09-14T06:00:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015011899999999999 2024-09-14T06:00:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54844 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 0~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.389947725999999, 2024-09-14T06:00:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092708507999999995, 2024-09-14T06:00:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.545 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54844 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:00:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139775+0000", 2024-09-14T06:00:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3500000000000002e-07 2024-09-14T06:00:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139777+0000", 2024-09-14T06:00:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.979e-06 2024-09-14T06:00:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139787+0000", 2024-09-14T06:00:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0779e-05 2024-09-14T06:00:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139799+0000", 2024-09-14T06:00:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1719000000000001e-05 2024-09-14T06:00:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232151+0000", 2024-09-14T06:00:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092351767000000001 2024-09-14T06:00:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232217+0000", 2024-09-14T06:00:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6655000000000005e-05 2024-09-14T06:00:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232483+0000", 2024-09-14T06:00:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026517400000000002 2024-09-14T06:00:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54845 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 55296~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.389914054999998, 2024-09-14T06:00:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093127583999999999, 2024-09-14T06:00:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54845 2024-09-14T06:00:21.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:00:21.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4899999999999995e-07 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139811+0000", 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000001e-06 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139821+0000", 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0168e-05 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139826+0000", 2024-09-14T06:00:21.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2780000000000001e-06 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232556+0000", 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092729729999999996 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232652+0000", 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680999999999994e-05 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232935+0000", 2024-09-14T06:00:21.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000283758 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54846 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.389887748, 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093492079000000006, 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.554 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54846 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139835+0000", 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139837+0000", 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1059999999999998e-06 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139845+0000", 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4300000000000006e-06 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139851+0000", 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232987+0000", 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093136073999999999 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233075+0000", 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7318999999999995e-05 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233326+0000", 2024-09-14T06:00:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025159 2024-09-14T06:00:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54847 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 67584~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.389862032, 2024-09-14T06:00:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093777452999999997, 2024-09-14T06:00:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.558 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54847 2024-09-14T06:00:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:21.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:00:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T06:00:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139862+0000", 2024-09-14T06:00:21.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0200000000000001e-06 2024-09-14T06:00:21.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139870+0000", 2024-09-14T06:00:21.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0520000000000002e-06 2024-09-14T06:00:21.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139875+0000", 2024-09-14T06:00:21.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:00:21.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233389+0000", 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093514054999999999 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233443+0000", 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3913999999999999e-05 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233637+0000", 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019392899999999999 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.562 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54848 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 73728~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.389838936, 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094064464, 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54848 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:21.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:21.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:00:21.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T06:00:21.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139885+0000", 2024-09-14T06:00:21.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9929999999999998e-06 2024-09-14T06:00:21.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139893+0000", 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9759999999999995e-06 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139898+0000", 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6059999999999996e-06 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233681+0000", 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093782921000000005 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233730+0000", 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9410999999999998e-05 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233947+0000", 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021710300000000001 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54849 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.567 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:21.568 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.389815479999999, 2024-09-14T06:00:21.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094499257000000003, 2024-09-14T06:00:21.568 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.568 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.568 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.568 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.568 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.568 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.568 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54849 2024-09-14T06:00:21.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.568 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:21.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:00:21.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139907+0000", 2024-09-14T06:00:21.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T06:00:21.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.570 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139909+0000", 2024-09-14T06:00:21.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T06:00:21.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.570 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.570 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139916+0000", 2024-09-14T06:00:21.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T06:00:21.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.570 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.570 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139921+0000", 2024-09-14T06:00:21.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:00:21.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234032+0000", 2024-09-14T06:00:21.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094111037999999994 2024-09-14T06:00:21.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234150+0000", 2024-09-14T06:00:21.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118408 2024-09-14T06:00:21.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234406+0000", 2024-09-14T06:00:21.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025540600000000001 2024-09-14T06:00:21.572 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.572 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.572 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.572 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54850 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 135168~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.572 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:21.572 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.389793772000001, 2024-09-14T06:00:21.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094814605999999996, 2024-09-14T06:00:21.572 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.572 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.572 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.572 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.572 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.573 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.573 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54850 2024-09-14T06:00:21.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.573 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:21.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:00:21.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139929+0000", 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139931+0000", 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.024e-06 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139937+0000", 2024-09-14T06:00:21.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3770000000000001e-06 2024-09-14T06:00:21.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139942+0000", 2024-09-14T06:00:21.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0289999999999996e-06 2024-09-14T06:00:21.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234447+0000", 2024-09-14T06:00:21.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094505426000000003 2024-09-14T06:00:21.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234539+0000", 2024-09-14T06:00:21.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1793999999999996e-05 2024-09-14T06:00:21.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234743+0000", 2024-09-14T06:00:21.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020354600000000001 2024-09-14T06:00:21.576 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.576 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.576 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54851 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 141312~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.389772059999999, 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095179749999999994, 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54851 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.577 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.578 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:21.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.578 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.578 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:21.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.578 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.578 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:00:21.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:00:21.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.579 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.579 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139952+0000", 2024-09-14T06:00:21.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0600000000000002e-06 2024-09-14T06:00:21.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.579 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.579 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139959+0000", 2024-09-14T06:00:21.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.584e-06 2024-09-14T06:00:21.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.579 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.579 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139964+0000", 2024-09-14T06:00:21.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8890000000000001e-06 2024-09-14T06:00:21.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234786+0000", 2024-09-14T06:00:21.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094822241000000002 2024-09-14T06:00:21.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234877+0000", 2024-09-14T06:00:21.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1158999999999999e-05 2024-09-14T06:00:21.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235130+0000", 2024-09-14T06:00:21.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025235999999999998 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54852 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 147456~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.389750931999998, 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095437742000000006, 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.581 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54852 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.582 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140125+0000", 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154332 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140130+0000", 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.284e-06 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140140+0000", 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0789e-05 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.583 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140147+0000", 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9879999999999998e-06 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235174+0000", 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095026749999999993 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235230+0000", 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6224000000000002e-05 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235409+0000", 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017837500000000001 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54853 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 202752~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.38956211, 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095632919999999996, 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.585 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54853 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.586 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147748+0000", 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075884910000000002 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147798+0000", 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0152999999999999e-05 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147814+0000", 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5866e-05 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147831+0000", 2024-09-14T06:00:21.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6991999999999999e-05 2024-09-14T06:00:21.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.588 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235451+0000", 2024-09-14T06:00:21.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087620077000000005 2024-09-14T06:00:21.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.588 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235539+0000", 2024-09-14T06:00:21.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7800000000000006e-05 2024-09-14T06:00:21.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235793+0000", 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025354099999999998 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54868 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 442368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.381371789999999, 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091802783999999998, 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.589 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.590 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.590 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.590 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54868 2024-09-14T06:00:21.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.590 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.590 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.590 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:21.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.590 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.590 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148350+0000", 2024-09-14T06:00:21.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.591 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.591 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148351+0000", 2024-09-14T06:00:21.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6800000000000001e-07 2024-09-14T06:00:21.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.591 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.591 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148353+0000", 2024-09-14T06:00:21.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2299999999999998e-06 2024-09-14T06:00:21.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.591 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148362+0000", 2024-09-14T06:00:21.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9800000000000004e-06 2024-09-14T06:00:21.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148367+0000", 2024-09-14T06:00:21.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.327e-06 2024-09-14T06:00:21.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.239863+0000", 2024-09-14T06:00:21.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091496018999999998 2024-09-14T06:00:21.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.239932+0000", 2024-09-14T06:00:21.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8838999999999996e-05 2024-09-14T06:00:21.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240153+0000", 2024-09-14T06:00:21.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00022092100000000001 2024-09-14T06:00:21.593 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.593 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.593 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.593 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54869 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 497664~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.381345891999999, 2024-09-14T06:00:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092147413999999997, 2024-09-14T06:00:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54869 2024-09-14T06:00:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:21.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.595 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148376+0000", 2024-09-14T06:00:21.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.595 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148377+0000", 2024-09-14T06:00:21.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1399999999999997e-07 2024-09-14T06:00:21.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.596 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.596 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148379+0000", 2024-09-14T06:00:21.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.429e-06 2024-09-14T06:00:21.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.596 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.596 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148389+0000", 2024-09-14T06:00:21.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9029999999999999e-06 2024-09-14T06:00:21.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.596 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.596 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148395+0000", 2024-09-14T06:00:21.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5080000000000002e-06 2024-09-14T06:00:21.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240191+0000", 2024-09-14T06:00:21.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091796066999999995 2024-09-14T06:00:21.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240284+0000", 2024-09-14T06:00:21.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2445e-05 2024-09-14T06:00:21.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240523+0000", 2024-09-14T06:00:21.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023954799999999999 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54870 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 503808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.381316562999999, 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092420756000000007, 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.598 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.599 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54870 2024-09-14T06:00:21.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.599 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:21.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:00:21.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.600 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.600 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148406+0000", 2024-09-14T06:00:21.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T06:00:21.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.600 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.600 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148409+0000", 2024-09-14T06:00:21.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T06:00:21.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.600 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.600 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148418+0000", 2024-09-14T06:00:21.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7329999999999998e-06 2024-09-14T06:00:21.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148425+0000", 2024-09-14T06:00:21.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2079999999999997e-06 2024-09-14T06:00:21.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240591+0000", 2024-09-14T06:00:21.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092166441000000002 2024-09-14T06:00:21.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240648+0000", 2024-09-14T06:00:21.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6733e-05 2024-09-14T06:00:21.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240826+0000", 2024-09-14T06:00:21.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017834700000000001 2024-09-14T06:00:21.602 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.602 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.602 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.602 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54871 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 509952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.602 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:21.603 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.381286603, 2024-09-14T06:00:21.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092702341999999993, 2024-09-14T06:00:21.603 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.603 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.603 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.603 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.603 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.603 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.603 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54871 2024-09-14T06:00:21.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.603 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.603 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.603 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:21.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:00:21.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148436+0000", 2024-09-14T06:00:21.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5499999999999998e-07 2024-09-14T06:00:21.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148439+0000", 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8090000000000001e-06 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148449+0000", 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0115000000000001e-05 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148466+0000", 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6761000000000001e-05 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240857+0000", 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092391089999999995 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240939+0000", 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2387999999999998e-05 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241138+0000", 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000198624 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.606 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.607 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54872 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 516096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.607 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:21.607 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.381245405000001, 2024-09-14T06:00:21.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093126020000000004, 2024-09-14T06:00:21.607 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.607 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.607 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.607 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.607 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.607 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.607 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54872 2024-09-14T06:00:21.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.608 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:21.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:00:21.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155484+0000", 2024-09-14T06:00:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070072429999999998 2024-09-14T06:00:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155490+0000", 2024-09-14T06:00:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6379999999999998e-06 2024-09-14T06:00:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155504+0000", 2024-09-14T06:00:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4065e-05 2024-09-14T06:00:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155513+0000", 2024-09-14T06:00:21.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6799999999999999e-06 2024-09-14T06:00:21.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241216+0000", 2024-09-14T06:00:21.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085702922000000001 2024-09-14T06:00:21.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241277+0000", 2024-09-14T06:00:21.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0980000000000002e-05 2024-09-14T06:00:21.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241602+0000", 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032549199999999998 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54888 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 114688~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.373800924000001, 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091627085999999996, 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.611 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54888 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:21.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155921+0000", 2024-09-14T06:00:21.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8299999999999998e-07 2024-09-14T06:00:21.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155923+0000", 2024-09-14T06:00:21.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4720000000000001e-06 2024-09-14T06:00:21.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155926+0000", 2024-09-14T06:00:21.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.444e-06 2024-09-14T06:00:21.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155929+0000", 2024-09-14T06:00:21.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:21.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247321+0000", 2024-09-14T06:00:21.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091391587999999996 2024-09-14T06:00:21.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247382+0000", 2024-09-14T06:00:21.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1944000000000002e-05 2024-09-14T06:00:21.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247548+0000", 2024-09-14T06:00:21.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000165558 2024-09-14T06:00:21.615 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.615 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.615 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.615 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54889 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 169984~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:21.615 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.373788324, 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091908118999999996, 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54889 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:21.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:21.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155934+0000", 2024-09-14T06:00:21.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:21.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:21.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163444+0000", 2024-09-14T06:00:21.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00751033 2024-09-14T06:00:21.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:21.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163454+0000", 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0579e-05 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163468+0000", 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3794999999999999e-05 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.163487+0000", 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8907999999999999e-05 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:21.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247591+0000", 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.084103333000000002 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247651+0000", 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0587000000000001e-05 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.247842+0000", 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019058700000000001 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:21.620 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:21.620 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:21.620 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:21.621 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:21.622 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:00:21.622 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.6 to 1 (10000) 2024-09-14T06:00:21.624 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-14T06:00:21.624 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:21.617+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:21.721 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:21.719+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:21.755 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:21.755 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:21.755 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:21.756 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:21.769 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:00:21.822 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:21.817+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:21.832 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-14T06:00:21.835 INFO:teuthology.orchestra.run.smithi006.stdout:4873 write 0xa738b6c thru 0xa741a24 (0x8eb9 bytes) 2024-09-14T06:00:21.845 INFO:teuthology.orchestra.run.smithi006.stdout:4874 punch from 0x87c6e50 to 0x87d1332, (0xa4e2 bytes) 2024-09-14T06:00:21.845 INFO:teuthology.orchestra.run.smithi006.stdout:4875 clone 30 order 18 su 65536 sc 15 2024-09-14T06:00:21.923 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:21.921+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:21.937 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:21.937 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:21.937 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:21.937 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:21.937 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:21.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:00:22.023 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:22.021+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:22.076 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23550 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 606208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:22.076 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.126388786, 2024-09-14T06:00:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048793072999999999, 2024-09-14T06:00:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23550 2024-09-14T06:00:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.077 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:22.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7800000000000002e-07 2024-09-14T06:00:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948677+0000", 2024-09-14T06:00:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1949999999999997e-06 2024-09-14T06:00:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948687+0000", 2024-09-14T06:00:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0849000000000001e-05 2024-09-14T06:00:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948692+0000", 2024-09-14T06:00:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8670000000000002e-06 2024-09-14T06:00:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997290+0000", 2024-09-14T06:00:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048597596999999999 2024-09-14T06:00:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997367+0000", 2024-09-14T06:00:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7236000000000004e-05 2024-09-14T06:00:22.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997462+0000", 2024-09-14T06:00:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4951000000000006e-05 2024-09-14T06:00:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23551 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 620544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.126357929000001, 2024-09-14T06:00:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048938838999999998, 2024-09-14T06:00:22.081 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23551 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1e-07 2024-09-14T06:00:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948701+0000", 2024-09-14T06:00:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2950000000000001e-06 2024-09-14T06:00:22.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948705+0000", 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7929999999999999e-06 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948709+0000", 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997535+0000", 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048826181000000003 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997580+0000", 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5355000000000002e-05 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997639+0000", 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8479e-05 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.085 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.126342452000003, 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T06:00:22.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T06:00:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T06:00:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T06:00:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T06:00:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T06:00:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T06:00:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T06:00:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T06:00:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T06:00:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T06:00:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.089 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.126323177000003, 2024-09-14T06:00:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T06:00:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.090 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T06:00:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T06:00:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T06:00:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T06:00:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T06:00:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T06:00:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T06:00:22.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T06:00:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T06:00:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.126303600999996, 2024-09-14T06:00:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T06:00:22.094 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T06:00:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:22.098 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.126284144000003, 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T06:00:22.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T06:00:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T06:00:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T06:00:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T06:00:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T06:00:22.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.102 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.126265093000001, 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T06:00:22.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T06:00:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T06:00:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T06:00:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T06:00:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T06:00:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.126245412000003, 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.110 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.126225460999997, 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.111 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T06:00:22.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.114 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.126206148999998, 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T06:00:22.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:22.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T06:00:22.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T06:00:22.118 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.126186388000001, 2024-09-14T06:00:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T06:00:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.119 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T06:00:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T06:00:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:00:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T06:00:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T06:00:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T06:00:22.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T06:00:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T06:00:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T06:00:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T06:00:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T06:00:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T06:00:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T06:00:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T06:00:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T06:00:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.126165467, 2024-09-14T06:00:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T06:00:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T06:00:22.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T06:00:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T06:00:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.125006132999999, 2024-09-14T06:00:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T06:00:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.128 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:22.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T06:00:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T06:00:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T06:00:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T06:00:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T06:00:22.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T06:00:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T06:00:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T06:00:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.124707350999998, 2024-09-14T06:00:22.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T06:00:22.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.124556613000003, 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T06:00:22.136 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T06:00:22.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T06:00:22.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23582 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 911360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.123631226000001, 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048708939999999999, 2024-09-14T06:00:22.140 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23582 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6300000000000005e-07 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951430+0000", 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5179999999999999e-06 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951437+0000", 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0940000000000002e-06 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951443+0000", 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7910000000000001e-06 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000047+0000", 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048604550000000003 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000095+0000", 2024-09-14T06:00:22.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7735999999999998e-05 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000135+0000", 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0587999999999998e-05 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23588 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 722944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.123606361, 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048792653999999998, 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.144 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23588 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:22.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951665+0000", 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021337600000000001 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951669+0000", 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3460000000000004e-06 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951688+0000", 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9042000000000002e-05 2024-09-14T06:00:22.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951696+0000", 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6660000000000008e-06 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000162+0000", 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048465824999999997 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000199+0000", 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7143e-05 2024-09-14T06:00:22.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000244+0000", 2024-09-14T06:00:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5256000000000002e-05 2024-09-14T06:00:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23590 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 745472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.123348905999997, 2024-09-14T06:00:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048677684999999998, 2024-09-14T06:00:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23590 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:22.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951850+0000", 2024-09-14T06:00:22.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014113 2024-09-14T06:00:22.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951855+0000", 2024-09-14T06:00:22.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6349999999999997e-06 2024-09-14T06:00:22.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951863+0000", 2024-09-14T06:00:22.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8189999999999998e-06 2024-09-14T06:00:22.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951871+0000", 2024-09-14T06:00:22.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2030000000000003e-06 2024-09-14T06:00:22.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000283+0000", 2024-09-14T06:00:22.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048412531000000002 2024-09-14T06:00:22.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000338+0000", 2024-09-14T06:00:22.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4462000000000001e-05 2024-09-14T06:00:22.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000387+0000", 2024-09-14T06:00:22.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8905e-05 2024-09-14T06:00:22.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.152 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.153 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T06:00:22.153 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:22.153 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.499255050000002, 2024-09-14T06:00:22.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T06:00:22.153 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.153 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.153 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:22.153 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:22.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T06:00:22.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T06:00:22.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T06:00:22.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T06:00:22.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T06:00:22.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T06:00:22.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T06:00:22.156 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 49.976165111, 2024-09-14T06:00:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T06:00:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.158 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T06:00:22.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.158 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:22.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:22.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T06:00:22.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T06:00:22.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T06:00:22.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:22.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T06:00:22.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T06:00:22.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:22.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T06:00:22.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T06:00:22.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.162 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:22.164 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:00:22.164 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:22.161+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:22.264 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:22.261+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:22.289 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:22.289 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:22.289 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:22.289 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:22.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:00:22.366 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:22.363+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:22.420 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:22.420 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:22.434 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:00:22.477 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:22.475+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:22.568 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:22.563+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.7 to 1 (10000) 2024-09-14T06:00:22.602 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:22.602 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:22.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:22.602 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:22.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.602 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:22.602 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:22.602 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.054057882000002, 2024-09-14T06:00:22.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:00:22.602 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.602 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:22.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:00:22.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:00:22.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:00:22.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:00:22.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:00:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:00:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:00:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:00:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:00:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:00:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:00:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:22.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:00:22.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:00:22.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:22.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:00:22.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:00:22.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:00:22.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:00:22.608 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.608 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.608 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.608 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38842 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.608 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:22.608 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.078931161, 2024-09-14T06:00:22.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083698121, 2024-09-14T06:00:22.608 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.608 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.608 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.608 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.609 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.609 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.609 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38842 2024-09-14T06:00:22.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.609 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:22.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:22.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521563+0000", 2024-09-14T06:00:22.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:00:22.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521566+0000", 2024-09-14T06:00:22.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1140000000000002e-06 2024-09-14T06:00:22.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521575+0000", 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8769999999999999e-06 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521581+0000", 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2369999999999997e-06 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605076+0000", 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083494992000000004 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605168+0000", 2024-09-14T06:00:22.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1731999999999995e-05 2024-09-14T06:00:22.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605260+0000", 2024-09-14T06:00:22.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2511999999999998e-05 2024-09-14T06:00:22.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.612 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.612 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38844 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9469952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.613 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:22.613 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.078903793999999, 2024-09-14T06:00:22.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084006762999999998, 2024-09-14T06:00:22.613 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.613 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.613 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.613 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38844 2024-09-14T06:00:22.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.613 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:22.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:22.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521590+0000", 2024-09-14T06:00:22.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9699999999999996e-07 2024-09-14T06:00:22.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521593+0000", 2024-09-14T06:00:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5909999999999998e-06 2024-09-14T06:00:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521603+0000", 2024-09-14T06:00:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0642000000000001e-05 2024-09-14T06:00:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521609+0000", 2024-09-14T06:00:22.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1020000000000002e-06 2024-09-14T06:00:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605318+0000", 2024-09-14T06:00:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083709166000000002 2024-09-14T06:00:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605454+0000", 2024-09-14T06:00:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013557400000000001 2024-09-14T06:00:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605596+0000", 2024-09-14T06:00:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014209100000000001 2024-09-14T06:00:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38845 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9650176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.078875494000002, 2024-09-14T06:00:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084212700000000001, 2024-09-14T06:00:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.617 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38845 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:22.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1200000000000003e-07 2024-09-14T06:00:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521628+0000", 2024-09-14T06:00:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0196e-05 2024-09-14T06:00:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521637+0000", 2024-09-14T06:00:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6649999999999992e-06 2024-09-14T06:00:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521643+0000", 2024-09-14T06:00:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.285e-06 2024-09-14T06:00:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605652+0000", 2024-09-14T06:00:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084009025000000001 2024-09-14T06:00:22.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605741+0000", 2024-09-14T06:00:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8473000000000005e-05 2024-09-14T06:00:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605830+0000", 2024-09-14T06:00:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9444000000000006e-05 2024-09-14T06:00:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38848 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8536064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.078837485000001, 2024-09-14T06:00:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084375567999999998, 2024-09-14T06:00:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38848 2024-09-14T06:00:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.622 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0200000000000002e-07 2024-09-14T06:00:22.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521659+0000", 2024-09-14T06:00:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7800000000000001e-06 2024-09-14T06:00:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521667+0000", 2024-09-14T06:00:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6599999999999995e-06 2024-09-14T06:00:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521674+0000", 2024-09-14T06:00:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4560000000000003e-06 2024-09-14T06:00:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605872+0000", 2024-09-14T06:00:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084198010000000004 2024-09-14T06:00:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605945+0000", 2024-09-14T06:00:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2681000000000004e-05 2024-09-14T06:00:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606031+0000", 2024-09-14T06:00:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6378999999999994e-05 2024-09-14T06:00:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38849 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9748480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.078807058999999, 2024-09-14T06:00:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084581577000000005, 2024-09-14T06:00:22.626 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38849 2024-09-14T06:00:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521687+0000", 2024-09-14T06:00:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9400000000000005e-07 2024-09-14T06:00:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521729+0000", 2024-09-14T06:00:22.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2657000000000002e-05 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521749+0000", 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9264000000000001e-05 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521761+0000", 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2289999999999999e-05 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606078+0000", 2024-09-14T06:00:22.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084316772999999998 2024-09-14T06:00:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606176+0000", 2024-09-14T06:00:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7992999999999995e-05 2024-09-14T06:00:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606268+0000", 2024-09-14T06:00:22.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2006e-05 2024-09-14T06:00:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38851 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9928704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.078711747, 2024-09-14T06:00:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084695081000000005, 2024-09-14T06:00:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.631 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38851 2024-09-14T06:00:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521783+0000", 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1000000000000001e-06 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521788+0000", 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2619999999999998e-06 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521803+0000", 2024-09-14T06:00:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5421999999999999e-05 2024-09-14T06:00:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521815+0000", 2024-09-14T06:00:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.171e-05 2024-09-14T06:00:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606320+0000", 2024-09-14T06:00:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084504698000000003 2024-09-14T06:00:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606404+0000", 2024-09-14T06:00:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4379e-05 2024-09-14T06:00:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606476+0000", 2024-09-14T06:00:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2509999999999995e-05 2024-09-14T06:00:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.635 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.078660997, 2024-09-14T06:00:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:00:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:00:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:00:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:00:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:00:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:00:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:00:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:00:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:00:22.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:00:22.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.078622674000002, 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:00:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:00:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:00:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:00:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:00:22.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:00:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:00:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:00:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:00:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:00:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:00:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:00:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:00:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:00:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:22.644 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.078595982000003, 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:00:22.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:00:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:00:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:00:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:00:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:00:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:00:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:00:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:00:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:00:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:00:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.648 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.078570116000002, 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.649 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:00:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:00:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:00:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:00:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:00:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:00:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:00:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:00:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.653 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.077469747000002, 2024-09-14T06:00:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:00:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.656 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:00:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:00:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:00:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:00:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:00:22.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:00:22.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:00:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:00:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:00:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:22.660 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.077425767999998, 2024-09-14T06:00:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:00:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:00:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:00:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:00:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:00:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:00:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:00:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:00:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.664 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38865 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1392640~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.076447389999998, 2024-09-14T06:00:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084340500999999998, 2024-09-14T06:00:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.665 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38865 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524047+0000", 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5290000000000001e-06 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524054+0000", 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1910000000000003e-06 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524074+0000", 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9383999999999999e-05 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524089+0000", 2024-09-14T06:00:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4647000000000001e-05 2024-09-14T06:00:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608123+0000", 2024-09-14T06:00:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084034837000000001 2024-09-14T06:00:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608224+0000", 2024-09-14T06:00:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100182 2024-09-14T06:00:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608386+0000", 2024-09-14T06:00:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162731 2024-09-14T06:00:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.076364007999999, 2024-09-14T06:00:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:00:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.669 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:00:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:00:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:00:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:00:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:00:22.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:00:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:00:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:00:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:00:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:00:22.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:00:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:00:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:00:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:00:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:00:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38869 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.075958538000002, 2024-09-14T06:00:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084608905999999998, 2024-09-14T06:00:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38869 2024-09-14T06:00:22.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525138+0000", 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00060367999999999999 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525160+0000", 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1875999999999999e-05 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525182+0000", 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1427e-05 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525198+0000", 2024-09-14T06:00:22.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507e-05 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608907+0000", 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083708535000000001 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609011+0000", 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010461199999999999 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609144+0000", 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013226899999999999 2024-09-14T06:00:22.677 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38871 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1671168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.075267328000002, 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084308214000000006, 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.678 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38871 2024-09-14T06:00:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525487+0000", 2024-09-14T06:00:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026091100000000001 2024-09-14T06:00:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525493+0000", 2024-09-14T06:00:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.742e-06 2024-09-14T06:00:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525508+0000", 2024-09-14T06:00:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:22.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525518+0000", 2024-09-14T06:00:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8500000000000006e-06 2024-09-14T06:00:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609229+0000", 2024-09-14T06:00:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083711775000000002 2024-09-14T06:00:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609388+0000", 2024-09-14T06:00:22.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158286 2024-09-14T06:00:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609534+0000", 2024-09-14T06:00:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000146308 2024-09-14T06:00:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38873 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 737280~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.074955756000001, 2024-09-14T06:00:22.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084288875999999999, 2024-09-14T06:00:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38873 2024-09-14T06:00:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526372+0000", 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00083508200000000001 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526383+0000", 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0282000000000001e-05 2024-09-14T06:00:22.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526445+0000", 2024-09-14T06:00:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1975000000000002e-05 2024-09-14T06:00:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526460+0000", 2024-09-14T06:00:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5233e-05 2024-09-14T06:00:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609585+0000", 2024-09-14T06:00:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083125216000000002 2024-09-14T06:00:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609689+0000", 2024-09-14T06:00:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104126 2024-09-14T06:00:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609826+0000", 2024-09-14T06:00:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013696199999999999 2024-09-14T06:00:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.686 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38874 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.073988821999997, 2024-09-14T06:00:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083631987000000005, 2024-09-14T06:00:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38874 2024-09-14T06:00:22.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526505+0000", 2024-09-14T06:00:22.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7699999999999992e-07 2024-09-14T06:00:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526511+0000", 2024-09-14T06:00:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9139999999999996e-06 2024-09-14T06:00:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526525+0000", 2024-09-14T06:00:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3644e-05 2024-09-14T06:00:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526533+0000", 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6510000000000001e-06 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609897+0000", 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083364173 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610007+0000", 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110707 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610136+0000", 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012892099999999999 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38877 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1949696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.073944128999997, 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083886717, 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:22.691 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38877 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529354+0000", 2024-09-14T06:00:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028049170000000001 2024-09-14T06:00:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529373+0000", 2024-09-14T06:00:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.933e-05 2024-09-14T06:00:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529399+0000", 2024-09-14T06:00:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6129e-05 2024-09-14T06:00:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529418+0000", 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8944e-05 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610197+0000", 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080778271999999998 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610300+0000", 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103868 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:22.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610436+0000", 2024-09-14T06:00:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013525700000000001 2024-09-14T06:00:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:22.695 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:22.695 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:22.695 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T06:00:22.697 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T06:00:22.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T06:00:22.698 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:22.693+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:22.698 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:00:22.712 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone29 from 0xbda7548 (overlap 0xbda7548) to 0x25ee441 2024-09-14T06:00:22.797 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:22.795+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:22.899 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:22.897+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:22.902 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:22.902 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:22.902 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:22.902 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:22.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:00:22.927 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-14T06:00:23.005 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:23.003+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:23.077 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:23.077 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:23.077 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:23.077 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:23.077 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:23.091 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:00:23.101 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:00:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T06:00:23.102 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:23.097+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:23.127 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-09-14T06:00:22.583011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":826412410,"num_objects":1368,"num_object_clones":254,"num_object_copies":2736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1368,"num_whiteouts":514,"num_read":116604,"num_read_kb":428107,"num_write":17467,"num_write_kb":254135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":5610454,"num_keys_recovered":69,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13618,"ondisk_log_size":13618,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":448356,"kb_used_data":163128,"kb_used_omap":15,"kb_used_meta":284976,"kb_avail":754526364,"statfs":{"total":773094113280,"available":772634996736,"internally_reserved":0,"allocated":167043072,"data_stored":213775429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":291816220},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":94090343,"num_objects":54,"num_object_clones":16,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":14,"num_read":4429,"num_read_kb":16100,"num_write":720,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.045367"},"pg_stats":[{"pgid":"3.1f","version":"74'450","reported_seq":1851,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-14T06:00:18.561658+0000","last_change":"2024-09-14T05:59:43.763150+0000","last_active":"2024-09-14T06:00:18.561658+0000","last_peered":"2024-09-14T06:00:18.561658+0000","last_clean":"2024-09-14T06:00:18.561658+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T06:00:18.561658+0000","last_undegraded":"2024-09-14T06:00:18.561658+0000","last_fullsized":"2024-09-14T06:00:18.561658+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:48.283822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001224482,"stat_sum":{"num_bytes":34014237,"num_objects":48,"num_object_clones":8,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":21,"num_read":3189,"num_read_kb":12209,"num_write":560,"num_write_kb":2865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"78'409","reported_seq":2382,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.579102+0000","last_change":"2024-09-14T05:59:08.299658+0000","last_active":"2024-09-14T06:00:21.579102+0000","last_peered":"2024-09-14T06:00:21.579102+0000","last_clean":"2024-09-14T06:00:21.579102+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T06:00:21.579102+0000","last_undegraded":"2024-09-14T06:00:21.579102+0000","last_fullsized":"2024-09-14T06:00:21.579102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:20.830746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882171,"stat_sum":{"num_bytes":20778727,"num_objects":37,"num_object_clones":7,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":10,"num_read":2852,"num_read_kb":5737,"num_write":543,"num_write_kb":9021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"77'224","reported_seq":3696,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576738+0000","last_change":"2024-09-14T05:59:08.293155+0000","last_active":"2024-09-14T06:00:21.576738+0000","last_peered":"2024-09-14T06:00:21.576738+0000","last_clean":"2024-09-14T06:00:21.576738+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T06:00:21.576738+0000","last_undegraded":"2024-09-14T06:00:21.576738+0000","last_fullsized":"2024-09-14T06:00:21.576738+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:04.326844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000618802,"stat_sum":{"num_bytes":12487728,"num_objects":31,"num_object_clones":3,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":10,"num_read":3463,"num_read_kb":12801,"num_write":258,"num_write_kb":20395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"79'270","reported_seq":3356,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.601516+0000","last_change":"2024-09-14T05:59:08.294498+0000","last_active":"2024-09-14T06:00:21.601516+0000","last_peered":"2024-09-14T06:00:21.601516+0000","last_clean":"2024-09-14T06:00:21.601516+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T06:00:21.601516+0000","last_undegraded":"2024-09-14T06:00:21.601516+0000","last_fullsized":"2024-09-14T06:00:21.601516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:04.755037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014905350000000001,"stat_sum":{"num_bytes":15057371,"num_objects":45,"num_object_clones":8,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":22,"num_read":3069,"num_read_kb":10183,"num_write":260,"num_write_kb":5962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'362","reported_seq":926,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-14T06:00:18.561144+0000","last_change":"2024-09-14T05:59:40.834308+0000","last_active":"2024-09-14T06:00:18.561144+0000","last_peered":"2024-09-14T06:00:18.561144+0000","last_clean":"2024-09-14T06:00:18.561144+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T06:00:18.561144+0000","last_undegraded":"2024-09-14T06:00:18.561144+0000","last_fullsized":"2024-09-14T06:00:18.561144+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:56.432574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5370068,"num_objects":42,"num_object_clones":9,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":21,"num_read":1743,"num_read_kb":2739,"num_write":366,"num_write_kb":3158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"79'524","reported_seq":2624,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.606895+0000","last_change":"2024-09-14T05:59:08.282710+0000","last_active":"2024-09-14T06:00:21.606895+0000","last_peered":"2024-09-14T06:00:21.606895+0000","last_clean":"2024-09-14T06:00:21.606895+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T06:00:21.606895+0000","last_undegraded":"2024-09-14T06:00:21.606895+0000","last_fullsized":"2024-09-14T06:00:21.606895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:27:47.943734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078735700000000003,"stat_sum":{"num_bytes":8694258,"num_objects":33,"num_object_clones":3,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":14,"num_read":4043,"num_read_kb":7374,"num_write":674,"num_write_kb":4703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"79'295","reported_seq":1851,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.606240+0000","last_change":"2024-09-14T05:59:08.283122+0000","last_active":"2024-09-14T06:00:21.606240+0000","last_peered":"2024-09-14T06:00:21.606240+0000","last_clean":"2024-09-14T06:00:21.606240+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T06:00:21.606240+0000","last_undegraded":"2024-09-14T06:00:21.606240+0000","last_fullsized":"2024-09-14T06:00:21.606240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:02.340070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020244989999999999,"stat_sum":{"num_bytes":25889839,"num_objects":36,"num_object_clones":4,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":13,"num_read":1970,"num_read_kb":9004,"num_write":316,"num_write_kb":7826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"74'379","reported_seq":4065,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.579338+0000","last_change":"2024-09-14T05:59:43.761389+0000","last_active":"2024-09-14T06:00:21.579338+0000","last_peered":"2024-09-14T06:00:21.579338+0000","last_clean":"2024-09-14T06:00:21.579338+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T06:00:21.579338+0000","last_undegraded":"2024-09-14T06:00:21.579338+0000","last_fullsized":"2024-09-14T06:00:21.579338+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:29.674376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090099400000000001,"stat_sum":{"num_bytes":47785170,"num_objects":47,"num_object_clones":10,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":17,"num_read":5354,"num_read_kb":28960,"num_write":386,"num_write_kb":5089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"70'257","reported_seq":2169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-14T06:00:18.561364+0000","last_change":"2024-09-14T05:59:40.929839+0000","last_active":"2024-09-14T06:00:18.561364+0000","last_peered":"2024-09-14T06:00:18.561364+0000","last_clean":"2024-09-14T06:00:18.561364+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T06:00:18.561364+0000","last_undegraded":"2024-09-14T06:00:18.561364+0000","last_fullsized":"2024-09-14T06:00:18.561364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:44:00.208657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18345553,"num_objects":41,"num_object_clones":10,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":18,"num_read":2379,"num_read_kb":13855,"num_write":246,"num_write_kb":4427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"78'1353","reported_seq":2994,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576805+0000","last_change":"2024-09-14T05:59:08.293088+0000","last_active":"2024-09-14T06:00:21.576805+0000","last_peered":"2024-09-14T06:00:21.576805+0000","last_clean":"2024-09-14T06:00:21.576805+0000","last_became_active":"2024-09-14T05:59:06.296607+0000","last_became_peered":"2024-09-14T05:59:06.296607+0000","last_unstale":"2024-09-14T06:00:21.576805+0000","last_undegraded":"2024-09-14T06:00:21.576805+0000","last_fullsized":"2024-09-14T06:00:21.576805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1353,"log_dups_size":0,"ondisk_log_size":1353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:31.445038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056627299999999995,"stat_sum":{"num_bytes":35252280,"num_objects":39,"num_object_clones":9,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":12,"num_read":7780,"num_read_kb":14392,"num_write":2352,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"77'536","reported_seq":3865,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.613026+0000","last_change":"2024-09-14T05:59:08.370304+0000","last_active":"2024-09-14T06:00:21.613026+0000","last_peered":"2024-09-14T06:00:21.613026+0000","last_clean":"2024-09-14T06:00:21.613026+0000","last_became_active":"2024-09-14T05:59:06.295335+0000","last_became_peered":"2024-09-14T05:59:06.295335+0000","last_unstale":"2024-09-14T06:00:21.613026+0000","last_undegraded":"2024-09-14T06:00:21.613026+0000","last_fullsized":"2024-09-14T06:00:21.613026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:04:36.006987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001779487,"stat_sum":{"num_bytes":49261121,"num_objects":62,"num_object_clones":16,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":25,"num_read":5281,"num_read_kb":30445,"num_write":676,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"78'468","reported_seq":4187,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.575789+0000","last_change":"2024-09-14T05:59:08.282513+0000","last_active":"2024-09-14T06:00:21.575789+0000","last_peered":"2024-09-14T06:00:21.575789+0000","last_clean":"2024-09-14T06:00:21.575789+0000","last_became_active":"2024-09-14T05:59:06.307548+0000","last_became_peered":"2024-09-14T05:59:06.307548+0000","last_unstale":"2024-09-14T06:00:21.575789+0000","last_undegraded":"2024-09-14T06:00:21.575789+0000","last_fullsized":"2024-09-14T06:00:21.575789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:47.300695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061538200000000004,"stat_sum":{"num_bytes":17242668,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":13,"num_read":4978,"num_read_kb":16010,"num_write":687,"num_write_kb":7895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-14T06:00:20.584915+0000","last_change":"2024-09-14T05:58:56.312544+0000","last_active":"2024-09-14T06:00:20.584915+0000","last_peered":"2024-09-14T06:00:20.584915+0000","last_clean":"2024-09-14T06:00:20.584915+0000","last_became_active":"2024-09-14T05:58:54.103612+0000","last_became_peered":"2024-09-14T05:58:54.103612+0000","last_unstale":"2024-09-14T06:00:20.584915+0000","last_undegraded":"2024-09-14T06:00:20.584915+0000","last_fullsized":"2024-09-14T06:00:20.584915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:08.678742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"74'540","reported_seq":3161,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-14T06:00:18.679954+0000","last_change":"2024-09-14T05:59:43.762927+0000","last_active":"2024-09-14T06:00:18.679954+0000","last_peered":"2024-09-14T06:00:18.679954+0000","last_clean":"2024-09-14T06:00:18.679954+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T06:00:18.679954+0000","last_undegraded":"2024-09-14T06:00:18.679954+0000","last_fullsized":"2024-09-14T06:00:18.679954+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:48.210100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19066315,"num_objects":40,"num_object_clones":6,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":14,"num_read":4879,"num_read_kb":11491,"num_write":652,"num_write_kb":4703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.577088+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T06:00:21.577088+0000","last_peered":"2024-09-14T06:00:21.577088+0000","last_clean":"2024-09-14T06:00:21.577088+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T06:00:21.577088+0000","last_undegraded":"2024-09-14T06:00:21.577088+0000","last_fullsized":"2024-09-14T06:00:21.577088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"78'316","reported_seq":3981,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.579186+0000","last_change":"2024-09-14T05:59:08.299312+0000","last_active":"2024-09-14T06:00:21.579186+0000","last_peered":"2024-09-14T06:00:21.579186+0000","last_clean":"2024-09-14T06:00:21.579186+0000","last_became_active":"2024-09-14T05:59:06.302779+0000","last_became_peered":"2024-09-14T05:59:06.302779+0000","last_unstale":"2024-09-14T06:00:21.579186+0000","last_undegraded":"2024-09-14T06:00:21.579186+0000","last_fullsized":"2024-09-14T06:00:21.579186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:04.029259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001533155,"stat_sum":{"num_bytes":61627479,"num_objects":51,"num_object_clones":8,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":17,"num_read":3609,"num_read_kb":26720,"num_write":334,"num_write_kb":13300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.613503+0000","last_change":"2024-09-14T05:59:40.765463+0000","last_active":"2024-09-14T06:00:21.613503+0000","last_peered":"2024-09-14T06:00:21.613503+0000","last_clean":"2024-09-14T06:00:21.613503+0000","last_became_active":"2024-09-14T05:59:40.764785+0000","last_became_peered":"2024-09-14T05:59:40.764785+0000","last_unstale":"2024-09-14T06:00:21.613503+0000","last_undegraded":"2024-09-14T06:00:21.613503+0000","last_fullsized":"2024-09-14T06:00:21.613503+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:47.547246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"77'250","reported_seq":2115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576983+0000","last_change":"2024-09-14T05:59:08.282105+0000","last_active":"2024-09-14T06:00:21.576983+0000","last_peered":"2024-09-14T06:00:21.576983+0000","last_clean":"2024-09-14T06:00:21.576983+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T06:00:21.576983+0000","last_undegraded":"2024-09-14T06:00:21.576983+0000","last_fullsized":"2024-09-14T06:00:21.576983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:51:42.343777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010945919999999999,"stat_sum":{"num_bytes":19085586,"num_objects":33,"num_object_clones":5,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":14,"num_read":1993,"num_read_kb":4581,"num_write":300,"num_write_kb":3411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576939+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T06:00:21.576939+0000","last_peered":"2024-09-14T06:00:21.576939+0000","last_clean":"2024-09-14T06:00:21.576939+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T06:00:21.576939+0000","last_undegraded":"2024-09-14T06:00:21.576939+0000","last_fullsized":"2024-09-14T06:00:21.576939+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"77'333","reported_seq":3460,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576921+0000","last_change":"2024-09-14T05:59:08.293368+0000","last_active":"2024-09-14T06:00:21.576921+0000","last_peered":"2024-09-14T06:00:21.576921+0000","last_clean":"2024-09-14T06:00:21.576921+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T06:00:21.576921+0000","last_undegraded":"2024-09-14T06:00:21.576921+0000","last_fullsized":"2024-09-14T06:00:21.576921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:37.491681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072033799999999995,"stat_sum":{"num_bytes":11192414,"num_objects":41,"num_object_clones":8,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":16,"num_read":4434,"num_read_kb":12530,"num_write":315,"num_write_kb":2935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"76'254","reported_seq":1201,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.575558+0000","last_change":"2024-09-14T05:59:40.846399+0000","last_active":"2024-09-14T06:00:21.575558+0000","last_peered":"2024-09-14T06:00:21.575558+0000","last_clean":"2024-09-14T06:00:21.575558+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T06:00:21.575558+0000","last_undegraded":"2024-09-14T06:00:21.575558+0000","last_fullsized":"2024-09-14T06:00:21.575558+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:10.986760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047912600000000002,"stat_sum":{"num_bytes":55872928,"num_objects":33,"num_object_clones":5,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":12,"num_read":815,"num_read_kb":10865,"num_write":253,"num_write_kb":4941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576102+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T06:00:21.576102+0000","last_peered":"2024-09-14T06:00:21.576102+0000","last_clean":"2024-09-14T06:00:21.576102+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T06:00:21.576102+0000","last_undegraded":"2024-09-14T06:00:21.576102+0000","last_fullsized":"2024-09-14T06:00:21.576102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"78'827","reported_seq":2259,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576949+0000","last_change":"2024-09-14T05:59:08.281926+0000","last_active":"2024-09-14T06:00:21.576949+0000","last_peered":"2024-09-14T06:00:21.576949+0000","last_clean":"2024-09-14T06:00:21.576949+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T06:00:21.576949+0000","last_undegraded":"2024-09-14T06:00:21.576949+0000","last_fullsized":"2024-09-14T06:00:21.576949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:01:49.280883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096925799999999997,"stat_sum":{"num_bytes":20832519,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":17,"num_read":4480,"num_read_kb":16493,"num_write":1293,"num_write_kb":11794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":126,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-14T06:00:17.526587+0000","last_change":"2024-09-14T05:58:56.096637+0000","last_active":"2024-09-14T06:00:17.526587+0000","last_peered":"2024-09-14T06:00:17.526587+0000","last_clean":"2024-09-14T06:00:17.526587+0000","last_became_active":"2024-09-14T05:58:54.356560+0000","last_became_peered":"2024-09-14T05:58:54.356560+0000","last_unstale":"2024-09-14T06:00:17.526587+0000","last_undegraded":"2024-09-14T06:00:17.526587+0000","last_fullsized":"2024-09-14T06:00:17.526587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:10.136136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012156140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"72'304","reported_seq":1232,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-14T06:00:18.679365+0000","last_change":"2024-09-14T05:59:40.894081+0000","last_active":"2024-09-14T06:00:18.679365+0000","last_peered":"2024-09-14T06:00:18.679365+0000","last_clean":"2024-09-14T06:00:18.679365+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T06:00:18.679365+0000","last_undegraded":"2024-09-14T06:00:18.679365+0000","last_fullsized":"2024-09-14T06:00:18.679365+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:42.490838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18162471,"num_objects":49,"num_object_clones":10,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":18,"num_read":1097,"num_read_kb":12117,"num_write":313,"num_write_kb":7494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.612711+0000","last_change":"2024-09-14T05:58:56.593338+0000","last_active":"2024-09-14T06:00:21.612711+0000","last_peered":"2024-09-14T06:00:21.612711+0000","last_clean":"2024-09-14T06:00:21.612711+0000","last_became_active":"2024-09-14T05:58:54.099699+0000","last_became_peered":"2024-09-14T05:58:54.099699+0000","last_unstale":"2024-09-14T06:00:21.612711+0000","last_undegraded":"2024-09-14T06:00:21.612711+0000","last_fullsized":"2024-09-14T06:00:21.612711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:40.481832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"70'201","reported_seq":1429,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.579064+0000","last_change":"2024-09-14T05:59:08.298483+0000","last_active":"2024-09-14T06:00:21.579064+0000","last_peered":"2024-09-14T06:00:21.579064+0000","last_clean":"2024-09-14T06:00:21.579064+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T06:00:21.579064+0000","last_undegraded":"2024-09-14T06:00:21.579064+0000","last_fullsized":"2024-09-14T06:00:21.579064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:06:21.894669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011244670000000001,"stat_sum":{"num_bytes":11599098,"num_objects":35,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":14,"num_read":1184,"num_read_kb":13382,"num_write":244,"num_write_kb":5044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.575850+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T06:00:21.575850+0000","last_peered":"2024-09-14T06:00:21.575850+0000","last_clean":"2024-09-14T06:00:21.575850+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T06:00:21.575850+0000","last_undegraded":"2024-09-14T06:00:21.575850+0000","last_fullsized":"2024-09-14T06:00:21.575850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":234,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.612738+0000","last_change":"2024-09-14T05:59:40.766729+0000","last_active":"2024-09-14T06:00:21.612738+0000","last_peered":"2024-09-14T06:00:21.612738+0000","last_clean":"2024-09-14T06:00:21.612738+0000","last_became_active":"2024-09-14T05:59:40.765914+0000","last_became_peered":"2024-09-14T05:59:40.765914+0000","last_unstale":"2024-09-14T06:00:21.612738+0000","last_undegraded":"2024-09-14T06:00:21.612738+0000","last_fullsized":"2024-09-14T06:00:21.612738+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:02.407639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"77'534","reported_seq":1555,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.579092+0000","last_change":"2024-09-14T05:59:08.298535+0000","last_active":"2024-09-14T06:00:21.579092+0000","last_peered":"2024-09-14T06:00:21.579092+0000","last_clean":"2024-09-14T06:00:21.579092+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T06:00:21.579092+0000","last_undegraded":"2024-09-14T06:00:21.579092+0000","last_fullsized":"2024-09-14T06:00:21.579092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:02.845527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085964400000000001,"stat_sum":{"num_bytes":18041420,"num_objects":40,"num_object_clones":7,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":13,"num_read":2676,"num_read_kb":5194,"num_write":769,"num_write_kb":2437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"79'223","reported_seq":2381,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.631900+0000","last_change":"2024-09-14T05:59:08.282238+0000","last_active":"2024-09-14T06:00:21.631900+0000","last_peered":"2024-09-14T06:00:21.631900+0000","last_clean":"2024-09-14T06:00:21.631900+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T06:00:21.631900+0000","last_undegraded":"2024-09-14T06:00:21.631900+0000","last_fullsized":"2024-09-14T06:00:21.631900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:51:42.121460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052576800000000003,"stat_sum":{"num_bytes":28985383,"num_objects":36,"num_object_clones":4,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":9,"num_read":2057,"num_read_kb":8123,"num_write":238,"num_write_kb":18683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"77'332","reported_seq":1816,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-14T06:00:20.584816+0000","last_change":"2024-09-14T05:59:08.303592+0000","last_active":"2024-09-14T06:00:20.584816+0000","last_peered":"2024-09-14T06:00:20.584816+0000","last_clean":"2024-09-14T06:00:20.584816+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T06:00:20.584816+0000","last_undegraded":"2024-09-14T06:00:20.584816+0000","last_fullsized":"2024-09-14T06:00:20.584816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:16.411748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035228000000000001,"stat_sum":{"num_bytes":29757425,"num_objects":48,"num_object_clones":11,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":18,"num_read":2203,"num_read_kb":8993,"num_write":372,"num_write_kb":3982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"78'706","reported_seq":1501,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.579295+0000","last_change":"2024-09-14T05:59:40.885530+0000","last_active":"2024-09-14T06:00:21.579295+0000","last_peered":"2024-09-14T06:00:21.579295+0000","last_clean":"2024-09-14T06:00:21.579295+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T06:00:21.579295+0000","last_undegraded":"2024-09-14T06:00:21.579295+0000","last_fullsized":"2024-09-14T06:00:21.579295+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:23.624073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083256200000000002,"stat_sum":{"num_bytes":8260195,"num_objects":37,"num_object_clones":6,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":11,"num_read":3815,"num_read_kb":5343,"num_write":1151,"num_write_kb":5480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"78'395","reported_seq":4410,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576694+0000","last_change":"2024-09-14T05:59:08.294210+0000","last_active":"2024-09-14T06:00:21.576694+0000","last_peered":"2024-09-14T06:00:21.576694+0000","last_clean":"2024-09-14T06:00:21.576694+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T06:00:21.576694+0000","last_undegraded":"2024-09-14T06:00:21.576694+0000","last_fullsized":"2024-09-14T06:00:21.576694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:04.122151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013095159999999999,"stat_sum":{"num_bytes":37167361,"num_objects":47,"num_object_clones":8,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":19,"num_read":5549,"num_read_kb":20943,"num_write":381,"num_write_kb":9879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"78'270","reported_seq":2355,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.613497+0000","last_change":"2024-09-14T05:59:08.371003+0000","last_active":"2024-09-14T06:00:21.613497+0000","last_peered":"2024-09-14T06:00:21.613497+0000","last_clean":"2024-09-14T06:00:21.613497+0000","last_became_active":"2024-09-14T05:59:06.300360+0000","last_became_peered":"2024-09-14T05:59:06.300360+0000","last_unstale":"2024-09-14T06:00:21.613497+0000","last_undegraded":"2024-09-14T06:00:21.613497+0000","last_fullsized":"2024-09-14T06:00:21.613497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:43.808752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022610920000000001,"stat_sum":{"num_bytes":15481138,"num_objects":35,"num_object_clones":8,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":13,"num_read":2833,"num_read_kb":10858,"num_write":285,"num_write_kb":5290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"76'281","reported_seq":2561,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.613310+0000","last_change":"2024-09-14T05:59:08.370421+0000","last_active":"2024-09-14T06:00:21.613310+0000","last_peered":"2024-09-14T06:00:21.613310+0000","last_clean":"2024-09-14T06:00:21.613310+0000","last_became_active":"2024-09-14T05:59:06.308504+0000","last_became_peered":"2024-09-14T05:59:06.308504+0000","last_unstale":"2024-09-14T06:00:21.613310+0000","last_undegraded":"2024-09-14T06:00:21.613310+0000","last_fullsized":"2024-09-14T06:00:21.613310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:35:41.967843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001798163,"stat_sum":{"num_bytes":17954071,"num_objects":52,"num_object_clones":11,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":19,"num_read":2788,"num_read_kb":13988,"num_write":299,"num_write_kb":4326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"77'441","reported_seq":5475,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.613476+0000","last_change":"2024-09-14T05:59:08.370940+0000","last_active":"2024-09-14T06:00:21.613476+0000","last_peered":"2024-09-14T06:00:21.613476+0000","last_clean":"2024-09-14T06:00:21.613476+0000","last_became_active":"2024-09-14T05:59:06.302019+0000","last_became_peered":"2024-09-14T05:59:06.302019+0000","last_unstale":"2024-09-14T06:00:21.613476+0000","last_undegraded":"2024-09-14T06:00:21.613476+0000","last_fullsized":"2024-09-14T06:00:21.613476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:37.390824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022861499999999998,"stat_sum":{"num_bytes":26249919,"num_objects":41,"num_object_clones":5,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":6578,"num_read_kb":12669,"num_write":539,"num_write_kb":5561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"78'715","reported_seq":2778,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.115400+0000","last_change":"2024-09-14T05:59:43.767147+0000","last_active":"2024-09-14T06:00:21.115400+0000","last_peered":"2024-09-14T06:00:21.115400+0000","last_clean":"2024-09-14T06:00:21.115400+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T06:00:21.115400+0000","last_undegraded":"2024-09-14T06:00:21.115400+0000","last_fullsized":"2024-09-14T06:00:21.115400+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:53.072436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047002699999999998,"stat_sum":{"num_bytes":37080104,"num_objects":56,"num_object_clones":12,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":23,"num_read":5150,"num_read_kb":10611,"num_write":1035,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"76'371","reported_seq":5460,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.612902+0000","last_change":"2024-09-14T05:59:08.369705+0000","last_active":"2024-09-14T06:00:21.612902+0000","last_peered":"2024-09-14T06:00:21.612902+0000","last_clean":"2024-09-14T06:00:21.612902+0000","last_became_active":"2024-09-14T05:59:06.311716+0000","last_became_peered":"2024-09-14T05:59:06.311716+0000","last_unstale":"2024-09-14T06:00:21.612902+0000","last_undegraded":"2024-09-14T06:00:21.612902+0000","last_fullsized":"2024-09-14T06:00:21.612902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:08.964290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001347256,"stat_sum":{"num_bytes":42290429,"num_objects":46,"num_object_clones":6,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":16,"num_read":5835,"num_read_kb":29571,"num_write":487,"num_write_kb":26932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"76'468","reported_seq":3320,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-14T06:00:18.743110+0000","last_change":"2024-09-14T05:59:43.765786+0000","last_active":"2024-09-14T06:00:18.743110+0000","last_peered":"2024-09-14T06:00:18.743110+0000","last_clean":"2024-09-14T06:00:18.743110+0000","last_became_active":"2024-09-14T05:59:43.763983+0000","last_became_peered":"2024-09-14T05:59:43.763983+0000","last_unstale":"2024-09-14T06:00:18.743110+0000","last_undegraded":"2024-09-14T06:00:18.743110+0000","last_fullsized":"2024-09-14T06:00:18.743110+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:29.106648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18390954,"num_objects":50,"num_object_clones":8,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":26,"num_read":3795,"num_read_kb":9298,"num_write":515,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":767927,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"78'255","reported_seq":4996,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.613232+0000","last_change":"2024-09-14T05:59:08.369685+0000","last_active":"2024-09-14T06:00:21.613232+0000","last_peered":"2024-09-14T06:00:21.613232+0000","last_clean":"2024-09-14T06:00:21.613232+0000","last_became_active":"2024-09-14T05:59:06.302125+0000","last_became_peered":"2024-09-14T05:59:06.302125+0000","last_unstale":"2024-09-14T06:00:21.613232+0000","last_undegraded":"2024-09-14T06:00:21.613232+0000","last_fullsized":"2024-09-14T06:00:21.613232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:56.156199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012750369999999999,"stat_sum":{"num_bytes":38545794,"num_objects":55,"num_object_clones":16,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":17,"num_read":4667,"num_read_kb":20573,"num_write":265,"num_write_kb":9153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":825822023,"num_objects":1364,"num_object_clones":254,"num_object_copies":2728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1364,"num_whiteouts":514,"num_read":116538,"num_read_kb":428052,"num_write":17364,"num_write_kb":252505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":5610454,"num_keys_recovered":69,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":158584832,"data_stored":209250196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13543,"ondisk_log_size":13543,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42868,"kb_used_data":7524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328972,"statfs":{"total":96636764160,"available":96592867328,"internally_reserved":0,"allocated":7704576,"data_stored":10243587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495625,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62416,"kb_used_data":21952,"kb_used_omap":4,"kb_used_meta":40443,"kb_avail":94309424,"statfs":{"total":96636764160,"available":96572850176,"internally_reserved":0,"allocated":22478848,"data_stored":32182561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":41414320},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77140,"kb_used_data":32004,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94294700,"statfs":{"total":96636764160,"available":96557772800,"internally_reserved":0,"allocated":32772096,"data_stored":40977332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40116,"kb_used_data":8920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331724,"statfs":{"total":96636764160,"available":96595685376,"internally_reserved":0,"allocated":9134080,"data_stored":12052072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61836,"kb_used_data":22332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94310004,"statfs":{"total":96636764160,"available":96573444096,"internally_reserved":0,"allocated":22867968,"data_stored":26565533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57688,"kb_used_data":30664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94314152,"statfs":{"total":96636764160,"available":96577691648,"internally_reserved":0,"allocated":31399936,"data_stored":39590253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53932,"kb_used_data":26876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94317908,"statfs":{"total":96636764160,"available":96581537792,"internally_reserved":0,"allocated":27521024,"data_stored":33587181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52360,"kb_used_data":12856,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319480,"statfs":{"total":96636764160,"available":96583147520,"internally_reserved":0,"allocated":13164544,"data_stored":18576910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21000192,"data_stored":31191114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12271616,"data_stored":18182636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6844416,"data_stored":9854433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26611712,"data_stored":33174227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30466048,"data_stored":39140584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21958656,"data_stored":26152600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8138752,"data_stored":11559688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":31293440,"data_stored":39994914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T06:00:23.129 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T06:00:23.219 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:23.217+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:23.251 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:23.251 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:23.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:23.251 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:23.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.251 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59148 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 419840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.252 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:23.252 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.982983111999999, 2024-09-14T06:00:23.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072974285999999999, 2024-09-14T06:00:23.252 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.252 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.252 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.252 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.252 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.252 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.252 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59148 2024-09-14T06:00:23.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.252 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:23.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:23.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268521+0000", 2024-09-14T06:00:23.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4199999999999995e-07 2024-09-14T06:00:23.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268524+0000", 2024-09-14T06:00:23.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.05e-06 2024-09-14T06:00:23.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268534+0000", 2024-09-14T06:00:23.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8719999999999997e-06 2024-09-14T06:00:23.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268541+0000", 2024-09-14T06:00:23.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5349999999999999e-06 2024-09-14T06:00:23.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341108+0000", 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072566624999999996 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341169+0000", 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1251e-05 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341494+0000", 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325311 2024-09-14T06:00:23.255 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.256 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.256 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.256 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59149 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 436224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.256 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:23.256 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.982943888000001, 2024-09-14T06:00:23.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073405053999999997, 2024-09-14T06:00:23.256 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.256 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.256 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.256 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.256 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.256 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.257 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59149 2024-09-14T06:00:23.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.257 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:23.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:23.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268560+0000", 2024-09-14T06:00:23.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9999999999999997e-07 2024-09-14T06:00:23.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268563+0000", 2024-09-14T06:00:23.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.292e-06 2024-09-14T06:00:23.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268573+0000", 2024-09-14T06:00:23.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3260000000000002e-06 2024-09-14T06:00:23.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268581+0000", 2024-09-14T06:00:23.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1960000000000008e-06 2024-09-14T06:00:23.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341537+0000", 2024-09-14T06:00:23.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072955916999999995 2024-09-14T06:00:23.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341641+0000", 2024-09-14T06:00:23.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104341 2024-09-14T06:00:23.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341964+0000", 2024-09-14T06:00:23.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032328199999999999 2024-09-14T06:00:23.260 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.260 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.260 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.261 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59150 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 452608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.261 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:23.261 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.982910648000001, 2024-09-14T06:00:23.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073829748000000001, 2024-09-14T06:00:23.261 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.261 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.261 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.261 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.261 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.261 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.261 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59150 2024-09-14T06:00:23.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.261 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:23.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:23.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:23.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0399999999999995e-07 2024-09-14T06:00:23.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268596+0000", 2024-09-14T06:00:23.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9859999999999999e-06 2024-09-14T06:00:23.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268606+0000", 2024-09-14T06:00:23.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0088000000000001e-05 2024-09-14T06:00:23.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268614+0000", 2024-09-14T06:00:23.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T06:00:23.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341999+0000", 2024-09-14T06:00:23.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073385011999999999 2024-09-14T06:00:23.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342093+0000", 2024-09-14T06:00:23.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3793000000000001e-05 2024-09-14T06:00:23.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342422+0000", 2024-09-14T06:00:23.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000329129 2024-09-14T06:00:23.265 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.265 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.265 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.265 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59151 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.265 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:23.265 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.982878280000001, 2024-09-14T06:00:23.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074207289999999995, 2024-09-14T06:00:23.266 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.266 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.266 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.266 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.266 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.266 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.266 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59151 2024-09-14T06:00:23.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.266 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:23.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268626+0000", 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268629+0000", 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.038e-06 2024-09-14T06:00:23.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268638+0000", 2024-09-14T06:00:23.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8139999999999995e-06 2024-09-14T06:00:23.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268647+0000", 2024-09-14T06:00:23.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4889999999999995e-06 2024-09-14T06:00:23.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342457+0000", 2024-09-14T06:00:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073809890000000003 2024-09-14T06:00:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342545+0000", 2024-09-14T06:00:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8697999999999997e-05 2024-09-14T06:00:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342832+0000", 2024-09-14T06:00:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028681799999999999 2024-09-14T06:00:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.269 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.270 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.270 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59152 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.270 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:23.270 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.982845639000001, 2024-09-14T06:00:23.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074695176000000002, 2024-09-14T06:00:23.270 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.270 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.270 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.270 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.270 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.270 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.271 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59152 2024-09-14T06:00:23.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.271 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:23.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:23.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:23.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2900000000000003e-07 2024-09-14T06:00:23.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268661+0000", 2024-09-14T06:00:23.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0230000000000001e-06 2024-09-14T06:00:23.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268670+0000", 2024-09-14T06:00:23.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2129999999999997e-06 2024-09-14T06:00:23.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268679+0000", 2024-09-14T06:00:23.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-09-14T06:00:23.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342937+0000", 2024-09-14T06:00:23.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074258781999999995 2024-09-14T06:00:23.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343044+0000", 2024-09-14T06:00:23.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-09-14T06:00:23.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343353+0000", 2024-09-14T06:00:23.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030911099999999999 2024-09-14T06:00:23.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.274 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.274 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59153 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 501760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.274 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:23.275 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.982812869, 2024-09-14T06:00:23.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074997241000000006, 2024-09-14T06:00:23.275 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.275 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.275 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.275 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59153 2024-09-14T06:00:23.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.275 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:23.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:23.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268691+0000", 2024-09-14T06:00:23.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:00:23.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268693+0000", 2024-09-14T06:00:23.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3599999999999999e-06 2024-09-14T06:00:23.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268699+0000", 2024-09-14T06:00:23.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-09-14T06:00:23.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268704+0000", 2024-09-14T06:00:23.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5759999999999999e-06 2024-09-14T06:00:23.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343398+0000", 2024-09-14T06:00:23.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074694522999999999 2024-09-14T06:00:23.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343450+0000", 2024-09-14T06:00:23.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1350999999999997e-05 2024-09-14T06:00:23.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343688+0000", 2024-09-14T06:00:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023806500000000001 2024-09-14T06:00:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59154 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 518144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.982793803, 2024-09-14T06:00:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075389938000000004, 2024-09-14T06:00:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59154 2024-09-14T06:00:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:23.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268710+0000", 2024-09-14T06:00:23.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8000000000000001e-07 2024-09-14T06:00:23.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268712+0000", 2024-09-14T06:00:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T06:00:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268717+0000", 2024-09-14T06:00:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8570000000000003e-06 2024-09-14T06:00:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268721+0000", 2024-09-14T06:00:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2039999999999999e-06 2024-09-14T06:00:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343721+0000", 2024-09-14T06:00:23.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074999748000000005 2024-09-14T06:00:23.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343784+0000", 2024-09-14T06:00:23.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3174000000000002e-05 2024-09-14T06:00:23.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.344099+0000", 2024-09-14T06:00:23.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000315299 2024-09-14T06:00:23.284 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.284 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.284 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.284 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59398 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 323584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.284 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:23.284 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.971829554999999, 2024-09-14T06:00:23.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073326565999999996, 2024-09-14T06:00:23.284 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.284 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.284 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.284 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.284 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.285 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.285 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59398 2024-09-14T06:00:23.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.285 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:23.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:23.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279675+0000", 2024-09-14T06:00:23.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-14T06:00:23.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279681+0000", 2024-09-14T06:00:23.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-09-14T06:00:23.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279702+0000", 2024-09-14T06:00:23.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1259000000000001e-05 2024-09-14T06:00:23.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279718+0000", 2024-09-14T06:00:23.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5475999999999999e-05 2024-09-14T06:00:23.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352360+0000", 2024-09-14T06:00:23.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.07264226 2024-09-14T06:00:23.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352447+0000", 2024-09-14T06:00:23.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7381999999999998e-05 2024-09-14T06:00:23.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353000+0000", 2024-09-14T06:00:23.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055309200000000004 2024-09-14T06:00:23.289 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.289 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.289 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.289 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59399 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.289 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:23.289 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.971765191999999, 2024-09-14T06:00:23.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073824446000000002, 2024-09-14T06:00:23.290 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.290 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.290 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.290 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.290 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.290 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.290 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59399 2024-09-14T06:00:23.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.290 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:23.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:23.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279739+0000", 2024-09-14T06:00:23.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T06:00:23.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279745+0000", 2024-09-14T06:00:23.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T06:00:23.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279767+0000", 2024-09-14T06:00:23.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639000000000001e-05 2024-09-14T06:00:23.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279781+0000", 2024-09-14T06:00:23.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4511999999999999e-05 2024-09-14T06:00:23.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353045+0000", 2024-09-14T06:00:23.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073263718000000005 2024-09-14T06:00:23.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353168+0000", 2024-09-14T06:00:23.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012314499999999999 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353562+0000", 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039435199999999999 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59400 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.971701432, 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074271465999999994, 2024-09-14T06:00:23.294 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59400 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:23.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279803+0000", 2024-09-14T06:00:23.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2100000000000001e-06 2024-09-14T06:00:23.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279819+0000", 2024-09-14T06:00:23.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6409000000000002e-05 2024-09-14T06:00:23.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279841+0000", 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1878e-05 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279856+0000", 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4392999999999999e-05 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353650+0000", 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073794144000000006 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353757+0000", 2024-09-14T06:00:23.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010687 2024-09-14T06:00:23.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354073+0000", 2024-09-14T06:00:23.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000316562 2024-09-14T06:00:23.298 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.298 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.298 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.298 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59401 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 372736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.298 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.971626607000001, 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074643900999999999, 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59401 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:23.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279878+0000", 2024-09-14T06:00:23.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.31e-06 2024-09-14T06:00:23.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279883+0000", 2024-09-14T06:00:23.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3770000000000004e-06 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279906+0000", 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2398000000000001e-05 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279920+0000", 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.402e-05 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354125+0000", 2024-09-14T06:00:23.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074205750000000001 2024-09-14T06:00:23.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354227+0000", 2024-09-14T06:00:23.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101612 2024-09-14T06:00:23.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354521+0000", 2024-09-14T06:00:23.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029343400000000002 2024-09-14T06:00:23.302 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.302 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.302 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.303 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59402 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 389120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.303 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:23.303 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.971565024, 2024-09-14T06:00:23.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075017027999999999, 2024-09-14T06:00:23.303 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.303 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.303 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.303 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59402 2024-09-14T06:00:23.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279939+0000", 2024-09-14T06:00:23.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2470000000000001e-06 2024-09-14T06:00:23.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279945+0000", 2024-09-14T06:00:23.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-09-14T06:00:23.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279966+0000", 2024-09-14T06:00:23.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1801999999999999e-05 2024-09-14T06:00:23.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279980+0000", 2024-09-14T06:00:23.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3589e-05 2024-09-14T06:00:23.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354569+0000", 2024-09-14T06:00:23.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074588707000000004 2024-09-14T06:00:23.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354671+0000", 2024-09-14T06:00:23.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102398 2024-09-14T06:00:23.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354955+0000", 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028406500000000001 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59403 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 405504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.971503237, 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075434395000000001, 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.307 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.308 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.308 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.308 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59403 2024-09-14T06:00:23.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.308 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:23.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:23.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280001+0000", 2024-09-14T06:00:23.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2669999999999999e-06 2024-09-14T06:00:23.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280008+0000", 2024-09-14T06:00:23.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5849999999999996e-06 2024-09-14T06:00:23.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280030+0000", 2024-09-14T06:00:23.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2293000000000002e-05 2024-09-14T06:00:23.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280044+0000", 2024-09-14T06:00:23.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3974999999999999e-05 2024-09-14T06:00:23.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355013+0000", 2024-09-14T06:00:23.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074969039000000001 2024-09-14T06:00:23.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355144+0000", 2024-09-14T06:00:23.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000131333 2024-09-14T06:00:23.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355434+0000", 2024-09-14T06:00:23.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028990299999999999 2024-09-14T06:00:23.312 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.312 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.312 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.312 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59404 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.312 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:23.312 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.971438118000002, 2024-09-14T06:00:23.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075696103000000001, 2024-09-14T06:00:23.312 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.312 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.312 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.312 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.313 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59404 2024-09-14T06:00:23.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.313 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:23.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:23.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280066+0000", 2024-09-14T06:00:23.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2640000000000001e-06 2024-09-14T06:00:23.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280072+0000", 2024-09-14T06:00:23.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129999999999997e-06 2024-09-14T06:00:23.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280094+0000", 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2608000000000001e-05 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280109+0000", 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355479+0000", 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075370699999999999 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355554+0000", 2024-09-14T06:00:23.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4674999999999999e-05 2024-09-14T06:00:23.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355761+0000", 2024-09-14T06:00:23.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-14T06:00:23.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.316 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.316 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59405 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.316 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:23.317 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.971374208, 2024-09-14T06:00:23.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076008867999999993, 2024-09-14T06:00:23.317 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.317 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.317 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.317 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59405 2024-09-14T06:00:23.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.317 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:23.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:23.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280130+0000", 2024-09-14T06:00:23.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2500000000000001e-06 2024-09-14T06:00:23.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280136+0000", 2024-09-14T06:00:23.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-09-14T06:00:23.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280158+0000", 2024-09-14T06:00:23.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1795000000000001e-05 2024-09-14T06:00:23.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280172+0000", 2024-09-14T06:00:23.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4303e-05 2024-09-14T06:00:23.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355797+0000", 2024-09-14T06:00:23.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075624835000000001 2024-09-14T06:00:23.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355866+0000", 2024-09-14T06:00:23.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9043999999999998e-05 2024-09-14T06:00:23.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356138+0000", 2024-09-14T06:00:23.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027207799999999998 2024-09-14T06:00:23.321 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.321 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.321 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.321 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59406 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.321 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:23.322 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.971310266, 2024-09-14T06:00:23.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076435642999999998, 2024-09-14T06:00:23.322 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.322 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.322 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.322 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59406 2024-09-14T06:00:23.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.322 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:23.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:23.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280194+0000", 2024-09-14T06:00:23.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-14T06:00:23.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280200+0000", 2024-09-14T06:00:23.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6359999999999999e-06 2024-09-14T06:00:23.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280222+0000", 2024-09-14T06:00:23.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1628999999999999e-05 2024-09-14T06:00:23.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280236+0000", 2024-09-14T06:00:23.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4413000000000001e-05 2024-09-14T06:00:23.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356172+0000", 2024-09-14T06:00:23.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075936466999999994 2024-09-14T06:00:23.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356260+0000", 2024-09-14T06:00:23.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7437999999999999e-05 2024-09-14T06:00:23.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356629+0000", 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036877600000000002 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59407 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 471040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.971246033, 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076820083999999997, 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.327 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.327 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59407 2024-09-14T06:00:23.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.327 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:23.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:23.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280258+0000", 2024-09-14T06:00:23.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1370000000000001e-06 2024-09-14T06:00:23.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280264+0000", 2024-09-14T06:00:23.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6930000000000004e-06 2024-09-14T06:00:23.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280285+0000", 2024-09-14T06:00:23.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1455999999999999e-05 2024-09-14T06:00:23.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280300+0000", 2024-09-14T06:00:23.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4319e-05 2024-09-14T06:00:23.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356676+0000", 2024-09-14T06:00:23.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076376615999999994 2024-09-14T06:00:23.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356768+0000", 2024-09-14T06:00:23.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1234000000000001e-05 2024-09-14T06:00:23.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357077+0000", 2024-09-14T06:00:23.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030962900000000001 2024-09-14T06:00:23.330 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.330 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.330 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.331 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59408 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 487424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.331 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:23.331 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.971181033000001, 2024-09-14T06:00:23.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077185511999999998, 2024-09-14T06:00:23.331 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.331 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.331 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.331 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.331 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.331 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.331 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59408 2024-09-14T06:00:23.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.331 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:23.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:23.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280323+0000", 2024-09-14T06:00:23.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2860000000000001e-06 2024-09-14T06:00:23.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280329+0000", 2024-09-14T06:00:23.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.553e-06 2024-09-14T06:00:23.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280352+0000", 2024-09-14T06:00:23.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-14T06:00:23.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280366+0000", 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357126+0000", 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076760326000000004 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357223+0000", 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6490000000000006e-05 2024-09-14T06:00:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357508+0000", 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028479900000000002 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59409 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.971116803000001, 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077536090000000002, 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.335 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.336 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.336 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.336 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.336 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.336 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59409 2024-09-14T06:00:23.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.336 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:23.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:23.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280388+0000", 2024-09-14T06:00:23.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.096e-06 2024-09-14T06:00:23.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280393+0000", 2024-09-14T06:00:23.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T06:00:23.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280414+0000", 2024-09-14T06:00:23.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1175999999999999e-05 2024-09-14T06:00:23.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280427+0000", 2024-09-14T06:00:23.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3032e-05 2024-09-14T06:00:23.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357553+0000", 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077125845999999998 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357624+0000", 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1062000000000005e-05 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357923+0000", 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029891199999999997 2024-09-14T06:00:23.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.340 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.340 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.340 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59410 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:23.340 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:23.340 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.971057491, 2024-09-14T06:00:23.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077854494999999996, 2024-09-14T06:00:23.340 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.340 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.340 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.340 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.340 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.341 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.341 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59410 2024-09-14T06:00:23.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.341 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:23.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:23.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280447+0000", 2024-09-14T06:00:23.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069999999999999e-06 2024-09-14T06:00:23.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280453+0000", 2024-09-14T06:00:23.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-06 2024-09-14T06:00:23.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280471+0000", 2024-09-14T06:00:23.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8295999999999999e-05 2024-09-14T06:00:23.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280484+0000", 2024-09-14T06:00:23.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2609000000000001e-05 2024-09-14T06:00:23.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357954+0000", 2024-09-14T06:00:23.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077470405000000006 2024-09-14T06:00:23.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358040+0000", 2024-09-14T06:00:23.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.551e-05 2024-09-14T06:00:23.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358300+0000", 2024-09-14T06:00:23.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026036800000000003 2024-09-14T06:00:23.344 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.344 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.344 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.344 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.345 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.345 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:23.346 INFO:teuthology.orchestra.run.smithi006.stdout:4876 write 0x7854c99 thru 0x78555a5 (0x90d bytes) 2024-09-14T06:00:23.346 INFO:teuthology.orchestra.run.smithi006.stdout:4877 read 0xa71dcc8 thru 0xa726f91 (0x92ca bytes) 2024-09-14T06:00:23.346 INFO:teuthology.orchestra.run.smithi006.stdout:4879 writesame 0xe5a3d5d thru 0xe5ab5e1 data_size 0x1(0x7885 bytes) 2024-09-14T06:00:23.347 INFO:teuthology.orchestra.run.smithi006.stdout:4880 writesame 0x2759f4b thru 0x275c38b data_size 0x1(0x2441 bytes) 2024-09-14T06:00:23.347 INFO:teuthology.orchestra.run.smithi006.stdout:4881 write 0xbfd58f7 thru 0xbfe2b08 (0xd212 bytes) 2024-09-14T06:00:23.347 INFO:teuthology.orchestra.run.smithi006.stdout:4882 trunc from 0xe5ab5e2 to 0x7548565 2024-09-14T06:00:23.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:00:23.347 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:23.341+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:23.348 INFO:teuthology.orchestra.run.smithi006.stdout:4883 read 0x3881e52 thru 0x3886fc8 (0x5177 bytes) 2024-09-14T06:00:23.348 INFO:teuthology.orchestra.run.smithi006.stdout:4884 read 0x44cd9dc thru 0x44dd685 (0xfcaa bytes) 2024-09-14T06:00:23.361 INFO:teuthology.orchestra.run.smithi006.stdout:4885 trunc from 0x7548565 to 0xe2e44ac 2024-09-14T06:00:23.368 INFO:teuthology.orchestra.run.smithi006.stdout:4886 punch from 0x416e62 to 0x417a4a, (0xbe8 bytes) 2024-09-14T06:00:23.370 INFO:teuthology.orchestra.run.smithi006.stdout:4887 trunc from 0xe2e44ac to 0xd29f6fd 2024-09-14T06:00:23.398 INFO:teuthology.orchestra.run.smithi006.stdout:4888 trunc from 0xd29f6fd to 0x1bb4dfc 2024-09-14T06:00:23.444 INFO:teuthology.orchestra.run.smithi006.stdout:4889 writesame 0x1e6a8e6 thru 0x1e6dc8c data_size 0x1(0x33a7 bytes) 2024-09-14T06:00:23.444 INFO:teuthology.orchestra.run.smithi006.stdout:4890 read 0xb36ad6 thru 0xb39ae8 (0x3013 bytes) 2024-09-14T06:00:23.444 INFO:teuthology.orchestra.run.smithi006.stdout:4891 punch from 0x1dbc933 to 0x1dbedbd, (0x248a bytes) 2024-09-14T06:00:23.447 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:23.445+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:23.466 INFO:teuthology.orchestra.run.smithi006.stdout:4892 writesame 0xac1c483 thru 0xac267aa data_size 0x2e(0xa328 bytes) 2024-09-14T06:00:23.466 INFO:teuthology.orchestra.run.smithi006.stdout:4893 read 0x1496892 thru 0x14977f5 (0xf64 bytes) 2024-09-14T06:00:23.466 INFO:teuthology.orchestra.run.smithi006.stdout:4894 writesame 0x19bef51 thru 0x19cb171 data_size 0x1(0xc221 bytes) 2024-09-14T06:00:23.487 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:87898 3.11 3:89ba0271:::rbd_data.1127f62ba4e4.0000000000000061:head [call rbd.sparse_copyup in=24b,set-alloc-hint object_size 262144 write_size 262144,write-same in=1b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T06:00:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:23.471157+0000", 2024-09-14T06:00:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.017460218999999999, 2024-09-14T06:00:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017507963000000001, 2024-09-14T06:00:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-09-14T06:00:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 87898 2024-09-14T06:00:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:23.471157+0000", 2024-09-14T06:00:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:23.471157+0000", 2024-09-14T06:00:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:23.471159+0000", 2024-09-14T06:00:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8870000000000001e-06 2024-09-14T06:00:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:23.471167+0000", 2024-09-14T06:00:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2370000000000003e-06 2024-09-14T06:00:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:23.471185+0000", 2024-09-14T06:00:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8864000000000001e-05 2024-09-14T06:00:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:23.471194+0000", 2024-09-14T06:00:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0040000000000005e-06 2024-09-14T06:00:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:23.471258+0000", 2024-09-14T06:00:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3338999999999998e-05 2024-09-14T06:00:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:23.471382+0000", 2024-09-14T06:00:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012395700000000001 2024-09-14T06:00:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:00:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:23.476718+0000", 2024-09-14T06:00:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053361060000000002 2024-09-14T06:00:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-09-14T06:00:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 1 2024-09-14T06:00:23.492 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:23.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:00:23.509 INFO:teuthology.orchestra.run.smithi006.stdout:4896 write 0x7f5257 thru 0x7f7000 (0x1daa bytes) 2024-09-14T06:00:23.517 INFO:teuthology.orchestra.run.smithi006.stdout:4897 read 0xab1a138 thru 0xab1cf13 (0x2ddc bytes) 2024-09-14T06:00:23.517 INFO:teuthology.orchestra.run.smithi006.stdout:4898 writesame 0x3b148ca thru 0x3b1affe data_size 0x1(0x6735 bytes) 2024-09-14T06:00:23.529 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:00:23.531 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T06:00:23.549 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:23.547+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:23.550 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-09-14T06:00:23.489157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":826412410,"num_objects":1368,"num_object_clones":254,"num_object_copies":2736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1368,"num_whiteouts":514,"num_read":116604,"num_read_kb":428107,"num_write":17467,"num_write_kb":254135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":5610454,"num_keys_recovered":69,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13618,"ondisk_log_size":13618,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":448504,"kb_used_data":163268,"kb_used_omap":15,"kb_used_meta":284976,"kb_avail":754526216,"statfs":{"total":773094113280,"available":772634845184,"internally_reserved":0,"allocated":167186432,"data_stored":213876544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":291816220},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":82949223,"num_objects":50,"num_object_clones":16,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":14,"num_read":3363,"num_read_kb":7337,"num_write":586,"num_write_kb":6768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001114"},"pg_stats":[{"pgid":"3.1f","version":"74'450","reported_seq":1851,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-14T06:00:18.561658+0000","last_change":"2024-09-14T05:59:43.763150+0000","last_active":"2024-09-14T06:00:18.561658+0000","last_peered":"2024-09-14T06:00:18.561658+0000","last_clean":"2024-09-14T06:00:18.561658+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T06:00:18.561658+0000","last_undegraded":"2024-09-14T06:00:18.561658+0000","last_fullsized":"2024-09-14T06:00:18.561658+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:48.283822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001224482,"stat_sum":{"num_bytes":34014237,"num_objects":48,"num_object_clones":8,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":21,"num_read":3189,"num_read_kb":12209,"num_write":560,"num_write_kb":2865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"78'409","reported_seq":2382,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.579102+0000","last_change":"2024-09-14T05:59:08.299658+0000","last_active":"2024-09-14T06:00:21.579102+0000","last_peered":"2024-09-14T06:00:21.579102+0000","last_clean":"2024-09-14T06:00:21.579102+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T06:00:21.579102+0000","last_undegraded":"2024-09-14T06:00:21.579102+0000","last_fullsized":"2024-09-14T06:00:21.579102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:20.830746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882171,"stat_sum":{"num_bytes":20778727,"num_objects":37,"num_object_clones":7,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":10,"num_read":2852,"num_read_kb":5737,"num_write":543,"num_write_kb":9021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"77'224","reported_seq":3696,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576738+0000","last_change":"2024-09-14T05:59:08.293155+0000","last_active":"2024-09-14T06:00:21.576738+0000","last_peered":"2024-09-14T06:00:21.576738+0000","last_clean":"2024-09-14T06:00:21.576738+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T06:00:21.576738+0000","last_undegraded":"2024-09-14T06:00:21.576738+0000","last_fullsized":"2024-09-14T06:00:21.576738+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:04.326844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000618802,"stat_sum":{"num_bytes":12487728,"num_objects":31,"num_object_clones":3,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":10,"num_read":3463,"num_read_kb":12801,"num_write":258,"num_write_kb":20395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"79'270","reported_seq":3356,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.601516+0000","last_change":"2024-09-14T05:59:08.294498+0000","last_active":"2024-09-14T06:00:21.601516+0000","last_peered":"2024-09-14T06:00:21.601516+0000","last_clean":"2024-09-14T06:00:21.601516+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T06:00:21.601516+0000","last_undegraded":"2024-09-14T06:00:21.601516+0000","last_fullsized":"2024-09-14T06:00:21.601516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:04.755037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014905350000000001,"stat_sum":{"num_bytes":15057371,"num_objects":45,"num_object_clones":8,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":22,"num_read":3069,"num_read_kb":10183,"num_write":260,"num_write_kb":5962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'362","reported_seq":926,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-14T06:00:18.561144+0000","last_change":"2024-09-14T05:59:40.834308+0000","last_active":"2024-09-14T06:00:18.561144+0000","last_peered":"2024-09-14T06:00:18.561144+0000","last_clean":"2024-09-14T06:00:18.561144+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T06:00:18.561144+0000","last_undegraded":"2024-09-14T06:00:18.561144+0000","last_fullsized":"2024-09-14T06:00:18.561144+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:56.432574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5370068,"num_objects":42,"num_object_clones":9,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":21,"num_read":1743,"num_read_kb":2739,"num_write":366,"num_write_kb":3158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"79'524","reported_seq":2624,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.606895+0000","last_change":"2024-09-14T05:59:08.282710+0000","last_active":"2024-09-14T06:00:21.606895+0000","last_peered":"2024-09-14T06:00:21.606895+0000","last_clean":"2024-09-14T06:00:21.606895+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T06:00:21.606895+0000","last_undegraded":"2024-09-14T06:00:21.606895+0000","last_fullsized":"2024-09-14T06:00:21.606895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:27:47.943734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078735700000000003,"stat_sum":{"num_bytes":8694258,"num_objects":33,"num_object_clones":3,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":14,"num_read":4043,"num_read_kb":7374,"num_write":674,"num_write_kb":4703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"79'295","reported_seq":1851,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.606240+0000","last_change":"2024-09-14T05:59:08.283122+0000","last_active":"2024-09-14T06:00:21.606240+0000","last_peered":"2024-09-14T06:00:21.606240+0000","last_clean":"2024-09-14T06:00:21.606240+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T06:00:21.606240+0000","last_undegraded":"2024-09-14T06:00:21.606240+0000","last_fullsized":"2024-09-14T06:00:21.606240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:02.340070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020244989999999999,"stat_sum":{"num_bytes":25889839,"num_objects":36,"num_object_clones":4,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":13,"num_read":1970,"num_read_kb":9004,"num_write":316,"num_write_kb":7826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"74'379","reported_seq":4065,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.579338+0000","last_change":"2024-09-14T05:59:43.761389+0000","last_active":"2024-09-14T06:00:21.579338+0000","last_peered":"2024-09-14T06:00:21.579338+0000","last_clean":"2024-09-14T06:00:21.579338+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T06:00:21.579338+0000","last_undegraded":"2024-09-14T06:00:21.579338+0000","last_fullsized":"2024-09-14T06:00:21.579338+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:29.674376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090099400000000001,"stat_sum":{"num_bytes":47785170,"num_objects":47,"num_object_clones":10,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":17,"num_read":5354,"num_read_kb":28960,"num_write":386,"num_write_kb":5089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"70'257","reported_seq":2169,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-14T06:00:18.561364+0000","last_change":"2024-09-14T05:59:40.929839+0000","last_active":"2024-09-14T06:00:18.561364+0000","last_peered":"2024-09-14T06:00:18.561364+0000","last_clean":"2024-09-14T06:00:18.561364+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T06:00:18.561364+0000","last_undegraded":"2024-09-14T06:00:18.561364+0000","last_fullsized":"2024-09-14T06:00:18.561364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:44:00.208657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18345553,"num_objects":41,"num_object_clones":10,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":18,"num_read":2379,"num_read_kb":13855,"num_write":246,"num_write_kb":4427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"78'1353","reported_seq":2994,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576805+0000","last_change":"2024-09-14T05:59:08.293088+0000","last_active":"2024-09-14T06:00:21.576805+0000","last_peered":"2024-09-14T06:00:21.576805+0000","last_clean":"2024-09-14T06:00:21.576805+0000","last_became_active":"2024-09-14T05:59:06.296607+0000","last_became_peered":"2024-09-14T05:59:06.296607+0000","last_unstale":"2024-09-14T06:00:21.576805+0000","last_undegraded":"2024-09-14T06:00:21.576805+0000","last_fullsized":"2024-09-14T06:00:21.576805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1353,"log_dups_size":0,"ondisk_log_size":1353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:31.445038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056627299999999995,"stat_sum":{"num_bytes":35252280,"num_objects":39,"num_object_clones":9,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":12,"num_read":7780,"num_read_kb":14392,"num_write":2352,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"77'536","reported_seq":3865,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.613026+0000","last_change":"2024-09-14T05:59:08.370304+0000","last_active":"2024-09-14T06:00:21.613026+0000","last_peered":"2024-09-14T06:00:21.613026+0000","last_clean":"2024-09-14T06:00:21.613026+0000","last_became_active":"2024-09-14T05:59:06.295335+0000","last_became_peered":"2024-09-14T05:59:06.295335+0000","last_unstale":"2024-09-14T06:00:21.613026+0000","last_undegraded":"2024-09-14T06:00:21.613026+0000","last_fullsized":"2024-09-14T06:00:21.613026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:04:36.006987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001779487,"stat_sum":{"num_bytes":49261121,"num_objects":62,"num_object_clones":16,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":25,"num_read":5281,"num_read_kb":30445,"num_write":676,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"78'468","reported_seq":4187,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.575789+0000","last_change":"2024-09-14T05:59:08.282513+0000","last_active":"2024-09-14T06:00:21.575789+0000","last_peered":"2024-09-14T06:00:21.575789+0000","last_clean":"2024-09-14T06:00:21.575789+0000","last_became_active":"2024-09-14T05:59:06.307548+0000","last_became_peered":"2024-09-14T05:59:06.307548+0000","last_unstale":"2024-09-14T06:00:21.575789+0000","last_undegraded":"2024-09-14T06:00:21.575789+0000","last_fullsized":"2024-09-14T06:00:21.575789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:47.300695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061538200000000004,"stat_sum":{"num_bytes":17242668,"num_objects":36,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":13,"num_read":4978,"num_read_kb":16010,"num_write":687,"num_write_kb":7895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-14T06:00:20.584915+0000","last_change":"2024-09-14T05:58:56.312544+0000","last_active":"2024-09-14T06:00:20.584915+0000","last_peered":"2024-09-14T06:00:20.584915+0000","last_clean":"2024-09-14T06:00:20.584915+0000","last_became_active":"2024-09-14T05:58:54.103612+0000","last_became_peered":"2024-09-14T05:58:54.103612+0000","last_unstale":"2024-09-14T06:00:20.584915+0000","last_undegraded":"2024-09-14T06:00:20.584915+0000","last_fullsized":"2024-09-14T06:00:20.584915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:08.678742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"74'540","reported_seq":3161,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-14T06:00:18.679954+0000","last_change":"2024-09-14T05:59:43.762927+0000","last_active":"2024-09-14T06:00:18.679954+0000","last_peered":"2024-09-14T06:00:18.679954+0000","last_clean":"2024-09-14T06:00:18.679954+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T06:00:18.679954+0000","last_undegraded":"2024-09-14T06:00:18.679954+0000","last_fullsized":"2024-09-14T06:00:18.679954+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:48.210100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19066315,"num_objects":40,"num_object_clones":6,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":14,"num_read":4879,"num_read_kb":11491,"num_write":652,"num_write_kb":4703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.577088+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T06:00:21.577088+0000","last_peered":"2024-09-14T06:00:21.577088+0000","last_clean":"2024-09-14T06:00:21.577088+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T06:00:21.577088+0000","last_undegraded":"2024-09-14T06:00:21.577088+0000","last_fullsized":"2024-09-14T06:00:21.577088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"78'316","reported_seq":3981,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.579186+0000","last_change":"2024-09-14T05:59:08.299312+0000","last_active":"2024-09-14T06:00:21.579186+0000","last_peered":"2024-09-14T06:00:21.579186+0000","last_clean":"2024-09-14T06:00:21.579186+0000","last_became_active":"2024-09-14T05:59:06.302779+0000","last_became_peered":"2024-09-14T05:59:06.302779+0000","last_unstale":"2024-09-14T06:00:21.579186+0000","last_undegraded":"2024-09-14T06:00:21.579186+0000","last_fullsized":"2024-09-14T06:00:21.579186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:04.029259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001533155,"stat_sum":{"num_bytes":61627479,"num_objects":51,"num_object_clones":8,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":17,"num_read":3609,"num_read_kb":26720,"num_write":334,"num_write_kb":13300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.613503+0000","last_change":"2024-09-14T05:59:40.765463+0000","last_active":"2024-09-14T06:00:21.613503+0000","last_peered":"2024-09-14T06:00:21.613503+0000","last_clean":"2024-09-14T06:00:21.613503+0000","last_became_active":"2024-09-14T05:59:40.764785+0000","last_became_peered":"2024-09-14T05:59:40.764785+0000","last_unstale":"2024-09-14T06:00:21.613503+0000","last_undegraded":"2024-09-14T06:00:21.613503+0000","last_fullsized":"2024-09-14T06:00:21.613503+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:47.547246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"77'250","reported_seq":2115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576983+0000","last_change":"2024-09-14T05:59:08.282105+0000","last_active":"2024-09-14T06:00:21.576983+0000","last_peered":"2024-09-14T06:00:21.576983+0000","last_clean":"2024-09-14T06:00:21.576983+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T06:00:21.576983+0000","last_undegraded":"2024-09-14T06:00:21.576983+0000","last_fullsized":"2024-09-14T06:00:21.576983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:51:42.343777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010945919999999999,"stat_sum":{"num_bytes":19085586,"num_objects":33,"num_object_clones":5,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":14,"num_read":1993,"num_read_kb":4581,"num_write":300,"num_write_kb":3411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576939+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T06:00:21.576939+0000","last_peered":"2024-09-14T06:00:21.576939+0000","last_clean":"2024-09-14T06:00:21.576939+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T06:00:21.576939+0000","last_undegraded":"2024-09-14T06:00:21.576939+0000","last_fullsized":"2024-09-14T06:00:21.576939+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"77'333","reported_seq":3460,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576921+0000","last_change":"2024-09-14T05:59:08.293368+0000","last_active":"2024-09-14T06:00:21.576921+0000","last_peered":"2024-09-14T06:00:21.576921+0000","last_clean":"2024-09-14T06:00:21.576921+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T06:00:21.576921+0000","last_undegraded":"2024-09-14T06:00:21.576921+0000","last_fullsized":"2024-09-14T06:00:21.576921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:37.491681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072033799999999995,"stat_sum":{"num_bytes":11192414,"num_objects":41,"num_object_clones":8,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":16,"num_read":4434,"num_read_kb":12530,"num_write":315,"num_write_kb":2935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"76'254","reported_seq":1201,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.575558+0000","last_change":"2024-09-14T05:59:40.846399+0000","last_active":"2024-09-14T06:00:21.575558+0000","last_peered":"2024-09-14T06:00:21.575558+0000","last_clean":"2024-09-14T06:00:21.575558+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T06:00:21.575558+0000","last_undegraded":"2024-09-14T06:00:21.575558+0000","last_fullsized":"2024-09-14T06:00:21.575558+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:10.986760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047912600000000002,"stat_sum":{"num_bytes":55872928,"num_objects":33,"num_object_clones":5,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":12,"num_read":815,"num_read_kb":10865,"num_write":253,"num_write_kb":4941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576102+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T06:00:21.576102+0000","last_peered":"2024-09-14T06:00:21.576102+0000","last_clean":"2024-09-14T06:00:21.576102+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T06:00:21.576102+0000","last_undegraded":"2024-09-14T06:00:21.576102+0000","last_fullsized":"2024-09-14T06:00:21.576102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"78'827","reported_seq":2259,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576949+0000","last_change":"2024-09-14T05:59:08.281926+0000","last_active":"2024-09-14T06:00:21.576949+0000","last_peered":"2024-09-14T06:00:21.576949+0000","last_clean":"2024-09-14T06:00:21.576949+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T06:00:21.576949+0000","last_undegraded":"2024-09-14T06:00:21.576949+0000","last_fullsized":"2024-09-14T06:00:21.576949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:01:49.280883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096925799999999997,"stat_sum":{"num_bytes":20832519,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":17,"num_read":4480,"num_read_kb":16493,"num_write":1293,"num_write_kb":11794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-14T06:00:22.586404+0000","last_change":"2024-09-14T05:58:56.096637+0000","last_active":"2024-09-14T06:00:22.586404+0000","last_peered":"2024-09-14T06:00:22.586404+0000","last_clean":"2024-09-14T06:00:22.586404+0000","last_became_active":"2024-09-14T05:58:54.356560+0000","last_became_peered":"2024-09-14T05:58:54.356560+0000","last_unstale":"2024-09-14T06:00:22.586404+0000","last_undegraded":"2024-09-14T06:00:22.586404+0000","last_fullsized":"2024-09-14T06:00:22.586404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:10.136136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012156140000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"72'304","reported_seq":1232,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-14T06:00:18.679365+0000","last_change":"2024-09-14T05:59:40.894081+0000","last_active":"2024-09-14T06:00:18.679365+0000","last_peered":"2024-09-14T06:00:18.679365+0000","last_clean":"2024-09-14T06:00:18.679365+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T06:00:18.679365+0000","last_undegraded":"2024-09-14T06:00:18.679365+0000","last_fullsized":"2024-09-14T06:00:18.679365+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:42.490838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18162471,"num_objects":49,"num_object_clones":10,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":18,"num_read":1097,"num_read_kb":12117,"num_write":313,"num_write_kb":7494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.612711+0000","last_change":"2024-09-14T05:58:56.593338+0000","last_active":"2024-09-14T06:00:21.612711+0000","last_peered":"2024-09-14T06:00:21.612711+0000","last_clean":"2024-09-14T06:00:21.612711+0000","last_became_active":"2024-09-14T05:58:54.099699+0000","last_became_peered":"2024-09-14T05:58:54.099699+0000","last_unstale":"2024-09-14T06:00:21.612711+0000","last_undegraded":"2024-09-14T06:00:21.612711+0000","last_fullsized":"2024-09-14T06:00:21.612711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:40.481832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"70'201","reported_seq":1429,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.579064+0000","last_change":"2024-09-14T05:59:08.298483+0000","last_active":"2024-09-14T06:00:21.579064+0000","last_peered":"2024-09-14T06:00:21.579064+0000","last_clean":"2024-09-14T06:00:21.579064+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T06:00:21.579064+0000","last_undegraded":"2024-09-14T06:00:21.579064+0000","last_fullsized":"2024-09-14T06:00:21.579064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:06:21.894669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011244670000000001,"stat_sum":{"num_bytes":11599098,"num_objects":35,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":14,"num_read":1184,"num_read_kb":13382,"num_write":244,"num_write_kb":5044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.575850+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T06:00:21.575850+0000","last_peered":"2024-09-14T06:00:21.575850+0000","last_clean":"2024-09-14T06:00:21.575850+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T06:00:21.575850+0000","last_undegraded":"2024-09-14T06:00:21.575850+0000","last_fullsized":"2024-09-14T06:00:21.575850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":234,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.612738+0000","last_change":"2024-09-14T05:59:40.766729+0000","last_active":"2024-09-14T06:00:21.612738+0000","last_peered":"2024-09-14T06:00:21.612738+0000","last_clean":"2024-09-14T06:00:21.612738+0000","last_became_active":"2024-09-14T05:59:40.765914+0000","last_became_peered":"2024-09-14T05:59:40.765914+0000","last_unstale":"2024-09-14T06:00:21.612738+0000","last_undegraded":"2024-09-14T06:00:21.612738+0000","last_fullsized":"2024-09-14T06:00:21.612738+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:02.407639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"77'534","reported_seq":1555,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.579092+0000","last_change":"2024-09-14T05:59:08.298535+0000","last_active":"2024-09-14T06:00:21.579092+0000","last_peered":"2024-09-14T06:00:21.579092+0000","last_clean":"2024-09-14T06:00:21.579092+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T06:00:21.579092+0000","last_undegraded":"2024-09-14T06:00:21.579092+0000","last_fullsized":"2024-09-14T06:00:21.579092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:02.845527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085964400000000001,"stat_sum":{"num_bytes":18041420,"num_objects":40,"num_object_clones":7,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":13,"num_read":2676,"num_read_kb":5194,"num_write":769,"num_write_kb":2437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"79'223","reported_seq":2381,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.631900+0000","last_change":"2024-09-14T05:59:08.282238+0000","last_active":"2024-09-14T06:00:21.631900+0000","last_peered":"2024-09-14T06:00:21.631900+0000","last_clean":"2024-09-14T06:00:21.631900+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T06:00:21.631900+0000","last_undegraded":"2024-09-14T06:00:21.631900+0000","last_fullsized":"2024-09-14T06:00:21.631900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:51:42.121460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052576800000000003,"stat_sum":{"num_bytes":28985383,"num_objects":36,"num_object_clones":4,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":9,"num_read":2057,"num_read_kb":8123,"num_write":238,"num_write_kb":18683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"77'332","reported_seq":1816,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-14T06:00:20.584816+0000","last_change":"2024-09-14T05:59:08.303592+0000","last_active":"2024-09-14T06:00:20.584816+0000","last_peered":"2024-09-14T06:00:20.584816+0000","last_clean":"2024-09-14T06:00:20.584816+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T06:00:20.584816+0000","last_undegraded":"2024-09-14T06:00:20.584816+0000","last_fullsized":"2024-09-14T06:00:20.584816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:16.411748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035228000000000001,"stat_sum":{"num_bytes":29757425,"num_objects":48,"num_object_clones":11,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":18,"num_read":2203,"num_read_kb":8993,"num_write":372,"num_write_kb":3982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"78'706","reported_seq":1501,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.579295+0000","last_change":"2024-09-14T05:59:40.885530+0000","last_active":"2024-09-14T06:00:21.579295+0000","last_peered":"2024-09-14T06:00:21.579295+0000","last_clean":"2024-09-14T06:00:21.579295+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T06:00:21.579295+0000","last_undegraded":"2024-09-14T06:00:21.579295+0000","last_fullsized":"2024-09-14T06:00:21.579295+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:47:23.624073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083256200000000002,"stat_sum":{"num_bytes":8260195,"num_objects":37,"num_object_clones":6,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":11,"num_read":3815,"num_read_kb":5343,"num_write":1151,"num_write_kb":5480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"78'395","reported_seq":4410,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.576694+0000","last_change":"2024-09-14T05:59:08.294210+0000","last_active":"2024-09-14T06:00:21.576694+0000","last_peered":"2024-09-14T06:00:21.576694+0000","last_clean":"2024-09-14T06:00:21.576694+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T06:00:21.576694+0000","last_undegraded":"2024-09-14T06:00:21.576694+0000","last_fullsized":"2024-09-14T06:00:21.576694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:04.122151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013095159999999999,"stat_sum":{"num_bytes":37167361,"num_objects":47,"num_object_clones":8,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":19,"num_read":5549,"num_read_kb":20943,"num_write":381,"num_write_kb":9879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"78'270","reported_seq":2355,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.613497+0000","last_change":"2024-09-14T05:59:08.371003+0000","last_active":"2024-09-14T06:00:21.613497+0000","last_peered":"2024-09-14T06:00:21.613497+0000","last_clean":"2024-09-14T06:00:21.613497+0000","last_became_active":"2024-09-14T05:59:06.300360+0000","last_became_peered":"2024-09-14T05:59:06.300360+0000","last_unstale":"2024-09-14T06:00:21.613497+0000","last_undegraded":"2024-09-14T06:00:21.613497+0000","last_fullsized":"2024-09-14T06:00:21.613497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:43.808752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022610920000000001,"stat_sum":{"num_bytes":15481138,"num_objects":35,"num_object_clones":8,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":13,"num_read":2833,"num_read_kb":10858,"num_write":285,"num_write_kb":5290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"76'281","reported_seq":2561,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.613310+0000","last_change":"2024-09-14T05:59:08.370421+0000","last_active":"2024-09-14T06:00:21.613310+0000","last_peered":"2024-09-14T06:00:21.613310+0000","last_clean":"2024-09-14T06:00:21.613310+0000","last_became_active":"2024-09-14T05:59:06.308504+0000","last_became_peered":"2024-09-14T05:59:06.308504+0000","last_unstale":"2024-09-14T06:00:21.613310+0000","last_undegraded":"2024-09-14T06:00:21.613310+0000","last_fullsized":"2024-09-14T06:00:21.613310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:35:41.967843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001798163,"stat_sum":{"num_bytes":17954071,"num_objects":52,"num_object_clones":11,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":19,"num_read":2788,"num_read_kb":13988,"num_write":299,"num_write_kb":4326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"77'441","reported_seq":5475,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.613476+0000","last_change":"2024-09-14T05:59:08.370940+0000","last_active":"2024-09-14T06:00:21.613476+0000","last_peered":"2024-09-14T06:00:21.613476+0000","last_clean":"2024-09-14T06:00:21.613476+0000","last_became_active":"2024-09-14T05:59:06.302019+0000","last_became_peered":"2024-09-14T05:59:06.302019+0000","last_unstale":"2024-09-14T06:00:21.613476+0000","last_undegraded":"2024-09-14T06:00:21.613476+0000","last_fullsized":"2024-09-14T06:00:21.613476+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:37.390824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022861499999999998,"stat_sum":{"num_bytes":26249919,"num_objects":41,"num_object_clones":5,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":6578,"num_read_kb":12669,"num_write":539,"num_write_kb":5561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"78'715","reported_seq":2778,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.115400+0000","last_change":"2024-09-14T05:59:43.767147+0000","last_active":"2024-09-14T06:00:21.115400+0000","last_peered":"2024-09-14T06:00:21.115400+0000","last_clean":"2024-09-14T06:00:21.115400+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T06:00:21.115400+0000","last_undegraded":"2024-09-14T06:00:21.115400+0000","last_fullsized":"2024-09-14T06:00:21.115400+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:53.072436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047002699999999998,"stat_sum":{"num_bytes":37080104,"num_objects":56,"num_object_clones":12,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":23,"num_read":5150,"num_read_kb":10611,"num_write":1035,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"76'371","reported_seq":5460,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.612902+0000","last_change":"2024-09-14T05:59:08.369705+0000","last_active":"2024-09-14T06:00:21.612902+0000","last_peered":"2024-09-14T06:00:21.612902+0000","last_clean":"2024-09-14T06:00:21.612902+0000","last_became_active":"2024-09-14T05:59:06.311716+0000","last_became_peered":"2024-09-14T05:59:06.311716+0000","last_unstale":"2024-09-14T06:00:21.612902+0000","last_undegraded":"2024-09-14T06:00:21.612902+0000","last_fullsized":"2024-09-14T06:00:21.612902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:08.964290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001347256,"stat_sum":{"num_bytes":42290429,"num_objects":46,"num_object_clones":6,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":16,"num_read":5835,"num_read_kb":29571,"num_write":487,"num_write_kb":26932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"76'468","reported_seq":3320,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-14T06:00:18.743110+0000","last_change":"2024-09-14T05:59:43.765786+0000","last_active":"2024-09-14T06:00:18.743110+0000","last_peered":"2024-09-14T06:00:18.743110+0000","last_clean":"2024-09-14T06:00:18.743110+0000","last_became_active":"2024-09-14T05:59:43.763983+0000","last_became_peered":"2024-09-14T05:59:43.763983+0000","last_unstale":"2024-09-14T06:00:18.743110+0000","last_undegraded":"2024-09-14T06:00:18.743110+0000","last_fullsized":"2024-09-14T06:00:18.743110+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:29.106648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18390954,"num_objects":50,"num_object_clones":8,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":26,"num_read":3795,"num_read_kb":9298,"num_write":515,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":767927,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"78'255","reported_seq":4996,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T06:00:21.613232+0000","last_change":"2024-09-14T05:59:08.369685+0000","last_active":"2024-09-14T06:00:21.613232+0000","last_peered":"2024-09-14T06:00:21.613232+0000","last_clean":"2024-09-14T06:00:21.613232+0000","last_became_active":"2024-09-14T05:59:06.302125+0000","last_became_peered":"2024-09-14T05:59:06.302125+0000","last_unstale":"2024-09-14T06:00:21.613232+0000","last_undegraded":"2024-09-14T06:00:21.613232+0000","last_fullsized":"2024-09-14T06:00:21.613232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:56.156199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012750369999999999,"stat_sum":{"num_bytes":38545794,"num_objects":55,"num_object_clones":16,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":17,"num_read":4667,"num_read_kb":20573,"num_write":265,"num_write_kb":9153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":825822023,"num_objects":1364,"num_object_clones":254,"num_object_copies":2728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1364,"num_whiteouts":514,"num_read":116538,"num_read_kb":428052,"num_write":17364,"num_write_kb":252505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":5610454,"num_keys_recovered":69,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":158666752,"data_stored":209321392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13543,"ondisk_log_size":13543,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43016,"kb_used_data":7664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328824,"statfs":{"total":96636764160,"available":96592715776,"internally_reserved":0,"allocated":7847936,"data_stored":10344702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495625,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62416,"kb_used_data":21952,"kb_used_omap":4,"kb_used_meta":40443,"kb_avail":94309424,"statfs":{"total":96636764160,"available":96572850176,"internally_reserved":0,"allocated":22478848,"data_stored":32182561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":41414320},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77140,"kb_used_data":32004,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94294700,"statfs":{"total":96636764160,"available":96557772800,"internally_reserved":0,"allocated":32772096,"data_stored":40977332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40116,"kb_used_data":8920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331724,"statfs":{"total":96636764160,"available":96595685376,"internally_reserved":0,"allocated":9134080,"data_stored":12052072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61836,"kb_used_data":22332,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94310004,"statfs":{"total":96636764160,"available":96573444096,"internally_reserved":0,"allocated":22867968,"data_stored":26565533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57688,"kb_used_data":30664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94314152,"statfs":{"total":96636764160,"available":96577691648,"internally_reserved":0,"allocated":31399936,"data_stored":39590253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53932,"kb_used_data":26876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94317908,"statfs":{"total":96636764160,"available":96581537792,"internally_reserved":0,"allocated":27521024,"data_stored":33587181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542165,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52360,"kb_used_data":12856,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319480,"statfs":{"total":96636764160,"available":96583147520,"internally_reserved":0,"allocated":13164544,"data_stored":18576910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21000192,"data_stored":31191114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12271616,"data_stored":18182636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6926336,"data_stored":9925629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26611712,"data_stored":33174227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":30466048,"data_stored":39140584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21958656,"data_stored":26152600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8138752,"data_stored":11559688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":31293440,"data_stored":39994914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T06:00:23.552 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T06:00:23.552 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T06:00:23.553 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T06:00:23.553 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.000000 2024-09-14T06:00:23.553 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0 2024-09-14T06:00:23.553 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:23.554 INFO:teuthology.orchestra.run.smithi006.stdout:4900 write 0x68eabee thru 0x68f3fee (0x9401 bytes) 2024-09-14T06:00:23.559 INFO:teuthology.orchestra.run.smithi006.stdout:4901 write 0x171f588 thru 0x17294e5 (0x9f5e bytes) 2024-09-14T06:00:23.576 INFO:teuthology.orchestra.run.smithi006.stdout:4902 write 0xd7f136f thru 0xd7fde42 (0xcad4 bytes) 2024-09-14T06:00:23.589 INFO:teuthology.orchestra.run.smithi006.stdout:4903 read 0x6035450 thru 0x603a8be (0x546f bytes) 2024-09-14T06:00:23.589 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:23.589 INFO:teuthology.orchestra.run.smithi006.stdout:4905 read 0xcdd4073 thru 0xcde03cc (0xc35a bytes) 2024-09-14T06:00:23.589 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:23.589 INFO:teuthology.orchestra.run.smithi006.stdout:4907 trunc from 0xd7fde43 to 0xc1db448 2024-09-14T06:00:23.596 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2024-09-14T06:00:23.602 INFO:teuthology.orchestra.run.smithi006.stdout:4908 read 0x368cfc7 thru 0x3695d85 (0x8dbf bytes) 2024-09-14T06:00:23.602 INFO:teuthology.orchestra.run.smithi006.stdout:4909 punch from 0xc0f9e14 to 0xc0fa0b6, (0x2a2 bytes) 2024-09-14T06:00:23.602 INFO:teuthology.orchestra.run.smithi006.stdout:4911 read 0xb903d46 thru 0xb91217c (0xe437 bytes) 2024-09-14T06:00:23.602 INFO:teuthology.orchestra.run.smithi006.stdout:4912 write 0x7064b61 thru 0x70724bf (0xd95f bytes) 2024-09-14T06:00:23.611 INFO:teuthology.orchestra.run.smithi006.stdout:4913 read 0x344d40a thru 0x3456e39 (0x9a30 bytes) 2024-09-14T06:00:23.611 INFO:teuthology.orchestra.run.smithi006.stdout:4914 read 0xbb8067c thru 0xbb80d31 (0x6b6 bytes) 2024-09-14T06:00:23.612 INFO:teuthology.orchestra.run.smithi006.stdout:4915 read 0x337604c thru 0x337ffa7 (0x9f5c bytes) 2024-09-14T06:00:23.612 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:23.612 INFO:teuthology.orchestra.run.smithi006.stdout:4917 writesame 0x582f623 thru 0x583ae44 data_size 0x2(0xb822 bytes) 2024-09-14T06:00:23.623 INFO:teuthology.orchestra.run.smithi006.stdout:4918 read 0x401ce7d thru 0x4020977 (0x3afb bytes) 2024-09-14T06:00:23.624 INFO:teuthology.orchestra.run.smithi006.stdout:4922 write 0x8bb168d thru 0x8bbc077 (0xa9eb bytes) 2024-09-14T06:00:23.624 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:00:23.628 INFO:teuthology.orchestra.run.smithi006.stdout:4923 read 0x5e6a19c thru 0x5e6ac4c (0xab1 bytes) 2024-09-14T06:00:23.628 INFO:teuthology.orchestra.run.smithi006.stdout:4924 writesame 0x3db19ef thru 0x3db241a data_size 0x2(0xa2c bytes) 2024-09-14T06:00:23.634 INFO:teuthology.orchestra.run.smithi006.stdout:4926 read 0xbb49070 thru 0xbb511b8 (0x8149 bytes) 2024-09-14T06:00:23.634 INFO:teuthology.orchestra.run.smithi006.stdout:4927 punch from 0x7a5143b to 0x7a60d6f, (0xf934 bytes) 2024-09-14T06:00:23.635 INFO:teuthology.orchestra.run.smithi006.stdout:4928 writesame 0x948d615 thru 0x94971f3 data_size 0x3(0x9bdf bytes) 2024-09-14T06:00:23.640 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:23.641 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:23.645 INFO:teuthology.orchestra.run.smithi006.stdout:4929 read 0xdc015c thru 0xdc229b (0x2140 bytes) 2024-09-14T06:00:23.648 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:23.643+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:23.656 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:00:23.657 INFO:teuthology.orchestra.run.smithi006.stdout:4930 write 0xd7045e2 thru 0xd70bafa (0x7519 bytes) 2024-09-14T06:00:23.660 INFO:teuthology.orchestra.run.smithi006.stdout:4931 write 0x7b09ba9 thru 0x7b1010a (0x6562 bytes) 2024-09-14T06:00:23.664 INFO:teuthology.orchestra.run.smithi006.stdout:4932 writesame 0xffd1ae thru 0x10087e0 data_size 0x1(0xb633 bytes) 2024-09-14T06:00:23.692 INFO:teuthology.orchestra.run.smithi006.stdout:4934 write 0x2acd242 thru 0x2ad0bc7 (0x3986 bytes) 2024-09-14T06:00:23.709 INFO:teuthology.orchestra.run.smithi006.stdout:4935 trunc from 0xd70bafb to 0x5bea7d8 2024-09-14T06:00:23.724 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:23.724 INFO:teuthology.orchestra.run.smithi006.stdout:4937 read 0x1df919b thru 0x1dfb518 (0x237e bytes) 2024-09-14T06:00:23.733 INFO:teuthology.orchestra.run.smithi006.stdout:4938 write 0x743b5c5 thru 0x7444907 (0x9343 bytes) 2024-09-14T06:00:23.745 INFO:teuthology.orchestra.run.smithi006.stdout:4939 trunc from 0x7444908 to 0xc97faf1 2024-09-14T06:00:23.749 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:23.745+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:23.752 INFO:teuthology.orchestra.run.smithi006.stdout:4940 write 0x93d0090 thru 0x93d1ae9 (0x1a5a bytes) 2024-09-14T06:00:23.756 INFO:teuthology.orchestra.run.smithi006.stdout:4941 write 0x1ec93ce thru 0x1ed4188 (0xadbb bytes) 2024-09-14T06:00:23.761 INFO:teuthology.orchestra.run.smithi006.stdout:4942 punch from 0xbe89a63 to 0xbe89fe1, (0x57e bytes) 2024-09-14T06:00:23.761 INFO:teuthology.orchestra.run.smithi006.stdout:4943 punch from 0x47427e1 to 0x474e776, (0xbf95 bytes) 2024-09-14T06:00:23.761 INFO:teuthology.orchestra.run.smithi006.stdout:4947 write 0xbac8c4f thru 0xbace9a0 (0x5d52 bytes) 2024-09-14T06:00:23.765 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:23.769 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:23.769 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:23.777 INFO:teuthology.orchestra.run.smithi006.stdout:4950 trunc from 0xc97faf1 to 0x203b9e6 2024-09-14T06:00:23.789 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:23.789 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:23.797 INFO:teuthology.orchestra.run.smithi006.stdout:4952 punch from 0x8f425b to 0x8f45a2, (0x347 bytes) 2024-09-14T06:00:23.806 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:23.806 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:23.809 INFO:teuthology.orchestra.run.smithi006.stdout:4954 write 0x58b7bcf thru 0x58c3814 (0xbc46 bytes) 2024-09-14T06:00:23.815 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:23.816 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:23.816 INFO:teuthology.orchestra.run.smithi006.stdout:4960 punch from 0x29f86a1 to 0x2a07840, (0xf19f bytes) 2024-09-14T06:00:23.816 INFO:teuthology.orchestra.run.smithi006.stdout:4961 punch from 0x44377a2 to 0x444596c, (0xe1ca bytes) 2024-09-14T06:00:23.823 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:23.824 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:23.833 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:23.833 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38916 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5193728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.529906+0000", 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.302575308000002, 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083853568000000003, 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38916 2024-09-14T06:00:23.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.835 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529906+0000", 2024-09-14T06:00:23.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529906+0000", 2024-09-14T06:00:23.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530166+0000", 2024-09-14T06:00:23.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026013499999999999 2024-09-14T06:00:23.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530171+0000", 2024-09-14T06:00:23.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1800000000000004e-06 2024-09-14T06:00:23.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530186+0000", 2024-09-14T06:00:23.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5342e-05 2024-09-14T06:00:23.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530200+0000", 2024-09-14T06:00:23.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3349e-05 2024-09-14T06:00:23.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613496+0000", 2024-09-14T06:00:23.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083296674000000001 2024-09-14T06:00:23.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613612+0000", 2024-09-14T06:00:23.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115895 2024-09-14T06:00:23.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613759+0000", 2024-09-14T06:00:23.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014699299999999999 2024-09-14T06:00:23.838 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.838 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.838 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.838 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38918 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5292032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.838 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530216+0000", 2024-09-14T06:00:23.838 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.302264682999997, 2024-09-14T06:00:23.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083840804000000005, 2024-09-14T06:00:23.839 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.839 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.839 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.839 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.839 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.839 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.839 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38918 2024-09-14T06:00:23.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.839 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530216+0000", 2024-09-14T06:00:23.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530216+0000", 2024-09-14T06:00:23.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530276+0000", 2024-09-14T06:00:23.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9855000000000002e-05 2024-09-14T06:00:23.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530284+0000", 2024-09-14T06:00:23.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0129999999999993e-06 2024-09-14T06:00:23.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530305+0000", 2024-09-14T06:00:23.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0574999999999999e-05 2024-09-14T06:00:23.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530320+0000", 2024-09-14T06:00:23.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5231999999999999e-05 2024-09-14T06:00:23.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613799+0000", 2024-09-14T06:00:23.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083479131999999998 2024-09-14T06:00:23.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613911+0000", 2024-09-14T06:00:23.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011215200000000001 2024-09-14T06:00:23.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614057+0000", 2024-09-14T06:00:23.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000145845 2024-09-14T06:00:23.843 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.843 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.843 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.843 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38919 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5472256~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.843 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530345+0000", 2024-09-14T06:00:23.843 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.302136062999999, 2024-09-14T06:00:23.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083997022000000005, 2024-09-14T06:00:23.843 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.843 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.843 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.844 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.844 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.844 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.844 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38919 2024-09-14T06:00:23.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.844 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530345+0000", 2024-09-14T06:00:23.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530345+0000", 2024-09-14T06:00:23.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530627+0000", 2024-09-14T06:00:23.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028190700000000002 2024-09-14T06:00:23.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530637+0000", 2024-09-14T06:00:23.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0005e-05 2024-09-14T06:00:23.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530662+0000", 2024-09-14T06:00:23.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5065000000000001e-05 2024-09-14T06:00:23.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530679+0000", 2024-09-14T06:00:23.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7255999999999999e-05 2024-09-14T06:00:23.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614130+0000", 2024-09-14T06:00:23.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083450478999999994 2024-09-14T06:00:23.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614225+0000", 2024-09-14T06:00:23.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5451000000000005e-05 2024-09-14T06:00:23.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614342+0000", 2024-09-14T06:00:23.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116859 2024-09-14T06:00:23.847 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.847 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.847 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.847 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38921 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6684672~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.848 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530704+0000", 2024-09-14T06:00:23.848 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.301777055999999, 2024-09-14T06:00:23.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083903330999999998, 2024-09-14T06:00:23.848 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.848 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.848 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.848 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.848 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.848 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.848 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38921 2024-09-14T06:00:23.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.848 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530704+0000", 2024-09-14T06:00:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530704+0000", 2024-09-14T06:00:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530705+0000", 2024-09-14T06:00:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1939999999999999e-06 2024-09-14T06:00:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530709+0000", 2024-09-14T06:00:23.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1289999999999998e-06 2024-09-14T06:00:23.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530721+0000", 2024-09-14T06:00:23.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-09-14T06:00:23.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530728+0000", 2024-09-14T06:00:23.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7729999999999999e-06 2024-09-14T06:00:23.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614393+0000", 2024-09-14T06:00:23.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083665164 2024-09-14T06:00:23.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614489+0000", 2024-09-14T06:00:23.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5168999999999996e-05 2024-09-14T06:00:23.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614607+0000", 2024-09-14T06:00:23.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011856 2024-09-14T06:00:23.852 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.852 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.852 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.852 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38924 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5570560~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.852 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530740+0000", 2024-09-14T06:00:23.852 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.301741374999999, 2024-09-14T06:00:23.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084072167000000003, 2024-09-14T06:00:23.852 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.852 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.852 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.852 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.853 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.853 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.853 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38924 2024-09-14T06:00:23.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.853 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530740+0000", 2024-09-14T06:00:23.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530740+0000", 2024-09-14T06:00:23.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530881+0000", 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014107799999999999 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530889+0000", 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1659999999999994e-06 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530908+0000", 2024-09-14T06:00:23.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8732e-05 2024-09-14T06:00:23.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530917+0000", 2024-09-14T06:00:23.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4390000000000006e-06 2024-09-14T06:00:23.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614661+0000", 2024-09-14T06:00:23.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083743567000000005 2024-09-14T06:00:23.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614736+0000", 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5394000000000004e-05 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614812+0000", 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5791000000000007e-05 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38925 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5750784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530934+0000", 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.301546827999999, 2024-09-14T06:00:23.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084075189999999994, 2024-09-14T06:00:23.857 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.857 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.857 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.857 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.857 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.857 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.857 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38925 2024-09-14T06:00:23.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.857 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530934+0000", 2024-09-14T06:00:23.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530934+0000", 2024-09-14T06:00:23.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531235+0000", 2024-09-14T06:00:23.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030118899999999999 2024-09-14T06:00:23.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531244+0000", 2024-09-14T06:00:23.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1530000000000003e-06 2024-09-14T06:00:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531267+0000", 2024-09-14T06:00:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2688e-05 2024-09-14T06:00:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531284+0000", 2024-09-14T06:00:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6558999999999998e-05 2024-09-14T06:00:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614874+0000", 2024-09-14T06:00:23.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083590082999999996 2024-09-14T06:00:23.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614937+0000", 2024-09-14T06:00:23.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3085999999999999e-05 2024-09-14T06:00:23.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615009+0000", 2024-09-14T06:00:23.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2432e-05 2024-09-14T06:00:23.860 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.860 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.860 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.861 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38927 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6963200~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.861 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.531313+0000", 2024-09-14T06:00:23.861 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.301168095000001, 2024-09-14T06:00:23.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083845550000000005, 2024-09-14T06:00:23.861 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.861 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.861 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.861 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.861 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.861 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.861 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38927 2024-09-14T06:00:23.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.862 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531313+0000", 2024-09-14T06:00:23.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531313+0000", 2024-09-14T06:00:23.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531590+0000", 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027672100000000001 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531597+0000", 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.61e-06 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531622+0000", 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5001e-05 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531634+0000", 2024-09-14T06:00:23.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1756000000000001e-05 2024-09-14T06:00:23.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615045+0000", 2024-09-14T06:00:23.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083411336000000003 2024-09-14T06:00:23.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615093+0000", 2024-09-14T06:00:23.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7812999999999998e-05 2024-09-14T06:00:23.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615158+0000", 2024-09-14T06:00:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5313000000000003e-05 2024-09-14T06:00:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38930 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.531670+0000", 2024-09-14T06:00:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.300810964, 2024-09-14T06:00:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083704600000000004, 2024-09-14T06:00:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.865 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.866 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.866 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.866 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.866 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.866 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38930 2024-09-14T06:00:23.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.866 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531670+0000", 2024-09-14T06:00:23.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531670+0000", 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531671+0000", 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1200000000000001e-06 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531675+0000", 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5530000000000001e-06 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531688+0000", 2024-09-14T06:00:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3592e-05 2024-09-14T06:00:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531696+0000", 2024-09-14T06:00:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-09-14T06:00:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615191+0000", 2024-09-14T06:00:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083494833000000004 2024-09-14T06:00:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615258+0000", 2024-09-14T06:00:23.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7366000000000005e-05 2024-09-14T06:00:23.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615375+0000", 2024-09-14T06:00:23.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011620600000000001 2024-09-14T06:00:23.869 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.869 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.869 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.869 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38933 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7241728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.531708+0000", 2024-09-14T06:00:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.300772512999998, 2024-09-14T06:00:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083895771999999993, 2024-09-14T06:00:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38933 2024-09-14T06:00:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531708+0000", 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531708+0000", 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532040+0000", 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00033176599999999999 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532049+0000", 2024-09-14T06:00:23.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3289999999999994e-06 2024-09-14T06:00:23.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532070+0000", 2024-09-14T06:00:23.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1498999999999999e-05 2024-09-14T06:00:23.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532086+0000", 2024-09-14T06:00:23.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5775000000000001e-05 2024-09-14T06:00:23.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615432+0000", 2024-09-14T06:00:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083345742 2024-09-14T06:00:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615515+0000", 2024-09-14T06:00:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3834999999999999e-05 2024-09-14T06:00:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615604+0000", 2024-09-14T06:00:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8826000000000006e-05 2024-09-14T06:00:23.873 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.874 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.874 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.874 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38935 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.874 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532153+0000", 2024-09-14T06:00:23.874 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.300327543000002, 2024-09-14T06:00:23.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083756399999999995, 2024-09-14T06:00:23.874 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.874 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.874 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.874 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.874 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.874 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38935 2024-09-14T06:00:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532153+0000", 2024-09-14T06:00:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532153+0000", 2024-09-14T06:00:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532155+0000", 2024-09-14T06:00:23.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5540000000000001e-06 2024-09-14T06:00:23.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532162+0000", 2024-09-14T06:00:23.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-09-14T06:00:23.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532183+0000", 2024-09-14T06:00:23.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1219000000000001e-05 2024-09-14T06:00:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532199+0000", 2024-09-14T06:00:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5707999999999999e-05 2024-09-14T06:00:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615666+0000", 2024-09-14T06:00:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083467348999999996 2024-09-14T06:00:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615774+0000", 2024-09-14T06:00:23.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108513 2024-09-14T06:00:23.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615910+0000", 2024-09-14T06:00:23.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013539199999999999 2024-09-14T06:00:23.878 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.878 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.878 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.878 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38938 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.878 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532221+0000", 2024-09-14T06:00:23.879 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.300260334999997, 2024-09-14T06:00:23.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942434999999996, 2024-09-14T06:00:23.879 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.879 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.879 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.879 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.879 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.879 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.879 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38938 2024-09-14T06:00:23.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.879 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532221+0000", 2024-09-14T06:00:23.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532221+0000", 2024-09-14T06:00:23.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532520+0000", 2024-09-14T06:00:23.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029975599999999998 2024-09-14T06:00:23.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532537+0000", 2024-09-14T06:00:23.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6325e-05 2024-09-14T06:00:23.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532555+0000", 2024-09-14T06:00:23.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8796000000000001e-05 2024-09-14T06:00:23.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532567+0000", 2024-09-14T06:00:23.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1691999999999999e-05 2024-09-14T06:00:23.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615972+0000", 2024-09-14T06:00:23.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083404513999999999 2024-09-14T06:00:23.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616068+0000", 2024-09-14T06:00:23.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6484999999999995e-05 2024-09-14T06:00:23.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616163+0000", 2024-09-14T06:00:23.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4866999999999998e-05 2024-09-14T06:00:23.883 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.883 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.883 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.883 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38939 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7520256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.883 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532620+0000", 2024-09-14T06:00:23.883 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.299861413999999, 2024-09-14T06:00:23.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083789983999999998, 2024-09-14T06:00:23.883 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.884 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.884 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.884 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.884 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.884 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.884 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38939 2024-09-14T06:00:23.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.884 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532620+0000", 2024-09-14T06:00:23.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532620+0000", 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532621+0000", 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.15e-06 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532625+0000", 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9770000000000002e-06 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532637+0000", 2024-09-14T06:00:23.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1902000000000001e-05 2024-09-14T06:00:23.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532645+0000", 2024-09-14T06:00:23.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0059999999999992e-06 2024-09-14T06:00:23.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616213+0000", 2024-09-14T06:00:23.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083568086999999999 2024-09-14T06:00:23.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616311+0000", 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8342000000000001e-05 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616410+0000", 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8519999999999999e-05 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38941 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532657+0000", 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.299824270000002, 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083960503000000006, 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38941 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532657+0000", 2024-09-14T06:00:23.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532657+0000", 2024-09-14T06:00:23.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532932+0000", 2024-09-14T06:00:23.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027501099999999997 2024-09-14T06:00:23.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532938+0000", 2024-09-14T06:00:23.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.857e-06 2024-09-14T06:00:23.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532959+0000", 2024-09-14T06:00:23.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1773999999999999e-05 2024-09-14T06:00:23.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532975+0000", 2024-09-14T06:00:23.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5858999999999998e-05 2024-09-14T06:00:23.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616462+0000", 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083486949000000005 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616524+0000", 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2255999999999995e-05 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616617+0000", 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2796999999999999e-05 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.891 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.892 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38944 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7618560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.892 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533002+0000", 2024-09-14T06:00:23.892 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.299479120999997, 2024-09-14T06:00:23.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083846326999999998, 2024-09-14T06:00:23.892 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.892 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.892 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.892 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.892 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.892 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.892 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38944 2024-09-14T06:00:23.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533002+0000", 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533002+0000", 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533107+0000", 2024-09-14T06:00:23.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104955 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533115+0000", 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3890000000000005e-06 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533138+0000", 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3302000000000002e-05 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533155+0000", 2024-09-14T06:00:23.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6201e-05 2024-09-14T06:00:23.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616671+0000", 2024-09-14T06:00:23.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083516786999999995 2024-09-14T06:00:23.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616762+0000", 2024-09-14T06:00:23.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0162999999999997e-05 2024-09-14T06:00:23.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616848+0000", 2024-09-14T06:00:23.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.653e-05 2024-09-14T06:00:23.896 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.896 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.896 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.896 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38945 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.896 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533182+0000", 2024-09-14T06:00:23.896 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.299299022, 2024-09-14T06:00:23.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083811267999999994, 2024-09-14T06:00:23.896 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.896 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.896 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.896 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.897 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.897 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.897 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38945 2024-09-14T06:00:23.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.897 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533182+0000", 2024-09-14T06:00:23.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533182+0000", 2024-09-14T06:00:23.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533333+0000", 2024-09-14T06:00:23.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000150588 2024-09-14T06:00:23.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533342+0000", 2024-09-14T06:00:23.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0089999999999996e-06 2024-09-14T06:00:23.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533365+0000", 2024-09-14T06:00:23.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3771e-05 2024-09-14T06:00:23.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533382+0000", 2024-09-14T06:00:23.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6748999999999998e-05 2024-09-14T06:00:23.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616884+0000", 2024-09-14T06:00:23.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083502178999999996 2024-09-14T06:00:23.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616930+0000", 2024-09-14T06:00:23.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5312999999999998e-05 2024-09-14T06:00:23.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616993+0000", 2024-09-14T06:00:23.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3658999999999995e-05 2024-09-14T06:00:23.900 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.900 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.900 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.901 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38947 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7897088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.901 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533411+0000", 2024-09-14T06:00:23.901 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.299070110999999, 2024-09-14T06:00:23.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083860599999999993, 2024-09-14T06:00:23.901 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.901 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.901 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.901 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.901 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.901 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.901 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38947 2024-09-14T06:00:23.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.902 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533411+0000", 2024-09-14T06:00:23.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533411+0000", 2024-09-14T06:00:23.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533731+0000", 2024-09-14T06:00:23.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031991499999999999 2024-09-14T06:00:23.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533738+0000", 2024-09-14T06:00:23.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8820000000000003e-06 2024-09-14T06:00:23.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533766+0000", 2024-09-14T06:00:23.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8218e-05 2024-09-14T06:00:23.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533781+0000", 2024-09-14T06:00:23.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4799e-05 2024-09-14T06:00:23.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617052+0000", 2024-09-14T06:00:23.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083271607999999997 2024-09-14T06:00:23.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617163+0000", 2024-09-14T06:00:23.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011053299999999999 2024-09-14T06:00:23.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617271+0000", 2024-09-14T06:00:23.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108645 2024-09-14T06:00:23.905 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.905 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.905 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.905 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38948 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 8077312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.905 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533801+0000", 2024-09-14T06:00:23.905 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.298680236000003, 2024-09-14T06:00:23.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083665502000000003, 2024-09-14T06:00:23.906 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.906 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.906 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.906 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.906 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.906 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.906 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38948 2024-09-14T06:00:23.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.906 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533801+0000", 2024-09-14T06:00:23.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533801+0000", 2024-09-14T06:00:23.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533802+0000", 2024-09-14T06:00:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.06e-06 2024-09-14T06:00:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533805+0000", 2024-09-14T06:00:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6540000000000001e-06 2024-09-14T06:00:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533816+0000", 2024-09-14T06:00:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0642000000000001e-05 2024-09-14T06:00:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533823+0000", 2024-09-14T06:00:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.396e-06 2024-09-14T06:00:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617327+0000", 2024-09-14T06:00:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083503933000000002 2024-09-14T06:00:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617394+0000", 2024-09-14T06:00:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6693999999999995e-05 2024-09-14T06:00:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617466+0000", 2024-09-14T06:00:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2123e-05 2024-09-14T06:00:23.910 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38950 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 9289728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533834+0000", 2024-09-14T06:00:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.298646918000003, 2024-09-14T06:00:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083881255000000002, 2024-09-14T06:00:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.911 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38950 2024-09-14T06:00:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533834+0000", 2024-09-14T06:00:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533834+0000", 2024-09-14T06:00:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534051+0000", 2024-09-14T06:00:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000217242 2024-09-14T06:00:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534061+0000", 2024-09-14T06:00:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3430000000000002e-06 2024-09-14T06:00:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534086+0000", 2024-09-14T06:00:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5384e-05 2024-09-14T06:00:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534104+0000", 2024-09-14T06:00:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8006e-05 2024-09-14T06:00:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617507+0000", 2024-09-14T06:00:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083403115999999999 2024-09-14T06:00:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617616+0000", 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108418 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617715+0000", 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9746000000000003e-05 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38953 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 8175616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.534133+0000", 2024-09-14T06:00:23.915 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.298347741999997, 2024-09-14T06:00:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083736141, 2024-09-14T06:00:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38953 2024-09-14T06:00:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534133+0000", 2024-09-14T06:00:23.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534133+0000", 2024-09-14T06:00:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534314+0000", 2024-09-14T06:00:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018080200000000001 2024-09-14T06:00:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534329+0000", 2024-09-14T06:00:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5375000000000001e-05 2024-09-14T06:00:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534354+0000", 2024-09-14T06:00:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4411999999999999e-05 2024-09-14T06:00:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534366+0000", 2024-09-14T06:00:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1949e-05 2024-09-14T06:00:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617758+0000", 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083392691000000005 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617817+0000", 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8471999999999999e-05 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617869+0000", 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2439999999999999e-05 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.919 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38954 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 8355840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.534386+0000", 2024-09-14T06:00:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.298094448999997, 2024-09-14T06:00:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083652403, 2024-09-14T06:00:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38954 2024-09-14T06:00:23.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534386+0000", 2024-09-14T06:00:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534386+0000", 2024-09-14T06:00:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:23.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534716+0000", 2024-09-14T06:00:23.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032903000000000001 2024-09-14T06:00:23.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:23.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534721+0000", 2024-09-14T06:00:23.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9089999999999997e-06 2024-09-14T06:00:23.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:23.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534739+0000", 2024-09-14T06:00:23.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7679000000000001e-05 2024-09-14T06:00:23.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534749+0000", 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0312999999999999e-05 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617901+0000", 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083152056000000002 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617977+0000", 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5772000000000006e-05 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:23.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.618039+0000", 2024-09-14T06:00:23.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1643999999999995e-05 2024-09-14T06:00:23.924 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.924 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.924 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.924 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:23.924 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:23.924 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:23.925 INFO:teuthology.orchestra.run.smithi006.stdout:4962 write 0xeab930e thru 0xeaba930 (0x1623 bytes) 2024-09-14T06:00:23.925 INFO:teuthology.orchestra.run.smithi006.stdout:4963 read 0x43e7cd5 thru 0x43ef1b5 (0x74e1 bytes) 2024-09-14T06:00:23.925 INFO:teuthology.orchestra.run.smithi006.stdout:4964 punch from 0xb0e3308 to 0xb0eeafe, (0xb7f6 bytes) 2024-09-14T06:00:23.925 INFO:teuthology.orchestra.run.smithi006.stdout:4965 writesame 0xc9b58f5 thru 0xc9bf220 data_size 0x2(0x992c bytes) 2024-09-14T06:00:23.926 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:23.926 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:23.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:00:23.927 INFO:teuthology.orchestra.run.smithi006.stdout:4967 read 0x6055937 thru 0x605939a (0x3a64 bytes) 2024-09-14T06:00:23.927 INFO:teuthology.orchestra.run.smithi006.stdout:4968 read 0xa894362 thru 0xa89ef60 (0xabff bytes) 2024-09-14T06:00:23.927 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:23.928 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:23.928 INFO:teuthology.orchestra.run.smithi006.stdout:4969 trunc from 0xeaba931 to 0x3be32ac 2024-09-14T06:00:23.928 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:23.928 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:23.929 INFO:teuthology.orchestra.run.smithi006.stdout:4970 read 0x2032027 thru 0x203a7fd (0x87d7 bytes) 2024-09-14T06:00:23.929 INFO:teuthology.orchestra.run.smithi006.stdout:4972 write 0x178edbb thru 0x17911ee (0x2434 bytes) 2024-09-14T06:00:23.929 INFO:teuthology.orchestra.run.smithi006.stdout:4973 read 0xa595b thru 0xa9e13 (0x44b9 bytes) 2024-09-14T06:00:23.929 INFO:teuthology.orchestra.run.smithi006.stdout:4974 trunc from 0x3be32ac to 0x267e4d0 2024-09-14T06:00:23.930 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:23.930 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:23.930 INFO:teuthology.orchestra.run.smithi006.stdout:4976 trunc from 0x267e4d0 to 0xeb8212d 2024-09-14T06:00:23.930 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:23.921+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:23.931 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:23.931 INFO:teuthology.orchestra.run.smithi006.stdout:4978 read 0xba1d49a thru 0xba2b32e (0xde95 bytes) 2024-09-14T06:00:23.931 INFO:teuthology.orchestra.run.smithi006.stdout:4979 read 0xee2976 thru 0xeee82f (0xbeba bytes) 2024-09-14T06:00:23.932 INFO:teuthology.orchestra.run.smithi006.stdout:4980 read 0x30e62be thru 0x30f5afb (0xf83e bytes) 2024-09-14T06:00:23.932 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:23.932 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:23.932 INFO:teuthology.orchestra.run.smithi006.stdout:4983 read 0x393a60c thru 0x39488ec (0xe2e1 bytes) 2024-09-14T06:00:23.932 INFO:teuthology.orchestra.run.smithi006.stdout:4985 read 0x6530616 thru 0x6536986 (0x6371 bytes) 2024-09-14T06:00:23.932 INFO:teuthology.orchestra.run.smithi006.stdout:4986 write 0xc1d7689 thru 0xc1d8c9e (0x1616 bytes) 2024-09-14T06:00:23.934 INFO:teuthology.orchestra.run.smithi006.stdout:4987 write 0x56bf52a thru 0x56c7a42 (0x8519 bytes) 2024-09-14T06:00:23.942 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:23.943 INFO:teuthology.orchestra.run.smithi006.stdout:4990 flatten 2024-09-14T06:00:24.000 INFO:teuthology.orchestra.run.smithi006.stdout:4991 punch from 0x5f9f59a to 0x5fa1fa3, (0x2a09 bytes) 2024-09-14T06:00:24.000 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:24.001 INFO:teuthology.orchestra.run.smithi006.stdout:4994 write 0xa8350a8 thru 0xa835704 (0x65d bytes) 2024-09-14T06:00:24.005 INFO:teuthology.orchestra.run.smithi006.stdout:4995 read 0x31e2e2f thru 0x31e39b6 (0xb88 bytes) 2024-09-14T06:00:24.005 INFO:teuthology.orchestra.run.smithi006.stdout:4996 write 0xd6f2af1 thru 0xd7001d0 (0xd6e0 bytes) 2024-09-14T06:00:24.012 INFO:teuthology.orchestra.run.smithi006.stdout:4997 punch from 0x6b5302b to 0x6b5c38c, (0x9361 bytes) 2024-09-14T06:00:24.012 INFO:teuthology.orchestra.run.smithi006.stdout:4998 write 0xa6ca8f5 thru 0xa6d8f20 (0xe62c bytes) 2024-09-14T06:00:24.018 INFO:teuthology.orchestra.run.smithi006.stdout:4999 write 0x2e09bf6 thru 0x2e1742f (0xd83a bytes) 2024-09-14T06:00:24.026 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:24.021+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:24.027 INFO:teuthology.orchestra.run.smithi006.stdout:5000 write 0x257254a thru 0x2580112 (0xdbc9 bytes) 2024-09-14T06:00:24.035 INFO:teuthology.orchestra.run.smithi006.stdout:5001 read 0x1689d3f thru 0x168faba (0x5d7c bytes) 2024-09-14T06:00:24.035 INFO:teuthology.orchestra.run.smithi006.stdout:5003 punch from 0x8263569 to 0x82730ce, (0xfb65 bytes) 2024-09-14T06:00:24.036 INFO:teuthology.orchestra.run.smithi006.stdout:5006 punch from 0xc9c3812 to 0xc9cab3f, (0x732d bytes) 2024-09-14T06:00:24.036 INFO:teuthology.orchestra.run.smithi006.stdout:5007 read 0x44611b0 thru 0x446e6c7 (0xd518 bytes) 2024-09-14T06:00:24.036 INFO:teuthology.orchestra.run.smithi006.stdout:5008 writesame 0xabcbf7b thru 0xabd6a30 data_size 0x1(0xaab6 bytes) 2024-09-14T06:00:24.057 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:24.057 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:24.057 INFO:teuthology.orchestra.run.smithi006.stdout:5009 writesame 0x5a8ec17 thru 0x5a9a2ec data_size 0x6(0xb6d6 bytes) 2024-09-14T06:00:24.068 INFO:teuthology.orchestra.run.smithi006.stdout:5010 write 0x940135 thru 0x94a530 (0xa3fc bytes) 2024-09-14T06:00:24.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:00:24.075 INFO:teuthology.orchestra.run.smithi006.stdout:5013 write 0x779fc65 thru 0x77a610f (0x64ab bytes) 2024-09-14T06:00:24.083 INFO:teuthology.orchestra.run.smithi006.stdout:5014 punch from 0x3132ea to 0x31a6c9, (0x73df bytes) 2024-09-14T06:00:24.084 INFO:teuthology.orchestra.run.smithi006.stdout:5016 write 0xb773de4 thru 0xb77a222 (0x643f bytes) 2024-09-14T06:00:24.089 INFO:teuthology.orchestra.run.smithi006.stdout:5017 read 0x200fb8b thru 0x20119c1 (0x1e37 bytes) 2024-09-14T06:00:24.095 INFO:teuthology.orchestra.run.smithi006.stdout:5018 trunc from 0xeb8212d to 0x949ff69 2024-09-14T06:00:24.121 INFO:teuthology.orchestra.run.smithi006.stdout:5019 writesame 0x576602b thru 0x576a908 data_size 0x3(0x48de bytes) 2024-09-14T06:00:24.127 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:24.125+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:24.133 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:24.135 INFO:teuthology.orchestra.run.smithi006.stdout:5021 trunc from 0x949ff69 to 0xa5ad835 2024-09-14T06:00:24.151 INFO:teuthology.orchestra.run.smithi006.stdout:5022 trunc from 0xa5ad835 to 0xeb4f4bd 2024-09-14T06:00:24.171 INFO:teuthology.orchestra.run.smithi006.stdout:5023 trunc from 0xeb4f4bd to 0x8ada988 2024-09-14T06:00:24.185 INFO:teuthology.orchestra.run.smithi006.stdout:5024 read 0x4f1a0f6 thru 0x4f2552e (0xb439 bytes) 2024-09-14T06:00:24.185 INFO:teuthology.orchestra.run.smithi006.stdout:5026 read 0x809fe12 thru 0x80a990d (0x9afc bytes) 2024-09-14T06:00:24.185 INFO:teuthology.orchestra.run.smithi006.stdout:5027 punch from 0x61a8e7f to 0x61a9fc9, (0x114a bytes) 2024-09-14T06:00:24.185 INFO:teuthology.orchestra.run.smithi006.stdout:5029 punch from 0x78a2d89 to 0x78b1f3a, (0xf1b1 bytes) 2024-09-14T06:00:24.185 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:24.185 INFO:teuthology.orchestra.run.smithi006.stdout:5031 read 0x1174930 thru 0x117d92c (0x8ffd bytes) 2024-09-14T06:00:24.185 INFO:teuthology.orchestra.run.smithi006.stdout:5034 punch from 0x73b0774 to 0x73be45d, (0xdce9 bytes) 2024-09-14T06:00:24.199 INFO:teuthology.orchestra.run.smithi006.stdout:5035 writesame 0x94fdabb thru 0x9507024 data_size 0x33(0x956a bytes) 2024-09-14T06:00:24.199 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:24.200 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:24.200 INFO:teuthology.orchestra.run.smithi006.stdout:5038 read 0x868f577 thru 0x869d0eb (0xdb75 bytes) 2024-09-14T06:00:24.204 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:24.204 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:24.206 INFO:teuthology.orchestra.run.smithi006.stdout:5039 trunc from 0x9507025 to 0x6508821 2024-09-14T06:00:24.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:00:24.228 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:24.223+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:24.230 INFO:teuthology.orchestra.run.smithi006.stdout:5040 read 0x37d6bcb thru 0x37d7083 (0x4b9 bytes) 2024-09-14T06:00:24.230 INFO:teuthology.orchestra.run.smithi006.stdout:5042 writesame 0x2a3c22e thru 0x2a411da data_size 0xd(0x4fad bytes) 2024-09-14T06:00:24.239 INFO:teuthology.orchestra.run.smithi006.stdout:5043 punch from 0x2f28580 to 0x2f2dddc, (0x585c bytes) 2024-09-14T06:00:24.242 INFO:teuthology.orchestra.run.smithi006.stdout:5044 trunc from 0x6508821 to 0x436b401 2024-09-14T06:00:24.270 INFO:teuthology.orchestra.run.smithi006.stdout:5045 trunc from 0x436b401 to 0x1293439 2024-09-14T06:00:24.303 INFO:teuthology.orchestra.run.smithi006.stdout:5048 writesame 0xce0575 thru 0xce2599 data_size 0xd(0x2025 bytes) 2024-09-14T06:00:24.310 INFO:teuthology.orchestra.run.smithi006.stdout:5049 read 0xe05054 thru 0xe0f028 (0x9fd5 bytes) 2024-09-14T06:00:24.310 INFO:teuthology.orchestra.run.smithi006.stdout:5052 punch from 0x50504 to 0x50813, (0x30f bytes) 2024-09-14T06:00:24.310 INFO:teuthology.orchestra.run.smithi006.stdout:5053 read 0xb680e0 thru 0xb70c55 (0x8b76 bytes) 2024-09-14T06:00:24.311 INFO:teuthology.orchestra.run.smithi006.stdout:5054 write 0x67b32a thru 0x686e5e (0xbb35 bytes) 2024-09-14T06:00:24.329 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:24.325+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:24.335 INFO:teuthology.orchestra.run.smithi006.stdout:5056 write 0x40be4cd thru 0x40c3ca8 (0x57dc bytes) 2024-09-14T06:00:24.344 INFO:teuthology.orchestra.run.smithi006.stdout:5058 read 0x31bd653 thru 0x31ca34c (0xccfa bytes) 2024-09-14T06:00:24.344 INFO:teuthology.orchestra.run.smithi006.stdout:5059 write 0xba63a4 thru 0xbab964 (0x55c1 bytes) 2024-09-14T06:00:24.363 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:24.364 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:24.365 INFO:teuthology.orchestra.run.smithi006.stdout:5060 trunc from 0x40c3ca9 to 0xeb95342 2024-09-14T06:00:24.380 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:00:24.381 INFO:teuthology.orchestra.run.smithi006.stdout:5061 write 0x63427e2 thru 0x6348c7b (0x649a bytes) 2024-09-14T06:00:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:5062 read 0x81e625e thru 0x81e8f2d (0x2cd0 bytes) 2024-09-14T06:00:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:5064 read 0x9503475 thru 0x950d21a (0x9da6 bytes) 2024-09-14T06:00:24.388 INFO:teuthology.orchestra.run.smithi006.stdout:5068 write 0x4e4db26 thru 0x4e56426 (0x8901 bytes) 2024-09-14T06:00:24.397 INFO:teuthology.orchestra.run.smithi006.stdout:5069 punch from 0x2a655c0 to 0x2a70b30, (0xb570 bytes) 2024-09-14T06:00:24.417 INFO:teuthology.orchestra.run.smithi006.stdout:5070 trunc from 0xeb95342 to 0x33ae60f 2024-09-14T06:00:24.430 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:24.427+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:24.440 INFO:teuthology.orchestra.run.smithi006.stdout:5071 read 0x3079e46 thru 0x30805ab (0x6766 bytes) 2024-09-14T06:00:24.449 INFO:teuthology.orchestra.run.smithi006.stdout:5072 trunc from 0x33ae60f to 0x7e3af31 2024-09-14T06:00:24.460 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:24.461 INFO:teuthology.orchestra.run.smithi006.stdout:5074 write 0x3b84bfd thru 0x3b87299 (0x269d bytes) 2024-09-14T06:00:24.485 INFO:teuthology.orchestra.run.smithi006.stdout:5075 write 0x9af7e04 thru 0x9af885e (0xa5b bytes) 2024-09-14T06:00:24.492 INFO:teuthology.orchestra.run.smithi006.stdout:5077 punch from 0x18482ac to 0x184af38, (0x2c8c bytes) 2024-09-14T06:00:24.492 INFO:teuthology.orchestra.run.smithi006.stdout:5078 read 0x9806121 thru 0x98141fe (0xe0de bytes) 2024-09-14T06:00:24.500 INFO:teuthology.orchestra.run.smithi006.stdout:5079 trunc from 0x9af885f to 0x65ebfea 2024-09-14T06:00:24.519 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:24.519 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:24.525 INFO:teuthology.orchestra.run.smithi006.stdout:5081 read 0x1088c4a thru 0x1091c31 (0x8fe8 bytes) 2024-09-14T06:00:24.525 INFO:teuthology.orchestra.run.smithi006.stdout:5085 read 0x23be1ef thru 0x23c629e (0x80b0 bytes) 2024-09-14T06:00:24.530 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:24.527+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:24.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:00:24.540 INFO:teuthology.orchestra.run.smithi006.stdout:5087 write 0x6cb2fd2 thru 0x6cb9915 (0x6944 bytes) 2024-09-14T06:00:24.549 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:24.549 INFO:teuthology.orchestra.run.smithi006.stdout:5089 read 0x40b995 thru 0x411727 (0x5d93 bytes) 2024-09-14T06:00:24.549 INFO:teuthology.orchestra.run.smithi006.stdout:5090 read 0x5ebb9f2 thru 0x5ec1993 (0x5fa2 bytes) 2024-09-14T06:00:24.549 INFO:teuthology.orchestra.run.smithi006.stdout:5091 read 0x25d4fb0 thru 0x25e435e (0xf3af bytes) 2024-09-14T06:00:24.549 INFO:teuthology.orchestra.run.smithi006.stdout:5092 write 0x6b34378 thru 0x6b42225 (0xdeae bytes) 2024-09-14T06:00:24.580 INFO:teuthology.orchestra.run.smithi006.stdout:5093 write 0xb22a80e thru 0xb22ac88 (0x47b bytes) 2024-09-14T06:00:24.588 INFO:teuthology.orchestra.run.smithi006.stdout:5094 writesame 0x3ad6fe2 thru 0x3ae3b00 data_size 0x1(0xcb1f bytes) 2024-09-14T06:00:24.600 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.2 primary-affinity to 0 (802) 2024-09-14T06:00:24.631 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:24.627+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:24.646 INFO:teuthology.orchestra.run.smithi006.stdout:5095 writesame 0x712c4e2 thru 0x7135993 data_size 0x7(0x94b2 bytes) 2024-09-14T06:00:24.666 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:24.666 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:24.681 INFO:teuthology.orchestra.run.smithi006.stdout:5096 write 0xdf73058 thru 0xdf80727 (0xd6d0 bytes) 2024-09-14T06:00:24.684 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:00:24.691 INFO:teuthology.orchestra.run.smithi006.stdout:5097 read 0x32e013c thru 0x32e6782 (0x6647 bytes) 2024-09-14T06:00:24.691 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:24.691 INFO:teuthology.orchestra.run.smithi006.stdout:5101 read 0xc1e41ad thru 0xc1e9065 (0x4eb9 bytes) 2024-09-14T06:00:24.691 INFO:teuthology.orchestra.run.smithi006.stdout:5102 writesame 0xcbc037c thru 0xcbcea9f data_size 0x6(0xe724 bytes) 2024-09-14T06:00:24.709 INFO:teuthology.orchestra.run.smithi006.stdout:5103 punch from 0x3c4c89 to 0x3c5e06, (0x117d bytes) 2024-09-14T06:00:24.709 INFO:teuthology.orchestra.run.smithi006.stdout:5104 read 0xe49957 thru 0xe59802 (0xfeac bytes) 2024-09-14T06:00:24.727 INFO:teuthology.orchestra.run.smithi006.stdout:5106 trunc from 0xdf80728 to 0x1877ee3 2024-09-14T06:00:24.732 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:24.729+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:24.755 INFO:teuthology.orchestra.run.smithi006.stdout:5107 read 0x348684 thru 0x34a36f (0x1cec bytes) 2024-09-14T06:00:24.756 INFO:teuthology.orchestra.run.smithi006.stdout:5110 punch from 0x14f516c to 0x14fc3cc, (0x7260 bytes) 2024-09-14T06:00:24.756 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:24.782 INFO:teuthology.orchestra.run.smithi006.stdout:5113 writesame 0x9a9e18e thru 0x9aa132a data_size 0x1(0x319d bytes) 2024-09-14T06:00:24.782 INFO:teuthology.orchestra.run.smithi006.stdout:5115 writesame 0x3e8eedb thru 0x3e93e47 data_size 0x1(0x4f6d bytes) 2024-09-14T06:00:24.811 INFO:teuthology.orchestra.run.smithi006.stdout:5116 read 0x7f52caa thru 0x7f56a37 (0x3d8e bytes) 2024-09-14T06:00:24.811 INFO:teuthology.orchestra.run.smithi006.stdout:5117 write 0x4b137db thru 0x4b1ede9 (0xb60f bytes) 2024-09-14T06:00:24.819 INFO:teuthology.orchestra.run.smithi006.stdout:5118 punch from 0x4b86053 to 0x4b8f05e, (0x900b bytes) 2024-09-14T06:00:24.819 INFO:teuthology.orchestra.run.smithi006.stdout:5119 punch from 0x191333e to 0x191b8e3, (0x85a5 bytes) 2024-09-14T06:00:24.822 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:24.822 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:24.832 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:24.827+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:24.841 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:00:24.842 INFO:teuthology.orchestra.run.smithi006.stdout:5121 write 0xda1a248 thru 0xda1ccb3 (0x2a6c bytes) 2024-09-14T06:00:24.849 INFO:teuthology.orchestra.run.smithi006.stdout:5122 read 0x7982867 thru 0x798b8c4 (0x905e bytes) 2024-09-14T06:00:24.849 INFO:teuthology.orchestra.run.smithi006.stdout:5123 read 0x6e5c634 thru 0x6e6a17a (0xdb47 bytes) 2024-09-14T06:00:24.849 INFO:teuthology.orchestra.run.smithi006.stdout:5124 write 0x3e2a0d2 thru 0x3e3039e (0x62cd bytes) 2024-09-14T06:00:24.859 INFO:teuthology.orchestra.run.smithi006.stdout:5125 clone 31 order 19 su 16384 sc 4 2024-09-14T06:00:24.933 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:24.931+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:24.970 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:24.970 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:24.987 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:00:25.034 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:25.031+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:25.136 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:25.133+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:25.159 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:25.159 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:25.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:00:25.259 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:25.257+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:25.338 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:25.335+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:25.344 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:25.345 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:25.358 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:00:25.439 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:25.439+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:25.530 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:25.530 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:25.540 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:25.535+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:25.548 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:00:25.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T06:00:25.671 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:25.669+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:25.683 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:25.683 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:25.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:00:25.743 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:25.741+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:25.843 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:25.839+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:25.865 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:25.865 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:25.882 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:00:25.915 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-14T06:00:25.933 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:00:25.979 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:25.977+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:25.981 INFO:teuthology.orchestra.run.smithi006.stdout:5126 punch from 0xbdb05f4 to 0xbdbbdfb, (0xb807 bytes) 2024-09-14T06:00:26.004 INFO:teuthology.orchestra.run.smithi006.stdout:5127 trunc from 0xda1ccb4 to 0x2b00a91 2024-09-14T06:00:26.020 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:26.020 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:26.028 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:26.035 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:00:26.044 INFO:teuthology.orchestra.run.smithi006.stdout:5129 trunc from 0x2b00a91 to 0xcbce88f 2024-09-14T06:00:26.053 INFO:teuthology.orchestra.run.smithi006.stdout:5131 write 0x5fd332a thru 0x5fdbbbc (0x8893 bytes) 2024-09-14T06:00:26.059 INFO:teuthology.orchestra.run.smithi006.stdout:5133 read 0x3e39015 thru 0x3e4729e (0xe28a bytes) 2024-09-14T06:00:26.059 INFO:teuthology.orchestra.run.smithi006.stdout:5134 punch from 0x3fb9ac to 0x3fc80c, (0xe60 bytes) 2024-09-14T06:00:26.059 INFO:teuthology.orchestra.run.smithi006.stdout:5135 read 0x4ef39f6 thru 0x4f02ee3 (0xf4ee bytes) 2024-09-14T06:00:26.059 INFO:teuthology.orchestra.run.smithi006.stdout:5137 write 0x22a88eb thru 0x22aa3c9 (0x1adf bytes) 2024-09-14T06:00:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:5139 write 0xa200f2d thru 0xa20f5ae (0xe682 bytes) 2024-09-14T06:00:26.070 INFO:teuthology.orchestra.run.smithi006.stdout:5140 write 0x86e2edd thru 0x86f24ae (0xf5d2 bytes) 2024-09-14T06:00:26.077 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:26.077 INFO:teuthology.orchestra.run.smithi006.stdout:5142 write 0x7845ac2 thru 0x784b0b6 (0x55f5 bytes) 2024-09-14T06:00:26.081 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:26.079+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:26.082 INFO:teuthology.orchestra.run.smithi006.stdout:5144 read 0x55c9d1a thru 0x55d3465 (0x974c bytes) 2024-09-14T06:00:26.082 INFO:teuthology.orchestra.run.smithi006.stdout:5145 write 0x8885b85 thru 0x8890a60 (0xaedc bytes) 2024-09-14T06:00:26.087 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:26.087 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:26.092 INFO:teuthology.orchestra.run.smithi006.stdout:5146 trunc from 0xcbce88f to 0xc61fbfe 2024-09-14T06:00:26.104 INFO:teuthology.orchestra.run.smithi006.stdout:5147 trunc from 0xc61fbfe to 0x758290e 2024-09-14T06:00:26.106 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:26.106 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:26.118 INFO:teuthology.orchestra.run.smithi006.stdout:5148 punch from 0x4550f3d to 0x4553f00, (0x2fc3 bytes) 2024-09-14T06:00:26.119 INFO:teuthology.orchestra.run.smithi006.stdout:5149 trunc from 0x758290e to 0x7fff4e2 2024-09-14T06:00:26.125 INFO:teuthology.orchestra.run.smithi006.stdout:5150 read 0x6009df6 thru 0x6011597 (0x77a2 bytes) 2024-09-14T06:00:26.125 INFO:teuthology.orchestra.run.smithi006.stdout:5151 read 0x5578efe thru 0x557dfea (0x50ed bytes) 2024-09-14T06:00:26.125 INFO:teuthology.orchestra.run.smithi006.stdout:5152 read 0x4e0770d thru 0x4e0b297 (0x3b8b bytes) 2024-09-14T06:00:26.126 INFO:teuthology.orchestra.run.smithi006.stdout:5153 read 0x14173fb thru 0x14270f6 (0xfcfc bytes) 2024-09-14T06:00:26.126 INFO:teuthology.orchestra.run.smithi006.stdout:5155 read 0x1ec5237 thru 0x1ecb92b (0x66f5 bytes) 2024-09-14T06:00:26.126 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:26.126 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:26.138 INFO:teuthology.orchestra.run.smithi006.stdout:5157 write 0xcbd9b01 thru 0xcbdcbe8 (0x30e8 bytes) 2024-09-14T06:00:26.144 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:26.145 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:26.145 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:26.143+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:26.150 INFO:teuthology.orchestra.run.smithi006.stdout:5158 write 0xd536864 thru 0xd542825 (0xbfc2 bytes) 2024-09-14T06:00:26.162 INFO:teuthology.orchestra.run.smithi006.stdout:5160 read 0x6c067aa thru 0x6c07321 (0xb78 bytes) 2024-09-14T06:00:26.162 INFO:teuthology.orchestra.run.smithi006.stdout:5162 punch from 0x3984504 to 0x3986d99, (0x2895 bytes) 2024-09-14T06:00:26.163 INFO:teuthology.orchestra.run.smithi006.stdout:5163 read 0x6d11bc thru 0x6de023 (0xce68 bytes) 2024-09-14T06:00:26.163 INFO:teuthology.orchestra.run.smithi006.stdout:5165 writesame 0x67e7a7d thru 0x67ee023 data_size 0x1(0x65a7 bytes) 2024-09-14T06:00:26.166 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:26.166 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:26.173 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:26.173 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:26.173 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:26.173 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:26.173 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:26.175 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:26.175 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:26.175 INFO:teuthology.orchestra.run.smithi006.stdout:5170 read 0x61fc94a thru 0x620c2c3 (0xf97a bytes) 2024-09-14T06:00:26.175 INFO:teuthology.orchestra.run.smithi006.stdout:5171 write 0x4f3558c thru 0x4f3f3c0 (0x9e35 bytes) 2024-09-14T06:00:26.181 INFO:teuthology.orchestra.run.smithi006.stdout:5173 writesame 0xcaa964f thru 0xcab47d4 data_size 0x2(0xb186 bytes) 2024-09-14T06:00:26.185 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:26.185 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:26.190 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:26.192 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:00:26.202 INFO:teuthology.orchestra.run.smithi006.stdout:5175 trunc from 0xd542826 to 0x4ba61a2 2024-09-14T06:00:26.204 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:26.204 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:26.218 INFO:teuthology.orchestra.run.smithi006.stdout:5177 read 0x25693e thru 0x25c7c5 (0x5e88 bytes) 2024-09-14T06:00:26.220 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:26.220 INFO:teuthology.orchestra.run.smithi006.stdout:5180 read 0xc5ab67 thru 0xc60956 (0x5df0 bytes) 2024-09-14T06:00:26.227 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:26.227 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:26.240 INFO:teuthology.orchestra.run.smithi006.stdout:5181 write 0xcc755a6 thru 0xcc76d7a (0x17d5 bytes) 2024-09-14T06:00:26.245 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:26.245 INFO:teuthology.orchestra.run.smithi006.stdout:5183 punch from 0xc7117d8 to 0xc717ede, (0x6706 bytes) 2024-09-14T06:00:26.246 INFO:teuthology.orchestra.run.smithi006.stdout:5184 read 0x5ed34b8 thru 0x5edd7ff (0xa348 bytes) 2024-09-14T06:00:26.246 INFO:teuthology.orchestra.run.smithi006.stdout:5185 write 0xb0ff933 thru 0xb10aebb (0xb589 bytes) 2024-09-14T06:00:26.246 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:26.241+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:26.255 INFO:teuthology.orchestra.run.smithi006.stdout:5186 read 0x5fe15ed thru 0x5fe291c (0x1330 bytes) 2024-09-14T06:00:26.258 INFO:teuthology.orchestra.run.smithi006.stdout:5187 trunc from 0xcc76d7b to 0xb899ae0 2024-09-14T06:00:26.271 INFO:teuthology.orchestra.run.smithi006.stdout:5188 write 0xad5d0b1 thru 0xad65c4e (0x8b9e bytes) 2024-09-14T06:00:26.290 INFO:teuthology.orchestra.run.smithi006.stdout:5189 writesame 0xda99eb3 thru 0xda9b6e6 data_size 0x2(0x1834 bytes) 2024-09-14T06:00:26.290 INFO:teuthology.orchestra.run.smithi006.stdout:5190 punch from 0xd0584fb to 0xd0607bf, (0x82c4 bytes) 2024-09-14T06:00:26.290 INFO:teuthology.orchestra.run.smithi006.stdout:5191 read 0x6857b thru 0x7811f (0xfba5 bytes) 2024-09-14T06:00:26.292 INFO:teuthology.orchestra.run.smithi006.stdout:5192 writesame 0x325797e thru 0x325cc05 data_size 0x4c(0x5288 bytes) 2024-09-14T06:00:26.312 INFO:teuthology.orchestra.run.smithi006.stdout:5193 trunc from 0xda9b6e7 to 0x7be93d7 2024-09-14T06:00:26.335 INFO:teuthology.orchestra.run.smithi006.stdout:5194 trunc from 0x7be93d7 to 0xaaedd32 2024-09-14T06:00:26.343 INFO:teuthology.orchestra.run.smithi006.stdout:5195 writesame 0xa7cc8a thru 0xa7dee1 data_size 0x4(0x1258 bytes) 2024-09-14T06:00:26.347 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:26.345+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:26.350 INFO:teuthology.orchestra.run.smithi006.stdout:5196 write 0x724c079 thru 0x7256f41 (0xaec9 bytes) 2024-09-14T06:00:26.358 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:26.360 INFO:teuthology.orchestra.run.smithi006.stdout:5199 trunc from 0xaaedd32 to 0x9d63894 2024-09-14T06:00:26.370 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:26.370 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:26.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:26.370 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:26.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.370 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23550 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 606208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.370 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:26.370 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.415355060000003, 2024-09-14T06:00:26.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048793072999999999, 2024-09-14T06:00:26.371 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.371 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.371 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.371 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.371 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.371 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.371 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23550 2024-09-14T06:00:26.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.371 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:26.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:26.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:26.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7800000000000002e-07 2024-09-14T06:00:26.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948677+0000", 2024-09-14T06:00:26.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1949999999999997e-06 2024-09-14T06:00:26.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948687+0000", 2024-09-14T06:00:26.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0849000000000001e-05 2024-09-14T06:00:26.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948692+0000", 2024-09-14T06:00:26.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8670000000000002e-06 2024-09-14T06:00:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997290+0000", 2024-09-14T06:00:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048597596999999999 2024-09-14T06:00:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997367+0000", 2024-09-14T06:00:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7236000000000004e-05 2024-09-14T06:00:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997462+0000", 2024-09-14T06:00:26.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4951000000000006e-05 2024-09-14T06:00:26.375 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.375 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.375 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.375 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23551 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 620544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.375 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:26.375 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.415324202999997, 2024-09-14T06:00:26.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048938838999999998, 2024-09-14T06:00:26.375 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.375 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.375 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.376 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23551 2024-09-14T06:00:26.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.376 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:26.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:26.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:26.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1e-07 2024-09-14T06:00:26.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948701+0000", 2024-09-14T06:00:26.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2950000000000001e-06 2024-09-14T06:00:26.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948705+0000", 2024-09-14T06:00:26.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7929999999999999e-06 2024-09-14T06:00:26.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948709+0000", 2024-09-14T06:00:26.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T06:00:26.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997535+0000", 2024-09-14T06:00:26.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048826181000000003 2024-09-14T06:00:26.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997580+0000", 2024-09-14T06:00:26.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5355000000000002e-05 2024-09-14T06:00:26.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997639+0000", 2024-09-14T06:00:26.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8479e-05 2024-09-14T06:00:26.379 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.379 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.379 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.380 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.380 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:26.380 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.415308725999999, 2024-09-14T06:00:26.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T06:00:26.380 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.380 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.380 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.380 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.380 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.380 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.380 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T06:00:26.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.381 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:26.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:26.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T06:00:26.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T06:00:26.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T06:00:26.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T06:00:26.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T06:00:26.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T06:00:26.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T06:00:26.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T06:00:26.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T06:00:26.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T06:00:26.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T06:00:26.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T06:00:26.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T06:00:26.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T06:00:26.384 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.384 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.384 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.384 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.385 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:26.385 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.415289451, 2024-09-14T06:00:26.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T06:00:26.385 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.385 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.385 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.385 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T06:00:26.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.386 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:26.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:26.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:26.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T06:00:26.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T06:00:26.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T06:00:26.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T06:00:26.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T06:00:26.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T06:00:26.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T06:00:26.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T06:00:26.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T06:00:26.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T06:00:26.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T06:00:26.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T06:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T06:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.415269875, 2024-09-14T06:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T06:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.390 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.391 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.391 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.391 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.391 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T06:00:26.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.391 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:26.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:26.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T06:00:26.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T06:00:26.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T06:00:26.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T06:00:26.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T06:00:26.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:26.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T06:00:26.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T06:00:26.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T06:00:26.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T06:00:26.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T06:00:26.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T06:00:26.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T06:00:26.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T06:00:26.394 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.394 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.394 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.395 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.395 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:26.395 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.415250417999999, 2024-09-14T06:00:26.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T06:00:26.395 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.395 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.395 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.395 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.395 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.395 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.395 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T06:00:26.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.395 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:26.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:26.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:26.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T06:00:26.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T06:00:26.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T06:00:26.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T06:00:26.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T06:00:26.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T06:00:26.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T06:00:26.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T06:00:26.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T06:00:26.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T06:00:26.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T06:00:26.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T06:00:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T06:00:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.415231366999997, 2024-09-14T06:00:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T06:00:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.400 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.400 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.400 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.400 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.400 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T06:00:26.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.400 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:26.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:26.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:26.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T06:00:26.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T06:00:26.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T06:00:26.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T06:00:26.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T06:00:26.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T06:00:26.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T06:00:26.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T06:00:26.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T06:00:26.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T06:00:26.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T06:00:26.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T06:00:26.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T06:00:26.403 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.403 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.403 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.404 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.404 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:26.404 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.415211685999999, 2024-09-14T06:00:26.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T06:00:26.404 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.404 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.404 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.404 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.404 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.404 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.404 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T06:00:26.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.405 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:26.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:26.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T06:00:26.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T06:00:26.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T06:00:26.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T06:00:26.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T06:00:26.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:26.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T06:00:26.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T06:00:26.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T06:00:26.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T06:00:26.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T06:00:26.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T06:00:26.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T06:00:26.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T06:00:26.408 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.408 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.408 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.408 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.408 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:26.408 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.415191735000001, 2024-09-14T06:00:26.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T06:00:26.408 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.409 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.409 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.409 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.409 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.409 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.409 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T06:00:26.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.409 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:26.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:26.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T06:00:26.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T06:00:26.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T06:00:26.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T06:00:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T06:00:26.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T06:00:26.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T06:00:26.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T06:00:26.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T06:00:26.412 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.412 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.412 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.415172423000001, 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.413 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:26.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T06:00:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T06:00:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T06:00:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T06:00:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T06:00:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T06:00:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T06:00:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T06:00:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T06:00:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T06:00:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T06:00:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T06:00:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T06:00:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.415152661999997, 2024-09-14T06:00:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T06:00:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.417 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T06:00:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T06:00:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:00:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T06:00:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T06:00:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T06:00:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T06:00:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T06:00:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T06:00:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.415131741000003, 2024-09-14T06:00:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T06:00:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T06:00:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T06:00:26.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T06:00:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T06:00:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T06:00:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T06:00:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T06:00:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T06:00:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T06:00:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T06:00:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T06:00:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T06:00:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T06:00:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.413972407000003, 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.426 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T06:00:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:26.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T06:00:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T06:00:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T06:00:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T06:00:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T06:00:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T06:00:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T06:00:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T06:00:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T06:00:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T06:00:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.430 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:26.431 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.413673625000001, 2024-09-14T06:00:26.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T06:00:26.431 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.431 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.431 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.431 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.431 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.431 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.431 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T06:00:26.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.431 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:26.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:26.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T06:00:26.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T06:00:26.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T06:00:26.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T06:00:26.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T06:00:26.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T06:00:26.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T06:00:26.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T06:00:26.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.434 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.435 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.435 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.435 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:26.435 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.413522886999999, 2024-09-14T06:00:26.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T06:00:26.435 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.435 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.435 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.436 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T06:00:26.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.436 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:26.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:26.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T06:00:26.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T06:00:26.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T06:00:26.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T06:00:26.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T06:00:26.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T06:00:26.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T06:00:26.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T06:00:26.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.439 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.439 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23582 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 911360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.439 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:26.439 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.412597499999997, 2024-09-14T06:00:26.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048708939999999999, 2024-09-14T06:00:26.439 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.440 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.440 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.440 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23582 2024-09-14T06:00:26.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.440 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:26.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:26.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:26.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6300000000000005e-07 2024-09-14T06:00:26.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951430+0000", 2024-09-14T06:00:26.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5179999999999999e-06 2024-09-14T06:00:26.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951437+0000", 2024-09-14T06:00:26.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0940000000000002e-06 2024-09-14T06:00:26.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951443+0000", 2024-09-14T06:00:26.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7910000000000001e-06 2024-09-14T06:00:26.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000047+0000", 2024-09-14T06:00:26.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048604550000000003 2024-09-14T06:00:26.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000095+0000", 2024-09-14T06:00:26.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7735999999999998e-05 2024-09-14T06:00:26.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000135+0000", 2024-09-14T06:00:26.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0587999999999998e-05 2024-09-14T06:00:26.443 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.443 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.443 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.444 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23588 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 722944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.444 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:26.444 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.412572634999997, 2024-09-14T06:00:26.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048792653999999998, 2024-09-14T06:00:26.444 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.444 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.444 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.444 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.444 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.444 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.444 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23588 2024-09-14T06:00:26.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951665+0000", 2024-09-14T06:00:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021337600000000001 2024-09-14T06:00:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951669+0000", 2024-09-14T06:00:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3460000000000004e-06 2024-09-14T06:00:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951688+0000", 2024-09-14T06:00:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9042000000000002e-05 2024-09-14T06:00:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951696+0000", 2024-09-14T06:00:26.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6660000000000008e-06 2024-09-14T06:00:26.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000162+0000", 2024-09-14T06:00:26.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048465824999999997 2024-09-14T06:00:26.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000199+0000", 2024-09-14T06:00:26.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7143e-05 2024-09-14T06:00:26.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000244+0000", 2024-09-14T06:00:26.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5256000000000002e-05 2024-09-14T06:00:26.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.448 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.448 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23590 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 745472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.448 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:26.448 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.41231518, 2024-09-14T06:00:26.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048677684999999998, 2024-09-14T06:00:26.448 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23590 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:26.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951850+0000", 2024-09-14T06:00:26.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014113 2024-09-14T06:00:26.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951855+0000", 2024-09-14T06:00:26.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6349999999999997e-06 2024-09-14T06:00:26.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951863+0000", 2024-09-14T06:00:26.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8189999999999998e-06 2024-09-14T06:00:26.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951871+0000", 2024-09-14T06:00:26.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2030000000000003e-06 2024-09-14T06:00:26.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000283+0000", 2024-09-14T06:00:26.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048412531000000002 2024-09-14T06:00:26.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000338+0000", 2024-09-14T06:00:26.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4462000000000001e-05 2024-09-14T06:00:26.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000387+0000", 2024-09-14T06:00:26.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8905e-05 2024-09-14T06:00:26.453 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.453 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.453 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.453 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T06:00:26.453 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:26.453 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 54.788221323999998, 2024-09-14T06:00:26.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T06:00:26.453 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.454 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.454 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:26.454 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:26.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:26.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T06:00:26.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T06:00:26.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T06:00:26.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T06:00:26.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T06:00:26.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T06:00:26.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:26.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T06:00:26.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T06:00:26.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T06:00:26.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T06:00:26.457 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.457 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.457 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 54.265131384999997, 2024-09-14T06:00:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T06:00:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T06:00:26.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T06:00:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T06:00:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T06:00:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T06:00:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T06:00:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T06:00:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T06:00:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T06:00:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T06:00:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T06:00:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T06:00:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T06:00:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T06:00:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T06:00:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T06:00:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T06:00:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T06:00:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.463 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.463 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:26.466 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:00:26.466 INFO:teuthology.orchestra.run.smithi006.stdout:5201 writesame 0xb730fda thru 0xb732610 data_size 0xb(0x1637 bytes) 2024-09-14T06:00:26.466 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:26.466 INFO:teuthology.orchestra.run.smithi006.stdout:5203 write 0x9e2fc84 thru 0x9e328a3 (0x2c20 bytes) 2024-09-14T06:00:26.466 INFO:teuthology.orchestra.run.smithi006.stdout:5207 punch from 0xa1bda26 to 0xa1c1e01, (0x43db bytes) 2024-09-14T06:00:26.466 INFO:teuthology.orchestra.run.smithi006.stdout:5208 trunc from 0xb732611 to 0x3e9f4fe 2024-09-14T06:00:26.466 INFO:teuthology.orchestra.run.smithi006.stdout:5209 read 0x23f8bdb thru 0x2400cad (0x80d3 bytes) 2024-09-14T06:00:26.467 INFO:teuthology.orchestra.run.smithi006.stdout:5210 punch from 0x60e4a9 to 0x614134, (0x5c8b bytes) 2024-09-14T06:00:26.467 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:26.467 INFO:teuthology.orchestra.run.smithi006.stdout:5213 write 0xc35fcc9 thru 0xc364d5b (0x5093 bytes) 2024-09-14T06:00:26.467 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:26.461+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:26.478 INFO:teuthology.orchestra.run.smithi006.stdout:5214 write 0x2841b48 thru 0x28519cc (0xfe85 bytes) 2024-09-14T06:00:26.491 INFO:teuthology.orchestra.run.smithi006.stdout:5215 punch from 0xa912601 to 0xa918e04, (0x6803 bytes) 2024-09-14T06:00:26.491 INFO:teuthology.orchestra.run.smithi006.stdout:5216 read 0x891a98b thru 0x891ce4e (0x24c4 bytes) 2024-09-14T06:00:26.491 INFO:teuthology.orchestra.run.smithi006.stdout:5217 write 0x777b2f3 thru 0x778b2c4 (0xffd2 bytes) 2024-09-14T06:00:26.502 INFO:teuthology.orchestra.run.smithi006.stdout:5218 punch from 0x724e8a4 to 0x725a180, (0xb8dc bytes) 2024-09-14T06:00:26.502 INFO:teuthology.orchestra.run.smithi006.stdout:5219 write 0xa0e68b5 thru 0xa0f32f2 (0xca3e bytes) 2024-09-14T06:00:26.513 INFO:teuthology.orchestra.run.smithi006.stdout:5220 write 0x54fee2e thru 0x5509b52 (0xad25 bytes) 2024-09-14T06:00:26.539 INFO:teuthology.orchestra.run.smithi006.stdout:5221 write 0xd6fb6ee thru 0xd6fe230 (0x2b43 bytes) 2024-09-14T06:00:26.548 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:26.549 INFO:teuthology.orchestra.run.smithi006.stdout:5223 writesame 0x1027d48 thru 0x102a063 data_size 0x2a(0x231c bytes) 2024-09-14T06:00:26.560 INFO:teuthology.orchestra.run.smithi006.stdout:5224 writesame 0x91806ef thru 0x9183d15 data_size 0x1(0x3627 bytes) 2024-09-14T06:00:26.566 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:26.561+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:26.573 INFO:teuthology.orchestra.run.smithi006.stdout:5225 trunc from 0xd6fe231 to 0xdd77a69 2024-09-14T06:00:26.585 INFO:teuthology.orchestra.run.smithi006.stdout:5226 read 0xcf05342 thru 0xcf0e8c6 (0x9585 bytes) 2024-09-14T06:00:26.585 INFO:teuthology.orchestra.run.smithi006.stdout:5227 write 0x6574435 thru 0x65780df (0x3cab bytes) 2024-09-14T06:00:26.592 INFO:teuthology.orchestra.run.smithi006.stdout:5228 read 0x1cbf67d thru 0x1ccddfe (0xe782 bytes) 2024-09-14T06:00:26.593 INFO:teuthology.orchestra.run.smithi006.stdout:5230 write 0x921f1e1 thru 0x92279d1 (0x87f1 bytes) 2024-09-14T06:00:26.603 INFO:teuthology.orchestra.run.smithi006.stdout:5231 write 0x708f288 thru 0x7096c5a (0x79d3 bytes) 2024-09-14T06:00:26.613 INFO:teuthology.orchestra.run.smithi006.stdout:5232 read 0x111f7d9 thru 0x112c4d8 (0xcd00 bytes) 2024-09-14T06:00:26.613 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:26.613 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:26.613 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:26.614 INFO:teuthology.orchestra.run.smithi006.stdout:5233 read 0xd6f4e9 thru 0xd6fdb4 (0x8cc bytes) 2024-09-14T06:00:26.623 INFO:teuthology.orchestra.run.smithi006.stdout:5234 trunc from 0xdd77a69 to 0xa708ae8 2024-09-14T06:00:26.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:00:26.632 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2024-09-14T06:00:26.645 INFO:teuthology.orchestra.run.smithi006.stdout:5235 writesame 0x49b4a99 thru 0x49b8ec4 data_size 0x2(0x442c bytes) 2024-09-14T06:00:26.654 INFO:teuthology.orchestra.run.smithi006.stdout:5236 read 0x2887943 thru 0x28913d8 (0x9a96 bytes) 2024-09-14T06:00:26.670 INFO:teuthology.orchestra.run.smithi006.stdout:5238 writesame 0xe2204aa thru 0xe224f12 data_size 0x1(0x4a69 bytes) 2024-09-14T06:00:26.670 INFO:teuthology.orchestra.run.smithi006.stdout:5239 writesame 0x4abd42e thru 0x4ac14c0 data_size 0x1(0x4093 bytes) 2024-09-14T06:00:26.673 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:26.671+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:26.680 INFO:teuthology.orchestra.run.smithi006.stdout:5241 writesame 0xdb59073 thru 0xdb596eb data_size 0x1(0x679 bytes) 2024-09-14T06:00:26.685 INFO:teuthology.orchestra.run.smithi006.stdout:5243 writesame 0x28a0407 thru 0x28b024a data_size 0x2(0xfe44 bytes) 2024-09-14T06:00:26.716 INFO:teuthology.orchestra.run.smithi006.stdout:5246 punch from 0x444a745 to 0x44533cf, (0x8c8a bytes) 2024-09-14T06:00:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:5247 read 0x4bc72b4 thru 0x4bcc5a7 (0x52f4 bytes) 2024-09-14T06:00:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:5249 read 0x3ed5fa3 thru 0x3ee1c08 (0xbc66 bytes) 2024-09-14T06:00:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:5250 read 0x5db8112 thru 0x5dbdbd7 (0x5ac6 bytes) 2024-09-14T06:00:26.717 INFO:teuthology.orchestra.run.smithi006.stdout:5251 writesame 0xd14a0bd thru 0xd154060 data_size 0x11(0x9fa4 bytes) 2024-09-14T06:00:26.728 INFO:teuthology.orchestra.run.smithi006.stdout:5252 clone 32 order 19 su 16384 sc 3 2024-09-14T06:00:26.755 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:26.755 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:26.756 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:26.756 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:26.756 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:26.768 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:26.765+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:26.769 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:00:26.869 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:26.869+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:26.937 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:26.937 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:26.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:26.937 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:26.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.937 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:26.937 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:26.937 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.390521030999999, 2024-09-14T06:00:26.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:00:26.938 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.938 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.938 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:26.938 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.938 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.938 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.938 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:00:26.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.938 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:26.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:26.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:00:26.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:00:26.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:00:26.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:00:26.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:00:26.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:00:26.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:00:26.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:00:26.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:00:26.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:00:26.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:00:26.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:00:26.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:00:26.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:00:26.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:00:26.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:26.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:00:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:00:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:00:26.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:00:26.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:26.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:00:26.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:00:26.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:00:26.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:00:26.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.948 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.948 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38842 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:26.948 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:26.948 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.415394310000003, 2024-09-14T06:00:26.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083698121, 2024-09-14T06:00:26.948 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.949 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.949 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.949 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.949 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.949 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.949 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38842 2024-09-14T06:00:26.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.949 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:26.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:26.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521563+0000", 2024-09-14T06:00:26.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:00:26.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521566+0000", 2024-09-14T06:00:26.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1140000000000002e-06 2024-09-14T06:00:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521575+0000", 2024-09-14T06:00:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8769999999999999e-06 2024-09-14T06:00:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521581+0000", 2024-09-14T06:00:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2369999999999997e-06 2024-09-14T06:00:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605076+0000", 2024-09-14T06:00:26.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083494992000000004 2024-09-14T06:00:26.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605168+0000", 2024-09-14T06:00:26.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1731999999999995e-05 2024-09-14T06:00:26.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605260+0000", 2024-09-14T06:00:26.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2511999999999998e-05 2024-09-14T06:00:26.953 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.953 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.953 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.953 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38844 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9469952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:26.953 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:26.953 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.415366943000002, 2024-09-14T06:00:26.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084006762999999998, 2024-09-14T06:00:26.953 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.953 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.953 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.954 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.954 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38844 2024-09-14T06:00:26.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.954 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:26.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:26.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521590+0000", 2024-09-14T06:00:26.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9699999999999996e-07 2024-09-14T06:00:26.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521593+0000", 2024-09-14T06:00:26.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5909999999999998e-06 2024-09-14T06:00:26.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521603+0000", 2024-09-14T06:00:26.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0642000000000001e-05 2024-09-14T06:00:26.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521609+0000", 2024-09-14T06:00:26.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1020000000000002e-06 2024-09-14T06:00:26.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605318+0000", 2024-09-14T06:00:26.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083709166000000002 2024-09-14T06:00:26.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605454+0000", 2024-09-14T06:00:26.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013557400000000001 2024-09-14T06:00:26.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605596+0000", 2024-09-14T06:00:26.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014209100000000001 2024-09-14T06:00:26.957 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.957 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.957 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.958 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38845 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9650176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:26.958 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:26.958 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.415338642999998, 2024-09-14T06:00:26.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084212700000000001, 2024-09-14T06:00:26.958 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.958 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.958 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.958 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.958 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.958 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.958 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38845 2024-09-14T06:00:26.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.958 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:26.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:26.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:26.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1200000000000003e-07 2024-09-14T06:00:26.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521628+0000", 2024-09-14T06:00:26.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0196e-05 2024-09-14T06:00:26.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521637+0000", 2024-09-14T06:00:26.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6649999999999992e-06 2024-09-14T06:00:26.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521643+0000", 2024-09-14T06:00:26.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.285e-06 2024-09-14T06:00:26.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605652+0000", 2024-09-14T06:00:26.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084009025000000001 2024-09-14T06:00:26.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605741+0000", 2024-09-14T06:00:26.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8473000000000005e-05 2024-09-14T06:00:26.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605830+0000", 2024-09-14T06:00:26.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9444000000000006e-05 2024-09-14T06:00:26.962 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.962 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.962 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.962 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38848 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8536064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:26.962 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:26.962 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.415300633999998, 2024-09-14T06:00:26.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084375567999999998, 2024-09-14T06:00:26.962 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.962 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.962 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.963 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.963 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.963 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.963 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38848 2024-09-14T06:00:26.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.963 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:26.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:26.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:26.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0200000000000002e-07 2024-09-14T06:00:26.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521659+0000", 2024-09-14T06:00:26.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7800000000000001e-06 2024-09-14T06:00:26.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521667+0000", 2024-09-14T06:00:26.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6599999999999995e-06 2024-09-14T06:00:26.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521674+0000", 2024-09-14T06:00:26.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4560000000000003e-06 2024-09-14T06:00:26.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605872+0000", 2024-09-14T06:00:26.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084198010000000004 2024-09-14T06:00:26.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605945+0000", 2024-09-14T06:00:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2681000000000004e-05 2024-09-14T06:00:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606031+0000", 2024-09-14T06:00:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6378999999999994e-05 2024-09-14T06:00:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38849 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9748480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.415270208000003, 2024-09-14T06:00:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084581577000000005, 2024-09-14T06:00:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38849 2024-09-14T06:00:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:26.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:26.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521687+0000", 2024-09-14T06:00:26.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9400000000000005e-07 2024-09-14T06:00:26.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521729+0000", 2024-09-14T06:00:26.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2657000000000002e-05 2024-09-14T06:00:26.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521749+0000", 2024-09-14T06:00:26.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9264000000000001e-05 2024-09-14T06:00:26.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521761+0000", 2024-09-14T06:00:26.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2289999999999999e-05 2024-09-14T06:00:26.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606078+0000", 2024-09-14T06:00:26.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084316772999999998 2024-09-14T06:00:26.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606176+0000", 2024-09-14T06:00:26.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7992999999999995e-05 2024-09-14T06:00:26.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606268+0000", 2024-09-14T06:00:26.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2006e-05 2024-09-14T06:00:26.971 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.971 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.971 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.971 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38851 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9928704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:26.971 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:26.971 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.415174896000003, 2024-09-14T06:00:26.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084695081000000005, 2024-09-14T06:00:26.971 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.971 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.972 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.972 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38851 2024-09-14T06:00:26.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.972 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:26.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521783+0000", 2024-09-14T06:00:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1000000000000001e-06 2024-09-14T06:00:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521788+0000", 2024-09-14T06:00:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2619999999999998e-06 2024-09-14T06:00:26.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521803+0000", 2024-09-14T06:00:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5421999999999999e-05 2024-09-14T06:00:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521815+0000", 2024-09-14T06:00:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.171e-05 2024-09-14T06:00:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606320+0000", 2024-09-14T06:00:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084504698000000003 2024-09-14T06:00:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606404+0000", 2024-09-14T06:00:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4379e-05 2024-09-14T06:00:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606476+0000", 2024-09-14T06:00:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2509999999999995e-05 2024-09-14T06:00:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.975 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.415124145999997, 2024-09-14T06:00:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:00:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:00:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:00:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:00:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:00:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:00:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:00:26.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:00:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:00:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:00:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:00:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:00:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:00:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:00:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:00:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:00:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.415085822999998, 2024-09-14T06:00:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:00:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:00:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:00:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:00:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:00:26.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:00:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:00:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:00:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:00:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:00:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:00:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:00:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:00:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:26.985 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.415059131, 2024-09-14T06:00:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:00:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:00:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:00:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:00:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:00:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:00:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:00:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:00:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:00:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:00:26.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:00:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:00:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:00:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:00:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:00:26.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:00:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.415033264999998, 2024-09-14T06:00:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:00:26.990 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:00:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:00:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:00:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:00:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:00:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:00:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:00:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:00:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:00:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:00:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:00:26.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:00:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:00:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:00:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:00:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:26.995 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.413932895999999, 2024-09-14T06:00:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:00:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:26.996 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:00:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:00:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:00:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:00:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:00:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:00:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:00:26.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:00:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:00:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:00:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:00:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:00:26.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:00:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:00:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:00:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:27.000 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.413888917000001, 2024-09-14T06:00:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:00:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:00:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.001 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:00:27.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:00:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:00:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:00:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:00:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:00:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:00:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:00:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:00:27.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:00:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:00:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:00:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:00:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:00:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.005 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38865 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1392640~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.412910539000002, 2024-09-14T06:00:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084340500999999998, 2024-09-14T06:00:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.006 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38865 2024-09-14T06:00:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.007 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524047+0000", 2024-09-14T06:00:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5290000000000001e-06 2024-09-14T06:00:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524054+0000", 2024-09-14T06:00:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1910000000000003e-06 2024-09-14T06:00:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524074+0000", 2024-09-14T06:00:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9383999999999999e-05 2024-09-14T06:00:27.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524089+0000", 2024-09-14T06:00:27.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4647000000000001e-05 2024-09-14T06:00:27.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608123+0000", 2024-09-14T06:00:27.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084034837000000001 2024-09-14T06:00:27.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608224+0000", 2024-09-14T06:00:27.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100182 2024-09-14T06:00:27.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608386+0000", 2024-09-14T06:00:27.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162731 2024-09-14T06:00:27.012 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.012 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.412827157000002, 2024-09-14T06:00:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:00:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.013 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:00:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:00:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:00:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:00:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:00:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:00:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:00:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:00:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:00:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:00:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:00:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:00:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:00:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:00:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:00:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38869 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.412421686999998, 2024-09-14T06:00:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084608905999999998, 2024-09-14T06:00:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38869 2024-09-14T06:00:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525138+0000", 2024-09-14T06:00:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00060367999999999999 2024-09-14T06:00:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525160+0000", 2024-09-14T06:00:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1875999999999999e-05 2024-09-14T06:00:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525182+0000", 2024-09-14T06:00:27.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1427e-05 2024-09-14T06:00:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525198+0000", 2024-09-14T06:00:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507e-05 2024-09-14T06:00:27.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608907+0000", 2024-09-14T06:00:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083708535000000001 2024-09-14T06:00:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609011+0000", 2024-09-14T06:00:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010461199999999999 2024-09-14T06:00:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609144+0000", 2024-09-14T06:00:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013226899999999999 2024-09-14T06:00:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38871 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1671168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.411730476999999, 2024-09-14T06:00:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084308214000000006, 2024-09-14T06:00:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38871 2024-09-14T06:00:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525487+0000", 2024-09-14T06:00:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026091100000000001 2024-09-14T06:00:27.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525493+0000", 2024-09-14T06:00:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.742e-06 2024-09-14T06:00:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525508+0000", 2024-09-14T06:00:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525518+0000", 2024-09-14T06:00:27.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8500000000000006e-06 2024-09-14T06:00:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609229+0000", 2024-09-14T06:00:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083711775000000002 2024-09-14T06:00:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609388+0000", 2024-09-14T06:00:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158286 2024-09-14T06:00:27.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609534+0000", 2024-09-14T06:00:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000146308 2024-09-14T06:00:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38873 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 737280~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.411418904999998, 2024-09-14T06:00:27.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084288875999999999, 2024-09-14T06:00:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38873 2024-09-14T06:00:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526372+0000", 2024-09-14T06:00:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00083508200000000001 2024-09-14T06:00:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526383+0000", 2024-09-14T06:00:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0282000000000001e-05 2024-09-14T06:00:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526445+0000", 2024-09-14T06:00:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1975000000000002e-05 2024-09-14T06:00:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526460+0000", 2024-09-14T06:00:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5233e-05 2024-09-14T06:00:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609585+0000", 2024-09-14T06:00:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083125216000000002 2024-09-14T06:00:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609689+0000", 2024-09-14T06:00:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104126 2024-09-14T06:00:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609826+0000", 2024-09-14T06:00:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013696199999999999 2024-09-14T06:00:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.032 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38874 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.410451971000001, 2024-09-14T06:00:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083631987000000005, 2024-09-14T06:00:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38874 2024-09-14T06:00:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526505+0000", 2024-09-14T06:00:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7699999999999992e-07 2024-09-14T06:00:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526511+0000", 2024-09-14T06:00:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9139999999999996e-06 2024-09-14T06:00:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526525+0000", 2024-09-14T06:00:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3644e-05 2024-09-14T06:00:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526533+0000", 2024-09-14T06:00:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6510000000000001e-06 2024-09-14T06:00:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609897+0000", 2024-09-14T06:00:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083364173 2024-09-14T06:00:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610007+0000", 2024-09-14T06:00:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110707 2024-09-14T06:00:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610136+0000", 2024-09-14T06:00:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012892099999999999 2024-09-14T06:00:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38877 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1949696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:27.038 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.410407278000001, 2024-09-14T06:00:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083886717, 2024-09-14T06:00:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38877 2024-09-14T06:00:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529354+0000", 2024-09-14T06:00:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028049170000000001 2024-09-14T06:00:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529373+0000", 2024-09-14T06:00:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.933e-05 2024-09-14T06:00:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529399+0000", 2024-09-14T06:00:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6129e-05 2024-09-14T06:00:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529418+0000", 2024-09-14T06:00:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8944e-05 2024-09-14T06:00:27.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610197+0000", 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080778271999999998 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610300+0000", 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103868 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610436+0000", 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013525700000000001 2024-09-14T06:00:27.042 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.043 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.043 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:27.044 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:00:27.045 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:27.041+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:27.146 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:27.143+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:27.170 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:27.170 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:27.170 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:27.170 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:27.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:00:27.246 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:27.245+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:27.347 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:27.345+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:27.349 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:27.350 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:27.350 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:27.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:00:27.447 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:27.445+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:27.487 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59148 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 419840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.218639848999999, 2024-09-14T06:00:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072974285999999999, 2024-09-14T06:00:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59148 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268521+0000", 2024-09-14T06:00:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4199999999999995e-07 2024-09-14T06:00:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268524+0000", 2024-09-14T06:00:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.05e-06 2024-09-14T06:00:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268534+0000", 2024-09-14T06:00:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8719999999999997e-06 2024-09-14T06:00:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268541+0000", 2024-09-14T06:00:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5349999999999999e-06 2024-09-14T06:00:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341108+0000", 2024-09-14T06:00:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072566624999999996 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341169+0000", 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1251e-05 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341494+0000", 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325311 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59149 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 436224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.218600625000001, 2024-09-14T06:00:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073405053999999997, 2024-09-14T06:00:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59149 2024-09-14T06:00:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268560+0000", 2024-09-14T06:00:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9999999999999997e-07 2024-09-14T06:00:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268563+0000", 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.292e-06 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268573+0000", 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3260000000000002e-06 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268581+0000", 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1960000000000008e-06 2024-09-14T06:00:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341537+0000", 2024-09-14T06:00:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072955916999999995 2024-09-14T06:00:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341641+0000", 2024-09-14T06:00:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104341 2024-09-14T06:00:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341964+0000", 2024-09-14T06:00:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032328199999999999 2024-09-14T06:00:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59150 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 452608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.218567385, 2024-09-14T06:00:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073829748000000001, 2024-09-14T06:00:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59150 2024-09-14T06:00:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0399999999999995e-07 2024-09-14T06:00:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268596+0000", 2024-09-14T06:00:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9859999999999999e-06 2024-09-14T06:00:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268606+0000", 2024-09-14T06:00:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0088000000000001e-05 2024-09-14T06:00:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268614+0000", 2024-09-14T06:00:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T06:00:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341999+0000", 2024-09-14T06:00:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073385011999999999 2024-09-14T06:00:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342093+0000", 2024-09-14T06:00:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3793000000000001e-05 2024-09-14T06:00:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342422+0000", 2024-09-14T06:00:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000329129 2024-09-14T06:00:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59151 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.218535017000001, 2024-09-14T06:00:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074207289999999995, 2024-09-14T06:00:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59151 2024-09-14T06:00:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268626+0000", 2024-09-14T06:00:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T06:00:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268629+0000", 2024-09-14T06:00:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.038e-06 2024-09-14T06:00:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268638+0000", 2024-09-14T06:00:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8139999999999995e-06 2024-09-14T06:00:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268647+0000", 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4889999999999995e-06 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342457+0000", 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073809890000000003 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342545+0000", 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8697999999999997e-05 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342832+0000", 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028681799999999999 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59152 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.218502376000004, 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074695176000000002, 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59152 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2900000000000003e-07 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268661+0000", 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0230000000000001e-06 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268670+0000", 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2129999999999997e-06 2024-09-14T06:00:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268679+0000", 2024-09-14T06:00:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-09-14T06:00:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342937+0000", 2024-09-14T06:00:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074258781999999995 2024-09-14T06:00:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343044+0000", 2024-09-14T06:00:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-09-14T06:00:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343353+0000", 2024-09-14T06:00:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030911099999999999 2024-09-14T06:00:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59153 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 501760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.218469605999999, 2024-09-14T06:00:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074997241000000006, 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59153 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268691+0000", 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268693+0000", 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3599999999999999e-06 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268699+0000", 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268704+0000", 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5759999999999999e-06 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343398+0000", 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074694522999999999 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343450+0000", 2024-09-14T06:00:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1350999999999997e-05 2024-09-14T06:00:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343688+0000", 2024-09-14T06:00:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023806500000000001 2024-09-14T06:00:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59154 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 518144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.218450539999999, 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075389938000000004, 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59154 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268710+0000", 2024-09-14T06:00:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8000000000000001e-07 2024-09-14T06:00:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268712+0000", 2024-09-14T06:00:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T06:00:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268717+0000", 2024-09-14T06:00:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8570000000000003e-06 2024-09-14T06:00:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268721+0000", 2024-09-14T06:00:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2039999999999999e-06 2024-09-14T06:00:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343721+0000", 2024-09-14T06:00:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074999748000000005 2024-09-14T06:00:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343784+0000", 2024-09-14T06:00:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3174000000000002e-05 2024-09-14T06:00:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.344099+0000", 2024-09-14T06:00:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000315299 2024-09-14T06:00:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59398 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 323584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.207486291999999, 2024-09-14T06:00:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073326565999999996, 2024-09-14T06:00:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59398 2024-09-14T06:00:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279675+0000", 2024-09-14T06:00:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-14T06:00:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279681+0000", 2024-09-14T06:00:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-09-14T06:00:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279702+0000", 2024-09-14T06:00:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1259000000000001e-05 2024-09-14T06:00:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279718+0000", 2024-09-14T06:00:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5475999999999999e-05 2024-09-14T06:00:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352360+0000", 2024-09-14T06:00:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.07264226 2024-09-14T06:00:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352447+0000", 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7381999999999998e-05 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353000+0000", 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055309200000000004 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59399 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.207421928999999, 2024-09-14T06:00:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073824446000000002, 2024-09-14T06:00:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59399 2024-09-14T06:00:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279739+0000", 2024-09-14T06:00:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T06:00:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279745+0000", 2024-09-14T06:00:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T06:00:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279767+0000", 2024-09-14T06:00:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639000000000001e-05 2024-09-14T06:00:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279781+0000", 2024-09-14T06:00:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4511999999999999e-05 2024-09-14T06:00:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353045+0000", 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073263718000000005 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353168+0000", 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012314499999999999 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353562+0000", 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039435199999999999 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59400 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.207358169000003, 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074271465999999994, 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59400 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279803+0000", 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2100000000000001e-06 2024-09-14T06:00:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279819+0000", 2024-09-14T06:00:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6409000000000002e-05 2024-09-14T06:00:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279841+0000", 2024-09-14T06:00:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1878e-05 2024-09-14T06:00:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279856+0000", 2024-09-14T06:00:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4392999999999999e-05 2024-09-14T06:00:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353650+0000", 2024-09-14T06:00:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073794144000000006 2024-09-14T06:00:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353757+0000", 2024-09-14T06:00:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010687 2024-09-14T06:00:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354073+0000", 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000316562 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59401 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 372736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.207283343999997, 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074643900999999999, 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59401 2024-09-14T06:00:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279878+0000", 2024-09-14T06:00:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.31e-06 2024-09-14T06:00:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279883+0000", 2024-09-14T06:00:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3770000000000004e-06 2024-09-14T06:00:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279906+0000", 2024-09-14T06:00:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2398000000000001e-05 2024-09-14T06:00:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279920+0000", 2024-09-14T06:00:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.402e-05 2024-09-14T06:00:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354125+0000", 2024-09-14T06:00:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074205750000000001 2024-09-14T06:00:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354227+0000", 2024-09-14T06:00:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101612 2024-09-14T06:00:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354521+0000", 2024-09-14T06:00:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029343400000000002 2024-09-14T06:00:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.536 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59402 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 389120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.536 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:27.536 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.207221761, 2024-09-14T06:00:27.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075017027999999999, 2024-09-14T06:00:27.536 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.536 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.536 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.536 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.536 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.536 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.536 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59402 2024-09-14T06:00:27.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.536 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279939+0000", 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2470000000000001e-06 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279945+0000", 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279966+0000", 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1801999999999999e-05 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279980+0000", 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3589e-05 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354569+0000", 2024-09-14T06:00:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074588707000000004 2024-09-14T06:00:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354671+0000", 2024-09-14T06:00:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102398 2024-09-14T06:00:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354955+0000", 2024-09-14T06:00:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028406500000000001 2024-09-14T06:00:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59403 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 405504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.207159974, 2024-09-14T06:00:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075434395000000001, 2024-09-14T06:00:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59403 2024-09-14T06:00:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280001+0000", 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2669999999999999e-06 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280008+0000", 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5849999999999996e-06 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280030+0000", 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2293000000000002e-05 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280044+0000", 2024-09-14T06:00:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3974999999999999e-05 2024-09-14T06:00:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355013+0000", 2024-09-14T06:00:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074969039000000001 2024-09-14T06:00:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355144+0000", 2024-09-14T06:00:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000131333 2024-09-14T06:00:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355434+0000", 2024-09-14T06:00:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028990299999999999 2024-09-14T06:00:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59404 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.207094855000001, 2024-09-14T06:00:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075696103000000001, 2024-09-14T06:00:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59404 2024-09-14T06:00:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280066+0000", 2024-09-14T06:00:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2640000000000001e-06 2024-09-14T06:00:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280072+0000", 2024-09-14T06:00:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129999999999997e-06 2024-09-14T06:00:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280094+0000", 2024-09-14T06:00:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2608000000000001e-05 2024-09-14T06:00:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280109+0000", 2024-09-14T06:00:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355479+0000", 2024-09-14T06:00:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075370699999999999 2024-09-14T06:00:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355554+0000", 2024-09-14T06:00:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4674999999999999e-05 2024-09-14T06:00:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355761+0000", 2024-09-14T06:00:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-14T06:00:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59405 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.207030945, 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076008867999999993, 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59405 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280130+0000", 2024-09-14T06:00:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2500000000000001e-06 2024-09-14T06:00:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280136+0000", 2024-09-14T06:00:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-09-14T06:00:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280158+0000", 2024-09-14T06:00:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1795000000000001e-05 2024-09-14T06:00:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280172+0000", 2024-09-14T06:00:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4303e-05 2024-09-14T06:00:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355797+0000", 2024-09-14T06:00:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075624835000000001 2024-09-14T06:00:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355866+0000", 2024-09-14T06:00:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9043999999999998e-05 2024-09-14T06:00:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356138+0000", 2024-09-14T06:00:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027207799999999998 2024-09-14T06:00:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59406 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.206967003000003, 2024-09-14T06:00:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076435642999999998, 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59406 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280194+0000", 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280200+0000", 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6359999999999999e-06 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280222+0000", 2024-09-14T06:00:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1628999999999999e-05 2024-09-14T06:00:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280236+0000", 2024-09-14T06:00:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4413000000000001e-05 2024-09-14T06:00:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356172+0000", 2024-09-14T06:00:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075936466999999994 2024-09-14T06:00:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356260+0000", 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7437999999999999e-05 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356629+0000", 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036877600000000002 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59407 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 471040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.206902769999999, 2024-09-14T06:00:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076820083999999997, 2024-09-14T06:00:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59407 2024-09-14T06:00:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280258+0000", 2024-09-14T06:00:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1370000000000001e-06 2024-09-14T06:00:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280264+0000", 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6930000000000004e-06 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280285+0000", 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1455999999999999e-05 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280300+0000", 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4319e-05 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356676+0000", 2024-09-14T06:00:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076376615999999994 2024-09-14T06:00:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356768+0000", 2024-09-14T06:00:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1234000000000001e-05 2024-09-14T06:00:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357077+0000", 2024-09-14T06:00:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030962900000000001 2024-09-14T06:00:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59408 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 487424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.20683777, 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077185511999999998, 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59408 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280323+0000", 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2860000000000001e-06 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280329+0000", 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.553e-06 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280352+0000", 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280366+0000", 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357126+0000", 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076760326000000004 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357223+0000", 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6490000000000006e-05 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357508+0000", 2024-09-14T06:00:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028479900000000002 2024-09-14T06:00:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59409 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.20677354, 2024-09-14T06:00:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077536090000000002, 2024-09-14T06:00:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59409 2024-09-14T06:00:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280388+0000", 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.096e-06 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280393+0000", 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280414+0000", 2024-09-14T06:00:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1175999999999999e-05 2024-09-14T06:00:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280427+0000", 2024-09-14T06:00:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3032e-05 2024-09-14T06:00:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357553+0000", 2024-09-14T06:00:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077125845999999998 2024-09-14T06:00:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357624+0000", 2024-09-14T06:00:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1062000000000005e-05 2024-09-14T06:00:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357923+0000", 2024-09-14T06:00:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029891199999999997 2024-09-14T06:00:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59410 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.206714228000003, 2024-09-14T06:00:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077854494999999996, 2024-09-14T06:00:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59410 2024-09-14T06:00:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280447+0000", 2024-09-14T06:00:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069999999999999e-06 2024-09-14T06:00:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280453+0000", 2024-09-14T06:00:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-06 2024-09-14T06:00:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280471+0000", 2024-09-14T06:00:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8295999999999999e-05 2024-09-14T06:00:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280484+0000", 2024-09-14T06:00:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2609000000000001e-05 2024-09-14T06:00:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357954+0000", 2024-09-14T06:00:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077470405000000006 2024-09-14T06:00:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358040+0000", 2024-09-14T06:00:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.551e-05 2024-09-14T06:00:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358300+0000", 2024-09-14T06:00:27.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026036800000000003 2024-09-14T06:00:27.575 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.575 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.575 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.575 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:27.575 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:27.575 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:27.576 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:00:27.577 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:27.571+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:27.677 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:27.673+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:27.758 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:27.758 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:27.758 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:27.758 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:27.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:00:27.781 INFO:teuthology.orchestra.run.smithi006.stdout:leaving image image_client.0-clone31 intact 2024-09-14T06:00:27.817 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:27.815+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:27.879 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:27.877+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:27.892 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:27.892 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:27.892 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:27.892 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:27.892 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:27.907 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:00:27.979 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:27.977+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:28.037 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-14T06:00:28.071 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:28.071 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:28.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:28.071 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:28.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.071 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38916 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5193728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.071 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.529906+0000", 2024-09-14T06:00:28.071 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.539833612999999, 2024-09-14T06:00:28.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083853568000000003, 2024-09-14T06:00:28.071 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.071 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.071 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.072 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.072 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.072 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.072 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38916 2024-09-14T06:00:28.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.072 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529906+0000", 2024-09-14T06:00:28.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529906+0000", 2024-09-14T06:00:28.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530166+0000", 2024-09-14T06:00:28.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026013499999999999 2024-09-14T06:00:28.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530171+0000", 2024-09-14T06:00:28.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1800000000000004e-06 2024-09-14T06:00:28.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530186+0000", 2024-09-14T06:00:28.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5342e-05 2024-09-14T06:00:28.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530200+0000", 2024-09-14T06:00:28.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3349e-05 2024-09-14T06:00:28.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613496+0000", 2024-09-14T06:00:28.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083296674000000001 2024-09-14T06:00:28.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613612+0000", 2024-09-14T06:00:28.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115895 2024-09-14T06:00:28.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613759+0000", 2024-09-14T06:00:28.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014699299999999999 2024-09-14T06:00:28.075 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.075 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.075 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.076 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38918 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5292032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.076 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530216+0000", 2024-09-14T06:00:28.076 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.539522988000002, 2024-09-14T06:00:28.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083840804000000005, 2024-09-14T06:00:28.076 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.076 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.076 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.076 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.076 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.076 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.076 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38918 2024-09-14T06:00:28.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.077 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530216+0000", 2024-09-14T06:00:28.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530216+0000", 2024-09-14T06:00:28.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530276+0000", 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9855000000000002e-05 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530284+0000", 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0129999999999993e-06 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530305+0000", 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0574999999999999e-05 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530320+0000", 2024-09-14T06:00:28.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5231999999999999e-05 2024-09-14T06:00:28.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613799+0000", 2024-09-14T06:00:28.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083479131999999998 2024-09-14T06:00:28.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613911+0000", 2024-09-14T06:00:28.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011215200000000001 2024-09-14T06:00:28.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614057+0000", 2024-09-14T06:00:28.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000145845 2024-09-14T06:00:28.080 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.080 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.080 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.080 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38919 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5472256~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.080 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530345+0000", 2024-09-14T06:00:28.080 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.539394368000004, 2024-09-14T06:00:28.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083997022000000005, 2024-09-14T06:00:28.080 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.080 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38919 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530345+0000", 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530345+0000", 2024-09-14T06:00:28.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530627+0000", 2024-09-14T06:00:28.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028190700000000002 2024-09-14T06:00:28.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530637+0000", 2024-09-14T06:00:28.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0005e-05 2024-09-14T06:00:28.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530662+0000", 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5065000000000001e-05 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530679+0000", 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7255999999999999e-05 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614130+0000", 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083450478999999994 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614225+0000", 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5451000000000005e-05 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614342+0000", 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116859 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38921 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6684672~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530704+0000", 2024-09-14T06:00:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.539035361000003, 2024-09-14T06:00:28.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083903330999999998, 2024-09-14T06:00:28.085 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.085 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.085 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.085 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.085 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.085 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.085 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38921 2024-09-14T06:00:28.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.085 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530704+0000", 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530704+0000", 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530705+0000", 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1939999999999999e-06 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530709+0000", 2024-09-14T06:00:28.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1289999999999998e-06 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530721+0000", 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530728+0000", 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7729999999999999e-06 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614393+0000", 2024-09-14T06:00:28.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083665164 2024-09-14T06:00:28.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614489+0000", 2024-09-14T06:00:28.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5168999999999996e-05 2024-09-14T06:00:28.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614607+0000", 2024-09-14T06:00:28.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011856 2024-09-14T06:00:28.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.088 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38924 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5570560~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530740+0000", 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.538999680000003, 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084072167000000003, 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38924 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530740+0000", 2024-09-14T06:00:28.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530740+0000", 2024-09-14T06:00:28.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530881+0000", 2024-09-14T06:00:28.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014107799999999999 2024-09-14T06:00:28.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530889+0000", 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1659999999999994e-06 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530908+0000", 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8732e-05 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530917+0000", 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4390000000000006e-06 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614661+0000", 2024-09-14T06:00:28.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083743567000000005 2024-09-14T06:00:28.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614736+0000", 2024-09-14T06:00:28.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5394000000000004e-05 2024-09-14T06:00:28.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614812+0000", 2024-09-14T06:00:28.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5791000000000007e-05 2024-09-14T06:00:28.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.093 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.093 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.093 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38925 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5750784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.093 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530934+0000", 2024-09-14T06:00:28.093 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.538805132999997, 2024-09-14T06:00:28.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084075189999999994, 2024-09-14T06:00:28.093 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.093 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.093 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38925 2024-09-14T06:00:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530934+0000", 2024-09-14T06:00:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530934+0000", 2024-09-14T06:00:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531235+0000", 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030118899999999999 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531244+0000", 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1530000000000003e-06 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531267+0000", 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2688e-05 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531284+0000", 2024-09-14T06:00:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6558999999999998e-05 2024-09-14T06:00:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614874+0000", 2024-09-14T06:00:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083590082999999996 2024-09-14T06:00:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614937+0000", 2024-09-14T06:00:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3085999999999999e-05 2024-09-14T06:00:28.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615009+0000", 2024-09-14T06:00:28.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2432e-05 2024-09-14T06:00:28.097 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.097 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.097 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.097 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38927 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6963200~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.097 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.531313+0000", 2024-09-14T06:00:28.097 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.538426399999999, 2024-09-14T06:00:28.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083845550000000005, 2024-09-14T06:00:28.097 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.098 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.098 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.098 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38927 2024-09-14T06:00:28.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.098 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531313+0000", 2024-09-14T06:00:28.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531313+0000", 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531590+0000", 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027672100000000001 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531597+0000", 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.61e-06 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531622+0000", 2024-09-14T06:00:28.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5001e-05 2024-09-14T06:00:28.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531634+0000", 2024-09-14T06:00:28.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1756000000000001e-05 2024-09-14T06:00:28.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615045+0000", 2024-09-14T06:00:28.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083411336000000003 2024-09-14T06:00:28.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615093+0000", 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7812999999999998e-05 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615158+0000", 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5313000000000003e-05 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.101 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38930 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.102 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.531670+0000", 2024-09-14T06:00:28.102 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.538069268999998, 2024-09-14T06:00:28.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083704600000000004, 2024-09-14T06:00:28.102 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.102 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.102 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.102 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.102 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.102 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.102 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38930 2024-09-14T06:00:28.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.102 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531670+0000", 2024-09-14T06:00:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531670+0000", 2024-09-14T06:00:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531671+0000", 2024-09-14T06:00:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1200000000000001e-06 2024-09-14T06:00:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531675+0000", 2024-09-14T06:00:28.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5530000000000001e-06 2024-09-14T06:00:28.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531688+0000", 2024-09-14T06:00:28.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3592e-05 2024-09-14T06:00:28.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531696+0000", 2024-09-14T06:00:28.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-09-14T06:00:28.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615191+0000", 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083494833000000004 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615258+0000", 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7366000000000005e-05 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615375+0000", 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011620600000000001 2024-09-14T06:00:28.105 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38933 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7241728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.531708+0000", 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.538030818000003, 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083895771999999993, 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.106 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38933 2024-09-14T06:00:28.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.107 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531708+0000", 2024-09-14T06:00:28.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531708+0000", 2024-09-14T06:00:28.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532040+0000", 2024-09-14T06:00:28.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00033176599999999999 2024-09-14T06:00:28.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532049+0000", 2024-09-14T06:00:28.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3289999999999994e-06 2024-09-14T06:00:28.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532070+0000", 2024-09-14T06:00:28.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1498999999999999e-05 2024-09-14T06:00:28.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532086+0000", 2024-09-14T06:00:28.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5775000000000001e-05 2024-09-14T06:00:28.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615432+0000", 2024-09-14T06:00:28.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083345742 2024-09-14T06:00:28.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615515+0000", 2024-09-14T06:00:28.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3834999999999999e-05 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615604+0000", 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8826000000000006e-05 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38935 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532153+0000", 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.537585847999999, 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083756399999999995, 2024-09-14T06:00:28.110 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.111 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.111 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.111 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38935 2024-09-14T06:00:28.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.111 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532153+0000", 2024-09-14T06:00:28.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532153+0000", 2024-09-14T06:00:28.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532155+0000", 2024-09-14T06:00:28.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5540000000000001e-06 2024-09-14T06:00:28.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532162+0000", 2024-09-14T06:00:28.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-09-14T06:00:28.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532183+0000", 2024-09-14T06:00:28.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1219000000000001e-05 2024-09-14T06:00:28.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532199+0000", 2024-09-14T06:00:28.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5707999999999999e-05 2024-09-14T06:00:28.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615666+0000", 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083467348999999996 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615774+0000", 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108513 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615910+0000", 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013539199999999999 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.115 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38938 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.115 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532221+0000", 2024-09-14T06:00:28.115 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.537518640000002, 2024-09-14T06:00:28.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942434999999996, 2024-09-14T06:00:28.115 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.115 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.115 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.115 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38938 2024-09-14T06:00:28.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.116 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532221+0000", 2024-09-14T06:00:28.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532221+0000", 2024-09-14T06:00:28.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532520+0000", 2024-09-14T06:00:28.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029975599999999998 2024-09-14T06:00:28.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532537+0000", 2024-09-14T06:00:28.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6325e-05 2024-09-14T06:00:28.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532555+0000", 2024-09-14T06:00:28.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8796000000000001e-05 2024-09-14T06:00:28.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532567+0000", 2024-09-14T06:00:28.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1691999999999999e-05 2024-09-14T06:00:28.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615972+0000", 2024-09-14T06:00:28.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083404513999999999 2024-09-14T06:00:28.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616068+0000", 2024-09-14T06:00:28.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6484999999999995e-05 2024-09-14T06:00:28.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616163+0000", 2024-09-14T06:00:28.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4866999999999998e-05 2024-09-14T06:00:28.119 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.119 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.119 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.119 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38939 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7520256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.119 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532620+0000", 2024-09-14T06:00:28.119 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.537119719000003, 2024-09-14T06:00:28.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083789983999999998, 2024-09-14T06:00:28.120 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.120 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.120 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.120 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38939 2024-09-14T06:00:28.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.120 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532620+0000", 2024-09-14T06:00:28.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532620+0000", 2024-09-14T06:00:28.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532621+0000", 2024-09-14T06:00:28.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.15e-06 2024-09-14T06:00:28.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532625+0000", 2024-09-14T06:00:28.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9770000000000002e-06 2024-09-14T06:00:28.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532637+0000", 2024-09-14T06:00:28.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1902000000000001e-05 2024-09-14T06:00:28.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532645+0000", 2024-09-14T06:00:28.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0059999999999992e-06 2024-09-14T06:00:28.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616213+0000", 2024-09-14T06:00:28.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083568086999999999 2024-09-14T06:00:28.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616311+0000", 2024-09-14T06:00:28.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8342000000000001e-05 2024-09-14T06:00:28.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616410+0000", 2024-09-14T06:00:28.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8519999999999999e-05 2024-09-14T06:00:28.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.123 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.124 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38941 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.124 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532657+0000", 2024-09-14T06:00:28.124 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.537082574999999, 2024-09-14T06:00:28.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083960503000000006, 2024-09-14T06:00:28.124 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.124 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.124 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.124 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38941 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532657+0000", 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532657+0000", 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532932+0000", 2024-09-14T06:00:28.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027501099999999997 2024-09-14T06:00:28.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532938+0000", 2024-09-14T06:00:28.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.857e-06 2024-09-14T06:00:28.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532959+0000", 2024-09-14T06:00:28.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1773999999999999e-05 2024-09-14T06:00:28.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532975+0000", 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5858999999999998e-05 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616462+0000", 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083486949000000005 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616524+0000", 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2255999999999995e-05 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616617+0000", 2024-09-14T06:00:28.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2796999999999999e-05 2024-09-14T06:00:28.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.128 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.128 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38944 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7618560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.128 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533002+0000", 2024-09-14T06:00:28.128 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.536737426000002, 2024-09-14T06:00:28.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083846326999999998, 2024-09-14T06:00:28.128 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.128 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.129 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.129 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38944 2024-09-14T06:00:28.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.129 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533002+0000", 2024-09-14T06:00:28.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533002+0000", 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533107+0000", 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104955 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533115+0000", 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3890000000000005e-06 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533138+0000", 2024-09-14T06:00:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3302000000000002e-05 2024-09-14T06:00:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533155+0000", 2024-09-14T06:00:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6201e-05 2024-09-14T06:00:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616671+0000", 2024-09-14T06:00:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083516786999999995 2024-09-14T06:00:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616762+0000", 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0162999999999997e-05 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616848+0000", 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.653e-05 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38945 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533182+0000", 2024-09-14T06:00:28.132 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.536557326999997, 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083811267999999994, 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38945 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533182+0000", 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533182+0000", 2024-09-14T06:00:28.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533333+0000", 2024-09-14T06:00:28.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000150588 2024-09-14T06:00:28.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533342+0000", 2024-09-14T06:00:28.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0089999999999996e-06 2024-09-14T06:00:28.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533365+0000", 2024-09-14T06:00:28.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3771e-05 2024-09-14T06:00:28.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533382+0000", 2024-09-14T06:00:28.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6748999999999998e-05 2024-09-14T06:00:28.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616884+0000", 2024-09-14T06:00:28.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083502178999999996 2024-09-14T06:00:28.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616930+0000", 2024-09-14T06:00:28.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5312999999999998e-05 2024-09-14T06:00:28.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616993+0000", 2024-09-14T06:00:28.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3658999999999995e-05 2024-09-14T06:00:28.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.136 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.137 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.137 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38947 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7897088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.137 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533411+0000", 2024-09-14T06:00:28.137 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.536328416000003, 2024-09-14T06:00:28.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083860599999999993, 2024-09-14T06:00:28.137 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.137 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.137 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.137 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.137 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.137 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.137 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38947 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533411+0000", 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533411+0000", 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533731+0000", 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031991499999999999 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533738+0000", 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8820000000000003e-06 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533766+0000", 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8218e-05 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533781+0000", 2024-09-14T06:00:28.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4799e-05 2024-09-14T06:00:28.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617052+0000", 2024-09-14T06:00:28.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083271607999999997 2024-09-14T06:00:28.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617163+0000", 2024-09-14T06:00:28.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011053299999999999 2024-09-14T06:00:28.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617271+0000", 2024-09-14T06:00:28.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108645 2024-09-14T06:00:28.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.141 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.141 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38948 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 8077312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.141 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533801+0000", 2024-09-14T06:00:28.141 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.535938541, 2024-09-14T06:00:28.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083665502000000003, 2024-09-14T06:00:28.141 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.141 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.141 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38948 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533801+0000", 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533801+0000", 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533802+0000", 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.06e-06 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533805+0000", 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6540000000000001e-06 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533816+0000", 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0642000000000001e-05 2024-09-14T06:00:28.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533823+0000", 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.396e-06 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617327+0000", 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083503933000000002 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617394+0000", 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6693999999999995e-05 2024-09-14T06:00:28.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617466+0000", 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2123e-05 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38950 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 9289728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533834+0000", 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.535905223, 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083881255000000002, 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.145 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38950 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533834+0000", 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533834+0000", 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534051+0000", 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000217242 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534061+0000", 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3430000000000002e-06 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534086+0000", 2024-09-14T06:00:28.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5384e-05 2024-09-14T06:00:28.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534104+0000", 2024-09-14T06:00:28.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8006e-05 2024-09-14T06:00:28.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617507+0000", 2024-09-14T06:00:28.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083403115999999999 2024-09-14T06:00:28.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617616+0000", 2024-09-14T06:00:28.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108418 2024-09-14T06:00:28.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617715+0000", 2024-09-14T06:00:28.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9746000000000003e-05 2024-09-14T06:00:28.149 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.149 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.149 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.149 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38953 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 8175616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.149 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.534133+0000", 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.535606047000002, 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083736141, 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38953 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534133+0000", 2024-09-14T06:00:28.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534133+0000", 2024-09-14T06:00:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534314+0000", 2024-09-14T06:00:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018080200000000001 2024-09-14T06:00:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534329+0000", 2024-09-14T06:00:28.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5375000000000001e-05 2024-09-14T06:00:28.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534354+0000", 2024-09-14T06:00:28.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4411999999999999e-05 2024-09-14T06:00:28.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534366+0000", 2024-09-14T06:00:28.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1949e-05 2024-09-14T06:00:28.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617758+0000", 2024-09-14T06:00:28.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083392691000000005 2024-09-14T06:00:28.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617817+0000", 2024-09-14T06:00:28.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8471999999999999e-05 2024-09-14T06:00:28.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617869+0000", 2024-09-14T06:00:28.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2439999999999999e-05 2024-09-14T06:00:28.153 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.154 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.154 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.154 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38954 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 8355840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:28.154 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.534386+0000", 2024-09-14T06:00:28.154 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.535352754000002, 2024-09-14T06:00:28.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083652403, 2024-09-14T06:00:28.154 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:28.154 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:28.154 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:28.154 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:28.154 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:28.154 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:28.155 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38954 2024-09-14T06:00:28.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.155 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:28.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:28.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534386+0000", 2024-09-14T06:00:28.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:28.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534386+0000", 2024-09-14T06:00:28.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:28.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:28.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534716+0000", 2024-09-14T06:00:28.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032903000000000001 2024-09-14T06:00:28.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:28.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534721+0000", 2024-09-14T06:00:28.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9089999999999997e-06 2024-09-14T06:00:28.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:28.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534739+0000", 2024-09-14T06:00:28.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7679000000000001e-05 2024-09-14T06:00:28.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:28.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534749+0000", 2024-09-14T06:00:28.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0312999999999999e-05 2024-09-14T06:00:28.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:28.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617901+0000", 2024-09-14T06:00:28.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083152056000000002 2024-09-14T06:00:28.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:28.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617977+0000", 2024-09-14T06:00:28.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5772000000000006e-05 2024-09-14T06:00:28.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:28.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:28.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:28.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.618039+0000", 2024-09-14T06:00:28.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1643999999999995e-05 2024-09-14T06:00:28.158 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.158 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.158 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.158 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:28.158 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:28.158 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:28.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:00:28.167 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:28.159+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:28.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:00:28.292 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:28.292 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:28.292 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:00:28.292 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:28.293 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:28.289+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:28.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:00:28.361 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:28.359+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:28.412 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:28.412 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:28.431 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:28.432 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:28.450 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:28.450 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:28.462 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:28.463+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:28.484 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:28.485 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:28.497 INFO:teuthology.orchestra.run.smithi006.stdout:5253 write 0xc8b864 thru 0xc91639 (0x5dd6 bytes) 2024-09-14T06:00:28.503 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:28.503 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:28.506 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:28.506 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:28.518 INFO:teuthology.orchestra.run.smithi006.stdout:5254 write 0x6a5a6ed thru 0x6a6419f (0x9ab3 bytes) 2024-09-14T06:00:28.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:00:28.527 INFO:teuthology.orchestra.run.smithi006.stdout:5255 read 0x16703d0 thru 0x167b4ec (0xb11d bytes) 2024-09-14T06:00:28.527 INFO:teuthology.orchestra.run.smithi006.stdout:5256 writesame 0x9e22066 thru 0x9e2ba59 data_size 0x76(0x99f4 bytes) 2024-09-14T06:00:28.536 INFO:teuthology.orchestra.run.smithi006.stdout:5257 read 0x49db14b thru 0x49e7369 (0xc21f bytes) 2024-09-14T06:00:28.537 INFO:teuthology.orchestra.run.smithi006.stdout:5258 read 0x29f5786 thru 0x2a04604 (0xee7f bytes) 2024-09-14T06:00:28.538 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:28.539 INFO:teuthology.orchestra.run.smithi006.stdout:5260 read 0xcb692c6 thru 0xcb73507 (0xa242 bytes) 2024-09-14T06:00:28.539 INFO:teuthology.orchestra.run.smithi006.stdout:5262 read 0x8b6f694 thru 0x8b7d9ab (0xe318 bytes) 2024-09-14T06:00:28.539 INFO:teuthology.orchestra.run.smithi006.stdout:5263 writesame 0x41e76db thru 0x41f4a0f data_size 0x3(0xd335 bytes) 2024-09-14T06:00:28.552 INFO:teuthology.orchestra.run.smithi006.stdout:5264 punch from 0x7967340 to 0x79751d0, (0xde90 bytes) 2024-09-14T06:00:28.552 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:28.552 INFO:teuthology.orchestra.run.smithi006.stdout:5266 writesame 0x69fb82b thru 0x6a01df5 data_size 0x17(0x65cb bytes) 2024-09-14T06:00:28.557 INFO:teuthology.orchestra.run.smithi006.stdout:5267 clone 33 order 24 su 131072 sc 8 2024-09-14T06:00:28.562 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:28.557+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:28.576 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:28.576 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:28.612 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:28.612 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:28.656 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T06:00:28.683 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:28.681+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:28.684 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:28.684 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:28.701 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:00:28.772 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone32 from 0xe224f13 (overlap 0xe224f13) to 0x0 2024-09-14T06:00:28.772 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:28.769+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:28.864 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:28.861+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:28.915 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:28.915 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:28.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:00:28.965 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:28.963+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:29.066 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:29.063+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:29.167 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:29.163+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:29.203 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:29.203 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:29.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:00:29.268 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:29.263+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:29.286 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-14T06:00:29.344 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:29.344 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:29.362 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:00:29.407 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:29.405+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:29.470 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:29.465+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:29.491 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:29.491 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:29.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:00:29.571 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:29.567+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:29.627 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-14T06:00:29.627 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T06:00:29.627 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T06:00:29.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T06:00:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2024-09-14T06:00:29.672 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:29.669+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:29.686 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:29.686 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:29.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:00:29.726 INFO:teuthology.orchestra.run.smithi006.stdout:5268 trunc from 0xe224f13 to 0x8a46007 2024-09-14T06:00:29.773 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:29.767+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:29.793 INFO:teuthology.orchestra.run.smithi006.stdout:5270 trunc from 0x8a46007 to 0xd4433e5 2024-09-14T06:00:29.812 INFO:teuthology.orchestra.run.smithi006.stdout:5275 trunc from 0xd4433e5 to 0x2fc03c4 2024-09-14T06:00:29.874 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:29.869+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:29.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:00:29.974 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:29.971+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:30.018 INFO:teuthology.orchestra.run.smithi006.stdout:5276 write 0xea65fb7 thru 0xea6bb1a (0x5b64 bytes) 2024-09-14T06:00:30.024 INFO:teuthology.orchestra.run.smithi006.stdout:5277 writesame 0x1243b42 thru 0x12440c2 data_size 0x1(0x581 bytes) 2024-09-14T06:00:30.028 INFO:teuthology.orchestra.run.smithi006.stdout:5278 write 0x1beb14c thru 0x1bf231c (0x71d1 bytes) 2024-09-14T06:00:30.032 INFO:teuthology.orchestra.run.smithi006.stdout:5279 writesame 0x4c4591f thru 0x4c50c6b data_size 0x1(0xb34d bytes) 2024-09-14T06:00:30.046 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:00:30.046 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:30.046 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 87, 2024-09-14T06:00:30.047 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "8db933fa-392d-4966-864a-b73b8a91dd2d", 2024-09-14T06:00:30.047 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2024-09-14T05:58:34.536616+0000", 2024-09-14T06:00:30.047 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2024-09-14T06:00:29.637848+0000", 2024-09-14T06:00:30.047 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2024-09-14T05:59:39.727882+0000", 2024-09-14T06:00:30.047 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2024-09-14T05:58:36.841702+0000", 2024-09-14T06:00:30.047 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T06:00:30.047 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5801984, 2024-09-14T06:00:30.047 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2024-09-14T06:00:30.047 INFO:teuthology.orchestra.run.smithi006.stdout: "noscrub", 2024-09-14T06:00:30.047 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2024-09-14T06:00:30.047 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2024-09-14T06:00:30.047 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2024-09-14T06:00:30.047 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2024-09-14T06:00:30.048 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:00:30.048 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 6, 2024-09-14T06:00:30.048 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T06:00:30.048 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T06:00:30.048 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T06:00:30.048 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2024-09-14T06:00:30.048 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 3, 2024-09-14T06:00:30.048 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2024-09-14T06:00:30.048 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2024-09-14T06:00:30.048 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "jewel", 2024-09-14T06:00:30.049 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "squid", 2024-09-14T06:00:30.049 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_crimson": false, 2024-09-14T06:00:30.049 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2024-09-14T06:00:30.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.049 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2024-09-14T06:00:30.049 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2024-09-14T06:00:30.049 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2024-09-14T05:58:47.505149+0000", 2024-09-14T06:00:30.049 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-14T06:00:30.049 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2024-09-14T06:00:30.049 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2024-09-14T06:00:30.050 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2024-09-14T06:00:30.050 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2024-09-14T06:00:30.050 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2024-09-14T06:00:30.050 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2024-09-14T06:00:30.050 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2024-09-14T06:00:30.050 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T06:00:30.050 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T06:00:30.050 INFO:teuthology.orchestra.run.smithi006.stdout: "is_stretch_pool": false, 2024-09-14T06:00:30.050 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2024-09-14T06:00:30.050 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2024-09-14T06:00:30.050 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2024-09-14T06:00:30.050 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2024-09-14T06:00:30.051 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2024-09-14T06:00:30.051 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2024-09-14T06:00:30.051 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2024-09-14T06:00:30.051 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2024-09-14T06:00:30.051 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2024-09-14T06:00:30.051 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2024-09-14T06:00:30.051 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2024-09-14T06:00:30.051 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2024-09-14T06:00:30.051 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2024-09-14T06:00:30.051 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2024-09-14T06:00:30.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.052 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "18", 2024-09-14T06:00:30.052 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2024-09-14T06:00:30.052 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T06:00:30.052 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T06:00:30.052 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2024-09-14T06:00:30.052 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2024-09-14T06:00:30.052 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2024-09-14T06:00:30.052 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2024-09-14T06:00:30.052 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2024-09-14T06:00:30.052 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2024-09-14T06:00:30.052 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2024-09-14T06:00:30.052 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2024-09-14T06:00:30.053 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2024-09-14T06:00:30.053 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2024-09-14T06:00:30.053 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2024-09-14T06:00:30.053 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2024-09-14T06:00:30.053 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2024-09-14T06:00:30.053 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2024-09-14T06:00:30.053 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2024-09-14T06:00:30.053 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T06:00:30.053 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T06:00:30.053 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T06:00:30.053 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2024-09-14T06:00:30.053 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2024-09-14T06:00:30.054 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2024-09-14T06:00:30.054 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2024-09-14T06:00:30.054 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2024-09-14T06:00:30.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.054 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2024-09-14T06:00:30.054 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2024-09-14T06:00:30.054 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2024-09-14T06:00:30.054 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2024-09-14T06:00:30.054 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2024-09-14T06:00:30.054 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T06:00:30.054 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2024-09-14T06:00:30.054 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2024-09-14T06:00:30.055 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2024-09-14T06:00:30.055 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2024-09-14T06:00:30.055 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2024-09-14T06:00:30.055 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2024-09-14T06:00:30.055 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2024-09-14T06:00:30.055 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2024-09-14T06:00:30.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.055 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2024-09-14T06:00:30.055 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2024-09-14T06:00:30.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.055 INFO:teuthology.orchestra.run.smithi006.stdout: "read_balance": { 2024-09-14T06:00:30.056 INFO:teuthology.orchestra.run.smithi006.stdout: "score_type": "Fair distribution", 2024-09-14T06:00:30.056 INFO:teuthology.orchestra.run.smithi006.stdout: "score_acting": 6.9000000953674316, 2024-09-14T06:00:30.056 INFO:teuthology.orchestra.run.smithi006.stdout: "score_stable": 6.9000000953674316, 2024-09-14T06:00:30.056 INFO:teuthology.orchestra.run.smithi006.stdout: "optimal_score": 0.28999999165534973, 2024-09-14T06:00:30.056 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_acting": 2, 2024-09-14T06:00:30.056 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_stable": 2, 2024-09-14T06:00:30.056 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity_weighted": 0.875, 2024-09-14T06:00:30.056 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity": 1, 2024-09-14T06:00:30.056 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-14T06:00:30.056 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.057 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 2, 2024-09-14T06:00:30.057 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "rbd", 2024-09-14T06:00:30.057 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2024-09-14T05:58:52.779258+0000", 2024-09-14T06:00:30.057 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 8193, 2024-09-14T06:00:30.057 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T06:00:30.057 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2024-09-14T06:00:30.057 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2024-09-14T06:00:30.057 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2024-09-14T06:00:30.058 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2024-09-14T06:00:30.058 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2024-09-14T06:00:30.058 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2024-09-14T06:00:30.058 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T06:00:30.058 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T06:00:30.058 INFO:teuthology.orchestra.run.smithi006.stdout: "is_stretch_pool": false, 2024-09-14T06:00:30.058 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2024-09-14T06:00:30.058 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2024-09-14T06:00:30.058 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 8, 2024-09-14T06:00:30.058 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 8, 2024-09-14T06:00:30.058 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 8, 2024-09-14T06:00:30.059 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 8, 2024-09-14T06:00:30.059 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 8, 2024-09-14T06:00:30.059 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2024-09-14T06:00:30.059 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2024-09-14T06:00:30.059 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2024-09-14T06:00:30.059 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2024-09-14T06:00:30.059 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2024-09-14T06:00:30.059 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2024-09-14T06:00:30.059 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2024-09-14T06:00:30.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.060 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "22", 2024-09-14T06:00:30.060 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2024-09-14T06:00:30.060 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T06:00:30.060 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T06:00:30.060 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2024-09-14T06:00:30.060 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2024-09-14T06:00:30.060 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 2, 2024-09-14T06:00:30.060 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 22, 2024-09-14T06:00:30.061 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2024-09-14T06:00:30.061 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2024-09-14T06:00:30.061 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2024-09-14T06:00:30.061 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2024-09-14T06:00:30.061 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2024-09-14T06:00:30.061 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2024-09-14T06:00:30.061 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2024-09-14T06:00:30.061 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2024-09-14T06:00:30.061 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2024-09-14T06:00:30.061 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2024-09-14T06:00:30.062 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2024-09-14T06:00:30.062 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T06:00:30.062 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T06:00:30.062 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T06:00:30.062 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2024-09-14T06:00:30.062 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2024-09-14T06:00:30.062 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2024-09-14T06:00:30.062 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2024-09-14T06:00:30.062 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2024-09-14T06:00:30.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.063 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2024-09-14T06:00:30.063 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2024-09-14T06:00:30.063 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2024-09-14T06:00:30.063 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2024-09-14T06:00:30.063 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2024-09-14T06:00:30.063 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T06:00:30.063 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2024-09-14T06:00:30.063 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2024-09-14T06:00:30.064 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2024-09-14T06:00:30.064 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2024-09-14T06:00:30.064 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2024-09-14T06:00:30.064 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2024-09-14T06:00:30.064 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2024-09-14T06:00:30.064 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2024-09-14T06:00:30.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.064 INFO:teuthology.orchestra.run.smithi006.stdout: "read_balance": { 2024-09-14T06:00:30.064 INFO:teuthology.orchestra.run.smithi006.stdout: "score_type": "Fair distribution", 2024-09-14T06:00:30.064 INFO:teuthology.orchestra.run.smithi006.stdout: "score_acting": 1.75, 2024-09-14T06:00:30.065 INFO:teuthology.orchestra.run.smithi006.stdout: "score_stable": 1.75, 2024-09-14T06:00:30.065 INFO:teuthology.orchestra.run.smithi006.stdout: "optimal_score": 1, 2024-09-14T06:00:30.065 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_acting": 1.75, 2024-09-14T06:00:30.065 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_stable": 1.75, 2024-09-14T06:00:30.065 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity_weighted": 0.875, 2024-09-14T06:00:30.065 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity": 1, 2024-09-14T06:00:30.065 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-14T06:00:30.065 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.066 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2024-09-14T06:00:30.066 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "pool_client.0", 2024-09-14T06:00:30.066 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2024-09-14T05:59:04.433909+0000", 2024-09-14T06:00:30.066 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 8193, 2024-09-14T06:00:30.066 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T06:00:30.066 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2024-09-14T06:00:30.066 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2024-09-14T06:00:30.066 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2024-09-14T06:00:30.066 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2024-09-14T06:00:30.066 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2024-09-14T06:00:30.067 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2024-09-14T06:00:30.067 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T06:00:30.067 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T06:00:30.067 INFO:teuthology.orchestra.run.smithi006.stdout: "is_stretch_pool": false, 2024-09-14T06:00:30.067 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2024-09-14T06:00:30.067 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2024-09-14T06:00:30.067 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2024-09-14T06:00:30.067 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2024-09-14T06:00:30.067 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2024-09-14T06:00:30.067 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2024-09-14T06:00:30.068 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2024-09-14T06:00:30.068 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2024-09-14T06:00:30.068 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2024-09-14T06:00:30.068 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2024-09-14T06:00:30.068 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2024-09-14T06:00:30.068 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2024-09-14T06:00:30.068 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2024-09-14T06:00:30.068 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2024-09-14T06:00:30.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "86", 2024-09-14T06:00:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2024-09-14T06:00:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T06:00:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T06:00:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2024-09-14T06:00:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2024-09-14T06:00:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 35, 2024-09-14T06:00:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 86, 2024-09-14T06:00:30.069 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2024-09-14T06:00:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2024-09-14T06:00:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2024-09-14T06:00:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2024-09-14T06:00:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2024-09-14T06:00:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2024-09-14T06:00:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2024-09-14T06:00:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2024-09-14T06:00:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2024-09-14T06:00:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2024-09-14T06:00:30.070 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2024-09-14T06:00:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T06:00:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T06:00:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T06:00:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2024-09-14T06:00:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2024-09-14T06:00:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2024-09-14T06:00:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2024-09-14T06:00:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2024-09-14T06:00:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2024-09-14T06:00:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2024-09-14T06:00:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2024-09-14T06:00:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2024-09-14T06:00:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2024-09-14T06:00:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T06:00:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2024-09-14T06:00:30.072 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2024-09-14T06:00:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2024-09-14T06:00:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2024-09-14T06:00:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2024-09-14T06:00:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2024-09-14T06:00:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2024-09-14T06:00:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2024-09-14T06:00:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "read_balance": { 2024-09-14T06:00:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: "score_type": "Fair distribution", 2024-09-14T06:00:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "score_acting": 1.3200000524520874, 2024-09-14T06:00:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "score_stable": 1.3200000524520874, 2024-09-14T06:00:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "optimal_score": 1.1399999856948853, 2024-09-14T06:00:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_acting": 1.5, 2024-09-14T06:00:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_stable": 1.5, 2024-09-14T06:00:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity_weighted": 0.875, 2024-09-14T06:00:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity": 1, 2024-09-14T06:00:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-14T06:00:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.074 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:00:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2024-09-14T06:00:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2024-09-14T06:00:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "9ef61ed5-359d-4de3-be54-41d3a66c393a", 2024-09-14T06:00:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:00:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 15, 2024-09-14T06:00:30.075 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 27, 2024-09-14T06:00:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 46, 2024-09-14T06:00:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 49, 2024-09-14T06:00:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 28, 2024-09-14T06:00:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2024-09-14T06:00:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:30.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2024-09-14T06:00:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.077 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2024-09-14T06:00:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2024-09-14T06:00:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.078 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2024-09-14T06:00:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2024-09-14T06:00:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:30.079 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2024-09-14T06:00:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.081 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.081 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2024-09-14T06:00:30.081 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:30.081 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.081 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.081 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6825/643732088", 2024-09-14T06:00:30.081 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6827/643732088", 2024-09-14T06:00:30.081 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/643732088", 2024-09-14T06:00:30.081 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/643732088", 2024-09-14T06:00:30.082 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:30.082 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:30.082 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:30.082 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.082 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.082 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.082 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2024-09-14T06:00:30.082 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "f180c483-9b53-4808-b5ec-537bf956087d", 2024-09-14T06:00:30.082 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:30.082 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:30.082 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:30.083 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:00:30.083 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:00:30.083 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:00:30.083 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:00:30.083 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 48, 2024-09-14T06:00:30.083 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:00:30.083 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:30.083 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:30.083 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.083 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.083 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.084 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2024-09-14T06:00:30.084 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:30.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.084 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.084 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.084 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2024-09-14T06:00:30.084 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:30.084 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.084 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.085 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:30.085 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.085 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.085 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2024-09-14T06:00:30.085 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:30.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.085 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.086 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2024-09-14T06:00:30.086 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:30.086 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.086 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.086 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:30.086 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.086 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.086 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.087 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2024-09-14T06:00:30.087 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:30.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.087 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.087 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.087 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2024-09-14T06:00:30.087 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:30.087 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.087 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.088 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:30.088 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.088 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.088 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.088 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2024-09-14T06:00:30.088 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:30.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.088 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.089 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.089 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2024-09-14T06:00:30.089 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:30.089 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.089 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.089 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6815/1278360579", 2024-09-14T06:00:30.089 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/1278360579", 2024-09-14T06:00:30.089 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6823/1278360579", 2024-09-14T06:00:30.089 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6821/1278360579", 2024-09-14T06:00:30.089 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:30.090 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:30.090 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:30.090 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.090 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.090 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2024-09-14T06:00:30.090 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "bc59bb00-b3b0-4483-a5b1-cc5907cf660a", 2024-09-14T06:00:30.090 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:30.090 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:30.090 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:30.090 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 0, 2024-09-14T06:00:30.090 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:00:30.091 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:00:30.091 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 15, 2024-09-14T06:00:30.091 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2024-09-14T06:00:30.091 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:00:30.091 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:30.091 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:30.091 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.091 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.091 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.091 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2024-09-14T06:00:30.092 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:30.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.092 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.092 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.092 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2024-09-14T06:00:30.092 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:30.092 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.092 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.092 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:30.092 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.093 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.093 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.093 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2024-09-14T06:00:30.093 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:30.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.093 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.093 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.093 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2024-09-14T06:00:30.093 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:30.093 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.094 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.094 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:30.094 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.094 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.094 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.094 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2024-09-14T06:00:30.094 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:30.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.094 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.095 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.095 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2024-09-14T06:00:30.095 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:30.095 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.095 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.095 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:30.095 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.095 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2024-09-14T06:00:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2024-09-14T06:00:30.096 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/4171349592", 2024-09-14T06:00:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/4171349592", 2024-09-14T06:00:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6817/4171349592", 2024-09-14T06:00:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6814/4171349592", 2024-09-14T06:00:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:30.097 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2024-09-14T06:00:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "7aa9fc3b-29c5-4e9a-a894-e2abfb586263", 2024-09-14T06:00:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:30.098 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:30.099 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:00:30.099 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:00:30.099 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:00:30.099 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:00:30.099 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 82, 2024-09-14T06:00:30.099 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:00:30.099 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:30.099 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:30.099 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.099 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.100 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.100 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2024-09-14T06:00:30.100 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:30.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.100 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.100 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.100 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2024-09-14T06:00:30.100 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:30.100 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.101 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.101 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:30.101 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.101 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.101 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.101 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2024-09-14T06:00:30.101 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:30.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.101 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.102 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.102 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2024-09-14T06:00:30.102 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:30.102 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.102 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.102 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:30.102 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.102 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.102 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.103 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2024-09-14T06:00:30.103 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:30.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.103 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.103 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.103 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2024-09-14T06:00:30.103 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:30.103 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.103 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.104 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:30.104 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.104 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.104 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.104 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2024-09-14T06:00:30.104 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:30.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.104 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.104 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.104 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2024-09-14T06:00:30.105 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:30.105 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.105 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.105 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/3999210088", 2024-09-14T06:00:30.105 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/3999210088", 2024-09-14T06:00:30.105 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/3999210088", 2024-09-14T06:00:30.105 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/3999210088", 2024-09-14T06:00:30.105 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:30.105 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:30.106 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:30.106 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.106 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2024-09-14T06:00:30.106 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "a0665f54-f53d-4536-a322-4974c2f23aa1", 2024-09-14T06:00:30.106 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:30.106 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:30.106 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:30.106 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:00:30.106 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:00:30.106 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:00:30.107 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:00:30.107 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 46, 2024-09-14T06:00:30.107 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:00:30.107 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:30.107 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:30.107 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.107 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.107 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.107 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6824", 2024-09-14T06:00:30.107 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:30.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.107 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.108 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.108 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6825", 2024-09-14T06:00:30.108 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:30.108 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.108 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.108 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.108 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:30.108 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.108 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.108 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.108 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6826", 2024-09-14T06:00:30.108 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:30.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.109 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.109 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.109 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6827", 2024-09-14T06:00:30.109 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:30.109 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.109 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.109 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:30.109 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.109 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.109 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.110 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6830", 2024-09-14T06:00:30.110 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:30.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.110 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.110 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.110 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6831", 2024-09-14T06:00:30.110 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:30.110 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.110 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.110 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:30.111 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.111 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.111 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.111 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6828", 2024-09-14T06:00:30.111 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:30.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.111 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.111 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.111 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6829", 2024-09-14T06:00:30.111 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:30.111 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.111 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.112 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6825/575863621", 2024-09-14T06:00:30.112 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6827/575863621", 2024-09-14T06:00:30.112 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6831/575863621", 2024-09-14T06:00:30.112 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6829/575863621", 2024-09-14T06:00:30.112 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:30.112 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:30.112 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:30.112 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.112 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2024-09-14T06:00:30.113 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "302ab31c-c228-44da-a0d2-58505ad571cf", 2024-09-14T06:00:30.113 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:30.113 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:30.113 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:30.113 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:00:30.113 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:00:30.113 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:00:30.113 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:00:30.113 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 48, 2024-09-14T06:00:30.113 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:00:30.113 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:30.114 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:30.114 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.114 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.114 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.114 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6808", 2024-09-14T06:00:30.114 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:30.114 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.114 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.114 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.114 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6809", 2024-09-14T06:00:30.114 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:30.114 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.115 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.115 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:30.115 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.115 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.115 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.115 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6810", 2024-09-14T06:00:30.115 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:30.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.115 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.116 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.116 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6811", 2024-09-14T06:00:30.116 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:30.116 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.116 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.116 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.116 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:30.116 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.116 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.116 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.117 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6814", 2024-09-14T06:00:30.117 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:30.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.117 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.117 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.117 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6815", 2024-09-14T06:00:30.117 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:30.117 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.117 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.118 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:30.118 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.118 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.118 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.118 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6812", 2024-09-14T06:00:30.118 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:30.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.118 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.118 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.119 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6813", 2024-09-14T06:00:30.119 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:30.119 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.119 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.119 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.119 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6809/2498345645", 2024-09-14T06:00:30.119 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6811/2498345645", 2024-09-14T06:00:30.119 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6815/2498345645", 2024-09-14T06:00:30.119 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6813/2498345645", 2024-09-14T06:00:30.119 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:30.119 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:30.120 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:30.120 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.120 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.120 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2024-09-14T06:00:30.120 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "1adbca34-daef-4229-b25e-40dec6800f85", 2024-09-14T06:00:30.120 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:30.120 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:30.120 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:30.121 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:00:30.121 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:00:30.121 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:00:30.121 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:00:30.121 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 49, 2024-09-14T06:00:30.121 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:00:30.121 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:30.121 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:30.121 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.121 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.122 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.122 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6816", 2024-09-14T06:00:30.122 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:30.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.122 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.122 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.122 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6817", 2024-09-14T06:00:30.122 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:30.122 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.122 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.123 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:30.123 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.123 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.123 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.123 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6818", 2024-09-14T06:00:30.123 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:30.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.123 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.124 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.124 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6819", 2024-09-14T06:00:30.124 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:30.124 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.124 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.124 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:30.124 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.124 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.124 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.125 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6822", 2024-09-14T06:00:30.125 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:30.125 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.125 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.125 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.125 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6823", 2024-09-14T06:00:30.125 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:30.125 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.125 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.126 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:30.126 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.126 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.126 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.126 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6820", 2024-09-14T06:00:30.126 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:30.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.126 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.127 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.127 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6821", 2024-09-14T06:00:30.127 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:30.127 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.127 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.127 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.127 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6817/267756224", 2024-09-14T06:00:30.127 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6819/267756224", 2024-09-14T06:00:30.127 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6823/267756224", 2024-09-14T06:00:30.127 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6821/267756224", 2024-09-14T06:00:30.128 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:30.128 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:30.128 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:30.128 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.128 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.128 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2024-09-14T06:00:30.128 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "a75d9794-68bf-4e8c-bf75-448a7a783769", 2024-09-14T06:00:30.128 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:30.128 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:30.129 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:30.129 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:00:30.129 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:00:30.129 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:00:30.129 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:00:30.129 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 48, 2024-09-14T06:00:30.129 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:00:30.129 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:30.129 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:30.129 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.130 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.130 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.130 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6800", 2024-09-14T06:00:30.130 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:30.130 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.130 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.130 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.130 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6801", 2024-09-14T06:00:30.130 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:30.130 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.131 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.131 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:30.131 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.131 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.131 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.131 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6802", 2024-09-14T06:00:30.131 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:30.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.131 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.132 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.132 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6803", 2024-09-14T06:00:30.132 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:30.132 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.132 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.132 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:30.132 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.132 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.132 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.133 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6806", 2024-09-14T06:00:30.133 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:30.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.133 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.133 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.133 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6807", 2024-09-14T06:00:30.133 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:30.133 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.133 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.133 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:30.133 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:30.134 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.134 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:30.134 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6804", 2024-09-14T06:00:30.134 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:30.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.134 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.134 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:30.134 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6805", 2024-09-14T06:00:30.134 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:30.134 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.134 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.135 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6801/4119173763", 2024-09-14T06:00:30.135 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6803/4119173763", 2024-09-14T06:00:30.135 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6807/4119173763", 2024-09-14T06:00:30.135 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6805/4119173763", 2024-09-14T06:00:30.135 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:30.135 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:30.135 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:30.135 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:30.135 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.135 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:00:30.135 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2024-09-14T06:00:30.135 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.135 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2024-09-14T06:00:30.136 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:30.136 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:30.136 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:30.136 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:30.136 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:30.136 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.791330+0000", 2024-09-14T06:00:30.136 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 28 2024-09-14T06:00:30.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.136 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.136 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2024-09-14T06:00:30.136 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:30.136 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:30.137 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:30.137 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:30.137 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:30.137 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.526550+0000", 2024-09-14T06:00:30.137 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:00:30.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.137 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.137 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2024-09-14T06:00:30.137 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:30.137 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:30.137 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:30.137 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:30.137 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:30.138 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.664242+0000", 2024-09-14T06:00:30.138 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:00:30.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.138 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2024-09-14T06:00:30.138 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:30.138 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:30.138 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:30.138 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:30.138 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:30.138 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.327736+0000", 2024-09-14T06:00:30.138 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:00:30.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.139 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.139 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2024-09-14T06:00:30.139 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:30.139 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:30.139 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:30.139 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:30.139 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:30.139 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.687393+0000", 2024-09-14T06:00:30.139 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:00:30.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.139 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.140 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2024-09-14T06:00:30.140 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:30.140 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:30.140 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:30.140 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:30.140 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:30.140 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.314438+0000", 2024-09-14T06:00:30.140 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:00:30.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.140 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.140 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2024-09-14T06:00:30.141 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:30.141 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:30.141 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:30.141 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:30.141 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:30.141 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.487578+0000", 2024-09-14T06:00:30.141 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:00:30.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:30.141 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2024-09-14T06:00:30.142 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:30.142 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:30.142 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:30.142 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:30.142 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:30.142 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.106833+0000", 2024-09-14T06:00:30.142 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:00:30.142 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.143 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:00:30.143 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [], 2024-09-14T06:00:30.143 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2024-09-14T06:00:30.143 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_primaries": [], 2024-09-14T06:00:30.143 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2024-09-14T06:00:30.143 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2024-09-14T06:00:30.143 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2024-09-14T06:00:30.143 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2024-09-14T06:00:30.143 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2024-09-14T06:00:30.143 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2024-09-14T06:00:30.143 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2024-09-14T06:00:30.144 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2024-09-14T06:00:30.144 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2024-09-14T06:00:30.144 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2024-09-14T06:00:30.144 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2024-09-14T06:00:30.144 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:30.144 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [], 2024-09-14T06:00:30.144 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [], 2024-09-14T06:00:30.144 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2024-09-14T06:00:30.145 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2024-09-14T06:00:30.145 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2024-09-14T06:00:30.145 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2024-09-14T06:00:30.145 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2024-09-14T06:00:30.145 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2024-09-14T06:00:30.145 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2024-09-14T06:00:30.145 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2024-09-14T06:00:30.145 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2024-09-14T06:00:30.145 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:30.145 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:30.148 INFO:tasks.thrashosds.thrasher:j is {'epoch': 87, 'fsid': '8db933fa-392d-4966-864a-b73b8a91dd2d', 'created': '2024-09-14T05:58:34.536616+0000', 'modified': '2024-09-14T06:00:29.637848+0000', 'last_up_change': '2024-09-14T05:59:39.727882+0000', 'last_in_change': '2024-09-14T05:58:36.841702+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T05:58:47.505149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T05:58:52.779258+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T05:59:04.433909+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 35, 'snap_epoch': 86, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3200000524520874, 'score_stable': 1.3200000524520874, 'optimal_score': 1.1399999856948853, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}], 'osds': [{'osd': 0, 'uuid': '9ef61ed5-359d-4de3-be54-41d3a66c393a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 15, 'last_clean_end': 27, 'up_from': 46, 'up_thru': 49, 'down_at': 28, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6824', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6825', 'nonce': 643732088}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6826', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6827', 'nonce': 643732088}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6830', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6831', 'nonce': 643732088}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6828', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6829', 'nonce': 643732088}]}, 'public_addr': '172.21.15.6:6825/643732088', 'cluster_addr': '172.21.15.6:6827/643732088', 'heartbeat_back_addr': '172.21.15.6:6831/643732088', 'heartbeat_front_addr': '172.21.15.6:6829/643732088', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f180c483-9b53-4808-b5ec-537bf956087d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6812', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6815', 'nonce': 1278360579}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6818', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6819', 'nonce': 1278360579}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6822', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6823', 'nonce': 1278360579}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6820', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6821', 'nonce': 1278360579}]}, 'public_addr': '172.21.15.6:6815/1278360579', 'cluster_addr': '172.21.15.6:6819/1278360579', 'heartbeat_back_addr': '172.21.15.6:6823/1278360579', 'heartbeat_front_addr': '172.21.15.6:6821/1278360579', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'bc59bb00-b3b0-4483-a5b1-cc5907cf660a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6808', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6809', 'nonce': 4171349592}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6810', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6811', 'nonce': 4171349592}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6816', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6817', 'nonce': 4171349592}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6813', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6814', 'nonce': 4171349592}]}, 'public_addr': '172.21.15.6:6809/4171349592', 'cluster_addr': '172.21.15.6:6811/4171349592', 'heartbeat_back_addr': '172.21.15.6:6817/4171349592', 'heartbeat_front_addr': '172.21.15.6:6814/4171349592', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '7aa9fc3b-29c5-4e9a-a894-e2abfb586263', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 82, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6800', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6801', 'nonce': 3999210088}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6802', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6803', 'nonce': 3999210088}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6806', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6807', 'nonce': 3999210088}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6804', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6805', 'nonce': 3999210088}]}, 'public_addr': '172.21.15.6:6801/3999210088', 'cluster_addr': '172.21.15.6:6803/3999210088', 'heartbeat_back_addr': '172.21.15.6:6807/3999210088', 'heartbeat_front_addr': '172.21.15.6:6805/3999210088', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'a0665f54-f53d-4536-a322-4974c2f23aa1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6824', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6825', 'nonce': 575863621}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6826', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6827', 'nonce': 575863621}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6830', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6831', 'nonce': 575863621}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6828', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6829', 'nonce': 575863621}]}, 'public_addr': '172.21.15.154:6825/575863621', 'cluster_addr': '172.21.15.154:6827/575863621', 'heartbeat_back_addr': '172.21.15.154:6831/575863621', 'heartbeat_front_addr': '172.21.15.154:6829/575863621', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '302ab31c-c228-44da-a0d2-58505ad571cf', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6808', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6809', 'nonce': 2498345645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6810', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6811', 'nonce': 2498345645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6814', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6815', 'nonce': 2498345645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6812', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6813', 'nonce': 2498345645}]}, 'public_addr': '172.21.15.154:6809/2498345645', 'cluster_addr': '172.21.15.154:6811/2498345645', 'heartbeat_back_addr': '172.21.15.154:6815/2498345645', 'heartbeat_front_addr': '172.21.15.154:6813/2498345645', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '1adbca34-daef-4229-b25e-40dec6800f85', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 49, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6816', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6817', 'nonce': 267756224}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6818', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6819', 'nonce': 267756224}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6822', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6823', 'nonce': 267756224}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6820', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6821', 'nonce': 267756224}]}, 'public_addr': '172.21.15.154:6817/267756224', 'cluster_addr': '172.21.15.154:6819/267756224', 'heartbeat_back_addr': '172.21.15.154:6823/267756224', 'heartbeat_front_addr': '172.21.15.154:6821/267756224', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a75d9794-68bf-4e8c-bf75-448a7a783769', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 4119173763}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 4119173763}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 4119173763}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 4119173763}]}, 'public_addr': '172.21.15.154:6801/4119173763', 'cluster_addr': '172.21.15.154:6803/4119173763', 'heartbeat_back_addr': '172.21.15.154:6807/4119173763', 'heartbeat_front_addr': '172.21.15.154:6805/4119173763', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.791330+0000', 'dead_epoch': 28}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.526550+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.664242+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.327736+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.687393+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.314438+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.487578+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.106833+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T06:00:30.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T06:00:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:5280 write 0x3f2cc5f thru 0x3f359c4 (0x8d66 bytes) 2024-09-14T06:00:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:5282 write 0x12f4c95 thru 0x12f7625 (0x2991 bytes) 2024-09-14T06:00:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:5283 write 0x3953281 thru 0x3957dbf (0x4b3f bytes) 2024-09-14T06:00:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:5286 read 0xc784c11 thru 0xc78d6d0 (0x8ac0 bytes) 2024-09-14T06:00:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:5288 write 0x8a53d3f thru 0x8a542ba (0x57c bytes) 2024-09-14T06:00:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:5289 read 0xbead140 thru 0xbeafebf (0x2d80 bytes) 2024-09-14T06:00:30.150 INFO:teuthology.orchestra.run.smithi006.stdout:5290 writesame 0x9b32edd thru 0x9b39cd7 data_size 0x5(0x6dfb bytes) 2024-09-14T06:00:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:5291 read 0x991cf97 thru 0x9923a2f (0x6a99 bytes) 2024-09-14T06:00:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:5292 read 0xb36a89f thru 0xb37373f (0x8ea1 bytes) 2024-09-14T06:00:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:30.151 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:5293 read 0x7706cdd thru 0x7708b80 (0x1ea4 bytes) 2024-09-14T06:00:30.152 INFO:teuthology.orchestra.run.smithi006.stdout:5294 writesame 0xe45e142 thru 0xe46d8d4 data_size 0x1(0xf793 bytes) 2024-09-14T06:00:30.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:00:30.153 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:30.145+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:5296 punch from 0xa8dda78 to 0xa8ddc47, (0x1cf bytes) 2024-09-14T06:00:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:30.155 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:30.156 INFO:teuthology.orchestra.run.smithi006.stdout:5303 write 0x83cdb4f thru 0x83d5b43 (0x7ff5 bytes) 2024-09-14T06:00:30.161 INFO:teuthology.orchestra.run.smithi006.stdout:5304 writesame 0x4774754 thru 0x4779ea1 data_size 0x4b(0x574e bytes) 2024-09-14T06:00:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:5305 write 0xb4d51d9 thru 0xb4d8fe2 (0x3e0a bytes) 2024-09-14T06:00:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:5306 trunc from 0xea6bb1b to 0x66ad727 2024-09-14T06:00:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:5307 punch from 0x137282e to 0x1377cd2, (0x54a4 bytes) 2024-09-14T06:00:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:5308 punch from 0x17f4fac to 0x17fa3f2, (0x5446 bytes) 2024-09-14T06:00:30.201 INFO:teuthology.orchestra.run.smithi006.stdout:5309 read 0x324e7bc thru 0x325a226 (0xba6b bytes) 2024-09-14T06:00:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:5313 punch from 0x76cc6c to 0x76e973, (0x1d07 bytes) 2024-09-14T06:00:30.202 INFO:teuthology.orchestra.run.smithi006.stdout:5314 write 0x46ddb1f thru 0x46eb142 (0xd624 bytes) 2024-09-14T06:00:30.209 INFO:teuthology.orchestra.run.smithi006.stdout:5315 trunc from 0x66ad727 to 0x2fe688c 2024-09-14T06:00:30.246 INFO:teuthology.orchestra.run.smithi006.stdout:5316 write 0xda37a34 thru 0xda3f791 (0x7d5e bytes) 2024-09-14T06:00:30.247 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:30.243+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:30.251 INFO:teuthology.orchestra.run.smithi006.stdout:5319 writesame 0x8468126 thru 0x846a55e data_size 0xb(0x2439 bytes) 2024-09-14T06:00:30.258 INFO:teuthology.orchestra.run.smithi006.stdout:5320 punch from 0x468bcd8 to 0x4698d13, (0xd03b bytes) 2024-09-14T06:00:30.258 INFO:teuthology.orchestra.run.smithi006.stdout:5321 clone 34 order 18 su 65536 sc 7 2024-09-14T06:00:30.277 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:30.277 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:30.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:00:30.348 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:30.347+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:30.446 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:30.446 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:30.448 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:30.445+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:30.459 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:00:30.461 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:00:30.462 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T06:00:30.478 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-09-14T06:00:29.642608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":861166881,"num_objects":1623,"num_object_clones":258,"num_object_copies":3246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1623,"num_whiteouts":668,"num_read":121759,"num_read_kb":437122,"num_write":18790,"num_write_kb":261182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":5610454,"num_keys_recovered":69,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14832,"ondisk_log_size":14832,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":472724,"kb_used_data":170820,"kb_used_omap":15,"kb_used_meta":301616,"kb_avail":754501996,"statfs":{"total":773094113280,"available":772610043904,"internally_reserved":0,"allocated":174919680,"data_stored":221110231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":308855580},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19876831,"num_objects":226,"num_object_clones":3,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":226,"num_whiteouts":136,"num_read":4664,"num_read_kb":7477,"num_write":1240,"num_write_kb":6122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031047"},"pg_stats":[{"pgid":"3.1f","version":"84'487","reported_seq":1940,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-14T06:00:28.641297+0000","last_change":"2024-09-14T05:59:43.763150+0000","last_active":"2024-09-14T06:00:28.641297+0000","last_peered":"2024-09-14T06:00:28.641297+0000","last_clean":"2024-09-14T06:00:28.641297+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T06:00:28.641297+0000","last_undegraded":"2024-09-14T06:00:28.641297+0000","last_fullsized":"2024-09-14T06:00:28.641297+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:13.637468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001224482,"stat_sum":{"num_bytes":39130531,"num_objects":56,"num_object_clones":8,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":24,"num_read":3227,"num_read_kb":12223,"num_write":594,"num_write_kb":3432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"83'453","reported_seq":2436,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.211915+0000","last_change":"2024-09-14T05:59:08.299658+0000","last_active":"2024-09-14T06:00:26.211915+0000","last_peered":"2024-09-14T06:00:26.211915+0000","last_clean":"2024-09-14T06:00:26.211915+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T06:00:26.211915+0000","last_undegraded":"2024-09-14T06:00:26.211915+0000","last_fullsized":"2024-09-14T06:00:26.211915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:52:43.123440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882171,"stat_sum":{"num_bytes":21839174,"num_objects":50,"num_object_clones":7,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":19,"num_read":2866,"num_read_kb":5737,"num_write":579,"num_write_kb":9415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"83'248","reported_seq":3729,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.162911+0000","last_change":"2024-09-14T05:59:08.293155+0000","last_active":"2024-09-14T06:00:26.162911+0000","last_peered":"2024-09-14T06:00:26.162911+0000","last_clean":"2024-09-14T06:00:26.162911+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T06:00:26.162911+0000","last_undegraded":"2024-09-14T06:00:26.162911+0000","last_fullsized":"2024-09-14T06:00:26.162911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:14.339935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000618802,"stat_sum":{"num_bytes":12664085,"num_objects":38,"num_object_clones":4,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":16,"num_read":3471,"num_read_kb":12801,"num_write":275,"num_write_kb":20571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"83'285","reported_seq":3393,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.415154+0000","last_change":"2024-09-14T05:59:08.294498+0000","last_active":"2024-09-14T06:00:26.415154+0000","last_peered":"2024-09-14T06:00:26.415154+0000","last_clean":"2024-09-14T06:00:26.415154+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T06:00:26.415154+0000","last_undegraded":"2024-09-14T06:00:26.415154+0000","last_fullsized":"2024-09-14T06:00:26.415154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:53.706859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014905350000000001,"stat_sum":{"num_bytes":15253979,"num_objects":47,"num_object_clones":8,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":23,"num_read":3086,"num_read_kb":10199,"num_write":274,"num_write_kb":6046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"86'384","reported_seq":979,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-14T06:00:28.741742+0000","last_change":"2024-09-14T05:59:40.834308+0000","last_active":"2024-09-14T06:00:28.741742+0000","last_peered":"2024-09-14T06:00:28.741742+0000","last_clean":"2024-09-14T06:00:28.741742+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T06:00:28.741742+0000","last_undegraded":"2024-09-14T06:00:28.741742+0000","last_fullsized":"2024-09-14T06:00:28.741742+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:48.475934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7688688,"num_objects":53,"num_object_clones":10,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":23,"num_read":1760,"num_read_kb":2766,"num_write":385,"num_write_kb":3314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"83'746","reported_seq":2952,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.631276+0000","last_change":"2024-09-14T05:59:08.282710+0000","last_active":"2024-09-14T06:00:26.631276+0000","last_peered":"2024-09-14T06:00:26.631276+0000","last_clean":"2024-09-14T06:00:26.631276+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T06:00:26.631276+0000","last_undegraded":"2024-09-14T06:00:26.631276+0000","last_fullsized":"2024-09-14T06:00:26.631276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:47.159893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078735700000000003,"stat_sum":{"num_bytes":8956656,"num_objects":39,"num_object_clones":3,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":18,"num_read":5212,"num_read_kb":8335,"num_write":1050,"num_write_kb":5355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"83'329","reported_seq":1958,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.490453+0000","last_change":"2024-09-14T05:59:08.283122+0000","last_active":"2024-09-14T06:00:26.490453+0000","last_peered":"2024-09-14T06:00:26.490453+0000","last_clean":"2024-09-14T06:00:26.490453+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T06:00:26.490453+0000","last_undegraded":"2024-09-14T06:00:26.490453+0000","last_fullsized":"2024-09-14T06:00:26.490453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:17.174571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020244989999999999,"stat_sum":{"num_bytes":26564835,"num_objects":45,"num_object_clones":4,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":18,"num_read":2204,"num_read_kb":9194,"num_write":343,"num_write_kb":8242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"83'402","reported_seq":4099,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.210363+0000","last_change":"2024-09-14T05:59:43.761389+0000","last_active":"2024-09-14T06:00:26.210363+0000","last_peered":"2024-09-14T06:00:26.210363+0000","last_clean":"2024-09-14T06:00:26.210363+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T06:00:26.210363+0000","last_undegraded":"2024-09-14T06:00:26.210363+0000","last_fullsized":"2024-09-14T06:00:26.210363+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:46.294868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090099400000000001,"stat_sum":{"num_bytes":48309458,"num_objects":54,"num_object_clones":10,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":23,"num_read":5364,"num_read_kb":28960,"num_write":403,"num_write_kb":5114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"86'278","reported_seq":2229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-14T06:00:28.779491+0000","last_change":"2024-09-14T05:59:40.929839+0000","last_active":"2024-09-14T06:00:28.779491+0000","last_peered":"2024-09-14T06:00:28.779491+0000","last_clean":"2024-09-14T06:00:28.779491+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T06:00:28.779491+0000","last_undegraded":"2024-09-14T06:00:28.779491+0000","last_fullsized":"2024-09-14T06:00:28.779491+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:03.312596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19115601,"num_objects":47,"num_object_clones":10,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":21,"num_read":2426,"num_read_kb":14189,"num_write":264,"num_write_kb":4810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"83'1369","reported_seq":3166,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:25.929581+0000","last_change":"2024-09-14T05:59:08.293088+0000","last_active":"2024-09-14T06:00:25.929581+0000","last_peered":"2024-09-14T06:00:25.929581+0000","last_clean":"2024-09-14T06:00:25.929581+0000","last_became_active":"2024-09-14T05:59:06.296607+0000","last_became_peered":"2024-09-14T05:59:06.296607+0000","last_unstale":"2024-09-14T06:00:25.929581+0000","last_undegraded":"2024-09-14T06:00:25.929581+0000","last_fullsized":"2024-09-14T06:00:25.929581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1369,"log_dups_size":0,"ondisk_log_size":1369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:55.122525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056627299999999995,"stat_sum":{"num_bytes":35779273,"num_objects":44,"num_object_clones":9,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":15,"num_read":7932,"num_read_kb":16065,"num_write":2366,"num_write_kb":15365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"83'554","reported_seq":3914,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.112421+0000","last_change":"2024-09-14T05:59:08.370304+0000","last_active":"2024-09-14T06:00:26.112421+0000","last_peered":"2024-09-14T06:00:26.112421+0000","last_clean":"2024-09-14T06:00:26.112421+0000","last_became_active":"2024-09-14T05:59:06.295335+0000","last_became_peered":"2024-09-14T05:59:06.295335+0000","last_unstale":"2024-09-14T06:00:26.112421+0000","last_undegraded":"2024-09-14T06:00:26.112421+0000","last_fullsized":"2024-09-14T06:00:26.112421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:05.958908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001779487,"stat_sum":{"num_bytes":49873934,"num_objects":69,"num_object_clones":16,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":30,"num_read":5358,"num_read_kb":30504,"num_write":689,"num_write_kb":8279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"84'493","reported_seq":4225,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.631355+0000","last_change":"2024-09-14T05:59:08.282513+0000","last_active":"2024-09-14T06:00:26.631355+0000","last_peered":"2024-09-14T06:00:26.631355+0000","last_clean":"2024-09-14T06:00:26.631355+0000","last_became_active":"2024-09-14T05:59:06.307548+0000","last_became_peered":"2024-09-14T05:59:06.307548+0000","last_unstale":"2024-09-14T06:00:26.631355+0000","last_undegraded":"2024-09-14T06:00:26.631355+0000","last_fullsized":"2024-09-14T06:00:26.631355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:05.860748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061538200000000004,"stat_sum":{"num_bytes":17317830,"num_objects":44,"num_object_clones":8,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":20,"num_read":4987,"num_read_kb":16026,"num_write":705,"num_write_kb":7963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":142,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:25.682821+0000","last_change":"2024-09-14T05:58:56.312544+0000","last_active":"2024-09-14T06:00:25.682821+0000","last_peered":"2024-09-14T06:00:25.682821+0000","last_clean":"2024-09-14T06:00:25.682821+0000","last_became_active":"2024-09-14T05:58:54.103612+0000","last_became_peered":"2024-09-14T05:58:54.103612+0000","last_unstale":"2024-09-14T06:00:25.682821+0000","last_undegraded":"2024-09-14T06:00:25.682821+0000","last_fullsized":"2024-09-14T06:00:25.682821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:08.678742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"85'553","reported_seq":3232,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-14T06:00:28.641319+0000","last_change":"2024-09-14T05:59:43.762927+0000","last_active":"2024-09-14T06:00:28.641319+0000","last_peered":"2024-09-14T06:00:28.641319+0000","last_clean":"2024-09-14T06:00:28.641319+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T06:00:28.641319+0000","last_undegraded":"2024-09-14T06:00:28.641319+0000","last_fullsized":"2024-09-14T06:00:28.641319+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:58.228154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20503350,"num_objects":48,"num_object_clones":6,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":4916,"num_read_kb":11961,"num_write":664,"num_write_kb":4886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:25.621994+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T06:00:25.621994+0000","last_peered":"2024-09-14T06:00:25.621994+0000","last_clean":"2024-09-14T06:00:25.621994+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T06:00:25.621994+0000","last_undegraded":"2024-09-14T06:00:25.621994+0000","last_fullsized":"2024-09-14T06:00:25.621994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"83'348","reported_seq":4045,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.291873+0000","last_change":"2024-09-14T05:59:08.299312+0000","last_active":"2024-09-14T06:00:26.291873+0000","last_peered":"2024-09-14T06:00:26.291873+0000","last_clean":"2024-09-14T06:00:26.291873+0000","last_became_active":"2024-09-14T05:59:06.302779+0000","last_became_peered":"2024-09-14T05:59:06.302779+0000","last_unstale":"2024-09-14T06:00:26.291873+0000","last_undegraded":"2024-09-14T06:00:26.291873+0000","last_fullsized":"2024-09-14T06:00:26.291873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:40:46.949102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001533155,"stat_sum":{"num_bytes":61945877,"num_objects":59,"num_object_clones":9,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":22,"num_read":3644,"num_read_kb":26795,"num_write":361,"num_write_kb":13742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:25.675108+0000","last_change":"2024-09-14T05:59:40.765463+0000","last_active":"2024-09-14T06:00:25.675108+0000","last_peered":"2024-09-14T06:00:25.675108+0000","last_clean":"2024-09-14T06:00:25.675108+0000","last_became_active":"2024-09-14T05:59:40.764785+0000","last_became_peered":"2024-09-14T05:59:40.764785+0000","last_unstale":"2024-09-14T06:00:25.675108+0000","last_undegraded":"2024-09-14T06:00:25.675108+0000","last_fullsized":"2024-09-14T06:00:25.675108+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:47.547246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"83'266","reported_seq":2141,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.501071+0000","last_change":"2024-09-14T05:59:08.282105+0000","last_active":"2024-09-14T06:00:26.501071+0000","last_peered":"2024-09-14T06:00:26.501071+0000","last_clean":"2024-09-14T06:00:26.501071+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T06:00:26.501071+0000","last_undegraded":"2024-09-14T06:00:26.501071+0000","last_fullsized":"2024-09-14T06:00:26.501071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:25.179483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010945919999999999,"stat_sum":{"num_bytes":19642642,"num_objects":40,"num_object_clones":5,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":19,"num_read":1998,"num_read_kb":4581,"num_write":311,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":151,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:25.622139+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T06:00:25.622139+0000","last_peered":"2024-09-14T06:00:25.622139+0000","last_clean":"2024-09-14T06:00:25.622139+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T06:00:25.622139+0000","last_undegraded":"2024-09-14T06:00:25.622139+0000","last_fullsized":"2024-09-14T06:00:25.622139+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"81'345","reported_seq":3492,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.294010+0000","last_change":"2024-09-14T05:59:08.293368+0000","last_active":"2024-09-14T06:00:26.294010+0000","last_peered":"2024-09-14T06:00:26.294010+0000","last_clean":"2024-09-14T06:00:26.294010+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T06:00:26.294010+0000","last_undegraded":"2024-09-14T06:00:26.294010+0000","last_fullsized":"2024-09-14T06:00:26.294010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:29.378246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072033799999999995,"stat_sum":{"num_bytes":11716702,"num_objects":47,"num_object_clones":8,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":20,"num_read":4452,"num_read_kb":12597,"num_write":325,"num_write_kb":3481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"83'330","reported_seq":1597,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.631439+0000","last_change":"2024-09-14T05:59:40.846399+0000","last_active":"2024-09-14T06:00:26.631439+0000","last_peered":"2024-09-14T06:00:26.631439+0000","last_clean":"2024-09-14T06:00:26.631439+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T06:00:26.631439+0000","last_undegraded":"2024-09-14T06:00:26.631439+0000","last_fullsized":"2024-09-14T06:00:26.631439+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:40:59.246331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047912600000000002,"stat_sum":{"num_bytes":56236796,"num_objects":42,"num_object_clones":5,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":19,"num_read":1719,"num_read_kb":11646,"num_write":320,"num_write_kb":5104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":144,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:25.645132+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T06:00:25.645132+0000","last_peered":"2024-09-14T06:00:25.645132+0000","last_clean":"2024-09-14T06:00:25.645132+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T06:00:25.645132+0000","last_undegraded":"2024-09-14T06:00:25.645132+0000","last_fullsized":"2024-09-14T06:00:25.645132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"83'848","reported_seq":2316,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.560485+0000","last_change":"2024-09-14T05:59:08.281926+0000","last_active":"2024-09-14T06:00:26.560485+0000","last_peered":"2024-09-14T06:00:26.560485+0000","last_clean":"2024-09-14T06:00:26.560485+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T06:00:26.560485+0000","last_undegraded":"2024-09-14T06:00:26.560485+0000","last_fullsized":"2024-09-14T06:00:26.560485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:49.003274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096925799999999997,"stat_sum":{"num_bytes":21940324,"num_objects":51,"num_object_clones":8,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":19,"num_read":4516,"num_read_kb":16534,"num_write":1313,"num_write_kb":11910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:25.626596+0000","last_change":"2024-09-14T06:00:25.625653+0000","last_active":"2024-09-14T06:00:25.626596+0000","last_peered":"2024-09-14T06:00:25.626596+0000","last_clean":"2024-09-14T06:00:25.626596+0000","last_became_active":"2024-09-14T06:00:25.625192+0000","last_became_peered":"2024-09-14T06:00:25.625192+0000","last_unstale":"2024-09-14T06:00:25.626596+0000","last_undegraded":"2024-09-14T06:00:25.626596+0000","last_fullsized":"2024-09-14T06:00:25.626596+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:36.805054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"85'361","reported_seq":1549,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-14T06:00:28.703639+0000","last_change":"2024-09-14T05:59:40.894081+0000","last_active":"2024-09-14T06:00:28.703639+0000","last_peered":"2024-09-14T06:00:28.703639+0000","last_clean":"2024-09-14T06:00:28.703639+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T06:00:28.703639+0000","last_undegraded":"2024-09-14T06:00:28.703639+0000","last_fullsized":"2024-09-14T06:00:28.703639+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:56.932961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26809356,"num_objects":59,"num_object_clones":10,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":24,"num_read":1727,"num_read_kb":13040,"num_write":362,"num_write_kb":7738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":142,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:25.674244+0000","last_change":"2024-09-14T05:58:56.593338+0000","last_active":"2024-09-14T06:00:25.674244+0000","last_peered":"2024-09-14T06:00:25.674244+0000","last_clean":"2024-09-14T06:00:25.674244+0000","last_became_active":"2024-09-14T05:58:54.099699+0000","last_became_peered":"2024-09-14T05:58:54.099699+0000","last_unstale":"2024-09-14T06:00:25.674244+0000","last_undegraded":"2024-09-14T06:00:25.674244+0000","last_fullsized":"2024-09-14T06:00:25.674244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:40.481832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"83'236","reported_seq":1474,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.511349+0000","last_change":"2024-09-14T05:59:08.298483+0000","last_active":"2024-09-14T06:00:26.511349+0000","last_peered":"2024-09-14T06:00:26.511349+0000","last_clean":"2024-09-14T06:00:26.511349+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T06:00:26.511349+0000","last_undegraded":"2024-09-14T06:00:26.511349+0000","last_fullsized":"2024-09-14T06:00:26.511349+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:45:13.266547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011244670000000001,"stat_sum":{"num_bytes":12286963,"num_objects":44,"num_object_clones":7,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":19,"num_read":1191,"num_read_kb":13382,"num_write":274,"num_write_kb":5221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":143,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:25.645095+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T06:00:25.645095+0000","last_peered":"2024-09-14T06:00:25.645095+0000","last_clean":"2024-09-14T06:00:25.645095+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T06:00:25.645095+0000","last_undegraded":"2024-09-14T06:00:25.645095+0000","last_fullsized":"2024-09-14T06:00:25.645095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":242,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:25.674331+0000","last_change":"2024-09-14T05:59:40.766729+0000","last_active":"2024-09-14T06:00:25.674331+0000","last_peered":"2024-09-14T06:00:25.674331+0000","last_clean":"2024-09-14T06:00:25.674331+0000","last_became_active":"2024-09-14T05:59:40.765914+0000","last_became_peered":"2024-09-14T05:59:40.765914+0000","last_unstale":"2024-09-14T06:00:25.674331+0000","last_undegraded":"2024-09-14T06:00:25.674331+0000","last_fullsized":"2024-09-14T06:00:25.674331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:02.407639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"83'568","reported_seq":1686,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.559186+0000","last_change":"2024-09-14T05:59:08.298535+0000","last_active":"2024-09-14T06:00:26.559186+0000","last_peered":"2024-09-14T06:00:26.559186+0000","last_clean":"2024-09-14T06:00:26.559186+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T06:00:26.559186+0000","last_undegraded":"2024-09-14T06:00:26.559186+0000","last_fullsized":"2024-09-14T06:00:26.559186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:15.953337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085964400000000001,"stat_sum":{"num_bytes":18090572,"num_objects":48,"num_object_clones":7,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":19,"num_read":2957,"num_read_kb":5420,"num_write":794,"num_write_kb":2480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"81'242","reported_seq":2416,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.631202+0000","last_change":"2024-09-14T05:59:08.282238+0000","last_active":"2024-09-14T06:00:26.631202+0000","last_peered":"2024-09-14T06:00:26.631202+0000","last_clean":"2024-09-14T06:00:26.631202+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T06:00:26.631202+0000","last_undegraded":"2024-09-14T06:00:26.631202+0000","last_fullsized":"2024-09-14T06:00:26.631202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:11.842557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052576800000000003,"stat_sum":{"num_bytes":29247527,"num_objects":43,"num_object_clones":4,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":15,"num_read":2072,"num_read_kb":8125,"num_write":252,"num_write_kb":18956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"83'472","reported_seq":1972,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.608832+0000","last_change":"2024-09-14T05:59:08.303592+0000","last_active":"2024-09-14T06:00:26.608832+0000","last_peered":"2024-09-14T06:00:26.608832+0000","last_clean":"2024-09-14T06:00:26.608832+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T06:00:26.608832+0000","last_undegraded":"2024-09-14T06:00:26.608832+0000","last_fullsized":"2024-09-14T06:00:26.608832+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:00:47.621362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035228000000000001,"stat_sum":{"num_bytes":31257795,"num_objects":56,"num_object_clones":11,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":23,"num_read":2847,"num_read_kb":9511,"num_write":602,"num_write_kb":4298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"83'728","reported_seq":1681,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.278753+0000","last_change":"2024-09-14T05:59:40.885530+0000","last_active":"2024-09-14T06:00:26.278753+0000","last_peered":"2024-09-14T06:00:26.278753+0000","last_clean":"2024-09-14T06:00:26.278753+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T06:00:26.278753+0000","last_undegraded":"2024-09-14T06:00:26.278753+0000","last_fullsized":"2024-09-14T06:00:26.278753+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:26.350168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083256200000000002,"stat_sum":{"num_bytes":8260195,"num_objects":43,"num_object_clones":6,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":17,"num_read":3971,"num_read_kb":6897,"num_write":1167,"num_write_kb":5508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"83'419","reported_seq":4445,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.360603+0000","last_change":"2024-09-14T05:59:08.294210+0000","last_active":"2024-09-14T06:00:26.360603+0000","last_peered":"2024-09-14T06:00:26.360603+0000","last_clean":"2024-09-14T06:00:26.360603+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T06:00:26.360603+0000","last_undegraded":"2024-09-14T06:00:26.360603+0000","last_fullsized":"2024-09-14T06:00:26.360603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:15:01.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013095159999999999,"stat_sum":{"num_bytes":37167361,"num_objects":55,"num_object_clones":8,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":27,"num_read":5560,"num_read_kb":21098,"num_write":397,"num_write_kb":9900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"83'297","reported_seq":2395,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.212064+0000","last_change":"2024-09-14T05:59:08.371003+0000","last_active":"2024-09-14T06:00:26.212064+0000","last_peered":"2024-09-14T06:00:26.212064+0000","last_clean":"2024-09-14T06:00:26.212064+0000","last_became_active":"2024-09-14T05:59:06.300360+0000","last_became_peered":"2024-09-14T05:59:06.300360+0000","last_unstale":"2024-09-14T06:00:26.212064+0000","last_undegraded":"2024-09-14T06:00:26.212064+0000","last_fullsized":"2024-09-14T06:00:26.212064+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:22.698288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022610920000000001,"stat_sum":{"num_bytes":15890075,"num_objects":44,"num_object_clones":8,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":20,"num_read":2861,"num_read_kb":10873,"num_write":308,"num_write_kb":5364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"83'302","reported_seq":2594,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.613794+0000","last_change":"2024-09-14T05:59:08.370421+0000","last_active":"2024-09-14T06:00:26.613794+0000","last_peered":"2024-09-14T06:00:26.613794+0000","last_clean":"2024-09-14T06:00:26.613794+0000","last_became_active":"2024-09-14T05:59:06.308504+0000","last_became_peered":"2024-09-14T05:59:06.308504+0000","last_unstale":"2024-09-14T06:00:26.613794+0000","last_undegraded":"2024-09-14T06:00:26.613794+0000","last_fullsized":"2024-09-14T06:00:26.613794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:04.940752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001798163,"stat_sum":{"num_bytes":19075443,"num_objects":62,"num_object_clones":11,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":24,"num_read":2798,"num_read_kb":13988,"num_write":315,"num_write_kb":4410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"83'454","reported_seq":5498,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.523253+0000","last_change":"2024-09-14T05:59:08.370940+0000","last_active":"2024-09-14T06:00:26.523253+0000","last_peered":"2024-09-14T06:00:26.523253+0000","last_clean":"2024-09-14T06:00:26.523253+0000","last_became_active":"2024-09-14T05:59:06.302019+0000","last_became_peered":"2024-09-14T05:59:06.302019+0000","last_unstale":"2024-09-14T06:00:26.523253+0000","last_undegraded":"2024-09-14T06:00:26.523253+0000","last_fullsized":"2024-09-14T06:00:26.523253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:27.353423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022861499999999998,"stat_sum":{"num_bytes":27147652,"num_objects":47,"num_object_clones":5,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":6580,"num_read_kb":12669,"num_write":551,"num_write_kb":5643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"83'753","reported_seq":2842,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.552424+0000","last_change":"2024-09-14T05:59:43.767147+0000","last_active":"2024-09-14T06:00:26.552424+0000","last_peered":"2024-09-14T06:00:26.552424+0000","last_clean":"2024-09-14T06:00:26.552424+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T06:00:26.552424+0000","last_undegraded":"2024-09-14T06:00:26.552424+0000","last_fullsized":"2024-09-14T06:00:26.552424+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:17.773292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047002699999999998,"stat_sum":{"num_bytes":39600995,"num_objects":75,"num_object_clones":13,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":34,"num_read":5186,"num_read_kb":10668,"num_write":1062,"num_write_kb":8572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"83'401","reported_seq":5500,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.110734+0000","last_change":"2024-09-14T05:59:08.369705+0000","last_active":"2024-09-14T06:00:26.110734+0000","last_peered":"2024-09-14T06:00:26.110734+0000","last_clean":"2024-09-14T06:00:26.110734+0000","last_became_active":"2024-09-14T05:59:06.311716+0000","last_became_peered":"2024-09-14T05:59:06.311716+0000","last_unstale":"2024-09-14T06:00:26.110734+0000","last_undegraded":"2024-09-14T06:00:26.110734+0000","last_fullsized":"2024-09-14T06:00:26.110734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:56.028818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001347256,"stat_sum":{"num_bytes":42929629,"num_objects":54,"num_object_clones":6,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":22,"num_read":5845,"num_read_kb":29571,"num_write":512,"num_write_kb":27316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"86'516","reported_seq":3540,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-14T06:00:28.641060+0000","last_change":"2024-09-14T05:59:43.765786+0000","last_active":"2024-09-14T06:00:28.641060+0000","last_peered":"2024-09-14T06:00:28.641060+0000","last_clean":"2024-09-14T06:00:28.641060+0000","last_became_active":"2024-09-14T05:59:43.763983+0000","last_became_peered":"2024-09-14T05:59:43.763983+0000","last_unstale":"2024-09-14T06:00:28.641060+0000","last_undegraded":"2024-09-14T06:00:28.641060+0000","last_fullsized":"2024-09-14T06:00:28.641060+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:40.236670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19047241,"num_objects":55,"num_object_clones":8,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":29,"num_read":4188,"num_read_kb":10009,"num_write":559,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":767927,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"83'290","reported_seq":5061,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-14T06:00:26.352101+0000","last_change":"2024-09-14T05:59:08.369685+0000","last_active":"2024-09-14T06:00:26.352101+0000","last_peered":"2024-09-14T06:00:26.352101+0000","last_clean":"2024-09-14T06:00:26.352101+0000","last_became_active":"2024-09-14T05:59:06.302125+0000","last_became_peered":"2024-09-14T05:59:06.302125+0000","last_unstale":"2024-09-14T06:00:26.352101+0000","last_undegraded":"2024-09-14T06:00:26.352101+0000","last_fullsized":"2024-09-14T06:00:26.352101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:47:33.521392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012750369999999999,"stat_sum":{"num_bytes":39285955,"num_objects":61,"num_object_clones":16,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":18,"num_read":4772,"num_read_kb":20703,"num_write":311,"num_write_kb":9342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":860576494,"num_objects":1619,"num_object_clones":258,"num_object_copies":3238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1619,"num_whiteouts":668,"num_read":121693,"num_read_kb":437067,"num_write":18687,"num_write_kb":259552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":308,"num_bytes_recovered":5610454,"num_keys_recovered":69,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":166522880,"data_stored":216880652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14757,"ondisk_log_size":14757,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43412,"kb_used_data":8064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328428,"statfs":{"total":96636764160,"available":96592310272,"internally_reserved":0,"allocated":8257536,"data_stored":10702120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495627,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63804,"kb_used_data":23336,"kb_used_omap":4,"kb_used_meta":40443,"kb_avail":94308036,"statfs":{"total":96636764160,"available":96571428864,"internally_reserved":0,"allocated":23896064,"data_stored":33471054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":41414320},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542168,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82296,"kb_used_data":32980,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94289544,"statfs":{"total":96636764160,"available":96552493056,"internally_reserved":0,"allocated":33771520,"data_stored":41912786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44604,"kb_used_data":9248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327236,"statfs":{"total":96636764160,"available":96591089664,"internally_reserved":0,"allocated":9469952,"data_stored":12358203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542167,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67208,"kb_used_data":23532,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94304632,"statfs":{"total":96636764160,"available":96567943168,"internally_reserved":0,"allocated":24096768,"data_stored":27747059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62872,"kb_used_data":31684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94308968,"statfs":{"total":96636764160,"available":96572383232,"internally_reserved":0,"allocated":32444416,"data_stored":40560074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55344,"kb_used_data":28316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94316496,"statfs":{"total":96636764160,"available":96580091904,"internally_reserved":0,"allocated":28995584,"data_stored":35020431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53184,"kb_used_data":13660,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94318656,"statfs":{"total":96636764160,"available":96582303744,"internally_reserved":0,"allocated":13987840,"data_stored":19338504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22298624,"data_stored":32419681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13066240,"data_stored":18935146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7274496,"data_stored":10253386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28123136,"data_stored":34662080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":31625216,"data_stored":40253344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23195648,"data_stored":27367270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8556544,"data_stored":11959751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32382976,"data_stored":41029994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T06:00:30.480 INFO:tasks.thrashosds.thrasher:Setting 3.7 to [5, 7] 2024-09-14T06:00:30.480 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.7', '5', '7'] 2024-09-14T06:00:30.480 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.7 5 7 2024-09-14T06:00:30.549 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:30.547+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:30.592 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:30.592 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:30.606 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:00:30.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:00:30.650 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:30.647+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:30.750 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:30.747+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:30.775 INFO:teuthology.orchestra.run.smithi006.stdout:leaving image image_client.0-clone33 intact 2024-09-14T06:00:30.778 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:30.778 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:30.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:00:30.793 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:30.793 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:30.825 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:30.826 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:30.850 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:30.849+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:30.857 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:30.890 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:30.890 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:30.910 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:30.910 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:30.945 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:30.946 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:30.952 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:30.947+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:30.961 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:30.961 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:30.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:30.961 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:30.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.961 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23550 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 606208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:30.961 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:30.962 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.010266493000003, 2024-09-14T06:00:30.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048793072999999999, 2024-09-14T06:00:30.962 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:30.962 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:30.962 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:30.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:30.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:30.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:30.962 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23550 2024-09-14T06:00:30.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.962 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:30.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:30.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:30.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:30.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:30.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:30.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:00:30.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7800000000000002e-07 2024-09-14T06:00:30.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948677+0000", 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1949999999999997e-06 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948687+0000", 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0849000000000001e-05 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948692+0000", 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8670000000000002e-06 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:30.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997290+0000", 2024-09-14T06:00:30.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048597596999999999 2024-09-14T06:00:30.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:30.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997367+0000", 2024-09-14T06:00:30.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7236000000000004e-05 2024-09-14T06:00:30.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:30.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997462+0000", 2024-09-14T06:00:30.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4951000000000006e-05 2024-09-14T06:00:30.966 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:30.966 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:30.966 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:30.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.966 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23551 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 620544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:30.966 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:30.966 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.010235635999997, 2024-09-14T06:00:30.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048938838999999998, 2024-09-14T06:00:30.966 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:30.966 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:30.966 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:30.966 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:30.966 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:30.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:30.967 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23551 2024-09-14T06:00:30.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.967 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:30.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:30.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:30.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:30.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:30.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:30.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:00:30.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1e-07 2024-09-14T06:00:30.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:30.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948701+0000", 2024-09-14T06:00:30.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2950000000000001e-06 2024-09-14T06:00:30.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:30.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948705+0000", 2024-09-14T06:00:30.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7929999999999999e-06 2024-09-14T06:00:30.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:30.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948709+0000", 2024-09-14T06:00:30.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T06:00:30.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:30.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997535+0000", 2024-09-14T06:00:30.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048826181000000003 2024-09-14T06:00:30.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:30.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997580+0000", 2024-09-14T06:00:30.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5355000000000002e-05 2024-09-14T06:00:30.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:30.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997639+0000", 2024-09-14T06:00:30.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8479e-05 2024-09-14T06:00:30.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:30.970 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:30.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:30.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.971 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:30.971 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:30.971 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.010220158999999, 2024-09-14T06:00:30.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T06:00:30.971 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:30.971 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:30.971 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:30.971 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:30.971 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:30.971 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T06:00:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:00:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:30.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T06:00:30.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T06:00:30.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:30.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T06:00:30.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T06:00:30.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:30.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T06:00:30.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T06:00:30.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:30.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T06:00:30.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T06:00:30.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:30.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T06:00:30.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T06:00:30.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:30.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T06:00:30.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T06:00:30.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:30.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T06:00:30.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T06:00:30.975 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:30.975 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:30.975 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:30.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.976 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:30.976 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:30.976 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.010200884, 2024-09-14T06:00:30.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T06:00:30.976 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:30.976 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:30.976 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:30.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:30.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:30.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:30.977 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T06:00:30.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.977 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:30.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:30.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:30.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:30.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:30.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:30.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:00:30.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T06:00:30.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:30.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T06:00:30.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T06:00:30.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:30.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T06:00:30.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T06:00:30.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:30.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T06:00:30.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T06:00:30.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:30.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T06:00:30.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T06:00:30.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:30.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T06:00:30.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T06:00:30.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:30.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T06:00:30.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T06:00:30.981 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:30.981 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:30.981 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:30.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.981 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:30.982 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:30.982 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.010181308, 2024-09-14T06:00:30.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T06:00:30.982 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:30.982 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:30.982 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:30.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:30.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:30.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:30.982 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T06:00:30.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.982 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:30.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:30.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:30.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:30.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:00:30.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:30.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T06:00:30.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T06:00:30.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:30.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T06:00:30.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T06:00:30.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:30.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T06:00:30.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:30.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:30.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T06:00:30.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T06:00:30.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:30.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T06:00:30.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T06:00:30.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:30.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T06:00:30.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T06:00:30.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:30.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T06:00:30.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T06:00:30.986 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:30.986 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:30.986 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:30.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.986 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:30.987 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:30.987 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.010161850999999, 2024-09-14T06:00:30.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T06:00:30.987 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:30.987 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:30.987 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:30.987 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:30.987 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:30.987 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:30.987 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T06:00:30.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.987 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:30.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:00:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T06:00:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:30.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T06:00:30.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T06:00:30.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:30.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T06:00:30.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T06:00:30.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:30.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T06:00:30.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T06:00:30.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:30.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T06:00:30.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T06:00:30.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:30.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T06:00:30.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T06:00:30.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:30.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.010142799999997, 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:30.991 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:30.992 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:30.992 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T06:00:30.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.992 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:30.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:30.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:30.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:30.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:30.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:30.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:00:30.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T06:00:30.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:30.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T06:00:30.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T06:00:30.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:30.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T06:00:30.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T06:00:30.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:30.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T06:00:30.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T06:00:30.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:30.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T06:00:30.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T06:00:30.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T06:00:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T06:00:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T06:00:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T06:00:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.995 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:30.996 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:30.996 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.010123118999999, 2024-09-14T06:00:30.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T06:00:30.996 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:30.996 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:30.996 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:30.996 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:30.996 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:30.996 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:30.996 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T06:00:30.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.996 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:30.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:30.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:30.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:30.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:00:30.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:30.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:30.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T06:00:30.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T06:00:30.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:30.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T06:00:30.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T06:00:30.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:30.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T06:00:30.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:00:30.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:30.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T06:00:30.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T06:00:30.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:30.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:30.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:30.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T06:00:30.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T06:00:30.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T06:00:31.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T06:00:31.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T06:00:31.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T06:00:31.000 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.001 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.001 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.001 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:31.001 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:31.001 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.010103168000001, 2024-09-14T06:00:31.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T06:00:31.001 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.001 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.001 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.001 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.002 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.002 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T06:00:31.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.002 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:31.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:00:31.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T06:00:31.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T06:00:31.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T06:00:31.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:00:31.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T06:00:31.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T06:00:31.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T06:00:31.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T06:00:31.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T06:00:31.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T06:00:31.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T06:00:31.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T06:00:31.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T06:00:31.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T06:00:31.006 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.006 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.006 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.006 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:31.006 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:31.006 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.010083856000001, 2024-09-14T06:00:31.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T06:00:31.006 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.007 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.007 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.007 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.007 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.007 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.007 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T06:00:31.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.007 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:31.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:31.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:00:31.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T06:00:31.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T06:00:31.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T06:00:31.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T06:00:31.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T06:00:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T06:00:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T06:00:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T06:00:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T06:00:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T06:00:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T06:00:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T06:00:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T06:00:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:31.011 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:31.012 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.010064094999997, 2024-09-14T06:00:31.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T06:00:31.012 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.012 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.012 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.012 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.012 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.012 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.012 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T06:00:31.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.012 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:00:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T06:00:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:00:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T06:00:31.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T06:00:31.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T06:00:31.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T06:00:31.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T06:00:31.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T06:00:31.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T06:00:31.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T06:00:31.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T06:00:31.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T06:00:31.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T06:00:31.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T06:00:31.016 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.016 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.016 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.016 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:31.016 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:31.016 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.010043174000003, 2024-09-14T06:00:31.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T06:00:31.016 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.017 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.017 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.017 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T06:00:31.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.017 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:31.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:00:31.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T06:00:31.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T06:00:31.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T06:00:31.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T06:00:31.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T06:00:31.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T06:00:31.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T06:00:31.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T06:00:31.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T06:00:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T06:00:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T06:00:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T06:00:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T06:00:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T06:00:31.020 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.021 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.021 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:31.021 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:31.021 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.008883840000003, 2024-09-14T06:00:31.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T06:00:31.021 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.021 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.021 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.021 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.021 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.022 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T06:00:31.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.022 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:31.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:00:31.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T06:00:31.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T06:00:31.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.024 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:31.024 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:31.024 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:31.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T06:00:31.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T06:00:31.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T06:00:31.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T06:00:31.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T06:00:31.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T06:00:31.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T06:00:31.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T06:00:31.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.008585058000001, 2024-09-14T06:00:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:00:31.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T06:00:31.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T06:00:31.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T06:00:31.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T06:00:31.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T06:00:31.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T06:00:31.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T06:00:31.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T06:00:31.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T06:00:31.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T06:00:31.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T06:00:31.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T06:00:31.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T06:00:31.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T06:00:31.032 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.032 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.032 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.032 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:31.032 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:31.032 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.008434319999999, 2024-09-14T06:00:31.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T06:00:31.033 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.033 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.033 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.033 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T06:00:31.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.033 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:31.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:00:31.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T06:00:31.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T06:00:31.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T06:00:31.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T06:00:31.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T06:00:31.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T06:00:31.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T06:00:31.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T06:00:31.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T06:00:31.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T06:00:31.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T06:00:31.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T06:00:31.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T06:00:31.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T06:00:31.037 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.037 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.037 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.038 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23582 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 911360~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:31.038 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:31.038 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.007508932999997, 2024-09-14T06:00:31.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048708939999999999, 2024-09-14T06:00:31.038 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.038 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.038 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.038 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.038 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.038 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.038 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23582 2024-09-14T06:00:31.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.039 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:31.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:31.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951427+0000", 2024-09-14T06:00:31.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6300000000000005e-07 2024-09-14T06:00:31.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951430+0000", 2024-09-14T06:00:31.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5179999999999999e-06 2024-09-14T06:00:31.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951437+0000", 2024-09-14T06:00:31.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0940000000000002e-06 2024-09-14T06:00:31.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951443+0000", 2024-09-14T06:00:31.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7910000000000001e-06 2024-09-14T06:00:31.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000047+0000", 2024-09-14T06:00:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048604550000000003 2024-09-14T06:00:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000095+0000", 2024-09-14T06:00:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7735999999999998e-05 2024-09-14T06:00:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000135+0000", 2024-09-14T06:00:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0587999999999998e-05 2024-09-14T06:00:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23588 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 722944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.007484067999997, 2024-09-14T06:00:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048792653999999998, 2024-09-14T06:00:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23588 2024-09-14T06:00:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951451+0000", 2024-09-14T06:00:31.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951665+0000", 2024-09-14T06:00:31.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021337600000000001 2024-09-14T06:00:31.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951669+0000", 2024-09-14T06:00:31.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3460000000000004e-06 2024-09-14T06:00:31.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951688+0000", 2024-09-14T06:00:31.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9042000000000002e-05 2024-09-14T06:00:31.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951696+0000", 2024-09-14T06:00:31.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6660000000000008e-06 2024-09-14T06:00:31.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000162+0000", 2024-09-14T06:00:31.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048465824999999997 2024-09-14T06:00:31.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000199+0000", 2024-09-14T06:00:31.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7143e-05 2024-09-14T06:00:31.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000244+0000", 2024-09-14T06:00:31.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5256000000000002e-05 2024-09-14T06:00:31.047 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.048 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.048 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.048 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23590 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 745472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:31.048 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:31.048 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.007226613, 2024-09-14T06:00:31.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048677684999999998, 2024-09-14T06:00:31.048 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.048 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.048 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.048 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.048 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.049 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.049 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23590 2024-09-14T06:00:31.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.049 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:31.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951709+0000", 2024-09-14T06:00:31.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951850+0000", 2024-09-14T06:00:31.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014113 2024-09-14T06:00:31.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951855+0000", 2024-09-14T06:00:31.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6349999999999997e-06 2024-09-14T06:00:31.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951863+0000", 2024-09-14T06:00:31.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8189999999999998e-06 2024-09-14T06:00:31.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951871+0000", 2024-09-14T06:00:31.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2030000000000003e-06 2024-09-14T06:00:31.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000283+0000", 2024-09-14T06:00:31.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048412531000000002 2024-09-14T06:00:31.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000338+0000", 2024-09-14T06:00:31.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4462000000000001e-05 2024-09-14T06:00:31.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.000387+0000", 2024-09-14T06:00:31.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8905e-05 2024-09-14T06:00:31.052 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.052 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.052 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T06:00:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.383132756999998, 2024-09-14T06:00:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T06:00:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:00:31.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T06:00:31.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T06:00:31.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T06:00:31.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T06:00:31.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T06:00:31.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T06:00:31.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T06:00:31.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T06:00:31.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T06:00:31.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T06:00:31.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T06:00:31.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T06:00:31.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:31.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T06:00:31.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T06:00:31.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T06:00:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T06:00:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.860042817999997, 2024-09-14T06:00:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T06:00:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T06:00:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:00:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T06:00:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T06:00:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T06:00:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T06:00:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T06:00:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T06:00:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T06:00:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T06:00:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T06:00:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T06:00:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T06:00:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T06:00:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T06:00:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T06:00:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T06:00:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T06:00:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T06:00:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T06:00:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T06:00:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T06:00:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T06:00:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T06:00:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T06:00:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.064 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:31.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:00:31.065 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:31.066 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-14T06:00:31.066 INFO:teuthology.orchestra.run.smithi006.stdout:5322 write 0xe6ad09e thru 0xe6ba377 (0xd2da bytes) 2024-09-14T06:00:31.066 INFO:teuthology.orchestra.run.smithi006.stdout:5323 read 0x396b553 thru 0x3975a5e (0xa50c bytes) 2024-09-14T06:00:31.066 INFO:teuthology.orchestra.run.smithi006.stdout:5325 trunc from 0xe6ba378 to 0x8030a8f 2024-09-14T06:00:31.075 INFO:teuthology.orchestra.run.smithi006.stdout:5326 read 0x64d91da thru 0x64dc416 (0x323d bytes) 2024-09-14T06:00:31.075 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:31.073+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:31.076 INFO:teuthology.orchestra.run.smithi006.stdout:5328 punch from 0x1c1c05a to 0x1c22e73, (0x6e19 bytes) 2024-09-14T06:00:31.076 INFO:teuthology.orchestra.run.smithi006.stdout:5330 read 0x4854cb7 thru 0x4858fdc (0x4326 bytes) 2024-09-14T06:00:31.076 INFO:teuthology.orchestra.run.smithi006.stdout:5331 read 0x6179143 thru 0x6182cef (0x9bad bytes) 2024-09-14T06:00:31.077 INFO:teuthology.orchestra.run.smithi006.stdout:5332 writesame 0x5fd1b0a thru 0x5fdb228 data_size 0x1(0x971f bytes) 2024-09-14T06:00:31.117 INFO:teuthology.orchestra.run.smithi006.stdout:5333 write 0xb32ee32 thru 0xb330eac (0x207b bytes) 2024-09-14T06:00:31.135 INFO:teuthology.orchestra.run.smithi006.stdout:5334 write 0xc14a980 thru 0xc154cae (0xa32f bytes) 2024-09-14T06:00:31.141 INFO:teuthology.orchestra.run.smithi006.stdout:5335 write 0x7638729 thru 0x7647c3a (0xf512 bytes) 2024-09-14T06:00:31.148 INFO:teuthology.orchestra.run.smithi006.stdout:5339 read 0xb1672ab thru 0xb16fd1e (0x8a74 bytes) 2024-09-14T06:00:31.149 INFO:teuthology.orchestra.run.smithi006.stdout:5341 write 0x36bad41 thru 0x36c9e3d (0xf0fd bytes) 2024-09-14T06:00:31.157 INFO:teuthology.orchestra.run.smithi006.stdout:5342 write 0xbd61ba0 thru 0xbd63e83 (0x22e4 bytes) 2024-09-14T06:00:31.161 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:31.161 INFO:teuthology.orchestra.run.smithi006.stdout:5344 read 0xa6f8d6e thru 0xa6fa4ba (0x174d bytes) 2024-09-14T06:00:31.165 INFO:teuthology.orchestra.run.smithi006.stdout:5345 trunc from 0xc154caf to 0xe364d7d 2024-09-14T06:00:31.168 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:31.163+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:31.176 INFO:teuthology.orchestra.run.smithi006.stdout:5346 punch from 0xe15cf0c to 0xe168368, (0xb45c bytes) 2024-09-14T06:00:31.176 INFO:teuthology.orchestra.run.smithi006.stdout:5347 read 0x5dcd31b thru 0x5dced2c (0x1a12 bytes) 2024-09-14T06:00:31.177 INFO:teuthology.orchestra.run.smithi006.stdout:5348 read 0x2a93879 thru 0x2aa1c30 (0xe3b8 bytes) 2024-09-14T06:00:31.179 INFO:teuthology.orchestra.run.smithi006.stdout:5349 write 0xbc0c0af thru 0xbc19113 (0xd065 bytes) 2024-09-14T06:00:31.187 INFO:teuthology.orchestra.run.smithi006.stdout:5350 write 0x18552b7 thru 0x185ad14 (0x5a5e bytes) 2024-09-14T06:00:31.203 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:31.203 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:31.203 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:31.215 INFO:teuthology.orchestra.run.smithi006.stdout:5351 trunc from 0xe364d7d to 0x5774a15 2024-09-14T06:00:31.217 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:00:31.277 INFO:teuthology.orchestra.run.smithi006.stdout:5353 write 0xd10315b thru 0xd108553 (0x53f9 bytes) 2024-09-14T06:00:31.283 INFO:teuthology.orchestra.run.smithi006.stdout:5354 write 0x52c9e32 thru 0x52cf0b8 (0x5287 bytes) 2024-09-14T06:00:31.290 INFO:teuthology.orchestra.run.smithi006.stdout:5356 read 0xb902f05 thru 0xb904f06 (0x2002 bytes) 2024-09-14T06:00:31.290 INFO:teuthology.orchestra.run.smithi006.stdout:5357 write 0x44744e4 thru 0x4481228 (0xcd45 bytes) 2024-09-14T06:00:31.309 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:31.307+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:31.310 INFO:teuthology.orchestra.run.smithi006.stdout:5358 write 0xd1c4d7a thru 0xd1caf7d (0x6204 bytes) 2024-09-14T06:00:31.317 INFO:teuthology.orchestra.run.smithi006.stdout:5359 write 0x4b91b40 thru 0x4b9d611 (0xbad2 bytes) 2024-09-14T06:00:31.323 INFO:teuthology.orchestra.run.smithi006.stdout:5360 writesame 0x39a3c2c thru 0x39ae9b6 data_size 0x3b(0xad8b bytes) 2024-09-14T06:00:31.330 INFO:teuthology.orchestra.run.smithi006.stdout:5361 writesame 0x6721ca7 thru 0x67241d8 data_size 0x2e(0x2532 bytes) 2024-09-14T06:00:31.336 INFO:teuthology.orchestra.run.smithi006.stdout:5362 read 0x6820aa4 thru 0x6826048 (0x55a5 bytes) 2024-09-14T06:00:31.338 INFO:teuthology.orchestra.run.smithi006.stdout:5363 trunc from 0xd1caf7e to 0xc63b7a5 2024-09-14T06:00:31.358 INFO:teuthology.orchestra.run.smithi006.stdout:5364 write 0x9e40be4 thru 0x9e47469 (0x6886 bytes) 2024-09-14T06:00:31.365 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:31.365 INFO:teuthology.orchestra.run.smithi006.stdout:5366 write 0x746f4d3 thru 0x747bb6a (0xc698 bytes) 2024-09-14T06:00:31.371 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:31.369+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:31.393 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:31.393 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:31.393 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:31.393 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:31.393 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:31.394 INFO:teuthology.orchestra.run.smithi006.stdout:5368 write 0xec565f4 thru 0xec5b2a1 (0x4cae bytes) 2024-09-14T06:00:31.401 INFO:teuthology.orchestra.run.smithi006.stdout:5370 write 0x56ccab thru 0x56e53d (0x1893 bytes) 2024-09-14T06:00:31.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:00:31.417 INFO:teuthology.orchestra.run.smithi006.stdout:5371 trunc from 0xec5b2a2 to 0xc29677f 2024-09-14T06:00:31.438 INFO:teuthology.orchestra.run.smithi006.stdout:5372 write 0x848fcf6 thru 0x84916d9 (0x19e4 bytes) 2024-09-14T06:00:31.460 INFO:teuthology.orchestra.run.smithi006.stdout:5373 write 0xc3cb6e7 thru 0xc3d0a4b (0x5365 bytes) 2024-09-14T06:00:31.467 INFO:teuthology.orchestra.run.smithi006.stdout:5374 read 0x4c4107c thru 0x4c46e16 (0x5d9b bytes) 2024-09-14T06:00:31.468 INFO:teuthology.orchestra.run.smithi006.stdout:5375 write 0xbe47be5 thru 0xbe4d1ed (0x5609 bytes) 2024-09-14T06:00:31.473 INFO:teuthology.orchestra.run.smithi006.stdout:5376 punch from 0xad7c882 to 0xad7f8f4, (0x3072 bytes) 2024-09-14T06:00:31.473 INFO:teuthology.orchestra.run.smithi006.stdout:5377 punch from 0x31f0ebd to 0x31f8836, (0x7979 bytes) 2024-09-14T06:00:31.473 INFO:teuthology.orchestra.run.smithi006.stdout:5378 write 0x2932272 thru 0x29386cb (0x645a bytes) 2024-09-14T06:00:31.480 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:31.481 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:31.481 INFO:teuthology.orchestra.run.smithi006.stdout:5382 punch from 0xba65eee to 0xba6fa26, (0x9b38 bytes) 2024-09-14T06:00:31.481 INFO:teuthology.orchestra.run.smithi006.stdout:5383 read 0x3c3f94 thru 0x3cbf6f (0x7fdc bytes) 2024-09-14T06:00:31.483 INFO:teuthology.orchestra.run.smithi006.stdout:5384 write 0x5cb077c thru 0x5cb5974 (0x51f9 bytes) 2024-09-14T06:00:31.489 INFO:teuthology.orchestra.run.smithi006.stdout:5385 write 0x1ad5cb3 thru 0x1adbce9 (0x6037 bytes) 2024-09-14T06:00:31.497 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:31.495+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:31.498 INFO:teuthology.orchestra.run.smithi006.stdout:5386 writesame 0x40eeda9 thru 0x40f2707 data_size 0x1(0x395f bytes) 2024-09-14T06:00:31.513 INFO:teuthology.orchestra.run.smithi006.stdout:5387 read 0x6fab7a4 thru 0x6fb3cc6 (0x8523 bytes) 2024-09-14T06:00:31.513 INFO:teuthology.orchestra.run.smithi006.stdout:5388 writesame 0x5470546 thru 0x54795df data_size 0x53(0x909a bytes) 2024-09-14T06:00:31.524 INFO:teuthology.orchestra.run.smithi006.stdout:5389 trunc from 0xc3d0a4c to 0xe04f8d8 2024-09-14T06:00:31.536 INFO:teuthology.orchestra.run.smithi006.stdout:5390 write 0x247c9a4 thru 0x2482f5f (0x65bc bytes) 2024-09-14T06:00:31.543 INFO:teuthology.orchestra.run.smithi006.stdout:5391 read 0xaa395ee thru 0xaa407f9 (0x720c bytes) 2024-09-14T06:00:31.543 INFO:teuthology.orchestra.run.smithi006.stdout:5392 read 0xd9343c5 thru 0xd942ef7 (0xeb33 bytes) 2024-09-14T06:00:31.564 INFO:teuthology.orchestra.run.smithi006.stdout:5393 trunc from 0xe04f8d8 to 0x6628f7a 2024-09-14T06:00:31.572 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:31.567+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:31.592 INFO:teuthology.orchestra.run.smithi006.stdout:5394 read 0x5aec38d thru 0x5af66b5 (0xa329 bytes) 2024-09-14T06:00:31.592 INFO:teuthology.orchestra.run.smithi006.stdout:5397 read 0x76d596 thru 0x776103 (0x8b6e bytes) 2024-09-14T06:00:31.593 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.045414063999999, 2024-09-14T06:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38842 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.070287342999997, 2024-09-14T06:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083698121, 2024-09-14T06:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38842 2024-09-14T06:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521563+0000", 2024-09-14T06:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521566+0000", 2024-09-14T06:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1140000000000002e-06 2024-09-14T06:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521575+0000", 2024-09-14T06:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8769999999999999e-06 2024-09-14T06:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521581+0000", 2024-09-14T06:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2369999999999997e-06 2024-09-14T06:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605076+0000", 2024-09-14T06:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083494992000000004 2024-09-14T06:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605168+0000", 2024-09-14T06:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1731999999999995e-05 2024-09-14T06:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605260+0000", 2024-09-14T06:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2511999999999998e-05 2024-09-14T06:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38844 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9469952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.070259976000003, 2024-09-14T06:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084006762999999998, 2024-09-14T06:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38844 2024-09-14T06:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521590+0000", 2024-09-14T06:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9699999999999996e-07 2024-09-14T06:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521593+0000", 2024-09-14T06:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5909999999999998e-06 2024-09-14T06:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521603+0000", 2024-09-14T06:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0642000000000001e-05 2024-09-14T06:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521609+0000", 2024-09-14T06:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1020000000000002e-06 2024-09-14T06:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605318+0000", 2024-09-14T06:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083709166000000002 2024-09-14T06:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605454+0000", 2024-09-14T06:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013557400000000001 2024-09-14T06:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605596+0000", 2024-09-14T06:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014209100000000001 2024-09-14T06:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38845 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9650176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.070231675999999, 2024-09-14T06:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084212700000000001, 2024-09-14T06:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38845 2024-09-14T06:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1200000000000003e-07 2024-09-14T06:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521628+0000", 2024-09-14T06:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0196e-05 2024-09-14T06:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521637+0000", 2024-09-14T06:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6649999999999992e-06 2024-09-14T06:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521643+0000", 2024-09-14T06:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.285e-06 2024-09-14T06:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605652+0000", 2024-09-14T06:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084009025000000001 2024-09-14T06:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605741+0000", 2024-09-14T06:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8473000000000005e-05 2024-09-14T06:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605830+0000", 2024-09-14T06:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9444000000000006e-05 2024-09-14T06:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38848 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8536064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.070193666999998, 2024-09-14T06:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084375567999999998, 2024-09-14T06:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38848 2024-09-14T06:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0200000000000002e-07 2024-09-14T06:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521659+0000", 2024-09-14T06:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7800000000000001e-06 2024-09-14T06:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521667+0000", 2024-09-14T06:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6599999999999995e-06 2024-09-14T06:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521674+0000", 2024-09-14T06:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4560000000000003e-06 2024-09-14T06:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605872+0000", 2024-09-14T06:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084198010000000004 2024-09-14T06:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605945+0000", 2024-09-14T06:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2681000000000004e-05 2024-09-14T06:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606031+0000", 2024-09-14T06:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6378999999999994e-05 2024-09-14T06:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38849 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9748480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.070163241000003, 2024-09-14T06:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084581577000000005, 2024-09-14T06:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38849 2024-09-14T06:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521687+0000", 2024-09-14T06:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9400000000000005e-07 2024-09-14T06:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521729+0000", 2024-09-14T06:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2657000000000002e-05 2024-09-14T06:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521749+0000", 2024-09-14T06:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9264000000000001e-05 2024-09-14T06:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521761+0000", 2024-09-14T06:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2289999999999999e-05 2024-09-14T06:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606078+0000", 2024-09-14T06:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084316772999999998 2024-09-14T06:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606176+0000", 2024-09-14T06:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7992999999999995e-05 2024-09-14T06:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606268+0000", 2024-09-14T06:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2006e-05 2024-09-14T06:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38851 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9928704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.070067928999997, 2024-09-14T06:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084695081000000005, 2024-09-14T06:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38851 2024-09-14T06:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521783+0000", 2024-09-14T06:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1000000000000001e-06 2024-09-14T06:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521788+0000", 2024-09-14T06:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2619999999999998e-06 2024-09-14T06:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521803+0000", 2024-09-14T06:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5421999999999999e-05 2024-09-14T06:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521815+0000", 2024-09-14T06:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.171e-05 2024-09-14T06:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606320+0000", 2024-09-14T06:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084504698000000003 2024-09-14T06:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606404+0000", 2024-09-14T06:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4379e-05 2024-09-14T06:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606476+0000", 2024-09-14T06:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2509999999999995e-05 2024-09-14T06:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.070017178999997, 2024-09-14T06:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.069978855999999, 2024-09-14T06:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.069952164, 2024-09-14T06:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.069926297999999, 2024-09-14T06:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.068825928999999, 2024-09-14T06:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.068781950000002, 2024-09-14T06:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:00:31.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:00:31.673 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.673 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.673 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.674 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38865 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1392640~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.674 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:31.674 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.067803572000003, 2024-09-14T06:00:31.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084340500999999998, 2024-09-14T06:00:31.674 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.674 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.674 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.675 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.675 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38865 2024-09-14T06:00:31.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.675 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:31.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:31.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524047+0000", 2024-09-14T06:00:31.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5290000000000001e-06 2024-09-14T06:00:31.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524054+0000", 2024-09-14T06:00:31.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1910000000000003e-06 2024-09-14T06:00:31.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524074+0000", 2024-09-14T06:00:31.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9383999999999999e-05 2024-09-14T06:00:31.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524089+0000", 2024-09-14T06:00:31.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4647000000000001e-05 2024-09-14T06:00:31.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608123+0000", 2024-09-14T06:00:31.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084034837000000001 2024-09-14T06:00:31.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608224+0000", 2024-09-14T06:00:31.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100182 2024-09-14T06:00:31.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608386+0000", 2024-09-14T06:00:31.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162731 2024-09-14T06:00:31.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.679 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.679 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.679 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:31.679 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.067720190000003, 2024-09-14T06:00:31.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:00:31.680 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.680 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.680 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.680 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:00:31.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.681 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:31.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:31.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:00:31.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:00:31.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:00:31.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:00:31.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:00:31.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:00:31.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:00:31.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:00:31.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:00:31.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:00:31.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:00:31.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:00:31.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:00:31.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:00:31.685 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.685 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.685 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.686 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38869 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.686 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:31.686 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.067314719999999, 2024-09-14T06:00:31.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084608905999999998, 2024-09-14T06:00:31.686 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.686 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.686 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.686 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38869 2024-09-14T06:00:31.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.687 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:31.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:31.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525138+0000", 2024-09-14T06:00:31.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00060367999999999999 2024-09-14T06:00:31.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525160+0000", 2024-09-14T06:00:31.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1875999999999999e-05 2024-09-14T06:00:31.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525182+0000", 2024-09-14T06:00:31.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1427e-05 2024-09-14T06:00:31.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525198+0000", 2024-09-14T06:00:31.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507e-05 2024-09-14T06:00:31.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608907+0000", 2024-09-14T06:00:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083708535000000001 2024-09-14T06:00:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609011+0000", 2024-09-14T06:00:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010461199999999999 2024-09-14T06:00:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609144+0000", 2024-09-14T06:00:31.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013226899999999999 2024-09-14T06:00:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38871 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1671168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.066623509999999, 2024-09-14T06:00:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084308214000000006, 2024-09-14T06:00:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.691 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.692 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.692 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38871 2024-09-14T06:00:31.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.692 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:31.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:31.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525487+0000", 2024-09-14T06:00:31.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026091100000000001 2024-09-14T06:00:31.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525493+0000", 2024-09-14T06:00:31.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.742e-06 2024-09-14T06:00:31.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525508+0000", 2024-09-14T06:00:31.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:31.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525518+0000", 2024-09-14T06:00:31.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8500000000000006e-06 2024-09-14T06:00:31.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609229+0000", 2024-09-14T06:00:31.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083711775000000002 2024-09-14T06:00:31.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609388+0000", 2024-09-14T06:00:31.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158286 2024-09-14T06:00:31.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609534+0000", 2024-09-14T06:00:31.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000146308 2024-09-14T06:00:31.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.696 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.696 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38873 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 737280~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.696 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:31.697 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.066311937999998, 2024-09-14T06:00:31.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084288875999999999, 2024-09-14T06:00:31.697 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.697 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.697 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.697 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38873 2024-09-14T06:00:31.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.697 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:31.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:31.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526372+0000", 2024-09-14T06:00:31.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00083508200000000001 2024-09-14T06:00:31.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526383+0000", 2024-09-14T06:00:31.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0282000000000001e-05 2024-09-14T06:00:31.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526445+0000", 2024-09-14T06:00:31.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1975000000000002e-05 2024-09-14T06:00:31.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526460+0000", 2024-09-14T06:00:31.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5233e-05 2024-09-14T06:00:31.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609585+0000", 2024-09-14T06:00:31.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083125216000000002 2024-09-14T06:00:31.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609689+0000", 2024-09-14T06:00:31.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104126 2024-09-14T06:00:31.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609826+0000", 2024-09-14T06:00:31.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013696199999999999 2024-09-14T06:00:31.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.702 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.702 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38874 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.065345004000001, 2024-09-14T06:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083631987000000005, 2024-09-14T06:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38874 2024-09-14T06:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:31.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526505+0000", 2024-09-14T06:00:31.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7699999999999992e-07 2024-09-14T06:00:31.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526511+0000", 2024-09-14T06:00:31.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9139999999999996e-06 2024-09-14T06:00:31.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526525+0000", 2024-09-14T06:00:31.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3644e-05 2024-09-14T06:00:31.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526533+0000", 2024-09-14T06:00:31.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6510000000000001e-06 2024-09-14T06:00:31.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609897+0000", 2024-09-14T06:00:31.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083364173 2024-09-14T06:00:31.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610007+0000", 2024-09-14T06:00:31.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110707 2024-09-14T06:00:31.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610136+0000", 2024-09-14T06:00:31.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012892099999999999 2024-09-14T06:00:31.708 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.708 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.708 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.708 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38877 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1949696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:31.709 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:31.709 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.065300311000001, 2024-09-14T06:00:31.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083886717, 2024-09-14T06:00:31.709 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:31.709 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:31.709 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:31.709 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:31.709 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:31.709 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:31.709 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38877 2024-09-14T06:00:31.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.710 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:31.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:31.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:31.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:31.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:31.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:31.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:31.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529354+0000", 2024-09-14T06:00:31.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028049170000000001 2024-09-14T06:00:31.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:31.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529373+0000", 2024-09-14T06:00:31.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.933e-05 2024-09-14T06:00:31.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:31.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529399+0000", 2024-09-14T06:00:31.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6129e-05 2024-09-14T06:00:31.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:31.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529418+0000", 2024-09-14T06:00:31.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8944e-05 2024-09-14T06:00:31.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:31.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610197+0000", 2024-09-14T06:00:31.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080778271999999998 2024-09-14T06:00:31.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:31.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610300+0000", 2024-09-14T06:00:31.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103868 2024-09-14T06:00:31.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:31.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:31.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:31.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610436+0000", 2024-09-14T06:00:31.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013525700000000001 2024-09-14T06:00:31.714 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.714 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.714 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.714 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:31.714 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:31.715 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:31.715 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T06:00:31.718 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:00:31.718 INFO:teuthology.orchestra.run.smithi006.stdout:5398 write 0x45ae4b1 thru 0x45badd2 (0xc922 bytes) 2024-09-14T06:00:31.718 INFO:teuthology.orchestra.run.smithi006.stdout:5402 punch from 0x63189b to 0x632031, (0x796 bytes) 2024-09-14T06:00:31.718 INFO:teuthology.orchestra.run.smithi006.stdout:5403 writesame 0xae98576 thru 0xae9f078 data_size 0x1(0x6b03 bytes) 2024-09-14T06:00:31.718 INFO:teuthology.orchestra.run.smithi006.stdout:5404 read 0x81357a4 thru 0x813dd55 (0x85b2 bytes) 2024-09-14T06:00:31.719 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:31.719 INFO:teuthology.orchestra.run.smithi006.stdout:5406 writesame 0x20d776f thru 0x20e0160 data_size 0x1(0x89f2 bytes) 2024-09-14T06:00:31.719 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:31.719 INFO:teuthology.orchestra.run.smithi006.stdout:5409 read 0xb5d60b thru 0xb67c26 (0xa61c bytes) 2024-09-14T06:00:31.719 INFO:teuthology.orchestra.run.smithi006.stdout:5410 write 0x5c0067c thru 0x5c1004f (0xf9d4 bytes) 2024-09-14T06:00:31.719 INFO:teuthology.orchestra.run.smithi006.stdout:5411 punch from 0xad2729d to 0xad2bcc7, (0x4a2a bytes) 2024-09-14T06:00:31.719 INFO:teuthology.orchestra.run.smithi006.stdout:5412 write 0x5d176ec thru 0x5d26fdd (0xf8f2 bytes) 2024-09-14T06:00:31.719 INFO:teuthology.orchestra.run.smithi006.stderr:set 3.7 pg_upmap mapping to [5,7] 2024-09-14T06:00:31.720 INFO:teuthology.orchestra.run.smithi006.stdout:5413 read 0x7cd59ed thru 0x7ce3eaf (0xe4c3 bytes) 2024-09-14T06:00:31.720 INFO:teuthology.orchestra.run.smithi006.stdout:5414 write 0x4d33f96 thru 0x4d3b40d (0x7478 bytes) 2024-09-14T06:00:31.720 INFO:teuthology.orchestra.run.smithi006.stdout:5416 write 0x2c5e8d2 thru 0x2c651db (0x690a bytes) 2024-09-14T06:00:31.720 INFO:teuthology.orchestra.run.smithi006.stdout:5419 clone 35 order 21 su 8192 sc 8 2024-09-14T06:00:31.721 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:31.713+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:31.817 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:31.813+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:31.890 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:31.891 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:31.891 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:31.891 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:31.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:00:31.917 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:31.913+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:32.018 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:32.013+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:32.029 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:32.029 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:32.029 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:32.029 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:32.029 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:32.043 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:00:32.119 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:32.117+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:32.172 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:32.172 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:32.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:32.172 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59148 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 419840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.901694984000002, 2024-09-14T06:00:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072974285999999999, 2024-09-14T06:00:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.173 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59148 2024-09-14T06:00:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:32.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268521+0000", 2024-09-14T06:00:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4199999999999995e-07 2024-09-14T06:00:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268524+0000", 2024-09-14T06:00:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.05e-06 2024-09-14T06:00:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268534+0000", 2024-09-14T06:00:32.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8719999999999997e-06 2024-09-14T06:00:32.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268541+0000", 2024-09-14T06:00:32.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5349999999999999e-06 2024-09-14T06:00:32.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341108+0000", 2024-09-14T06:00:32.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072566624999999996 2024-09-14T06:00:32.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341169+0000", 2024-09-14T06:00:32.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1251e-05 2024-09-14T06:00:32.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341494+0000", 2024-09-14T06:00:32.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325311 2024-09-14T06:00:32.177 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.177 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.177 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.177 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59149 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 436224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.178 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:32.178 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.901655759999997, 2024-09-14T06:00:32.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073405053999999997, 2024-09-14T06:00:32.178 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.178 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.178 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.178 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.178 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.178 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.178 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59149 2024-09-14T06:00:32.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.178 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:32.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:32.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268560+0000", 2024-09-14T06:00:32.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9999999999999997e-07 2024-09-14T06:00:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268563+0000", 2024-09-14T06:00:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.292e-06 2024-09-14T06:00:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268573+0000", 2024-09-14T06:00:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3260000000000002e-06 2024-09-14T06:00:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268581+0000", 2024-09-14T06:00:32.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1960000000000008e-06 2024-09-14T06:00:32.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341537+0000", 2024-09-14T06:00:32.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072955916999999995 2024-09-14T06:00:32.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341641+0000", 2024-09-14T06:00:32.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104341 2024-09-14T06:00:32.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341964+0000", 2024-09-14T06:00:32.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032328199999999999 2024-09-14T06:00:32.182 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.182 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.182 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.182 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59150 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 452608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.182 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:32.182 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.901622519999997, 2024-09-14T06:00:32.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073829748000000001, 2024-09-14T06:00:32.182 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.182 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59150 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:32.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:32.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0399999999999995e-07 2024-09-14T06:00:32.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268596+0000", 2024-09-14T06:00:32.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9859999999999999e-06 2024-09-14T06:00:32.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268606+0000", 2024-09-14T06:00:32.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0088000000000001e-05 2024-09-14T06:00:32.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268614+0000", 2024-09-14T06:00:32.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T06:00:32.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341999+0000", 2024-09-14T06:00:32.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073385011999999999 2024-09-14T06:00:32.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342093+0000", 2024-09-14T06:00:32.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3793000000000001e-05 2024-09-14T06:00:32.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342422+0000", 2024-09-14T06:00:32.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000329129 2024-09-14T06:00:32.186 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.186 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.186 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.187 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59151 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.187 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:32.187 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.901590151999997, 2024-09-14T06:00:32.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074207289999999995, 2024-09-14T06:00:32.187 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.187 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.187 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.187 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.187 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.187 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.187 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59151 2024-09-14T06:00:32.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.187 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:32.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:32.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268626+0000", 2024-09-14T06:00:32.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T06:00:32.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268629+0000", 2024-09-14T06:00:32.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.038e-06 2024-09-14T06:00:32.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268638+0000", 2024-09-14T06:00:32.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8139999999999995e-06 2024-09-14T06:00:32.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268647+0000", 2024-09-14T06:00:32.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4889999999999995e-06 2024-09-14T06:00:32.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342457+0000", 2024-09-14T06:00:32.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073809890000000003 2024-09-14T06:00:32.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342545+0000", 2024-09-14T06:00:32.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8697999999999997e-05 2024-09-14T06:00:32.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342832+0000", 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028681799999999999 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59152 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.901557511, 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074695176000000002, 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.191 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.192 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.192 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.192 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.192 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59152 2024-09-14T06:00:32.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.192 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:32.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:32.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:32.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2900000000000003e-07 2024-09-14T06:00:32.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268661+0000", 2024-09-14T06:00:32.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0230000000000001e-06 2024-09-14T06:00:32.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268670+0000", 2024-09-14T06:00:32.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2129999999999997e-06 2024-09-14T06:00:32.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268679+0000", 2024-09-14T06:00:32.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-09-14T06:00:32.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342937+0000", 2024-09-14T06:00:32.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074258781999999995 2024-09-14T06:00:32.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343044+0000", 2024-09-14T06:00:32.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-09-14T06:00:32.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343353+0000", 2024-09-14T06:00:32.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030911099999999999 2024-09-14T06:00:32.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.196 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.196 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.196 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59153 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 501760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.196 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:32.196 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.901524741000003, 2024-09-14T06:00:32.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074997241000000006, 2024-09-14T06:00:32.196 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.196 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.196 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.197 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.197 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.197 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.197 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59153 2024-09-14T06:00:32.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.197 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:32.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:32.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268691+0000", 2024-09-14T06:00:32.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:00:32.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268693+0000", 2024-09-14T06:00:32.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3599999999999999e-06 2024-09-14T06:00:32.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268699+0000", 2024-09-14T06:00:32.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-09-14T06:00:32.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268704+0000", 2024-09-14T06:00:32.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5759999999999999e-06 2024-09-14T06:00:32.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343398+0000", 2024-09-14T06:00:32.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074694522999999999 2024-09-14T06:00:32.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343450+0000", 2024-09-14T06:00:32.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1350999999999997e-05 2024-09-14T06:00:32.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343688+0000", 2024-09-14T06:00:32.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023806500000000001 2024-09-14T06:00:32.201 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.201 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.201 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.201 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59154 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 518144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.201 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:32.202 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.901505675000003, 2024-09-14T06:00:32.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075389938000000004, 2024-09-14T06:00:32.202 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.202 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.202 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.202 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.202 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.202 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.202 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59154 2024-09-14T06:00:32.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.202 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:32.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:32.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268710+0000", 2024-09-14T06:00:32.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8000000000000001e-07 2024-09-14T06:00:32.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268712+0000", 2024-09-14T06:00:32.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T06:00:32.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268717+0000", 2024-09-14T06:00:32.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8570000000000003e-06 2024-09-14T06:00:32.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268721+0000", 2024-09-14T06:00:32.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2039999999999999e-06 2024-09-14T06:00:32.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343721+0000", 2024-09-14T06:00:32.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074999748000000005 2024-09-14T06:00:32.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343784+0000", 2024-09-14T06:00:32.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3174000000000002e-05 2024-09-14T06:00:32.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.344099+0000", 2024-09-14T06:00:32.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000315299 2024-09-14T06:00:32.206 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.206 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.206 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.206 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59398 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 323584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.206 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:32.207 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.890541427000002, 2024-09-14T06:00:32.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073326565999999996, 2024-09-14T06:00:32.207 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.207 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.207 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.207 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.207 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.207 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.207 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59398 2024-09-14T06:00:32.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.207 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:32.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:32.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279675+0000", 2024-09-14T06:00:32.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-14T06:00:32.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279681+0000", 2024-09-14T06:00:32.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-09-14T06:00:32.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279702+0000", 2024-09-14T06:00:32.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1259000000000001e-05 2024-09-14T06:00:32.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279718+0000", 2024-09-14T06:00:32.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5475999999999999e-05 2024-09-14T06:00:32.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352360+0000", 2024-09-14T06:00:32.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.07264226 2024-09-14T06:00:32.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352447+0000", 2024-09-14T06:00:32.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7381999999999998e-05 2024-09-14T06:00:32.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353000+0000", 2024-09-14T06:00:32.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055309200000000004 2024-09-14T06:00:32.211 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.211 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.211 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.212 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59399 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.212 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:32.212 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.890477064000002, 2024-09-14T06:00:32.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073824446000000002, 2024-09-14T06:00:32.212 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.212 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.212 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.212 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.212 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.212 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.213 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59399 2024-09-14T06:00:32.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.213 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:32.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:32.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279739+0000", 2024-09-14T06:00:32.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T06:00:32.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279745+0000", 2024-09-14T06:00:32.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T06:00:32.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279767+0000", 2024-09-14T06:00:32.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639000000000001e-05 2024-09-14T06:00:32.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279781+0000", 2024-09-14T06:00:32.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4511999999999999e-05 2024-09-14T06:00:32.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353045+0000", 2024-09-14T06:00:32.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073263718000000005 2024-09-14T06:00:32.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353168+0000", 2024-09-14T06:00:32.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012314499999999999 2024-09-14T06:00:32.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353562+0000", 2024-09-14T06:00:32.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039435199999999999 2024-09-14T06:00:32.216 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.216 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.216 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.216 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59400 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.217 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:32.217 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.890413303999999, 2024-09-14T06:00:32.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074271465999999994, 2024-09-14T06:00:32.217 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.217 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.217 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.217 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.217 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.217 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.217 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59400 2024-09-14T06:00:32.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.217 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:32.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:32.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279803+0000", 2024-09-14T06:00:32.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2100000000000001e-06 2024-09-14T06:00:32.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279819+0000", 2024-09-14T06:00:32.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6409000000000002e-05 2024-09-14T06:00:32.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279841+0000", 2024-09-14T06:00:32.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1878e-05 2024-09-14T06:00:32.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279856+0000", 2024-09-14T06:00:32.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4392999999999999e-05 2024-09-14T06:00:32.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353650+0000", 2024-09-14T06:00:32.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073794144000000006 2024-09-14T06:00:32.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353757+0000", 2024-09-14T06:00:32.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010687 2024-09-14T06:00:32.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354073+0000", 2024-09-14T06:00:32.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000316562 2024-09-14T06:00:32.221 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.221 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.221 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.221 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59401 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 372736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.221 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:32.221 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.890338479, 2024-09-14T06:00:32.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074643900999999999, 2024-09-14T06:00:32.222 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.222 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.222 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.222 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.222 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.222 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.222 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59401 2024-09-14T06:00:32.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.222 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:32.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:32.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279878+0000", 2024-09-14T06:00:32.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.31e-06 2024-09-14T06:00:32.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279883+0000", 2024-09-14T06:00:32.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3770000000000004e-06 2024-09-14T06:00:32.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279906+0000", 2024-09-14T06:00:32.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2398000000000001e-05 2024-09-14T06:00:32.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279920+0000", 2024-09-14T06:00:32.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.402e-05 2024-09-14T06:00:32.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354125+0000", 2024-09-14T06:00:32.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074205750000000001 2024-09-14T06:00:32.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354227+0000", 2024-09-14T06:00:32.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101612 2024-09-14T06:00:32.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354521+0000", 2024-09-14T06:00:32.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029343400000000002 2024-09-14T06:00:32.227 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.227 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.227 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.227 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59402 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 389120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.227 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:32.227 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.890276896000003, 2024-09-14T06:00:32.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075017027999999999, 2024-09-14T06:00:32.227 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.227 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.228 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.228 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.228 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.228 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.228 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59402 2024-09-14T06:00:32.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.228 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:32.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:32.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279939+0000", 2024-09-14T06:00:32.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2470000000000001e-06 2024-09-14T06:00:32.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279945+0000", 2024-09-14T06:00:32.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-09-14T06:00:32.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279966+0000", 2024-09-14T06:00:32.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1801999999999999e-05 2024-09-14T06:00:32.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279980+0000", 2024-09-14T06:00:32.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3589e-05 2024-09-14T06:00:32.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354569+0000", 2024-09-14T06:00:32.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074588707000000004 2024-09-14T06:00:32.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354671+0000", 2024-09-14T06:00:32.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102398 2024-09-14T06:00:32.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354955+0000", 2024-09-14T06:00:32.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028406500000000001 2024-09-14T06:00:32.232 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.232 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.232 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.233 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59403 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 405504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.233 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:32.233 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.890215109000003, 2024-09-14T06:00:32.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075434395000000001, 2024-09-14T06:00:32.233 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.233 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.233 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.233 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.233 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.233 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.234 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59403 2024-09-14T06:00:32.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.234 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:32.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:32.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280001+0000", 2024-09-14T06:00:32.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2669999999999999e-06 2024-09-14T06:00:32.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280008+0000", 2024-09-14T06:00:32.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5849999999999996e-06 2024-09-14T06:00:32.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280030+0000", 2024-09-14T06:00:32.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2293000000000002e-05 2024-09-14T06:00:32.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280044+0000", 2024-09-14T06:00:32.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3974999999999999e-05 2024-09-14T06:00:32.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355013+0000", 2024-09-14T06:00:32.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074969039000000001 2024-09-14T06:00:32.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355144+0000", 2024-09-14T06:00:32.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000131333 2024-09-14T06:00:32.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355434+0000", 2024-09-14T06:00:32.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028990299999999999 2024-09-14T06:00:32.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.238 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.238 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59404 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.238 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:32.238 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.890149989999998, 2024-09-14T06:00:32.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075696103000000001, 2024-09-14T06:00:32.238 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.238 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.239 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.239 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.239 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.239 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.239 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59404 2024-09-14T06:00:32.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.239 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:32.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:32.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280066+0000", 2024-09-14T06:00:32.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2640000000000001e-06 2024-09-14T06:00:32.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280072+0000", 2024-09-14T06:00:32.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129999999999997e-06 2024-09-14T06:00:32.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280094+0000", 2024-09-14T06:00:32.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2608000000000001e-05 2024-09-14T06:00:32.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280109+0000", 2024-09-14T06:00:32.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:32.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355479+0000", 2024-09-14T06:00:32.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075370699999999999 2024-09-14T06:00:32.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355554+0000", 2024-09-14T06:00:32.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4674999999999999e-05 2024-09-14T06:00:32.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355761+0000", 2024-09-14T06:00:32.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-14T06:00:32.243 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.243 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.243 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.243 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59405 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.243 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:32.243 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.890086080000003, 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076008867999999993, 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59405 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:32.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280130+0000", 2024-09-14T06:00:32.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2500000000000001e-06 2024-09-14T06:00:32.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280136+0000", 2024-09-14T06:00:32.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280158+0000", 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1795000000000001e-05 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280172+0000", 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4303e-05 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355797+0000", 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075624835000000001 2024-09-14T06:00:32.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355866+0000", 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9043999999999998e-05 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356138+0000", 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027207799999999998 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.247 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59406 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.248 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:32.248 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.890022137999999, 2024-09-14T06:00:32.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076435642999999998, 2024-09-14T06:00:32.248 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.248 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.248 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.248 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.248 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.248 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.248 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59406 2024-09-14T06:00:32.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.248 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280194+0000", 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280200+0000", 2024-09-14T06:00:32.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6359999999999999e-06 2024-09-14T06:00:32.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280222+0000", 2024-09-14T06:00:32.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1628999999999999e-05 2024-09-14T06:00:32.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280236+0000", 2024-09-14T06:00:32.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4413000000000001e-05 2024-09-14T06:00:32.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356172+0000", 2024-09-14T06:00:32.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075936466999999994 2024-09-14T06:00:32.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356260+0000", 2024-09-14T06:00:32.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7437999999999999e-05 2024-09-14T06:00:32.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356629+0000", 2024-09-14T06:00:32.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036877600000000002 2024-09-14T06:00:32.252 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.252 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.252 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.252 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59407 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 471040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.252 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:32.252 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.889957905000003, 2024-09-14T06:00:32.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076820083999999997, 2024-09-14T06:00:32.252 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.252 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.252 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.252 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.253 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.253 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.253 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59407 2024-09-14T06:00:32.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.253 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:32.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:32.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280258+0000", 2024-09-14T06:00:32.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1370000000000001e-06 2024-09-14T06:00:32.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280264+0000", 2024-09-14T06:00:32.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6930000000000004e-06 2024-09-14T06:00:32.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280285+0000", 2024-09-14T06:00:32.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1455999999999999e-05 2024-09-14T06:00:32.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280300+0000", 2024-09-14T06:00:32.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4319e-05 2024-09-14T06:00:32.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356676+0000", 2024-09-14T06:00:32.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076376615999999994 2024-09-14T06:00:32.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356768+0000", 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1234000000000001e-05 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357077+0000", 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030962900000000001 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.256 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59408 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 487424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.889892904999996, 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077185511999999998, 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59408 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280323+0000", 2024-09-14T06:00:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2860000000000001e-06 2024-09-14T06:00:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280329+0000", 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.553e-06 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280352+0000", 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280366+0000", 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357126+0000", 2024-09-14T06:00:32.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076760326000000004 2024-09-14T06:00:32.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357223+0000", 2024-09-14T06:00:32.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6490000000000006e-05 2024-09-14T06:00:32.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357508+0000", 2024-09-14T06:00:32.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028479900000000002 2024-09-14T06:00:32.261 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.261 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.261 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.261 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59409 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.261 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:32.261 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.889828674999997, 2024-09-14T06:00:32.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077536090000000002, 2024-09-14T06:00:32.261 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.261 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.262 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.262 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.262 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.262 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.262 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59409 2024-09-14T06:00:32.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.262 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:32.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:32.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280388+0000", 2024-09-14T06:00:32.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.096e-06 2024-09-14T06:00:32.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280393+0000", 2024-09-14T06:00:32.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T06:00:32.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280414+0000", 2024-09-14T06:00:32.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1175999999999999e-05 2024-09-14T06:00:32.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280427+0000", 2024-09-14T06:00:32.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3032e-05 2024-09-14T06:00:32.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357553+0000", 2024-09-14T06:00:32.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077125845999999998 2024-09-14T06:00:32.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357624+0000", 2024-09-14T06:00:32.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1062000000000005e-05 2024-09-14T06:00:32.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357923+0000", 2024-09-14T06:00:32.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029891199999999997 2024-09-14T06:00:32.266 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.266 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.266 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.266 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59410 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:32.267 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:32.267 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.889769362999999, 2024-09-14T06:00:32.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077854494999999996, 2024-09-14T06:00:32.267 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.267 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.267 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.267 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.267 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.267 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.267 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59410 2024-09-14T06:00:32.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.268 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:32.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:32.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280447+0000", 2024-09-14T06:00:32.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069999999999999e-06 2024-09-14T06:00:32.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280453+0000", 2024-09-14T06:00:32.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-06 2024-09-14T06:00:32.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280471+0000", 2024-09-14T06:00:32.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8295999999999999e-05 2024-09-14T06:00:32.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280484+0000", 2024-09-14T06:00:32.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2609000000000001e-05 2024-09-14T06:00:32.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357954+0000", 2024-09-14T06:00:32.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077470405000000006 2024-09-14T06:00:32.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358040+0000", 2024-09-14T06:00:32.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.551e-05 2024-09-14T06:00:32.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358300+0000", 2024-09-14T06:00:32.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026036800000000003 2024-09-14T06:00:32.271 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.271 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.271 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.271 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.271 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.272 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:32.273 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:00:32.274 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:32.273+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:32.374 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:32.371+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:32.402 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:32.402 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:32.416 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:00:32.474 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:32.473+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:32.575 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:32.573+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:32.580 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:32.580 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:32.580 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:32.580 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:32.580 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:32.594 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:00:32.676 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:32.673+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:32.677 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2024-09-14T06:00:32.723 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38916 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5193728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.529906+0000", 2024-09-14T06:00:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.192720244999997, 2024-09-14T06:00:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083853568000000003, 2024-09-14T06:00:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38916 2024-09-14T06:00:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529906+0000", 2024-09-14T06:00:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529906+0000", 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530166+0000", 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026013499999999999 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530171+0000", 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1800000000000004e-06 2024-09-14T06:00:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530186+0000", 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5342e-05 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530200+0000", 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3349e-05 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613496+0000", 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083296674000000001 2024-09-14T06:00:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613612+0000", 2024-09-14T06:00:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115895 2024-09-14T06:00:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613759+0000", 2024-09-14T06:00:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014699299999999999 2024-09-14T06:00:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38918 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5292032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530216+0000", 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.192409619999999, 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083840804000000005, 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38918 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530216+0000", 2024-09-14T06:00:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530216+0000", 2024-09-14T06:00:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530276+0000", 2024-09-14T06:00:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9855000000000002e-05 2024-09-14T06:00:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530284+0000", 2024-09-14T06:00:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0129999999999993e-06 2024-09-14T06:00:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530305+0000", 2024-09-14T06:00:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0574999999999999e-05 2024-09-14T06:00:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530320+0000", 2024-09-14T06:00:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5231999999999999e-05 2024-09-14T06:00:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613799+0000", 2024-09-14T06:00:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083479131999999998 2024-09-14T06:00:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613911+0000", 2024-09-14T06:00:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011215200000000001 2024-09-14T06:00:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614057+0000", 2024-09-14T06:00:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000145845 2024-09-14T06:00:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38919 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5472256~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530345+0000", 2024-09-14T06:00:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.192281000000001, 2024-09-14T06:00:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083997022000000005, 2024-09-14T06:00:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38919 2024-09-14T06:00:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530345+0000", 2024-09-14T06:00:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530345+0000", 2024-09-14T06:00:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530627+0000", 2024-09-14T06:00:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028190700000000002 2024-09-14T06:00:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530637+0000", 2024-09-14T06:00:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0005e-05 2024-09-14T06:00:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530662+0000", 2024-09-14T06:00:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5065000000000001e-05 2024-09-14T06:00:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530679+0000", 2024-09-14T06:00:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7255999999999999e-05 2024-09-14T06:00:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614130+0000", 2024-09-14T06:00:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083450478999999994 2024-09-14T06:00:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614225+0000", 2024-09-14T06:00:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5451000000000005e-05 2024-09-14T06:00:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614342+0000", 2024-09-14T06:00:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116859 2024-09-14T06:00:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38921 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6684672~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530704+0000", 2024-09-14T06:00:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.191921993000001, 2024-09-14T06:00:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083903330999999998, 2024-09-14T06:00:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38921 2024-09-14T06:00:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530704+0000", 2024-09-14T06:00:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530704+0000", 2024-09-14T06:00:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530705+0000", 2024-09-14T06:00:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1939999999999999e-06 2024-09-14T06:00:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530709+0000", 2024-09-14T06:00:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1289999999999998e-06 2024-09-14T06:00:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530721+0000", 2024-09-14T06:00:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-09-14T06:00:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530728+0000", 2024-09-14T06:00:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7729999999999999e-06 2024-09-14T06:00:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614393+0000", 2024-09-14T06:00:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083665164 2024-09-14T06:00:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614489+0000", 2024-09-14T06:00:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5168999999999996e-05 2024-09-14T06:00:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614607+0000", 2024-09-14T06:00:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011856 2024-09-14T06:00:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38924 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5570560~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530740+0000", 2024-09-14T06:00:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.191886312000001, 2024-09-14T06:00:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084072167000000003, 2024-09-14T06:00:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38924 2024-09-14T06:00:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530740+0000", 2024-09-14T06:00:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530740+0000", 2024-09-14T06:00:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530881+0000", 2024-09-14T06:00:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014107799999999999 2024-09-14T06:00:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530889+0000", 2024-09-14T06:00:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1659999999999994e-06 2024-09-14T06:00:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530908+0000", 2024-09-14T06:00:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8732e-05 2024-09-14T06:00:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530917+0000", 2024-09-14T06:00:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4390000000000006e-06 2024-09-14T06:00:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614661+0000", 2024-09-14T06:00:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083743567000000005 2024-09-14T06:00:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614736+0000", 2024-09-14T06:00:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5394000000000004e-05 2024-09-14T06:00:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614812+0000", 2024-09-14T06:00:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5791000000000007e-05 2024-09-14T06:00:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38925 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5750784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530934+0000", 2024-09-14T06:00:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.191691765000002, 2024-09-14T06:00:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084075189999999994, 2024-09-14T06:00:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38925 2024-09-14T06:00:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530934+0000", 2024-09-14T06:00:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530934+0000", 2024-09-14T06:00:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531235+0000", 2024-09-14T06:00:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030118899999999999 2024-09-14T06:00:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531244+0000", 2024-09-14T06:00:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1530000000000003e-06 2024-09-14T06:00:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531267+0000", 2024-09-14T06:00:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2688e-05 2024-09-14T06:00:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531284+0000", 2024-09-14T06:00:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6558999999999998e-05 2024-09-14T06:00:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614874+0000", 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083590082999999996 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614937+0000", 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3085999999999999e-05 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615009+0000", 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2432e-05 2024-09-14T06:00:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38927 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6963200~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.531313+0000", 2024-09-14T06:00:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.191313031999996, 2024-09-14T06:00:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083845550000000005, 2024-09-14T06:00:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38927 2024-09-14T06:00:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531313+0000", 2024-09-14T06:00:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531313+0000", 2024-09-14T06:00:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531590+0000", 2024-09-14T06:00:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027672100000000001 2024-09-14T06:00:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531597+0000", 2024-09-14T06:00:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.61e-06 2024-09-14T06:00:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531622+0000", 2024-09-14T06:00:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5001e-05 2024-09-14T06:00:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531634+0000", 2024-09-14T06:00:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1756000000000001e-05 2024-09-14T06:00:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615045+0000", 2024-09-14T06:00:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083411336000000003 2024-09-14T06:00:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615093+0000", 2024-09-14T06:00:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7812999999999998e-05 2024-09-14T06:00:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615158+0000", 2024-09-14T06:00:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5313000000000003e-05 2024-09-14T06:00:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38930 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.531670+0000", 2024-09-14T06:00:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.190955901000002, 2024-09-14T06:00:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083704600000000004, 2024-09-14T06:00:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38930 2024-09-14T06:00:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531670+0000", 2024-09-14T06:00:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531670+0000", 2024-09-14T06:00:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531671+0000", 2024-09-14T06:00:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1200000000000001e-06 2024-09-14T06:00:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531675+0000", 2024-09-14T06:00:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5530000000000001e-06 2024-09-14T06:00:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531688+0000", 2024-09-14T06:00:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3592e-05 2024-09-14T06:00:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531696+0000", 2024-09-14T06:00:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-09-14T06:00:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615191+0000", 2024-09-14T06:00:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083494833000000004 2024-09-14T06:00:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615258+0000", 2024-09-14T06:00:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7366000000000005e-05 2024-09-14T06:00:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615375+0000", 2024-09-14T06:00:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011620600000000001 2024-09-14T06:00:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38933 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7241728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.531708+0000", 2024-09-14T06:00:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.190917450000001, 2024-09-14T06:00:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083895771999999993, 2024-09-14T06:00:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38933 2024-09-14T06:00:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531708+0000", 2024-09-14T06:00:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531708+0000", 2024-09-14T06:00:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532040+0000", 2024-09-14T06:00:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00033176599999999999 2024-09-14T06:00:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532049+0000", 2024-09-14T06:00:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3289999999999994e-06 2024-09-14T06:00:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532070+0000", 2024-09-14T06:00:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1498999999999999e-05 2024-09-14T06:00:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532086+0000", 2024-09-14T06:00:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5775000000000001e-05 2024-09-14T06:00:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615432+0000", 2024-09-14T06:00:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083345742 2024-09-14T06:00:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615515+0000", 2024-09-14T06:00:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3834999999999999e-05 2024-09-14T06:00:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615604+0000", 2024-09-14T06:00:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8826000000000006e-05 2024-09-14T06:00:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38935 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532153+0000", 2024-09-14T06:00:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.190472479999997, 2024-09-14T06:00:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083756399999999995, 2024-09-14T06:00:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38935 2024-09-14T06:00:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532153+0000", 2024-09-14T06:00:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532153+0000", 2024-09-14T06:00:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532155+0000", 2024-09-14T06:00:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5540000000000001e-06 2024-09-14T06:00:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532162+0000", 2024-09-14T06:00:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-09-14T06:00:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532183+0000", 2024-09-14T06:00:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1219000000000001e-05 2024-09-14T06:00:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532199+0000", 2024-09-14T06:00:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5707999999999999e-05 2024-09-14T06:00:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615666+0000", 2024-09-14T06:00:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083467348999999996 2024-09-14T06:00:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615774+0000", 2024-09-14T06:00:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108513 2024-09-14T06:00:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615910+0000", 2024-09-14T06:00:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013539199999999999 2024-09-14T06:00:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38938 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532221+0000", 2024-09-14T06:00:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.190405272, 2024-09-14T06:00:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942434999999996, 2024-09-14T06:00:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38938 2024-09-14T06:00:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532221+0000", 2024-09-14T06:00:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532221+0000", 2024-09-14T06:00:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532520+0000", 2024-09-14T06:00:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029975599999999998 2024-09-14T06:00:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532537+0000", 2024-09-14T06:00:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6325e-05 2024-09-14T06:00:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532555+0000", 2024-09-14T06:00:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8796000000000001e-05 2024-09-14T06:00:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532567+0000", 2024-09-14T06:00:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1691999999999999e-05 2024-09-14T06:00:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615972+0000", 2024-09-14T06:00:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083404513999999999 2024-09-14T06:00:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616068+0000", 2024-09-14T06:00:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6484999999999995e-05 2024-09-14T06:00:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616163+0000", 2024-09-14T06:00:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4866999999999998e-05 2024-09-14T06:00:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38939 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7520256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532620+0000", 2024-09-14T06:00:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.190006351000001, 2024-09-14T06:00:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083789983999999998, 2024-09-14T06:00:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38939 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532620+0000", 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532620+0000", 2024-09-14T06:00:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532621+0000", 2024-09-14T06:00:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.15e-06 2024-09-14T06:00:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532625+0000", 2024-09-14T06:00:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9770000000000002e-06 2024-09-14T06:00:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532637+0000", 2024-09-14T06:00:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1902000000000001e-05 2024-09-14T06:00:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532645+0000", 2024-09-14T06:00:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0059999999999992e-06 2024-09-14T06:00:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616213+0000", 2024-09-14T06:00:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083568086999999999 2024-09-14T06:00:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616311+0000", 2024-09-14T06:00:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8342000000000001e-05 2024-09-14T06:00:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616410+0000", 2024-09-14T06:00:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8519999999999999e-05 2024-09-14T06:00:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38941 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532657+0000", 2024-09-14T06:00:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.189969206999997, 2024-09-14T06:00:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083960503000000006, 2024-09-14T06:00:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38941 2024-09-14T06:00:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532657+0000", 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532657+0000", 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532932+0000", 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027501099999999997 2024-09-14T06:00:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532938+0000", 2024-09-14T06:00:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.857e-06 2024-09-14T06:00:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532959+0000", 2024-09-14T06:00:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1773999999999999e-05 2024-09-14T06:00:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532975+0000", 2024-09-14T06:00:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5858999999999998e-05 2024-09-14T06:00:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616462+0000", 2024-09-14T06:00:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083486949000000005 2024-09-14T06:00:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616524+0000", 2024-09-14T06:00:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2255999999999995e-05 2024-09-14T06:00:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616617+0000", 2024-09-14T06:00:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2796999999999999e-05 2024-09-14T06:00:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38944 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7618560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533002+0000", 2024-09-14T06:00:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.189624058, 2024-09-14T06:00:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083846326999999998, 2024-09-14T06:00:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38944 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533002+0000", 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533002+0000", 2024-09-14T06:00:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533107+0000", 2024-09-14T06:00:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104955 2024-09-14T06:00:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533115+0000", 2024-09-14T06:00:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3890000000000005e-06 2024-09-14T06:00:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533138+0000", 2024-09-14T06:00:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3302000000000002e-05 2024-09-14T06:00:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533155+0000", 2024-09-14T06:00:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6201e-05 2024-09-14T06:00:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616671+0000", 2024-09-14T06:00:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083516786999999995 2024-09-14T06:00:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616762+0000", 2024-09-14T06:00:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0162999999999997e-05 2024-09-14T06:00:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616848+0000", 2024-09-14T06:00:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.653e-05 2024-09-14T06:00:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38945 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533182+0000", 2024-09-14T06:00:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.189443959000002, 2024-09-14T06:00:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083811267999999994, 2024-09-14T06:00:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38945 2024-09-14T06:00:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533182+0000", 2024-09-14T06:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533182+0000", 2024-09-14T06:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533333+0000", 2024-09-14T06:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000150588 2024-09-14T06:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533342+0000", 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0089999999999996e-06 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533365+0000", 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3771e-05 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533382+0000", 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6748999999999998e-05 2024-09-14T06:00:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616884+0000", 2024-09-14T06:00:32.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083502178999999996 2024-09-14T06:00:32.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616930+0000", 2024-09-14T06:00:32.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5312999999999998e-05 2024-09-14T06:00:32.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616993+0000", 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3658999999999995e-05 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38947 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7897088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533411+0000", 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.189215048000001, 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083860599999999993, 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38947 2024-09-14T06:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533411+0000", 2024-09-14T06:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533411+0000", 2024-09-14T06:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533731+0000", 2024-09-14T06:00:32.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031991499999999999 2024-09-14T06:00:32.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533738+0000", 2024-09-14T06:00:32.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8820000000000003e-06 2024-09-14T06:00:32.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533766+0000", 2024-09-14T06:00:32.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8218e-05 2024-09-14T06:00:32.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533781+0000", 2024-09-14T06:00:32.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4799e-05 2024-09-14T06:00:32.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617052+0000", 2024-09-14T06:00:32.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083271607999999997 2024-09-14T06:00:32.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617163+0000", 2024-09-14T06:00:32.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011053299999999999 2024-09-14T06:00:32.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617271+0000", 2024-09-14T06:00:32.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108645 2024-09-14T06:00:32.798 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.798 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.798 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.798 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38948 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 8077312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.798 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533801+0000", 2024-09-14T06:00:32.799 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.188825172999998, 2024-09-14T06:00:32.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083665502000000003, 2024-09-14T06:00:32.799 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.799 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.799 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.799 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.799 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.799 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.799 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38948 2024-09-14T06:00:32.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.799 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533801+0000", 2024-09-14T06:00:32.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533801+0000", 2024-09-14T06:00:32.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533802+0000", 2024-09-14T06:00:32.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.06e-06 2024-09-14T06:00:32.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533805+0000", 2024-09-14T06:00:32.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6540000000000001e-06 2024-09-14T06:00:32.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533816+0000", 2024-09-14T06:00:32.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0642000000000001e-05 2024-09-14T06:00:32.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533823+0000", 2024-09-14T06:00:32.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.396e-06 2024-09-14T06:00:32.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617327+0000", 2024-09-14T06:00:32.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083503933000000002 2024-09-14T06:00:32.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617394+0000", 2024-09-14T06:00:32.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6693999999999995e-05 2024-09-14T06:00:32.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617466+0000", 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2123e-05 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38950 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 9289728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533834+0000", 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.188791854999998, 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083881255000000002, 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.803 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.804 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.804 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.804 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38950 2024-09-14T06:00:32.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.804 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533834+0000", 2024-09-14T06:00:32.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533834+0000", 2024-09-14T06:00:32.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534051+0000", 2024-09-14T06:00:32.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000217242 2024-09-14T06:00:32.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534061+0000", 2024-09-14T06:00:32.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3430000000000002e-06 2024-09-14T06:00:32.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534086+0000", 2024-09-14T06:00:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5384e-05 2024-09-14T06:00:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534104+0000", 2024-09-14T06:00:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8006e-05 2024-09-14T06:00:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617507+0000", 2024-09-14T06:00:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083403115999999999 2024-09-14T06:00:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617616+0000", 2024-09-14T06:00:32.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108418 2024-09-14T06:00:32.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617715+0000", 2024-09-14T06:00:32.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9746000000000003e-05 2024-09-14T06:00:32.807 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.807 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.807 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.808 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38953 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 8175616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.808 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.534133+0000", 2024-09-14T06:00:32.808 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.188492678999999, 2024-09-14T06:00:32.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083736141, 2024-09-14T06:00:32.808 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.808 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.808 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.808 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.808 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.808 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.808 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38953 2024-09-14T06:00:32.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.808 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534133+0000", 2024-09-14T06:00:32.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534133+0000", 2024-09-14T06:00:32.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534314+0000", 2024-09-14T06:00:32.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018080200000000001 2024-09-14T06:00:32.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534329+0000", 2024-09-14T06:00:32.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5375000000000001e-05 2024-09-14T06:00:32.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534354+0000", 2024-09-14T06:00:32.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4411999999999999e-05 2024-09-14T06:00:32.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534366+0000", 2024-09-14T06:00:32.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1949e-05 2024-09-14T06:00:32.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617758+0000", 2024-09-14T06:00:32.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083392691000000005 2024-09-14T06:00:32.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617817+0000", 2024-09-14T06:00:32.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8471999999999999e-05 2024-09-14T06:00:32.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617869+0000", 2024-09-14T06:00:32.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2439999999999999e-05 2024-09-14T06:00:32.812 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.812 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.812 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.812 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38954 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 8355840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:32.812 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.534386+0000", 2024-09-14T06:00:32.812 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.188239385999999, 2024-09-14T06:00:32.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083652403, 2024-09-14T06:00:32.812 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:32.812 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38954 2024-09-14T06:00:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534386+0000", 2024-09-14T06:00:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:32.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534386+0000", 2024-09-14T06:00:32.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:32.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:32.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534716+0000", 2024-09-14T06:00:32.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032903000000000001 2024-09-14T06:00:32.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:32.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534721+0000", 2024-09-14T06:00:32.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9089999999999997e-06 2024-09-14T06:00:32.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:32.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534739+0000", 2024-09-14T06:00:32.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7679000000000001e-05 2024-09-14T06:00:32.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:32.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534749+0000", 2024-09-14T06:00:32.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0312999999999999e-05 2024-09-14T06:00:32.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:32.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617901+0000", 2024-09-14T06:00:32.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083152056000000002 2024-09-14T06:00:32.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:32.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617977+0000", 2024-09-14T06:00:32.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5772000000000006e-05 2024-09-14T06:00:32.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:32.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:32.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:32.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.618039+0000", 2024-09-14T06:00:32.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1643999999999995e-05 2024-09-14T06:00:32.816 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.816 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.816 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.816 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:32.816 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:32.817 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:32.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:00:32.819 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:32.815+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:32.837 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone34 from 0xae9f079 (overlap 0x5774a15) to 0x34792d9 2024-09-14T06:00:32.920 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:32.915+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:32.997 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:32.998 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:32.998 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:00:32.998 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:33.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:00:33.055 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:33.053+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:33.066 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:00:33.151 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:33.149+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:33.179 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:33.179 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:33.179 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:33.179 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:33.180 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:33.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:00:33.222 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:33.219+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:33.240 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:33.258 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:33.258 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:33.275 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:33.292 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:33.292 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:33.313 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:33.323 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:33.319+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:33.333 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:33.333 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:33.355 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:33.355 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:33.357 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:33.357 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:33.372 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:00:33.377 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:33.439 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:33.437+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:33.500 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:33.500 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:33.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:00:33.525 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:33.523+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:33.626 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:33.623+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:33.691 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:33.691 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:33.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:00:33.728 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:33.727+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:33.827 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:33.823+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:33.833 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:33.833 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:33.849 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:00:33.927 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:33.925+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:33.968 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:33.969 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:33.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:00:34.027 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:34.023+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:34.129 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:34.125+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:34.171 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:34.171 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:34.189 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:00:34.230 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:34.227+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:34.242 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-14T06:00:34.331 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:34.327+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:34.379 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:34.379 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:34.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:00:34.432 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:34.427+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:34.533 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:34.531+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:34.587 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:34.587 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:34.604 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:00:34.655 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:34.653+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:34.707 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:34.707 INFO:teuthology.orchestra.run.smithi006.stdout:5422 writesame 0xa8469e7 thru 0xa84e218 data_size 0x55(0x7832 bytes) 2024-09-14T06:00:34.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T06:00:34.732 INFO:teuthology.orchestra.run.smithi006.stdout:5425 punch from 0x675b02b to 0x676ad91, (0xfd66 bytes) 2024-09-14T06:00:34.732 INFO:teuthology.orchestra.run.smithi006.stdout:5426 read 0x8c9b39f thru 0x8ca6acc (0xb72e bytes) 2024-09-14T06:00:34.732 INFO:teuthology.orchestra.run.smithi006.stdout:5427 write 0x49de0f7 thru 0x49ee0be (0xffc8 bytes) 2024-09-14T06:00:34.735 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:34.735 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:34.735 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:34.731+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:34.761 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:00:34.851 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:34.849+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:34.864 INFO:teuthology.orchestra.run.smithi006.stdout:5428 trunc from 0xae9f079 to 0xa8ed201 2024-09-14T06:00:34.888 INFO:teuthology.orchestra.run.smithi006.stdout:5429 trunc from 0xa8ed201 to 0x4e0956f 2024-09-14T06:00:34.929 INFO:teuthology.orchestra.run.smithi006.stdout:5430 write 0xcefdb37 thru 0xcf07fc0 (0xa48a bytes) 2024-09-14T06:00:34.936 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:34.931+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:34.942 INFO:teuthology.orchestra.run.smithi006.stdout:5432 read 0xa58e6c5 thru 0xa5988ca (0xa206 bytes) 2024-09-14T06:00:34.951 INFO:teuthology.orchestra.run.smithi006.stdout:5433 trunc from 0xcf07fc1 to 0x717da4a 2024-09-14T06:00:34.956 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:34.956 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:34.969 INFO:teuthology.orchestra.run.smithi006.stdout:5434 punch from 0x2651e33 to 0x26609b0, (0xeb7d bytes) 2024-09-14T06:00:34.970 INFO:teuthology.orchestra.run.smithi006.stdout:5438 read 0x5ce12f9 thru 0x5cee861 (0xd569 bytes) 2024-09-14T06:00:34.970 INFO:teuthology.orchestra.run.smithi006.stdout:5439 read 0xba24c3 thru 0xba52cc (0x2e0a bytes) 2024-09-14T06:00:34.970 INFO:teuthology.orchestra.run.smithi006.stdout:5440 read 0x5b3b675 thru 0x5b44072 (0x89fe bytes) 2024-09-14T06:00:34.970 INFO:teuthology.orchestra.run.smithi006.stdout:5441 read 0x1da2bd8 thru 0x1da925f (0x6688 bytes) 2024-09-14T06:00:34.972 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:34.972 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:34.972 INFO:teuthology.orchestra.run.smithi006.stdout:5446 writesame 0x2578001 thru 0x2582984 data_size 0x26(0xa984 bytes) 2024-09-14T06:00:34.973 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:00:35.037 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:35.033+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:35.066 INFO:teuthology.orchestra.run.smithi006.stdout:5447 read 0x505af06 thru 0x5068431 (0xd52c bytes) 2024-09-14T06:00:35.066 INFO:teuthology.orchestra.run.smithi006.stdout:5449 punch from 0xacede7 to 0xaded76, (0xff8f bytes) 2024-09-14T06:00:35.066 INFO:teuthology.orchestra.run.smithi006.stdout:5450 write 0x17199be thru 0x171a139 (0x77c bytes) 2024-09-14T06:00:35.100 INFO:teuthology.orchestra.run.smithi006.stdout:5451 write 0x1bbb41c thru 0x1bc1c18 (0x67fd bytes) 2024-09-14T06:00:35.138 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:35.133+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:35.147 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:35.147 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:35.153 INFO:teuthology.orchestra.run.smithi006.stdout:5452 read 0x231faf8 thru 0x2321417 (0x1920 bytes) 2024-09-14T06:00:35.154 INFO:teuthology.orchestra.run.smithi006.stdout:5453 clone 36 order 20 su 16384 sc 13 2024-09-14T06:00:35.161 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:00:35.239 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:35.235+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:35.275 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:35.275 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:35.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:00:35.377 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:35.375+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:35.395 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:00:35.440 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:35.435+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:35.452 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:35.452 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:35.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:00:35.547 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:35.547 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:35.553 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:35.551+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:35.563 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:35.564 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:35.580 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:35.580 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:35.596 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:35.597 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:35.615 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:35.615 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:35.636 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:35.636 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:35.636 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:35.636 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:35.636 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:35.637 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:35.642 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:35.637+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:35.650 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:00:35.655 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:35.655 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:35.675 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:35.701 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2024-09-14T06:00:35.771 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:35.769+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:35.816 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:35.816 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:35.816 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:35.817 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:35.817 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:35.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:00:35.844 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:35.841+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:35.846 INFO:teuthology.orchestra.run.smithi006.stdout:flattening image image_client.0-clone35 2024-09-14T06:00:35.944 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:35.939+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:36.012 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:36.012 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:36.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:36.012 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:36.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.012 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:36.013 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:36.013 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.465839321000004, 2024-09-14T06:00:36.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:00:36.013 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.013 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.013 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:36.013 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.013 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.013 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.013 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:00:36.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.013 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:36.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:36.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:00:36.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:00:36.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:00:36.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:00:36.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:00:36.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:00:36.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:00:36.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:00:36.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:00:36.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:00:36.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:00:36.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:00:36.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:00:36.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:00:36.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:00:36.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:36.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:00:36.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:00:36.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:36.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:00:36.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:00:36.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.018 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38842 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.019 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:36.019 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.490712600000002, 2024-09-14T06:00:36.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083698121, 2024-09-14T06:00:36.019 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.019 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.019 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.019 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.019 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.019 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.019 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38842 2024-09-14T06:00:36.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.019 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:36.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:36.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521563+0000", 2024-09-14T06:00:36.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:00:36.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521566+0000", 2024-09-14T06:00:36.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1140000000000002e-06 2024-09-14T06:00:36.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521575+0000", 2024-09-14T06:00:36.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8769999999999999e-06 2024-09-14T06:00:36.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521581+0000", 2024-09-14T06:00:36.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2369999999999997e-06 2024-09-14T06:00:36.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605076+0000", 2024-09-14T06:00:36.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083494992000000004 2024-09-14T06:00:36.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605168+0000", 2024-09-14T06:00:36.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1731999999999995e-05 2024-09-14T06:00:36.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605260+0000", 2024-09-14T06:00:36.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2511999999999998e-05 2024-09-14T06:00:36.023 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.023 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.023 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.023 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38844 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9469952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.023 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:36.023 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.490685233000001, 2024-09-14T06:00:36.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084006762999999998, 2024-09-14T06:00:36.023 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.023 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.023 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.023 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.024 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.024 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.024 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38844 2024-09-14T06:00:36.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.024 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:36.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:36.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521590+0000", 2024-09-14T06:00:36.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9699999999999996e-07 2024-09-14T06:00:36.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521593+0000", 2024-09-14T06:00:36.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5909999999999998e-06 2024-09-14T06:00:36.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521603+0000", 2024-09-14T06:00:36.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0642000000000001e-05 2024-09-14T06:00:36.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521609+0000", 2024-09-14T06:00:36.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1020000000000002e-06 2024-09-14T06:00:36.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605318+0000", 2024-09-14T06:00:36.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083709166000000002 2024-09-14T06:00:36.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605454+0000", 2024-09-14T06:00:36.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013557400000000001 2024-09-14T06:00:36.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605596+0000", 2024-09-14T06:00:36.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014209100000000001 2024-09-14T06:00:36.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.027 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38845 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9650176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.490656932999997, 2024-09-14T06:00:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084212700000000001, 2024-09-14T06:00:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38845 2024-09-14T06:00:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:36.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:36.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:36.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1200000000000003e-07 2024-09-14T06:00:36.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521628+0000", 2024-09-14T06:00:36.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0196e-05 2024-09-14T06:00:36.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521637+0000", 2024-09-14T06:00:36.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6649999999999992e-06 2024-09-14T06:00:36.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521643+0000", 2024-09-14T06:00:36.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.285e-06 2024-09-14T06:00:36.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605652+0000", 2024-09-14T06:00:36.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084009025000000001 2024-09-14T06:00:36.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605741+0000", 2024-09-14T06:00:36.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8473000000000005e-05 2024-09-14T06:00:36.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605830+0000", 2024-09-14T06:00:36.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9444000000000006e-05 2024-09-14T06:00:36.032 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.032 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.032 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.032 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38848 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8536064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.033 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:36.033 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.490618924000003, 2024-09-14T06:00:36.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084375567999999998, 2024-09-14T06:00:36.033 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.033 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.033 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.033 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38848 2024-09-14T06:00:36.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.033 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:36.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:36.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:36.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0200000000000002e-07 2024-09-14T06:00:36.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521659+0000", 2024-09-14T06:00:36.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7800000000000001e-06 2024-09-14T06:00:36.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521667+0000", 2024-09-14T06:00:36.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6599999999999995e-06 2024-09-14T06:00:36.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521674+0000", 2024-09-14T06:00:36.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4560000000000003e-06 2024-09-14T06:00:36.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605872+0000", 2024-09-14T06:00:36.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084198010000000004 2024-09-14T06:00:36.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605945+0000", 2024-09-14T06:00:36.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2681000000000004e-05 2024-09-14T06:00:36.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606031+0000", 2024-09-14T06:00:36.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6378999999999994e-05 2024-09-14T06:00:36.037 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.037 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.037 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.037 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38849 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9748480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.037 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:36.037 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.490588498000001, 2024-09-14T06:00:36.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084581577000000005, 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38849 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:36.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521687+0000", 2024-09-14T06:00:36.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9400000000000005e-07 2024-09-14T06:00:36.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521729+0000", 2024-09-14T06:00:36.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2657000000000002e-05 2024-09-14T06:00:36.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521749+0000", 2024-09-14T06:00:36.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9264000000000001e-05 2024-09-14T06:00:36.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521761+0000", 2024-09-14T06:00:36.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2289999999999999e-05 2024-09-14T06:00:36.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606078+0000", 2024-09-14T06:00:36.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084316772999999998 2024-09-14T06:00:36.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606176+0000", 2024-09-14T06:00:36.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7992999999999995e-05 2024-09-14T06:00:36.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606268+0000", 2024-09-14T06:00:36.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2006e-05 2024-09-14T06:00:36.041 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38851 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9928704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.490493186000002, 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084695081000000005, 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.042 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38851 2024-09-14T06:00:36.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.043 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:36.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:36.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521783+0000", 2024-09-14T06:00:36.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1000000000000001e-06 2024-09-14T06:00:36.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521788+0000", 2024-09-14T06:00:36.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2619999999999998e-06 2024-09-14T06:00:36.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521803+0000", 2024-09-14T06:00:36.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5421999999999999e-05 2024-09-14T06:00:36.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521815+0000", 2024-09-14T06:00:36.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.171e-05 2024-09-14T06:00:36.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606320+0000", 2024-09-14T06:00:36.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084504698000000003 2024-09-14T06:00:36.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606404+0000", 2024-09-14T06:00:36.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4379e-05 2024-09-14T06:00:36.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606476+0000", 2024-09-14T06:00:36.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2509999999999995e-05 2024-09-14T06:00:36.046 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.046 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.046 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.046 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.046 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:36.046 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.490442436000002, 2024-09-14T06:00:36.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:00:36.047 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.047 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.047 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.047 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.047 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.047 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.047 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:00:36.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.047 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:36.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:36.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:00:36.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:00:36.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:00:36.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:00:36.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:00:36.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:00:36.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:00:36.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:00:36.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:00:36.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:00:36.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:00:36.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:00:36.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:00:36.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:00:36.051 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.051 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.051 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.051 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.051 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:36.051 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.490404112999997, 2024-09-14T06:00:36.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:00:36.051 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.051 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.051 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.052 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.052 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.052 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.052 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:00:36.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.052 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:36.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:36.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:00:36.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:00:36.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:00:36.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:36.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:00:36.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:00:36.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:00:36.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:00:36.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:00:36.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:00:36.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:00:36.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:00:36.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:00:36.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:00:36.056 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.056 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.056 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.056 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.056 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:36.056 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.490377420999998, 2024-09-14T06:00:36.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:00:36.057 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.057 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.057 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.057 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.057 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.057 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.057 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:00:36.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.057 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:36.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:36.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:00:36.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:00:36.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:00:36.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:00:36.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:00:36.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:00:36.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:00:36.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:00:36.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:00:36.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:00:36.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:00:36.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:00:36.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:00:36.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:00:36.061 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.061 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.061 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.061 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.490351554999997, 2024-09-14T06:00:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:00:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:00:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:00:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:00:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:00:36.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:00:36.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:00:36.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:00:36.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:00:36.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:00:36.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:00:36.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:00:36.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:00:36.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:00:36.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:00:36.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:00:36.066 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.066 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.066 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.066 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.066 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:36.066 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.489251185999997, 2024-09-14T06:00:36.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:00:36.067 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.067 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.067 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.067 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.067 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.067 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.067 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:00:36.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.067 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:36.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:36.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:00:36.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:00:36.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:00:36.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:00:36.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:00:36.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:00:36.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:00:36.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:00:36.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:00:36.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:00:36.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:00:36.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:00:36.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:00:36.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:00:36.070 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.071 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.071 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.071 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.071 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:36.071 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.489207207, 2024-09-14T06:00:36.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:00:36.071 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.071 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.071 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.071 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.071 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.072 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.072 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:00:36.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.072 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:36.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:36.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:00:36.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:00:36.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:00:36.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:00:36.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:00:36.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:00:36.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:00:36.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:00:36.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:00:36.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:00:36.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:00:36.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:00:36.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:00:36.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:00:36.075 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.075 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.075 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.075 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38865 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1392640~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.076 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:36.076 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.488228829000001, 2024-09-14T06:00:36.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084340500999999998, 2024-09-14T06:00:36.076 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.076 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.076 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.076 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.076 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.076 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.076 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38865 2024-09-14T06:00:36.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.076 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:36.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:36.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524047+0000", 2024-09-14T06:00:36.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5290000000000001e-06 2024-09-14T06:00:36.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524054+0000", 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1910000000000003e-06 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524074+0000", 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9383999999999999e-05 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524089+0000", 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4647000000000001e-05 2024-09-14T06:00:36.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608123+0000", 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084034837000000001 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608224+0000", 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100182 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608386+0000", 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162731 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.079 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.080 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.080 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.080 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:36.080 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.488145447000001, 2024-09-14T06:00:36.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:00:36.080 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.080 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.080 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.080 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.080 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.080 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.081 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:00:36.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.081 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:36.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:36.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:00:36.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:00:36.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:00:36.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:00:36.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:00:36.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:00:36.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:00:36.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:00:36.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:00:36.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:00:36.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:00:36.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:00:36.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:00:36.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:00:36.084 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.084 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.084 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.084 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38869 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.084 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:36.085 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.487739976999997, 2024-09-14T06:00:36.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084608905999999998, 2024-09-14T06:00:36.085 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.085 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.085 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.085 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.085 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.085 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.085 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38869 2024-09-14T06:00:36.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.085 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:36.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:36.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525138+0000", 2024-09-14T06:00:36.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00060367999999999999 2024-09-14T06:00:36.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525160+0000", 2024-09-14T06:00:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1875999999999999e-05 2024-09-14T06:00:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525182+0000", 2024-09-14T06:00:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1427e-05 2024-09-14T06:00:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525198+0000", 2024-09-14T06:00:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507e-05 2024-09-14T06:00:36.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608907+0000", 2024-09-14T06:00:36.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083708535000000001 2024-09-14T06:00:36.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609011+0000", 2024-09-14T06:00:36.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010461199999999999 2024-09-14T06:00:36.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609144+0000", 2024-09-14T06:00:36.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013226899999999999 2024-09-14T06:00:36.089 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.089 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.089 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.089 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38871 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1671168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.089 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:36.089 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.487048766999997, 2024-09-14T06:00:36.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084308214000000006, 2024-09-14T06:00:36.089 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.089 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.089 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.089 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38871 2024-09-14T06:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525487+0000", 2024-09-14T06:00:36.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026091100000000001 2024-09-14T06:00:36.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525493+0000", 2024-09-14T06:00:36.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.742e-06 2024-09-14T06:00:36.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525508+0000", 2024-09-14T06:00:36.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:36.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525518+0000", 2024-09-14T06:00:36.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8500000000000006e-06 2024-09-14T06:00:36.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609229+0000", 2024-09-14T06:00:36.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083711775000000002 2024-09-14T06:00:36.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609388+0000", 2024-09-14T06:00:36.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158286 2024-09-14T06:00:36.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609534+0000", 2024-09-14T06:00:36.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000146308 2024-09-14T06:00:36.093 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.093 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.093 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.094 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38873 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 737280~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.094 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:36.094 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.486737195000003, 2024-09-14T06:00:36.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084288875999999999, 2024-09-14T06:00:36.094 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.094 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.094 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.094 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.094 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.094 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.094 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38873 2024-09-14T06:00:36.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.094 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:36.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:36.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526372+0000", 2024-09-14T06:00:36.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00083508200000000001 2024-09-14T06:00:36.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526383+0000", 2024-09-14T06:00:36.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0282000000000001e-05 2024-09-14T06:00:36.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526445+0000", 2024-09-14T06:00:36.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1975000000000002e-05 2024-09-14T06:00:36.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526460+0000", 2024-09-14T06:00:36.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5233e-05 2024-09-14T06:00:36.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609585+0000", 2024-09-14T06:00:36.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083125216000000002 2024-09-14T06:00:36.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609689+0000", 2024-09-14T06:00:36.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104126 2024-09-14T06:00:36.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609826+0000", 2024-09-14T06:00:36.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013696199999999999 2024-09-14T06:00:36.098 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.098 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.098 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.098 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38874 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.098 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:36.098 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.485770260999999, 2024-09-14T06:00:36.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083631987000000005, 2024-09-14T06:00:36.098 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.099 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.099 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.099 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.099 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.099 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.099 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38874 2024-09-14T06:00:36.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.099 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:36.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:36.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526505+0000", 2024-09-14T06:00:36.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7699999999999992e-07 2024-09-14T06:00:36.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526511+0000", 2024-09-14T06:00:36.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9139999999999996e-06 2024-09-14T06:00:36.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526525+0000", 2024-09-14T06:00:36.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3644e-05 2024-09-14T06:00:36.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526533+0000", 2024-09-14T06:00:36.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6510000000000001e-06 2024-09-14T06:00:36.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609897+0000", 2024-09-14T06:00:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083364173 2024-09-14T06:00:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610007+0000", 2024-09-14T06:00:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110707 2024-09-14T06:00:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610136+0000", 2024-09-14T06:00:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012892099999999999 2024-09-14T06:00:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.103 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.103 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38877 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1949696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:36.103 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:36.103 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.485725567999999, 2024-09-14T06:00:36.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083886717, 2024-09-14T06:00:36.103 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.103 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.103 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.103 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38877 2024-09-14T06:00:36.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.104 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:36.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:36.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529354+0000", 2024-09-14T06:00:36.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028049170000000001 2024-09-14T06:00:36.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529373+0000", 2024-09-14T06:00:36.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.933e-05 2024-09-14T06:00:36.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529399+0000", 2024-09-14T06:00:36.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6129e-05 2024-09-14T06:00:36.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529418+0000", 2024-09-14T06:00:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8944e-05 2024-09-14T06:00:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610197+0000", 2024-09-14T06:00:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080778271999999998 2024-09-14T06:00:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610300+0000", 2024-09-14T06:00:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103868 2024-09-14T06:00:36.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610436+0000", 2024-09-14T06:00:36.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013525700000000001 2024-09-14T06:00:36.107 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.107 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.107 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.107 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.107 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.107 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:36.109 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:00:36.109 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:36.105+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:36.210 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:36.205+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:36.279 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:36.279 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:36.279 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:36.279 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:36.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:00:36.301 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-14T06:00:36.311 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:36.309+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:36.411 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:36.407+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:36.425 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:36.426 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:36.426 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:36.426 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:36.426 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:36.439 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:00:36.488 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:36.513 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:36.509+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:36.518 INFO:teuthology.orchestra.run.smithi006.stdout:5455 write 0xcb51e51 thru 0xcb5f408 (0xd5b8 bytes) 2024-09-14T06:00:36.534 INFO:teuthology.orchestra.run.smithi006.stdout:5456 punch from 0xc28f2b8 to 0xc29c8be, (0xd606 bytes) 2024-09-14T06:00:36.534 INFO:teuthology.orchestra.run.smithi006.stdout:5457 read 0x7755fd8 thru 0x7756add (0xb06 bytes) 2024-09-14T06:00:36.534 INFO:teuthology.orchestra.run.smithi006.stdout:5460 punch from 0xf8bdc4 to 0xf8f421, (0x365d bytes) 2024-09-14T06:00:36.534 INFO:teuthology.orchestra.run.smithi006.stdout:5461 read 0x11346f6 thru 0x1140670 (0xbf7b bytes) 2024-09-14T06:00:36.535 INFO:teuthology.orchestra.run.smithi006.stdout:5462 writesame 0x219af3a thru 0x21a7de1 data_size 0x44(0xcea8 bytes) 2024-09-14T06:00:36.599 INFO:teuthology.orchestra.run.smithi006.stdout:5463 trunc from 0xcb5f409 to 0x9fcd43c 2024-09-14T06:00:36.613 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:36.611+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:36.621 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59148 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 419840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.352856174000003, 2024-09-14T06:00:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072974285999999999, 2024-09-14T06:00:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59148 2024-09-14T06:00:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268521+0000", 2024-09-14T06:00:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4199999999999995e-07 2024-09-14T06:00:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268524+0000", 2024-09-14T06:00:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.05e-06 2024-09-14T06:00:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268534+0000", 2024-09-14T06:00:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8719999999999997e-06 2024-09-14T06:00:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268541+0000", 2024-09-14T06:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5349999999999999e-06 2024-09-14T06:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341108+0000", 2024-09-14T06:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072566624999999996 2024-09-14T06:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341169+0000", 2024-09-14T06:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1251e-05 2024-09-14T06:00:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341494+0000", 2024-09-14T06:00:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325311 2024-09-14T06:00:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59149 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 436224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.352816949999998, 2024-09-14T06:00:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073405053999999997, 2024-09-14T06:00:36.627 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.627 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.627 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.627 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.627 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.627 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.627 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59149 2024-09-14T06:00:36.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.627 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:36.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:36.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268560+0000", 2024-09-14T06:00:36.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9999999999999997e-07 2024-09-14T06:00:36.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268563+0000", 2024-09-14T06:00:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.292e-06 2024-09-14T06:00:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268573+0000", 2024-09-14T06:00:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3260000000000002e-06 2024-09-14T06:00:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268581+0000", 2024-09-14T06:00:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1960000000000008e-06 2024-09-14T06:00:36.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341537+0000", 2024-09-14T06:00:36.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072955916999999995 2024-09-14T06:00:36.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341641+0000", 2024-09-14T06:00:36.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104341 2024-09-14T06:00:36.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341964+0000", 2024-09-14T06:00:36.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032328199999999999 2024-09-14T06:00:36.631 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.631 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.631 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.631 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59150 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 452608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.631 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:36.631 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.352783709999997, 2024-09-14T06:00:36.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073829748000000001, 2024-09-14T06:00:36.631 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.631 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.631 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.631 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.632 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.632 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.632 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59150 2024-09-14T06:00:36.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.632 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:36.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:36.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:36.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0399999999999995e-07 2024-09-14T06:00:36.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268596+0000", 2024-09-14T06:00:36.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9859999999999999e-06 2024-09-14T06:00:36.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268606+0000", 2024-09-14T06:00:36.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0088000000000001e-05 2024-09-14T06:00:36.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268614+0000", 2024-09-14T06:00:36.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T06:00:36.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341999+0000", 2024-09-14T06:00:36.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073385011999999999 2024-09-14T06:00:36.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342093+0000", 2024-09-14T06:00:36.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3793000000000001e-05 2024-09-14T06:00:36.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342422+0000", 2024-09-14T06:00:36.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000329129 2024-09-14T06:00:36.637 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.637 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.637 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.638 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59151 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.638 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:36.638 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.352751341999998, 2024-09-14T06:00:36.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074207289999999995, 2024-09-14T06:00:36.639 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.639 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.639 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.640 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59151 2024-09-14T06:00:36.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.640 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:36.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:36.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268626+0000", 2024-09-14T06:00:36.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T06:00:36.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268629+0000", 2024-09-14T06:00:36.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.038e-06 2024-09-14T06:00:36.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268638+0000", 2024-09-14T06:00:36.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8139999999999995e-06 2024-09-14T06:00:36.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268647+0000", 2024-09-14T06:00:36.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4889999999999995e-06 2024-09-14T06:00:36.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342457+0000", 2024-09-14T06:00:36.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073809890000000003 2024-09-14T06:00:36.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342545+0000", 2024-09-14T06:00:36.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8697999999999997e-05 2024-09-14T06:00:36.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342832+0000", 2024-09-14T06:00:36.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028681799999999999 2024-09-14T06:00:36.643 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.644 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.644 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.644 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59152 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.644 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:36.644 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.352718701000001, 2024-09-14T06:00:36.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074695176000000002, 2024-09-14T06:00:36.644 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.644 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.644 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.644 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.644 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.645 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59152 2024-09-14T06:00:36.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.645 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:36.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:36.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:36.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2900000000000003e-07 2024-09-14T06:00:36.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268661+0000", 2024-09-14T06:00:36.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0230000000000001e-06 2024-09-14T06:00:36.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268670+0000", 2024-09-14T06:00:36.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2129999999999997e-06 2024-09-14T06:00:36.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268679+0000", 2024-09-14T06:00:36.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-09-14T06:00:36.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342937+0000", 2024-09-14T06:00:36.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074258781999999995 2024-09-14T06:00:36.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343044+0000", 2024-09-14T06:00:36.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-09-14T06:00:36.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343353+0000", 2024-09-14T06:00:36.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030911099999999999 2024-09-14T06:00:36.648 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.649 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.649 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.649 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59153 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 501760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.649 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:36.649 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.352685931000003, 2024-09-14T06:00:36.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074997241000000006, 2024-09-14T06:00:36.649 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.649 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.649 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.649 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.649 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.650 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.650 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59153 2024-09-14T06:00:36.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.650 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:36.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:36.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268691+0000", 2024-09-14T06:00:36.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:00:36.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268693+0000", 2024-09-14T06:00:36.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3599999999999999e-06 2024-09-14T06:00:36.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268699+0000", 2024-09-14T06:00:36.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-09-14T06:00:36.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268704+0000", 2024-09-14T06:00:36.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5759999999999999e-06 2024-09-14T06:00:36.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343398+0000", 2024-09-14T06:00:36.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074694522999999999 2024-09-14T06:00:36.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343450+0000", 2024-09-14T06:00:36.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1350999999999997e-05 2024-09-14T06:00:36.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343688+0000", 2024-09-14T06:00:36.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023806500000000001 2024-09-14T06:00:36.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.653 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.654 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59154 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 518144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.654 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:36.654 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.352666865000003, 2024-09-14T06:00:36.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075389938000000004, 2024-09-14T06:00:36.654 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.654 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.654 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.654 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59154 2024-09-14T06:00:36.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.655 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:36.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:36.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268710+0000", 2024-09-14T06:00:36.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8000000000000001e-07 2024-09-14T06:00:36.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268712+0000", 2024-09-14T06:00:36.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T06:00:36.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268717+0000", 2024-09-14T06:00:36.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8570000000000003e-06 2024-09-14T06:00:36.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268721+0000", 2024-09-14T06:00:36.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2039999999999999e-06 2024-09-14T06:00:36.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343721+0000", 2024-09-14T06:00:36.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074999748000000005 2024-09-14T06:00:36.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343784+0000", 2024-09-14T06:00:36.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3174000000000002e-05 2024-09-14T06:00:36.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.344099+0000", 2024-09-14T06:00:36.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000315299 2024-09-14T06:00:36.659 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.659 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.659 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.660 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59398 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 323584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.660 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:36.660 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.341702617000003, 2024-09-14T06:00:36.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073326565999999996, 2024-09-14T06:00:36.660 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.661 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.661 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.661 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.661 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.661 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.661 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59398 2024-09-14T06:00:36.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.661 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:36.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:36.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279675+0000", 2024-09-14T06:00:36.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-14T06:00:36.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279681+0000", 2024-09-14T06:00:36.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-09-14T06:00:36.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279702+0000", 2024-09-14T06:00:36.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1259000000000001e-05 2024-09-14T06:00:36.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279718+0000", 2024-09-14T06:00:36.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5475999999999999e-05 2024-09-14T06:00:36.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352360+0000", 2024-09-14T06:00:36.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.07264226 2024-09-14T06:00:36.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352447+0000", 2024-09-14T06:00:36.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7381999999999998e-05 2024-09-14T06:00:36.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353000+0000", 2024-09-14T06:00:36.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055309200000000004 2024-09-14T06:00:36.665 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.665 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.665 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.665 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59399 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.665 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:36.665 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.341638254000003, 2024-09-14T06:00:36.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073824446000000002, 2024-09-14T06:00:36.665 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.665 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.666 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.666 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.666 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.666 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.666 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59399 2024-09-14T06:00:36.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.666 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:36.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:36.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279739+0000", 2024-09-14T06:00:36.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T06:00:36.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279745+0000", 2024-09-14T06:00:36.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T06:00:36.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279767+0000", 2024-09-14T06:00:36.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639000000000001e-05 2024-09-14T06:00:36.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279781+0000", 2024-09-14T06:00:36.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4511999999999999e-05 2024-09-14T06:00:36.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353045+0000", 2024-09-14T06:00:36.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073263718000000005 2024-09-14T06:00:36.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353168+0000", 2024-09-14T06:00:36.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012314499999999999 2024-09-14T06:00:36.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353562+0000", 2024-09-14T06:00:36.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039435199999999999 2024-09-14T06:00:36.670 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.670 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.670 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.670 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59400 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.670 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:36.671 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.341574494, 2024-09-14T06:00:36.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074271465999999994, 2024-09-14T06:00:36.671 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.671 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.671 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.671 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.671 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.671 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.671 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59400 2024-09-14T06:00:36.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.671 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:36.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:36.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279803+0000", 2024-09-14T06:00:36.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2100000000000001e-06 2024-09-14T06:00:36.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279819+0000", 2024-09-14T06:00:36.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6409000000000002e-05 2024-09-14T06:00:36.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279841+0000", 2024-09-14T06:00:36.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1878e-05 2024-09-14T06:00:36.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279856+0000", 2024-09-14T06:00:36.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4392999999999999e-05 2024-09-14T06:00:36.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353650+0000", 2024-09-14T06:00:36.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073794144000000006 2024-09-14T06:00:36.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353757+0000", 2024-09-14T06:00:36.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010687 2024-09-14T06:00:36.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354073+0000", 2024-09-14T06:00:36.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000316562 2024-09-14T06:00:36.675 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.675 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.675 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.675 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59401 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 372736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.675 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:36.675 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.341499669000001, 2024-09-14T06:00:36.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074643900999999999, 2024-09-14T06:00:36.676 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.676 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.676 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.676 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.676 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.676 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.676 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59401 2024-09-14T06:00:36.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.676 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:36.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:36.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279878+0000", 2024-09-14T06:00:36.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.31e-06 2024-09-14T06:00:36.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279883+0000", 2024-09-14T06:00:36.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3770000000000004e-06 2024-09-14T06:00:36.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279906+0000", 2024-09-14T06:00:36.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2398000000000001e-05 2024-09-14T06:00:36.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279920+0000", 2024-09-14T06:00:36.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.402e-05 2024-09-14T06:00:36.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354125+0000", 2024-09-14T06:00:36.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074205750000000001 2024-09-14T06:00:36.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354227+0000", 2024-09-14T06:00:36.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101612 2024-09-14T06:00:36.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354521+0000", 2024-09-14T06:00:36.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029343400000000002 2024-09-14T06:00:36.680 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.680 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.680 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.680 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59402 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 389120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.680 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:36.680 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.341438085999997, 2024-09-14T06:00:36.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075017027999999999, 2024-09-14T06:00:36.680 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.680 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.680 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.681 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.681 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.681 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59402 2024-09-14T06:00:36.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.681 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:36.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:36.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279939+0000", 2024-09-14T06:00:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2470000000000001e-06 2024-09-14T06:00:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279945+0000", 2024-09-14T06:00:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-09-14T06:00:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279966+0000", 2024-09-14T06:00:36.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1801999999999999e-05 2024-09-14T06:00:36.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279980+0000", 2024-09-14T06:00:36.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3589e-05 2024-09-14T06:00:36.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354569+0000", 2024-09-14T06:00:36.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074588707000000004 2024-09-14T06:00:36.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354671+0000", 2024-09-14T06:00:36.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102398 2024-09-14T06:00:36.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354955+0000", 2024-09-14T06:00:36.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028406500000000001 2024-09-14T06:00:36.684 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.684 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.684 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.684 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59403 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 405504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.684 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:36.685 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.341376298999997, 2024-09-14T06:00:36.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075434395000000001, 2024-09-14T06:00:36.685 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.685 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.685 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.685 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.685 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.685 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.685 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59403 2024-09-14T06:00:36.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.686 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:36.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:36.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280001+0000", 2024-09-14T06:00:36.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2669999999999999e-06 2024-09-14T06:00:36.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280008+0000", 2024-09-14T06:00:36.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5849999999999996e-06 2024-09-14T06:00:36.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280030+0000", 2024-09-14T06:00:36.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2293000000000002e-05 2024-09-14T06:00:36.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280044+0000", 2024-09-14T06:00:36.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3974999999999999e-05 2024-09-14T06:00:36.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355013+0000", 2024-09-14T06:00:36.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074969039000000001 2024-09-14T06:00:36.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355144+0000", 2024-09-14T06:00:36.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000131333 2024-09-14T06:00:36.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355434+0000", 2024-09-14T06:00:36.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028990299999999999 2024-09-14T06:00:36.689 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.689 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.689 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.689 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59404 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.690 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:36.690 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.341311179999998, 2024-09-14T06:00:36.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075696103000000001, 2024-09-14T06:00:36.690 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.690 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.690 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.690 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.690 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.690 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.690 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59404 2024-09-14T06:00:36.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.690 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:36.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:36.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280066+0000", 2024-09-14T06:00:36.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2640000000000001e-06 2024-09-14T06:00:36.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280072+0000", 2024-09-14T06:00:36.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129999999999997e-06 2024-09-14T06:00:36.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280094+0000", 2024-09-14T06:00:36.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2608000000000001e-05 2024-09-14T06:00:36.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280109+0000", 2024-09-14T06:00:36.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:36.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355479+0000", 2024-09-14T06:00:36.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075370699999999999 2024-09-14T06:00:36.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355554+0000", 2024-09-14T06:00:36.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4674999999999999e-05 2024-09-14T06:00:36.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355761+0000", 2024-09-14T06:00:36.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-14T06:00:36.694 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.694 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.694 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.694 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59405 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.694 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:36.694 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.341247269999997, 2024-09-14T06:00:36.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076008867999999993, 2024-09-14T06:00:36.694 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.695 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.695 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.695 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.695 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59405 2024-09-14T06:00:36.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.695 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:36.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:36.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280130+0000", 2024-09-14T06:00:36.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2500000000000001e-06 2024-09-14T06:00:36.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280136+0000", 2024-09-14T06:00:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-09-14T06:00:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280158+0000", 2024-09-14T06:00:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1795000000000001e-05 2024-09-14T06:00:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280172+0000", 2024-09-14T06:00:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4303e-05 2024-09-14T06:00:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355797+0000", 2024-09-14T06:00:36.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075624835000000001 2024-09-14T06:00:36.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355866+0000", 2024-09-14T06:00:36.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9043999999999998e-05 2024-09-14T06:00:36.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356138+0000", 2024-09-14T06:00:36.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027207799999999998 2024-09-14T06:00:36.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59406 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.341183328, 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076435642999999998, 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.699 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59406 2024-09-14T06:00:36.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.700 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:36.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:36.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280194+0000", 2024-09-14T06:00:36.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-14T06:00:36.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280200+0000", 2024-09-14T06:00:36.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6359999999999999e-06 2024-09-14T06:00:36.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280222+0000", 2024-09-14T06:00:36.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1628999999999999e-05 2024-09-14T06:00:36.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280236+0000", 2024-09-14T06:00:36.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4413000000000001e-05 2024-09-14T06:00:36.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356172+0000", 2024-09-14T06:00:36.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075936466999999994 2024-09-14T06:00:36.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356260+0000", 2024-09-14T06:00:36.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7437999999999999e-05 2024-09-14T06:00:36.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356629+0000", 2024-09-14T06:00:36.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036877600000000002 2024-09-14T06:00:36.703 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.703 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.703 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.704 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59407 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 471040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.704 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:36.704 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.341119095000003, 2024-09-14T06:00:36.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076820083999999997, 2024-09-14T06:00:36.704 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.704 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.704 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.704 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59407 2024-09-14T06:00:36.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.705 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:36.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:36.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280258+0000", 2024-09-14T06:00:36.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1370000000000001e-06 2024-09-14T06:00:36.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280264+0000", 2024-09-14T06:00:36.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6930000000000004e-06 2024-09-14T06:00:36.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280285+0000", 2024-09-14T06:00:36.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1455999999999999e-05 2024-09-14T06:00:36.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280300+0000", 2024-09-14T06:00:36.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4319e-05 2024-09-14T06:00:36.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356676+0000", 2024-09-14T06:00:36.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076376615999999994 2024-09-14T06:00:36.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356768+0000", 2024-09-14T06:00:36.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1234000000000001e-05 2024-09-14T06:00:36.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357077+0000", 2024-09-14T06:00:36.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030962900000000001 2024-09-14T06:00:36.708 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.708 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.708 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.708 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59408 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 487424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.708 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:36.709 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.341054094999997, 2024-09-14T06:00:36.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077185511999999998, 2024-09-14T06:00:36.709 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.709 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.709 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.709 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.709 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.709 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.709 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59408 2024-09-14T06:00:36.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.709 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:36.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:36.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280323+0000", 2024-09-14T06:00:36.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2860000000000001e-06 2024-09-14T06:00:36.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280329+0000", 2024-09-14T06:00:36.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.553e-06 2024-09-14T06:00:36.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280352+0000", 2024-09-14T06:00:36.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280366+0000", 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357126+0000", 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076760326000000004 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357223+0000", 2024-09-14T06:00:36.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6490000000000006e-05 2024-09-14T06:00:36.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357508+0000", 2024-09-14T06:00:36.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028479900000000002 2024-09-14T06:00:36.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.713 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.713 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59409 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.713 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:36.713 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.340989864999997, 2024-09-14T06:00:36.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077536090000000002, 2024-09-14T06:00:36.714 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.714 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.714 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.714 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.714 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.714 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.714 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59409 2024-09-14T06:00:36.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.714 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:36.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280388+0000", 2024-09-14T06:00:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.096e-06 2024-09-14T06:00:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280393+0000", 2024-09-14T06:00:36.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T06:00:36.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280414+0000", 2024-09-14T06:00:36.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1175999999999999e-05 2024-09-14T06:00:36.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280427+0000", 2024-09-14T06:00:36.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3032e-05 2024-09-14T06:00:36.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357553+0000", 2024-09-14T06:00:36.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077125845999999998 2024-09-14T06:00:36.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357624+0000", 2024-09-14T06:00:36.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1062000000000005e-05 2024-09-14T06:00:36.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357923+0000", 2024-09-14T06:00:36.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029891199999999997 2024-09-14T06:00:36.718 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.718 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.718 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.718 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59410 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:36.718 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:36.718 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.340930553, 2024-09-14T06:00:36.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077854494999999996, 2024-09-14T06:00:36.718 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:36.718 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:36.718 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:36.718 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:36.718 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59410 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:36.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280447+0000", 2024-09-14T06:00:36.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069999999999999e-06 2024-09-14T06:00:36.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:36.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280453+0000", 2024-09-14T06:00:36.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-06 2024-09-14T06:00:36.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:36.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280471+0000", 2024-09-14T06:00:36.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8295999999999999e-05 2024-09-14T06:00:36.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:36.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280484+0000", 2024-09-14T06:00:36.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2609000000000001e-05 2024-09-14T06:00:36.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:36.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357954+0000", 2024-09-14T06:00:36.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077470405000000006 2024-09-14T06:00:36.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:36.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358040+0000", 2024-09-14T06:00:36.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.551e-05 2024-09-14T06:00:36.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:36.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:36.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:36.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358300+0000", 2024-09-14T06:00:36.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026036800000000003 2024-09-14T06:00:36.722 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.722 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.722 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.722 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:36.722 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:36.722 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:36.723 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-14T06:00:36.723 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T06:00:36.724 INFO:teuthology.orchestra.run.smithi006.stdout:5464 write 0xdde0846 thru 0xdde555f (0x4d1a bytes) 2024-09-14T06:00:36.724 INFO:teuthology.orchestra.run.smithi006.stdout:5465 writesame 0x2fdcc3a thru 0x2fe4f62 data_size 0x1(0x8329 bytes) 2024-09-14T06:00:36.724 INFO:teuthology.orchestra.run.smithi006.stdout:5466 read 0x5407a1e thru 0x5411471 (0x9a54 bytes) 2024-09-14T06:00:36.724 INFO:teuthology.orchestra.run.smithi006.stdout:5468 writesame 0x409e2b thru 0x40d376 data_size 0x12(0x354c bytes) 2024-09-14T06:00:36.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:00:36.726 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:36.719+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:36.726 INFO:teuthology.orchestra.run.smithi006.stdout:5470 punch from 0x75ba0ab to 0x75bb097, (0xfec bytes) 2024-09-14T06:00:36.726 INFO:teuthology.orchestra.run.smithi006.stdout:5471 write 0x11e3c12 thru 0x11f0f86 (0xd375 bytes) 2024-09-14T06:00:36.797 INFO:teuthology.orchestra.run.smithi006.stdout:5473 trunc from 0xdde5560 to 0x1ca04e5 2024-09-14T06:00:36.830 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:36.819+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:36.884 INFO:teuthology.orchestra.run.smithi006.stdout:5475 read 0x716c14 thru 0x71fbea (0x8fd7 bytes) 2024-09-14T06:00:36.884 INFO:teuthology.orchestra.run.smithi006.stdout:5476 read 0x744d8c thru 0x74a9b2 (0x5c27 bytes) 2024-09-14T06:00:36.906 INFO:teuthology.orchestra.run.smithi006.stdout:5477 write 0xb3b2b4e thru 0xb3b5b64 (0x3017 bytes) 2024-09-14T06:00:36.910 INFO:teuthology.orchestra.run.smithi006.stdout:5478 write 0x9359ab4 thru 0x9364a84 (0xafd1 bytes) 2024-09-14T06:00:36.916 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:36.916 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:36.916 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:36.916 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:36.917 INFO:teuthology.orchestra.run.smithi006.stdout:5479 writesame 0xa89198c thru 0xa898638 data_size 0x1(0x6cad bytes) 2024-09-14T06:00:36.925 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:36.923+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:36.931 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:36.932 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:00:36.945 INFO:teuthology.orchestra.run.smithi006.stdout:5481 trunc from 0xb3b5b65 to 0x14bf8ce 2024-09-14T06:00:37.025 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:37.021+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:37.037 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:37.050 INFO:teuthology.orchestra.run.smithi006.stdout:5485 write 0x55c3b21 thru 0x55c994e (0x5e2e bytes) 2024-09-14T06:00:37.064 INFO:teuthology.orchestra.run.smithi006.stdout:5486 trunc from 0x55c994f to 0x9232eb 2024-09-14T06:00:37.126 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:37.125+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:37.133 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:37.133 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:37.134 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:37.134 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:37.134 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:37.152 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:00:37.227 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:37.223+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:37.266 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:37.267 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:37.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:37.267 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:37.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.267 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38916 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5193728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.267 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.529906+0000", 2024-09-14T06:00:37.267 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.737096721, 2024-09-14T06:00:37.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083853568000000003, 2024-09-14T06:00:37.267 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.267 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.267 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.267 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.267 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.268 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.268 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38916 2024-09-14T06:00:37.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.268 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529906+0000", 2024-09-14T06:00:37.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529906+0000", 2024-09-14T06:00:37.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530166+0000", 2024-09-14T06:00:37.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026013499999999999 2024-09-14T06:00:37.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530171+0000", 2024-09-14T06:00:37.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1800000000000004e-06 2024-09-14T06:00:37.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530186+0000", 2024-09-14T06:00:37.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5342e-05 2024-09-14T06:00:37.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530200+0000", 2024-09-14T06:00:37.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3349e-05 2024-09-14T06:00:37.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613496+0000", 2024-09-14T06:00:37.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083296674000000001 2024-09-14T06:00:37.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613612+0000", 2024-09-14T06:00:37.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115895 2024-09-14T06:00:37.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613759+0000", 2024-09-14T06:00:37.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014699299999999999 2024-09-14T06:00:37.271 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.271 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.271 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.272 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38918 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5292032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.272 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530216+0000", 2024-09-14T06:00:37.272 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.736786096000003, 2024-09-14T06:00:37.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083840804000000005, 2024-09-14T06:00:37.272 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.272 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.272 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.272 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.272 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.272 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.272 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38918 2024-09-14T06:00:37.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.272 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530216+0000", 2024-09-14T06:00:37.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530216+0000", 2024-09-14T06:00:37.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530276+0000", 2024-09-14T06:00:37.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9855000000000002e-05 2024-09-14T06:00:37.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530284+0000", 2024-09-14T06:00:37.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0129999999999993e-06 2024-09-14T06:00:37.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530305+0000", 2024-09-14T06:00:37.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0574999999999999e-05 2024-09-14T06:00:37.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530320+0000", 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5231999999999999e-05 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613799+0000", 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083479131999999998 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.613911+0000", 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011215200000000001 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614057+0000", 2024-09-14T06:00:37.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000145845 2024-09-14T06:00:37.276 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.276 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.276 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.276 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38919 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5472256~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.276 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530345+0000", 2024-09-14T06:00:37.276 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.736657475999998, 2024-09-14T06:00:37.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083997022000000005, 2024-09-14T06:00:37.276 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.276 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.277 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.277 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.277 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.277 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.277 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38919 2024-09-14T06:00:37.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.277 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530345+0000", 2024-09-14T06:00:37.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530345+0000", 2024-09-14T06:00:37.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530627+0000", 2024-09-14T06:00:37.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028190700000000002 2024-09-14T06:00:37.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530637+0000", 2024-09-14T06:00:37.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0005e-05 2024-09-14T06:00:37.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530662+0000", 2024-09-14T06:00:37.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5065000000000001e-05 2024-09-14T06:00:37.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530679+0000", 2024-09-14T06:00:37.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7255999999999999e-05 2024-09-14T06:00:37.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614130+0000", 2024-09-14T06:00:37.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083450478999999994 2024-09-14T06:00:37.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614225+0000", 2024-09-14T06:00:37.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5451000000000005e-05 2024-09-14T06:00:37.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614342+0000", 2024-09-14T06:00:37.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116859 2024-09-14T06:00:37.280 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.280 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.280 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.281 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38921 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6684672~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.281 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530704+0000", 2024-09-14T06:00:37.281 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.736298468999998, 2024-09-14T06:00:37.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083903330999999998, 2024-09-14T06:00:37.281 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.281 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.281 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.281 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.281 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.281 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.281 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38921 2024-09-14T06:00:37.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.282 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530704+0000", 2024-09-14T06:00:37.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530704+0000", 2024-09-14T06:00:37.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530705+0000", 2024-09-14T06:00:37.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1939999999999999e-06 2024-09-14T06:00:37.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530709+0000", 2024-09-14T06:00:37.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1289999999999998e-06 2024-09-14T06:00:37.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530721+0000", 2024-09-14T06:00:37.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-09-14T06:00:37.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530728+0000", 2024-09-14T06:00:37.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7729999999999999e-06 2024-09-14T06:00:37.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614393+0000", 2024-09-14T06:00:37.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083665164 2024-09-14T06:00:37.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614489+0000", 2024-09-14T06:00:37.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5168999999999996e-05 2024-09-14T06:00:37.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614607+0000", 2024-09-14T06:00:37.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011856 2024-09-14T06:00:37.285 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.285 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.285 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.285 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38924 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5570560~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.285 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530740+0000", 2024-09-14T06:00:37.285 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.736262787999998, 2024-09-14T06:00:37.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084072167000000003, 2024-09-14T06:00:37.286 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.286 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.286 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.286 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.286 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.286 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.286 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38924 2024-09-14T06:00:37.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.286 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530740+0000", 2024-09-14T06:00:37.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530740+0000", 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530881+0000", 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014107799999999999 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530889+0000", 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1659999999999994e-06 2024-09-14T06:00:37.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530908+0000", 2024-09-14T06:00:37.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8732e-05 2024-09-14T06:00:37.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530917+0000", 2024-09-14T06:00:37.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4390000000000006e-06 2024-09-14T06:00:37.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614661+0000", 2024-09-14T06:00:37.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083743567000000005 2024-09-14T06:00:37.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614736+0000", 2024-09-14T06:00:37.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5394000000000004e-05 2024-09-14T06:00:37.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614812+0000", 2024-09-14T06:00:37.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5791000000000007e-05 2024-09-14T06:00:37.289 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.289 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.289 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38925 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5750784~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.530934+0000", 2024-09-14T06:00:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.736068240999998, 2024-09-14T06:00:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084075189999999994, 2024-09-14T06:00:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38925 2024-09-14T06:00:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530934+0000", 2024-09-14T06:00:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.530934+0000", 2024-09-14T06:00:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531235+0000", 2024-09-14T06:00:37.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030118899999999999 2024-09-14T06:00:37.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531244+0000", 2024-09-14T06:00:37.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1530000000000003e-06 2024-09-14T06:00:37.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531267+0000", 2024-09-14T06:00:37.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2688e-05 2024-09-14T06:00:37.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531284+0000", 2024-09-14T06:00:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6558999999999998e-05 2024-09-14T06:00:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614874+0000", 2024-09-14T06:00:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083590082999999996 2024-09-14T06:00:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.614937+0000", 2024-09-14T06:00:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3085999999999999e-05 2024-09-14T06:00:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615009+0000", 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2432e-05 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38927 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6963200~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.531313+0000", 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.735689508, 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083845550000000005, 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.294 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.295 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.295 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.295 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.295 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38927 2024-09-14T06:00:37.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.295 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531313+0000", 2024-09-14T06:00:37.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531313+0000", 2024-09-14T06:00:37.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531590+0000", 2024-09-14T06:00:37.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027672100000000001 2024-09-14T06:00:37.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531597+0000", 2024-09-14T06:00:37.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.61e-06 2024-09-14T06:00:37.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531622+0000", 2024-09-14T06:00:37.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5001e-05 2024-09-14T06:00:37.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531634+0000", 2024-09-14T06:00:37.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1756000000000001e-05 2024-09-14T06:00:37.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615045+0000", 2024-09-14T06:00:37.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083411336000000003 2024-09-14T06:00:37.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615093+0000", 2024-09-14T06:00:37.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7812999999999998e-05 2024-09-14T06:00:37.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615158+0000", 2024-09-14T06:00:37.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5313000000000003e-05 2024-09-14T06:00:37.298 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.298 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.298 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.299 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38930 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.299 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.531670+0000", 2024-09-14T06:00:37.299 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.735332376999999, 2024-09-14T06:00:37.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083704600000000004, 2024-09-14T06:00:37.299 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.299 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.299 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.299 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.299 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.299 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.299 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38930 2024-09-14T06:00:37.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.300 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531670+0000", 2024-09-14T06:00:37.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531670+0000", 2024-09-14T06:00:37.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531671+0000", 2024-09-14T06:00:37.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1200000000000001e-06 2024-09-14T06:00:37.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531675+0000", 2024-09-14T06:00:37.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5530000000000001e-06 2024-09-14T06:00:37.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531688+0000", 2024-09-14T06:00:37.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3592e-05 2024-09-14T06:00:37.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531696+0000", 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9300000000000003e-06 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615191+0000", 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083494833000000004 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615258+0000", 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7366000000000005e-05 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615375+0000", 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011620600000000001 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38933 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7241728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.531708+0000", 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.735293925999997, 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083895771999999993, 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38933 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531708+0000", 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.531708+0000", 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532040+0000", 2024-09-14T06:00:37.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00033176599999999999 2024-09-14T06:00:37.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532049+0000", 2024-09-14T06:00:37.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3289999999999994e-06 2024-09-14T06:00:37.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532070+0000", 2024-09-14T06:00:37.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1498999999999999e-05 2024-09-14T06:00:37.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532086+0000", 2024-09-14T06:00:37.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5775000000000001e-05 2024-09-14T06:00:37.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615432+0000", 2024-09-14T06:00:37.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083345742 2024-09-14T06:00:37.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615515+0000", 2024-09-14T06:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3834999999999999e-05 2024-09-14T06:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615604+0000", 2024-09-14T06:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8826000000000006e-05 2024-09-14T06:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38935 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532153+0000", 2024-09-14T06:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.734848956, 2024-09-14T06:00:37.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083756399999999995, 2024-09-14T06:00:37.308 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.308 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.308 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.308 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.308 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.308 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.308 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38935 2024-09-14T06:00:37.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.308 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532153+0000", 2024-09-14T06:00:37.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532153+0000", 2024-09-14T06:00:37.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532155+0000", 2024-09-14T06:00:37.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5540000000000001e-06 2024-09-14T06:00:37.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532162+0000", 2024-09-14T06:00:37.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-09-14T06:00:37.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532183+0000", 2024-09-14T06:00:37.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1219000000000001e-05 2024-09-14T06:00:37.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532199+0000", 2024-09-14T06:00:37.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5707999999999999e-05 2024-09-14T06:00:37.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615666+0000", 2024-09-14T06:00:37.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083467348999999996 2024-09-14T06:00:37.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615774+0000", 2024-09-14T06:00:37.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108513 2024-09-14T06:00:37.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615910+0000", 2024-09-14T06:00:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013539199999999999 2024-09-14T06:00:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38938 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532221+0000", 2024-09-14T06:00:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.734781748000003, 2024-09-14T06:00:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942434999999996, 2024-09-14T06:00:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.313 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38938 2024-09-14T06:00:37.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.313 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532221+0000", 2024-09-14T06:00:37.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532221+0000", 2024-09-14T06:00:37.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532520+0000", 2024-09-14T06:00:37.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029975599999999998 2024-09-14T06:00:37.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532537+0000", 2024-09-14T06:00:37.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6325e-05 2024-09-14T06:00:37.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532555+0000", 2024-09-14T06:00:37.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8796000000000001e-05 2024-09-14T06:00:37.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532567+0000", 2024-09-14T06:00:37.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1691999999999999e-05 2024-09-14T06:00:37.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.615972+0000", 2024-09-14T06:00:37.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083404513999999999 2024-09-14T06:00:37.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616068+0000", 2024-09-14T06:00:37.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6484999999999995e-05 2024-09-14T06:00:37.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616163+0000", 2024-09-14T06:00:37.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4866999999999998e-05 2024-09-14T06:00:37.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.316 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.316 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38939 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7520256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.317 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532620+0000", 2024-09-14T06:00:37.317 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.734382826999997, 2024-09-14T06:00:37.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083789983999999998, 2024-09-14T06:00:37.317 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.317 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.317 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.317 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38939 2024-09-14T06:00:37.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.317 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532620+0000", 2024-09-14T06:00:37.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532620+0000", 2024-09-14T06:00:37.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532621+0000", 2024-09-14T06:00:37.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.15e-06 2024-09-14T06:00:37.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532625+0000", 2024-09-14T06:00:37.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9770000000000002e-06 2024-09-14T06:00:37.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532637+0000", 2024-09-14T06:00:37.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1902000000000001e-05 2024-09-14T06:00:37.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532645+0000", 2024-09-14T06:00:37.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0059999999999992e-06 2024-09-14T06:00:37.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616213+0000", 2024-09-14T06:00:37.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083568086999999999 2024-09-14T06:00:37.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616311+0000", 2024-09-14T06:00:37.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8342000000000001e-05 2024-09-14T06:00:37.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616410+0000", 2024-09-14T06:00:37.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8519999999999999e-05 2024-09-14T06:00:37.321 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.321 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.321 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.321 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38941 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.321 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.532657+0000", 2024-09-14T06:00:37.321 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.734345683000001, 2024-09-14T06:00:37.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083960503000000006, 2024-09-14T06:00:37.321 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.321 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.321 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.321 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.322 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38941 2024-09-14T06:00:37.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.322 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532657+0000", 2024-09-14T06:00:37.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532657+0000", 2024-09-14T06:00:37.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532932+0000", 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027501099999999997 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532938+0000", 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.857e-06 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532959+0000", 2024-09-14T06:00:37.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1773999999999999e-05 2024-09-14T06:00:37.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.532975+0000", 2024-09-14T06:00:37.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5858999999999998e-05 2024-09-14T06:00:37.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616462+0000", 2024-09-14T06:00:37.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083486949000000005 2024-09-14T06:00:37.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616524+0000", 2024-09-14T06:00:37.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2255999999999995e-05 2024-09-14T06:00:37.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616617+0000", 2024-09-14T06:00:37.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2796999999999999e-05 2024-09-14T06:00:37.325 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.325 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.325 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.325 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38944 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7618560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.325 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533002+0000", 2024-09-14T06:00:37.326 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.734000534000003, 2024-09-14T06:00:37.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083846326999999998, 2024-09-14T06:00:37.326 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.326 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.326 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.326 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38944 2024-09-14T06:00:37.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.326 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533002+0000", 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533002+0000", 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533107+0000", 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104955 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533115+0000", 2024-09-14T06:00:37.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3890000000000005e-06 2024-09-14T06:00:37.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533138+0000", 2024-09-14T06:00:37.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3302000000000002e-05 2024-09-14T06:00:37.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533155+0000", 2024-09-14T06:00:37.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6201e-05 2024-09-14T06:00:37.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616671+0000", 2024-09-14T06:00:37.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083516786999999995 2024-09-14T06:00:37.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616762+0000", 2024-09-14T06:00:37.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0162999999999997e-05 2024-09-14T06:00:37.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616848+0000", 2024-09-14T06:00:37.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.653e-05 2024-09-14T06:00:37.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38945 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533182+0000", 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.733820434999998, 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083811267999999994, 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.330 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38945 2024-09-14T06:00:37.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.331 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533182+0000", 2024-09-14T06:00:37.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533182+0000", 2024-09-14T06:00:37.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533333+0000", 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000150588 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533342+0000", 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0089999999999996e-06 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533365+0000", 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3771e-05 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533382+0000", 2024-09-14T06:00:37.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6748999999999998e-05 2024-09-14T06:00:37.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616884+0000", 2024-09-14T06:00:37.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083502178999999996 2024-09-14T06:00:37.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616930+0000", 2024-09-14T06:00:37.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5312999999999998e-05 2024-09-14T06:00:37.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.616993+0000", 2024-09-14T06:00:37.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3658999999999995e-05 2024-09-14T06:00:37.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.334 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.334 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38947 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 7897088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.334 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533411+0000", 2024-09-14T06:00:37.334 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.733591523999998, 2024-09-14T06:00:37.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083860599999999993, 2024-09-14T06:00:37.334 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.334 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.335 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.335 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38947 2024-09-14T06:00:37.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.335 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533411+0000", 2024-09-14T06:00:37.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533411+0000", 2024-09-14T06:00:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533731+0000", 2024-09-14T06:00:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031991499999999999 2024-09-14T06:00:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533738+0000", 2024-09-14T06:00:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8820000000000003e-06 2024-09-14T06:00:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533766+0000", 2024-09-14T06:00:37.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8218e-05 2024-09-14T06:00:37.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533781+0000", 2024-09-14T06:00:37.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4799e-05 2024-09-14T06:00:37.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617052+0000", 2024-09-14T06:00:37.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083271607999999997 2024-09-14T06:00:37.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617163+0000", 2024-09-14T06:00:37.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011053299999999999 2024-09-14T06:00:37.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617271+0000", 2024-09-14T06:00:37.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108645 2024-09-14T06:00:37.338 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.338 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.338 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.339 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38948 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 8077312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.339 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533801+0000", 2024-09-14T06:00:37.339 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.733201649000002, 2024-09-14T06:00:37.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083665502000000003, 2024-09-14T06:00:37.339 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.339 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.339 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.339 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.339 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.339 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.339 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38948 2024-09-14T06:00:37.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.339 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533801+0000", 2024-09-14T06:00:37.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533801+0000", 2024-09-14T06:00:37.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533802+0000", 2024-09-14T06:00:37.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.06e-06 2024-09-14T06:00:37.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533805+0000", 2024-09-14T06:00:37.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6540000000000001e-06 2024-09-14T06:00:37.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533816+0000", 2024-09-14T06:00:37.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0642000000000001e-05 2024-09-14T06:00:37.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533823+0000", 2024-09-14T06:00:37.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.396e-06 2024-09-14T06:00:37.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617327+0000", 2024-09-14T06:00:37.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083503933000000002 2024-09-14T06:00:37.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617394+0000", 2024-09-14T06:00:37.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6693999999999995e-05 2024-09-14T06:00:37.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617466+0000", 2024-09-14T06:00:37.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2123e-05 2024-09-14T06:00:37.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.343 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.343 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38950 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 9289728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.343 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.533834+0000", 2024-09-14T06:00:37.343 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.733168331000002, 2024-09-14T06:00:37.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083881255000000002, 2024-09-14T06:00:37.343 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.343 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.344 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.344 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38950 2024-09-14T06:00:37.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.344 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533834+0000", 2024-09-14T06:00:37.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.533834+0000", 2024-09-14T06:00:37.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534051+0000", 2024-09-14T06:00:37.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000217242 2024-09-14T06:00:37.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534061+0000", 2024-09-14T06:00:37.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3430000000000002e-06 2024-09-14T06:00:37.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534086+0000", 2024-09-14T06:00:37.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5384e-05 2024-09-14T06:00:37.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534104+0000", 2024-09-14T06:00:37.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8006e-05 2024-09-14T06:00:37.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617507+0000", 2024-09-14T06:00:37.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083403115999999999 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617616+0000", 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108418 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617715+0000", 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9746000000000003e-05 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38953 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 8175616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.534133+0000", 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.732869155000003, 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083736141, 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38953 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534133+0000", 2024-09-14T06:00:37.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534133+0000", 2024-09-14T06:00:37.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534314+0000", 2024-09-14T06:00:37.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018080200000000001 2024-09-14T06:00:37.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534329+0000", 2024-09-14T06:00:37.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5375000000000001e-05 2024-09-14T06:00:37.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534354+0000", 2024-09-14T06:00:37.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4411999999999999e-05 2024-09-14T06:00:37.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534366+0000", 2024-09-14T06:00:37.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1949e-05 2024-09-14T06:00:37.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617758+0000", 2024-09-14T06:00:37.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083392691000000005 2024-09-14T06:00:37.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617817+0000", 2024-09-14T06:00:37.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8471999999999999e-05 2024-09-14T06:00:37.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617869+0000", 2024-09-14T06:00:37.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2439999999999999e-05 2024-09-14T06:00:37.352 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.352 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.352 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.352 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38954 3.11 3:8f55c966:::rbd_data.11276864ec6c.0000000000000000:d [read 8355840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:37.352 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.534386+0000", 2024-09-14T06:00:37.352 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.732615862000003, 2024-09-14T06:00:37.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083652403, 2024-09-14T06:00:37.352 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:37.352 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:37.352 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:37.352 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:37.353 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:37.353 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.353 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38954 2024-09-14T06:00:37.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.353 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:37.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:37.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534386+0000", 2024-09-14T06:00:37.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:37.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534386+0000", 2024-09-14T06:00:37.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534716+0000", 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032903000000000001 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534721+0000", 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9089999999999997e-06 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534739+0000", 2024-09-14T06:00:37.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7679000000000001e-05 2024-09-14T06:00:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.534749+0000", 2024-09-14T06:00:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0312999999999999e-05 2024-09-14T06:00:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617901+0000", 2024-09-14T06:00:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083152056000000002 2024-09-14T06:00:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.617977+0000", 2024-09-14T06:00:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5772000000000006e-05 2024-09-14T06:00:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.618039+0000", 2024-09-14T06:00:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1643999999999995e-05 2024-09-14T06:00:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:37.356 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:37.358 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:00:37.358 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:37.353+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:37.458 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:37.453+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:37.500 INFO:teuthology.orchestra.run.smithi006.stdout:5487 read 0x7cb132 thru 0x7cd75e (0x262d bytes) 2024-09-14T06:00:37.503 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:37.503 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:37.503 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:00:37.504 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:37.524 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:00:37.529 INFO:teuthology.orchestra.run.smithi006.stdout:5489 write 0x6fee896 thru 0x6ffd862 (0xefcd bytes) 2024-09-14T06:00:37.541 INFO:teuthology.orchestra.run.smithi006.stdout:5490 read 0xacaf43 thru 0xacc286 (0x1344 bytes) 2024-09-14T06:00:37.542 INFO:teuthology.orchestra.run.smithi006.stdout:5492 punch from 0x103f029 to 0x10498b5, (0xa88c bytes) 2024-09-14T06:00:37.542 INFO:teuthology.orchestra.run.smithi006.stdout:5493 punch from 0x21d2ede to 0x21d568c, (0x27ae bytes) 2024-09-14T06:00:37.542 INFO:teuthology.orchestra.run.smithi006.stdout:5494 read 0x2ad8342 thru 0x2ade7a0 (0x645f bytes) 2024-09-14T06:00:37.551 INFO:teuthology.orchestra.run.smithi006.stdout:5495 trunc from 0x6ffd863 to 0xcefbf5c 2024-09-14T06:00:37.559 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:37.557+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:5496 punch from 0x71eb052 to 0x71f4893, (0x9841 bytes) 2024-09-14T06:00:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:5501 punch from 0x60f5dc3 to 0x60f94a2, (0x36df bytes) 2024-09-14T06:00:37.564 INFO:teuthology.orchestra.run.smithi006.stdout:5502 trunc from 0xcefbf5c to 0xde2b691 2024-09-14T06:00:37.576 INFO:teuthology.orchestra.run.smithi006.stdout:5503 write 0x2287c91 thru 0x228f26d (0x75dd bytes) 2024-09-14T06:00:37.583 INFO:teuthology.orchestra.run.smithi006.stdout:5504 read 0x4bc904e thru 0x4bd757e (0xe531 bytes) 2024-09-14T06:00:37.583 INFO:teuthology.orchestra.run.smithi006.stdout:5505 write 0x2c920e6 thru 0x2c9602b (0x3f46 bytes) 2024-09-14T06:00:37.589 INFO:teuthology.orchestra.run.smithi006.stdout:5506 read 0x58fdb93 thru 0x590072d (0x2b9b bytes) 2024-09-14T06:00:37.593 INFO:teuthology.orchestra.run.smithi006.stdout:5507 trunc from 0xde2b691 to 0xbf35f65 2024-09-14T06:00:37.604 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:37.604 INFO:teuthology.orchestra.run.smithi006.stdout:5509 write 0x16ced78 thru 0x16dcaea (0xdd73 bytes) 2024-09-14T06:00:37.629 INFO:teuthology.orchestra.run.smithi006.stdout:5510 writesame 0xd9e06cd thru 0xd9ee854 data_size 0xe(0xe188 bytes) 2024-09-14T06:00:37.629 INFO:teuthology.orchestra.run.smithi006.stdout:5511 punch from 0x11008fa to 0x1102f64, (0x266a bytes) 2024-09-14T06:00:37.641 INFO:teuthology.orchestra.run.smithi006.stdout:5512 trunc from 0xd9ee855 to 0x7ee0062 2024-09-14T06:00:37.654 INFO:teuthology.orchestra.run.smithi006.stdout:5513 writesame 0x14902a9 thru 0x1493778 data_size 0x50(0x34d0 bytes) 2024-09-14T06:00:37.660 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:37.655+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:37.669 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:37.669 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:37.669 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:37.670 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:37.670 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:37.683 INFO:teuthology.orchestra.run.smithi006.stdout:5514 write 0xe9cdc7b thru 0xe9d3fe4 (0x636a bytes) 2024-09-14T06:00:37.686 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:00:37.692 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:00:37.693 INFO:teuthology.orchestra.run.smithi006.stdout:5516 writesame 0x8018c72 thru 0x801d458 data_size 0x1(0x47e7 bytes) 2024-09-14T06:00:37.718 INFO:teuthology.orchestra.run.smithi006.stdout:5519 writesame 0x4a9c583 thru 0x4aa99ce data_size 0x2a(0xd44c bytes) 2024-09-14T06:00:37.723 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T06:00:37.724 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T06:00:37.737 INFO:teuthology.orchestra.run.smithi006.stdout:5522 write 0xe336db8 thru 0xe338341 (0x158a bytes) 2024-09-14T06:00:37.745 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:37.745 INFO:teuthology.orchestra.run.smithi006.stdout:5525 write 0x5df1e0f thru 0x5dfb093 (0x9285 bytes) 2024-09-14T06:00:37.754 INFO:teuthology.orchestra.run.smithi006.stdout:5526 punch from 0x4549f2e to 0x4550b2c, (0x6bfe bytes) 2024-09-14T06:00:37.754 INFO:teuthology.orchestra.run.smithi006.stdout:5527 punch from 0x50ef15d to 0x50fdfee, (0xee91 bytes) 2024-09-14T06:00:37.754 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:37.754 INFO:teuthology.orchestra.run.smithi006.stdout:5532 write 0xbbaa12e thru 0xbbb8832 (0xe705 bytes) 2024-09-14T06:00:37.760 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:37.755+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:37.761 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T06:00:37.767 INFO:teuthology.orchestra.run.smithi006.stdout:5533 read 0xa277b41 thru 0xa279ed3 (0x2393 bytes) 2024-09-14T06:00:37.767 INFO:teuthology.orchestra.run.smithi006.stdout:5535 punch from 0x4e5dd01 to 0x4e60bbe, (0x2ebd bytes) 2024-09-14T06:00:37.767 INFO:teuthology.orchestra.run.smithi006.stdout:5537 punch from 0xd2e8dbf to 0xd2ecd10, (0x3f51 bytes) 2024-09-14T06:00:37.767 INFO:teuthology.orchestra.run.smithi006.stdout:5538 read 0xc495924 thru 0xc498109 (0x27e6 bytes) 2024-09-14T06:00:37.767 INFO:teuthology.orchestra.run.smithi006.stdout:5539 read 0x5a8c975 thru 0x5a8ea34 (0x20c0 bytes) 2024-09-14T06:00:37.770 INFO:teuthology.orchestra.run.smithi006.stdout:5540 trunc from 0xe9d3fe5 to 0xc6d36f3 2024-09-14T06:00:37.792 INFO:teuthology.orchestra.run.smithi006.stdout:5541 punch from 0x6d631f2 to 0x6d69d37, (0x6b45 bytes) 2024-09-14T06:00:37.792 INFO:teuthology.orchestra.run.smithi006.stdout:5542 write 0x673a3de thru 0x6742c2a (0x884d bytes) 2024-09-14T06:00:37.804 INFO:teuthology.orchestra.run.smithi006.stdout:5543 read 0x73418f thru 0x734852 (0x6c4 bytes) 2024-09-14T06:00:37.805 INFO:teuthology.orchestra.run.smithi006.stdout:5545 write 0x6535310 thru 0x653a51c (0x520d bytes) 2024-09-14T06:00:37.809 INFO:teuthology.orchestra.run.smithi006.stdout:5546 write 0x566835d thru 0x56747e0 (0xc484 bytes) 2024-09-14T06:00:37.824 INFO:teuthology.orchestra.run.smithi006.stdout:5548 read 0x6547f7 thru 0x6637b1 (0xefbb bytes) 2024-09-14T06:00:37.841 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:37.842 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:00:37.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:00:37.842 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:37.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.842 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114446 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.842 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088608+0000", 2024-09-14T06:00:37.842 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75108404399999995, 2024-09-14T06:00:37.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046013902000000002, 2024-09-14T06:00:37.842 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.842 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114446 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088608+0000", 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.843 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088608+0000", 2024-09-14T06:00:37.844 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.844 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.844 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088609+0000", 2024-09-14T06:00:37.845 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8400000000000005e-07 2024-09-14T06:00:37.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.845 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.845 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.845 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088612+0000", 2024-09-14T06:00:37.845 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.796e-06 2024-09-14T06:00:37.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.845 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.845 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.845 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088621+0000", 2024-09-14T06:00:37.845 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9619999999999999e-06 2024-09-14T06:00:37.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.846 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.846 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088626+0000", 2024-09-14T06:00:37.846 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.643e-06 2024-09-14T06:00:37.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.846 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.846 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134616+0000", 2024-09-14T06:00:37.846 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045989531 2024-09-14T06:00:37.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.846 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.846 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134622+0000", 2024-09-14T06:00:37.846 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4860000000000002e-06 2024-09-14T06:00:37.847 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.847 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.847 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.848 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114447 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.848 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088635+0000", 2024-09-14T06:00:37.848 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75105774700000005, 2024-09-14T06:00:37.848 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046018501000000003, 2024-09-14T06:00:37.848 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.848 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.848 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.849 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.849 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.849 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.849 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114447 2024-09-14T06:00:37.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.849 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.849 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088635+0000", 2024-09-14T06:00:37.849 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.850 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088635+0000", 2024-09-14T06:00:37.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.850 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.850 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088635+0000", 2024-09-14T06:00:37.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5200000000000002e-07 2024-09-14T06:00:37.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.850 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.850 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088638+0000", 2024-09-14T06:00:37.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5469999999999999e-06 2024-09-14T06:00:37.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.851 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088647+0000", 2024-09-14T06:00:37.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.952e-06 2024-09-14T06:00:37.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.851 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088653+0000", 2024-09-14T06:00:37.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9479999999999996e-06 2024-09-14T06:00:37.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.852 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.852 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134646+0000", 2024-09-14T06:00:37.852 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045993648999999998 2024-09-14T06:00:37.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.852 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.852 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134653+0000", 2024-09-14T06:00:37.852 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9530000000000002e-06 2024-09-14T06:00:37.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.852 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.853 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114448 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.853 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088662+0000", 2024-09-14T06:00:37.853 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75103019599999998, 2024-09-14T06:00:37.853 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046021289, 2024-09-14T06:00:37.853 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.853 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.853 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.853 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.854 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.854 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114448 2024-09-14T06:00:37.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.854 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.854 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.854 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088662+0000", 2024-09-14T06:00:37.854 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.854 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.854 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088662+0000", 2024-09-14T06:00:37.854 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088663+0000", 2024-09-14T06:00:37.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8999999999999997e-07 2024-09-14T06:00:37.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088665+0000", 2024-09-14T06:00:37.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4399999999999999e-06 2024-09-14T06:00:37.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088674+0000", 2024-09-14T06:00:37.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4970000000000001e-06 2024-09-14T06:00:37.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088679+0000", 2024-09-14T06:00:37.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7379999999999999e-06 2024-09-14T06:00:37.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134676+0000", 2024-09-14T06:00:37.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045996713000000002 2024-09-14T06:00:37.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134684+0000", 2024-09-14T06:00:37.857 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4109999999999999e-06 2024-09-14T06:00:37.857 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.857 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.857 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.857 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114449 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.857 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088688+0000", 2024-09-14T06:00:37.857 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75100475200000005, 2024-09-14T06:00:37.857 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046025990000000003, 2024-09-14T06:00:37.857 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.857 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.857 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.857 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.858 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.858 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.858 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114449 2024-09-14T06:00:37.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.858 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.858 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.858 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088688+0000", 2024-09-14T06:00:37.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.858 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.858 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088688+0000", 2024-09-14T06:00:37.859 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.859 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.859 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088688+0000", 2024-09-14T06:00:37.859 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9099999999999999e-07 2024-09-14T06:00:37.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.859 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.859 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088696+0000", 2024-09-14T06:00:37.859 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5050000000000001e-06 2024-09-14T06:00:37.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.859 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088708+0000", 2024-09-14T06:00:37.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2577e-05 2024-09-14T06:00:37.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088714+0000", 2024-09-14T06:00:37.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2310000000000001e-06 2024-09-14T06:00:37.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134707+0000", 2024-09-14T06:00:37.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045992356999999998 2024-09-14T06:00:37.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.861 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134714+0000", 2024-09-14T06:00:37.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9290000000000001e-06 2024-09-14T06:00:37.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.861 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.861 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114562 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.861 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088725+0000", 2024-09-14T06:00:37.861 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75096767200000003, 2024-09-14T06:00:37.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046015292999999999, 2024-09-14T06:00:37.861 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.862 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.862 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.862 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.862 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.862 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114562 2024-09-14T06:00:37.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.862 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.862 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.862 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088725+0000", 2024-09-14T06:00:37.862 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088725+0000", 2024-09-14T06:00:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088725+0000", 2024-09-14T06:00:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5599999999999995e-07 2024-09-14T06:00:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088728+0000", 2024-09-14T06:00:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.959e-06 2024-09-14T06:00:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.864 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088736+0000", 2024-09-14T06:00:37.864 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6410000000000002e-06 2024-09-14T06:00:37.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.864 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088741+0000", 2024-09-14T06:00:37.864 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2630000000000003e-06 2024-09-14T06:00:37.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.864 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134734+0000", 2024-09-14T06:00:37.864 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.045992369999999998 2024-09-14T06:00:37.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.865 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134740+0000", 2024-09-14T06:00:37.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5039999999999999e-06 2024-09-14T06:00:37.865 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.865 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.865 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.865 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114563 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.865 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088747+0000", 2024-09-14T06:00:37.865 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75094549799999999, 2024-09-14T06:00:37.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046022304, 2024-09-14T06:00:37.866 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.866 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.866 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.866 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.866 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.866 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.866 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114563 2024-09-14T06:00:37.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.866 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088747+0000", 2024-09-14T06:00:37.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088747+0000", 2024-09-14T06:00:37.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088747+0000", 2024-09-14T06:00:37.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.53e-07 2024-09-14T06:00:37.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088749+0000", 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8509999999999999e-06 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088756+0000", 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9539999999999998e-06 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088761+0000", 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.13e-06 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.868 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134762+0000", 2024-09-14T06:00:37.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046001141000000002 2024-09-14T06:00:37.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.869 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134769+0000", 2024-09-14T06:00:37.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9750000000000001e-06 2024-09-14T06:00:37.869 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.869 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.869 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.869 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114564 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.869 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088768+0000", 2024-09-14T06:00:37.870 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75092406899999997, 2024-09-14T06:00:37.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046032348000000001, 2024-09-14T06:00:37.870 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.870 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.870 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.870 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.870 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.870 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.870 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114564 2024-09-14T06:00:37.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.870 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088768+0000", 2024-09-14T06:00:37.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.871 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.871 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088768+0000", 2024-09-14T06:00:37.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.871 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.871 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088769+0000", 2024-09-14T06:00:37.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7500000000000001e-07 2024-09-14T06:00:37.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.871 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088771+0000", 2024-09-14T06:00:37.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3190000000000002e-06 2024-09-14T06:00:37.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088778+0000", 2024-09-14T06:00:37.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3289999999999996e-06 2024-09-14T06:00:37.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088783+0000", 2024-09-14T06:00:37.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3069999999999996e-06 2024-09-14T06:00:37.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.873 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.873 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134795+0000", 2024-09-14T06:00:37.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046012194999999999 2024-09-14T06:00:37.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.873 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.873 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134801+0000", 2024-09-14T06:00:37.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.823e-06 2024-09-14T06:00:37.873 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.873 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.873 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114565 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088788+0000", 2024-09-14T06:00:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75090441299999999, 2024-09-14T06:00:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046043504999999998, 2024-09-14T06:00:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114565 2024-09-14T06:00:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.874 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088788+0000", 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088788+0000", 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088788+0000", 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3300000000000003e-07 2024-09-14T06:00:37.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088791+0000", 2024-09-14T06:00:37.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4789999999999999e-06 2024-09-14T06:00:37.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088800+0000", 2024-09-14T06:00:37.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.738e-06 2024-09-14T06:00:37.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088803+0000", 2024-09-14T06:00:37.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4020000000000002e-06 2024-09-14T06:00:37.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134825+0000", 2024-09-14T06:00:37.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046021411999999998 2024-09-14T06:00:37.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134832+0000", 2024-09-14T06:00:37.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.041e-06 2024-09-14T06:00:37.877 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.877 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.877 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114566 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088808+0000", 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.750884412, 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046054746000000001, 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114566 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088808+0000", 2024-09-14T06:00:37.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088808+0000", 2024-09-14T06:00:37.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088808+0000", 2024-09-14T06:00:37.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8299999999999998e-07 2024-09-14T06:00:37.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.880 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.880 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088811+0000", 2024-09-14T06:00:37.880 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1900000000000002e-06 2024-09-14T06:00:37.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.880 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.880 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088817+0000", 2024-09-14T06:00:37.880 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6279999999999999e-06 2024-09-14T06:00:37.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.880 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.880 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088823+0000", 2024-09-14T06:00:37.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3360000000000002e-06 2024-09-14T06:00:37.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134854+0000", 2024-09-14T06:00:37.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046031755000000001 2024-09-14T06:00:37.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134863+0000", 2024-09-14T06:00:37.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4540000000000007e-06 2024-09-14T06:00:37.881 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.881 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.882 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.882 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114567 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.882 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088832+0000", 2024-09-14T06:00:37.882 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75086021000000003, 2024-09-14T06:00:37.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046064458000000003, 2024-09-14T06:00:37.882 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.882 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.882 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.882 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.882 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.882 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.882 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114567 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088832+0000", 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088832+0000", 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.883 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088833+0000", 2024-09-14T06:00:37.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9900000000000001e-07 2024-09-14T06:00:37.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088835+0000", 2024-09-14T06:00:37.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.413e-06 2024-09-14T06:00:37.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088844+0000", 2024-09-14T06:00:37.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3850000000000008e-06 2024-09-14T06:00:37.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.885 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088851+0000", 2024-09-14T06:00:37.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4330000000000001e-06 2024-09-14T06:00:37.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.885 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.885 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134889+0000", 2024-09-14T06:00:37.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046038093000000002 2024-09-14T06:00:37.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.885 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.885 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134897+0000", 2024-09-14T06:00:37.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7349999999999996e-06 2024-09-14T06:00:37.885 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.885 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114568 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088859+0000", 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.750833262, 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046073322, 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114568 2024-09-14T06:00:37.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088859+0000", 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088859+0000", 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088860+0000", 2024-09-14T06:00:37.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.63e-07 2024-09-14T06:00:37.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088862+0000", 2024-09-14T06:00:37.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5069999999999999e-06 2024-09-14T06:00:37.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088872+0000", 2024-09-14T06:00:37.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3519999999999996e-06 2024-09-14T06:00:37.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.889 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088877+0000", 2024-09-14T06:00:37.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9089999999999997e-06 2024-09-14T06:00:37.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.889 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.889 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134923+0000", 2024-09-14T06:00:37.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046045744 2024-09-14T06:00:37.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.889 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.889 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134933+0000", 2024-09-14T06:00:37.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3470000000000005e-06 2024-09-14T06:00:37.889 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.889 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.890 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.890 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114569 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.890 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088887+0000", 2024-09-14T06:00:37.890 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75080561400000001, 2024-09-14T06:00:37.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046078863999999997, 2024-09-14T06:00:37.890 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.890 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.890 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.890 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.890 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.890 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.890 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114569 2024-09-14T06:00:37.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.891 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088887+0000", 2024-09-14T06:00:37.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088887+0000", 2024-09-14T06:00:37.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088887+0000", 2024-09-14T06:00:37.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0200000000000002e-07 2024-09-14T06:00:37.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088890+0000", 2024-09-14T06:00:37.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7949999999999999e-06 2024-09-14T06:00:37.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088900+0000", 2024-09-14T06:00:37.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7589999999999992e-06 2024-09-14T06:00:37.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088906+0000", 2024-09-14T06:00:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6890000000000001e-06 2024-09-14T06:00:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134958+0000", 2024-09-14T06:00:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046052615999999998 2024-09-14T06:00:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134966+0000", 2024-09-14T06:00:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.503e-06 2024-09-14T06:00:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114570 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088914+0000", 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75077823799999999, 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046084852000000003, 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114570 2024-09-14T06:00:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088914+0000", 2024-09-14T06:00:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088914+0000", 2024-09-14T06:00:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088915+0000", 2024-09-14T06:00:37.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4000000000000002e-07 2024-09-14T06:00:37.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088918+0000", 2024-09-14T06:00:37.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9500000000000001e-06 2024-09-14T06:00:37.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088927+0000", 2024-09-14T06:00:37.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680000000000005e-06 2024-09-14T06:00:37.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088933+0000", 2024-09-14T06:00:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9460000000000003e-06 2024-09-14T06:00:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134991+0000", 2024-09-14T06:00:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046058114999999997 2024-09-14T06:00:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.134999+0000", 2024-09-14T06:00:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7330000000000003e-06 2024-09-14T06:00:37.898 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.898 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.898 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.898 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114571 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.898 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088942+0000", 2024-09-14T06:00:37.898 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75075035300000004, 2024-09-14T06:00:37.898 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046077927999999997, 2024-09-14T06:00:37.898 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.898 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.898 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.898 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.899 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.899 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.899 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114571 2024-09-14T06:00:37.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.899 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088942+0000", 2024-09-14T06:00:37.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088942+0000", 2024-09-14T06:00:37.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088943+0000", 2024-09-14T06:00:37.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4199999999999996e-07 2024-09-14T06:00:37.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088945+0000", 2024-09-14T06:00:37.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6589999999999999e-06 2024-09-14T06:00:37.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088951+0000", 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0950000000000001e-06 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088957+0000", 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8470000000000001e-06 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.135016+0000", 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046059107000000002 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.135020+0000", 2024-09-14T06:00:37.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6780000000000002e-06 2024-09-14T06:00:37.902 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.902 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.902 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.902 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114572 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.902 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088965+0000", 2024-09-14T06:00:37.902 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75072765900000005, 2024-09-14T06:00:37.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046082472999999999, 2024-09-14T06:00:37.902 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.902 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.902 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.902 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.903 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.903 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.903 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114572 2024-09-14T06:00:37.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.903 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088965+0000", 2024-09-14T06:00:37.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088965+0000", 2024-09-14T06:00:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088965+0000", 2024-09-14T06:00:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1e-07 2024-09-14T06:00:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088967+0000", 2024-09-14T06:00:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5880000000000001e-06 2024-09-14T06:00:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088972+0000", 2024-09-14T06:00:37.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.524e-06 2024-09-14T06:00:37.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088976+0000", 2024-09-14T06:00:37.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2789999999999999e-06 2024-09-14T06:00:37.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.135041+0000", 2024-09-14T06:00:37.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046065270999999998 2024-09-14T06:00:37.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.906 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.906 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.135047+0000", 2024-09-14T06:00:37.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5010000000000001e-06 2024-09-14T06:00:37.906 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.906 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.906 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.906 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114573 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.906 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.088979+0000", 2024-09-14T06:00:37.906 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75071304599999999, 2024-09-14T06:00:37.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046118330999999999, 2024-09-14T06:00:37.906 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114573 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088979+0000", 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088979+0000", 2024-09-14T06:00:37.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088980+0000", 2024-09-14T06:00:37.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4999999999999999e-07 2024-09-14T06:00:37.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088986+0000", 2024-09-14T06:00:37.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9109999999999998e-06 2024-09-14T06:00:37.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088991+0000", 2024-09-14T06:00:37.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3669999999999996e-06 2024-09-14T06:00:37.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.088995+0000", 2024-09-14T06:00:37.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1359999999999999e-06 2024-09-14T06:00:37.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.135090+0000", 2024-09-14T06:00:37.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046094690000000001 2024-09-14T06:00:37.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.135098+0000", 2024-09-14T06:00:37.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.977e-06 2024-09-14T06:00:37.910 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.910 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.910 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.910 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114574 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.910 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.089003+0000", 2024-09-14T06:00:37.910 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75068984699999997, 2024-09-14T06:00:37.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046124898999999997, 2024-09-14T06:00:37.911 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.911 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.911 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.911 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.911 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.911 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.911 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114574 2024-09-14T06:00:37.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.911 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089003+0000", 2024-09-14T06:00:37.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089003+0000", 2024-09-14T06:00:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089003+0000", 2024-09-14T06:00:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3099999999999998e-07 2024-09-14T06:00:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089006+0000", 2024-09-14T06:00:37.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.65e-06 2024-09-14T06:00:37.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089010+0000", 2024-09-14T06:00:37.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3209999999999998e-06 2024-09-14T06:00:37.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089013+0000", 2024-09-14T06:00:37.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.005e-06 2024-09-14T06:00:37.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.135121+0000", 2024-09-14T06:00:37.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046107859000000001 2024-09-14T06:00:37.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.135128+0000", 2024-09-14T06:00:37.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6329999999999999e-06 2024-09-14T06:00:37.914 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.914 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.914 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.914 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114575 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.914 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.089017+0000", 2024-09-14T06:00:37.915 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75067525000000002, 2024-09-14T06:00:37.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046139379000000001, 2024-09-14T06:00:37.915 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.915 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.915 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.915 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.915 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.915 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.915 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114575 2024-09-14T06:00:37.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.915 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089017+0000", 2024-09-14T06:00:37.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089017+0000", 2024-09-14T06:00:37.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089017+0000", 2024-09-14T06:00:37.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4600000000000001e-07 2024-09-14T06:00:37.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089019+0000", 2024-09-14T06:00:37.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.184e-06 2024-09-14T06:00:37.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089022+0000", 2024-09-14T06:00:37.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.698e-06 2024-09-14T06:00:37.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089025+0000", 2024-09-14T06:00:37.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.931e-06 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.135150+0000", 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046124271000000001 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.135157+0000", 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0489999999999998e-06 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.919 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114576 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.919 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.089032+0000", 2024-09-14T06:00:37.919 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75066032599999999, 2024-09-14T06:00:37.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046153507000000003, 2024-09-14T06:00:37.919 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.919 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.919 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.919 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.919 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.919 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.919 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114576 2024-09-14T06:00:37.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.919 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089032+0000", 2024-09-14T06:00:37.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089032+0000", 2024-09-14T06:00:37.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089033+0000", 2024-09-14T06:00:37.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089035+0000", 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2180000000000002e-06 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089041+0000", 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4969999999999998e-06 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089044+0000", 2024-09-14T06:00:37.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2389999999999998e-06 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.135178+0000", 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046133908000000001 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.135186+0000", 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2350000000000002e-06 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.923 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114577 3.6 3.5cfbf186 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:37.923 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.089049+0000", 2024-09-14T06:00:37.923 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.75064344599999999, 2024-09-14T06:00:37.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046166995000000002, 2024-09-14T06:00:37.923 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:37.923 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:37.923 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:00:37.923 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:37.923 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:37.923 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:37.923 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114577 2024-09-14T06:00:37.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.923 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:37.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:37.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089049+0000", 2024-09-14T06:00:37.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:37.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089049+0000", 2024-09-14T06:00:37.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:37.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:37.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089049+0000", 2024-09-14T06:00:37.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7e-07 2024-09-14T06:00:37.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089051+0000", 2024-09-14T06:00:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9470000000000002e-06 2024-09-14T06:00:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089060+0000", 2024-09-14T06:00:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.772e-06 2024-09-14T06:00:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.089063+0000", 2024-09-14T06:00:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1810000000000001e-06 2024-09-14T06:00:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.135209+0000", 2024-09-14T06:00:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.046145723999999999 2024-09-14T06:00:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.135216+0000", 2024-09-14T06:00:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0010000000000004e-06 2024-09-14T06:00:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:37.927 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:37.927 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:37.928 INFO:teuthology.orchestra.run.smithi006.stdout:5549 trunc from 0xc6d36f3 to 0xf7535 2024-09-14T06:00:37.928 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:37.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:00:37.929 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:37.930 INFO:teuthology.orchestra.run.smithi006.stdout:5550 read 0x79237 thru 0x7f68c (0x6456 bytes) 2024-09-14T06:00:37.930 INFO:teuthology.orchestra.run.smithi006.stdout:5551 punch from 0x576e8 to 0x639c5, (0xc2dd bytes) 2024-09-14T06:00:37.930 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:37.930 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:37.931 INFO:teuthology.orchestra.run.smithi006.stdout:5553 write 0xb767a2d thru 0xb775199 (0xd76d bytes) 2024-09-14T06:00:37.931 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:37.931 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:37.925+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:37.934 INFO:teuthology.orchestra.run.smithi006.stdout:5554 writesame 0x49d1ea4 thru 0x49de8b3 data_size 0x10(0xca10 bytes) 2024-09-14T06:00:37.944 INFO:teuthology.orchestra.run.smithi006.stdout:5556 read 0x662a056 thru 0x662e836 (0x47e1 bytes) 2024-09-14T06:00:37.945 INFO:teuthology.orchestra.run.smithi006.stdout:5557 trunc from 0xb77519a to 0xba5a454 2024-09-14T06:00:37.952 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:37.953 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:37.958 INFO:teuthology.orchestra.run.smithi006.stdout:5559 punch from 0x22b15d9 to 0x22bd95c, (0xc383 bytes) 2024-09-14T06:00:37.965 INFO:teuthology.orchestra.run.smithi006.stdout:5560 trunc from 0xba5a454 to 0x7561418 2024-09-14T06:00:37.985 INFO:teuthology.orchestra.run.smithi006.stdout:5562 writesame 0x16f2bb0 thru 0x16fb836 data_size 0x5(0x8c87 bytes) 2024-09-14T06:00:37.993 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:37.995 INFO:teuthology.orchestra.run.smithi006.stdout:5563 writesame 0x3ae1dd thru 0x3b2b3c data_size 0x10(0x4960 bytes) 2024-09-14T06:00:38.005 INFO:teuthology.orchestra.run.smithi006.stdout:5564 trunc from 0x7561418 to 0x3af2f3e 2024-09-14T06:00:38.029 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:38.022+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:38.029 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:38.030 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:38.046 INFO:teuthology.orchestra.run.smithi006.stdout:5565 write 0x993086a thru 0x9930b93 (0x32a bytes) 2024-09-14T06:00:38.050 INFO:teuthology.orchestra.run.smithi006.stdout:5566 punch from 0x8787af6 to 0x8790c54, (0x915e bytes) 2024-09-14T06:00:38.053 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:38.053 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:38.054 INFO:teuthology.orchestra.run.smithi006.stdout:5567 trunc from 0x9930b94 to 0x700ddb1 2024-09-14T06:00:38.076 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:38.076 INFO:teuthology.orchestra.run.smithi006.stdout:5568 read 0x3dc536d thru 0x3dcd4b5 (0x8149 bytes) 2024-09-14T06:00:38.077 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:38.077 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.077 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.077 INFO:teuthology.orchestra.run.smithi006.stdout:5571 writesame 0x1862171 thru 0x186edbd data_size 0x1(0xcc4d bytes) 2024-09-14T06:00:38.083 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:38.083 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:38.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:00:38.110 INFO:teuthology.orchestra.run.smithi006.stdout:5572 punch from 0x3c92d3c to 0x3c952a5, (0x2569 bytes) 2024-09-14T06:00:38.110 INFO:teuthology.orchestra.run.smithi006.stdout:5573 write 0x4f0de2e thru 0x4f18b8f (0xad62 bytes) 2024-09-14T06:00:38.122 INFO:teuthology.orchestra.run.smithi006.stdout:5575 punch from 0x2e63dda to 0x2e71c18, (0xde3e bytes) 2024-09-14T06:00:38.122 INFO:teuthology.orchestra.run.smithi006.stdout:5577 punch from 0x77014d to 0x7733e4, (0x3297 bytes) 2024-09-14T06:00:38.122 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.122 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.122 INFO:teuthology.orchestra.run.smithi006.stdout:5581 read 0x59e6dfb thru 0x59ebff7 (0x51fd bytes) 2024-09-14T06:00:38.122 INFO:teuthology.orchestra.run.smithi006.stdout:5582 punch from 0x2732cc4 to 0x2738d97, (0x60d3 bytes) 2024-09-14T06:00:38.122 INFO:teuthology.orchestra.run.smithi006.stdout:5583 punch from 0xb162c9 to 0xb1a70a, (0x4441 bytes) 2024-09-14T06:00:38.122 INFO:teuthology.orchestra.run.smithi006.stdout:5584 writesame 0x2d88890 thru 0x2d9020f data_size 0x60(0x7980 bytes) 2024-09-14T06:00:38.129 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:38.125+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:38.133 INFO:teuthology.orchestra.run.smithi006.stdout:5585 trunc from 0x700ddb1 to 0x850c48f 2024-09-14T06:00:38.146 INFO:teuthology.orchestra.run.smithi006.stdout:5586 trunc from 0x850c48f to 0x91a4432 2024-09-14T06:00:38.161 INFO:teuthology.orchestra.run.smithi006.stdout:5587 trunc from 0x91a4432 to 0x5f25b6b 2024-09-14T06:00:38.176 INFO:teuthology.orchestra.run.smithi006.stdout:5588 trunc from 0x5f25b6b to 0x3547b53 2024-09-14T06:00:38.215 INFO:teuthology.orchestra.run.smithi006.stdout:5589 writesame 0x9853d47 thru 0x985fba7 data_size 0xd(0xbe61 bytes) 2024-09-14T06:00:38.219 INFO:teuthology.orchestra.run.smithi006.stdout:5590 trunc from 0x985fba8 to 0xbe1151a 2024-09-14T06:00:38.231 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:38.226+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:38.231 INFO:teuthology.orchestra.run.smithi006.stdout:5595 punch from 0x693d10a to 0x69421e7, (0x50dd bytes) 2024-09-14T06:00:38.231 INFO:teuthology.orchestra.run.smithi006.stdout:5598 read 0x1167096 thru 0x116994f (0x28ba bytes) 2024-09-14T06:00:38.232 INFO:teuthology.orchestra.run.smithi006.stdout:5599 write 0x8ab121e thru 0x8ab6249 (0x502c bytes) 2024-09-14T06:00:38.239 INFO:teuthology.orchestra.run.smithi006.stdout:5600 punch from 0x20e07c4 to 0x20e6264, (0x5aa0 bytes) 2024-09-14T06:00:38.239 INFO:teuthology.orchestra.run.smithi006.stdout:5601 write 0x82f32bd thru 0x82f40ee (0xe32 bytes) 2024-09-14T06:00:38.246 INFO:teuthology.orchestra.run.smithi006.stdout:5602 write 0x5f41e7e thru 0x5f4f60c (0xd78f bytes) 2024-09-14T06:00:38.256 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:38.256 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:38.260 INFO:teuthology.orchestra.run.smithi006.stdout:5603 write 0x87a5b61 thru 0x87b20b2 (0xc552 bytes) 2024-09-14T06:00:38.268 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.268 INFO:teuthology.orchestra.run.smithi006.stdout:5606 write 0x1380107 thru 0x1381cdf (0x1bd9 bytes) 2024-09-14T06:00:38.271 INFO:teuthology.orchestra.run.smithi006.stdout:5608 punch from 0x71f6c61 to 0x71fc563, (0x5902 bytes) 2024-09-14T06:00:38.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:00:38.287 INFO:teuthology.orchestra.run.smithi006.stdout:5609 trunc from 0xbe1151a to 0x1268ca5 2024-09-14T06:00:38.314 INFO:teuthology.orchestra.run.smithi006.stdout:5610 read 0xdefd9a thru 0xdfc8e5 (0xcb4c bytes) 2024-09-14T06:00:38.322 INFO:teuthology.orchestra.run.smithi006.stdout:5611 trunc from 0x1268ca5 to 0x5d9f410 2024-09-14T06:00:38.332 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:38.329+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:38.332 INFO:teuthology.orchestra.run.smithi006.stdout:5612 read 0x2d4b3e3 thru 0x2d52a18 (0x7636 bytes) 2024-09-14T06:00:38.332 INFO:teuthology.orchestra.run.smithi006.stdout:5613 punch from 0x3eddcc0 to 0x3eea192, (0xc4d2 bytes) 2024-09-14T06:00:38.348 INFO:teuthology.orchestra.run.smithi006.stdout:5614 writesame 0x8ba7189 thru 0x8bad811 data_size 0x1(0x6689 bytes) 2024-09-14T06:00:38.348 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.348 INFO:teuthology.orchestra.run.smithi006.stdout:5616 write 0x43c266 thru 0x443144 (0x6edf bytes) 2024-09-14T06:00:38.352 INFO:teuthology.orchestra.run.smithi006.stdout:5617 writesame 0x3518db1 thru 0x351eb6c data_size 0x2(0x5dbc bytes) 2024-09-14T06:00:38.362 INFO:teuthology.orchestra.run.smithi006.stdout:5618 writesame 0x366e88a thru 0x367463f data_size 0x5(0x5db6 bytes) 2024-09-14T06:00:38.371 INFO:teuthology.orchestra.run.smithi006.stdout:5619 punch from 0x3f5b8e0 to 0x3f616a1, (0x5dc1 bytes) 2024-09-14T06:00:38.377 INFO:teuthology.orchestra.run.smithi006.stdout:5623 trunc from 0x8bad812 to 0xcbf9d89 2024-09-14T06:00:38.391 INFO:teuthology.orchestra.run.smithi006.stdout:5624 write 0x8e0b327 thru 0x8e0c0f6 (0xdd0 bytes) 2024-09-14T06:00:38.397 INFO:teuthology.orchestra.run.smithi006.stdout:5625 write 0x209ee0f thru 0x20a5577 (0x6769 bytes) 2024-09-14T06:00:38.408 INFO:teuthology.orchestra.run.smithi006.stdout:5626 read 0x451bc7a thru 0x451db5d (0x1ee4 bytes) 2024-09-14T06:00:38.408 INFO:teuthology.orchestra.run.smithi006.stdout:5627 read 0x3333f69 thru 0x333743f (0x34d7 bytes) 2024-09-14T06:00:38.409 INFO:teuthology.orchestra.run.smithi006.stdout:5628 read 0x43c3d90 thru 0x43c4f60 (0x11d1 bytes) 2024-09-14T06:00:38.409 INFO:teuthology.orchestra.run.smithi006.stdout:5629 write 0x4c6759b thru 0x4c749bd (0xd423 bytes) 2024-09-14T06:00:38.422 INFO:teuthology.orchestra.run.smithi006.stdout:5631 punch from 0x9a29761 to 0x9a31362, (0x7c01 bytes) 2024-09-14T06:00:38.422 INFO:teuthology.orchestra.run.smithi006.stdout:5632 read 0x18c697f thru 0x18cafb7 (0x4639 bytes) 2024-09-14T06:00:38.424 INFO:teuthology.orchestra.run.smithi006.stdout:5634 trunc from 0xcbf9d89 to 0xbe59e8b 2024-09-14T06:00:38.430 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:38.430 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:38.432 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:38.429+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:38.436 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.437 INFO:teuthology.orchestra.run.smithi006.stdout:5636 trunc from 0xbe59e8b to 0xb6d78e6 2024-09-14T06:00:38.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:00:38.450 INFO:teuthology.orchestra.run.smithi006.stdout:5637 punch from 0x7cc1637 to 0x7cd0fbd, (0xf986 bytes) 2024-09-14T06:00:38.451 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.451 INFO:teuthology.orchestra.run.smithi006.stdout:5639 read 0x4390a65 thru 0x4391703 (0xc9f bytes) 2024-09-14T06:00:38.451 INFO:teuthology.orchestra.run.smithi006.stdout:5640 punch from 0xb1335e9 to 0xb13ff71, (0xc988 bytes) 2024-09-14T06:00:38.451 INFO:teuthology.orchestra.run.smithi006.stdout:5643 read 0x6b2fbbd thru 0x6b3a755 (0xab99 bytes) 2024-09-14T06:00:38.451 INFO:teuthology.orchestra.run.smithi006.stdout:5644 write 0x49ca18f thru 0x49d8ad6 (0xe948 bytes) 2024-09-14T06:00:38.457 INFO:teuthology.orchestra.run.smithi006.stdout:5645 read 0x46eaca4 thru 0x46f4a18 (0x9d75 bytes) 2024-09-14T06:00:38.458 INFO:teuthology.orchestra.run.smithi006.stdout:5646 writesame 0x9b57070 thru 0x9b6266b data_size 0x4(0xb5fc bytes) 2024-09-14T06:00:38.470 INFO:teuthology.orchestra.run.smithi006.stdout:5647 writesame 0x12ee87e thru 0x12fa424 data_size 0x43(0xbba7 bytes) 2024-09-14T06:00:38.477 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.477 INFO:teuthology.orchestra.run.smithi006.stdout:5649 read 0x895ba79 thru 0x896b71a (0xfca2 bytes) 2024-09-14T06:00:38.478 INFO:teuthology.orchestra.run.smithi006.stdout:5652 read 0x29923b8 thru 0x29987a1 (0x63ea bytes) 2024-09-14T06:00:38.478 INFO:teuthology.orchestra.run.smithi006.stdout:5653 punch from 0x33c3f1b to 0x33cc42d, (0x8512 bytes) 2024-09-14T06:00:38.478 INFO:teuthology.orchestra.run.smithi006.stdout:5654 read 0x26144b2 thru 0x261c829 (0x8378 bytes) 2024-09-14T06:00:38.479 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.479 INFO:teuthology.orchestra.run.smithi006.stdout:5656 punch from 0x6a7d563 to 0x6a8c699, (0xf136 bytes) 2024-09-14T06:00:38.479 INFO:teuthology.orchestra.run.smithi006.stdout:5657 read 0xa3d53b4 thru 0xa3dc495 (0x70e2 bytes) 2024-09-14T06:00:38.493 INFO:teuthology.orchestra.run.smithi006.stdout:5658 write 0xd869585 thru 0xd8774f5 (0xdf71 bytes) 2024-09-14T06:00:38.505 INFO:teuthology.orchestra.run.smithi006.stdout:5659 read 0xafcf39f thru 0xafd4ebd (0x5b1f bytes) 2024-09-14T06:00:38.505 INFO:teuthology.orchestra.run.smithi006.stdout:5660 read 0x477ac61 thru 0x4784aa2 (0x9e42 bytes) 2024-09-14T06:00:38.506 INFO:teuthology.orchestra.run.smithi006.stdout:5661 write 0x7e98be6 thru 0x7e9e0aa (0x54c5 bytes) 2024-09-14T06:00:38.513 INFO:teuthology.orchestra.run.smithi006.stdout:5662 read 0xd1824da thru 0xd1830ac (0xbd3 bytes) 2024-09-14T06:00:38.516 INFO:teuthology.orchestra.run.smithi006.stdout:5663 trunc from 0xd8774f6 to 0xc5644d2 2024-09-14T06:00:38.533 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:38.530+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:38.559 INFO:teuthology.orchestra.run.smithi006.stdout:5664 trunc from 0xc5644d2 to 0x225ba17 2024-09-14T06:00:38.582 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:38.582 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:38.593 INFO:teuthology.orchestra.run.smithi006.stdout:5665 punch from 0x13b79a to 0x144be1, (0x9447 bytes) 2024-09-14T06:00:38.593 INFO:teuthology.orchestra.run.smithi006.stdout:5666 write 0xdd0a2b thru 0xdd870b (0x7ce1 bytes) 2024-09-14T06:00:38.596 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:00:38.627 INFO:teuthology.orchestra.run.smithi006.stdout:5667 writesame 0xee66387 thru 0xee6b27f data_size 0x3(0x4ef9 bytes) 2024-09-14T06:00:38.628 INFO:teuthology.orchestra.run.smithi006.stdout:5669 write 0xbad1180 thru 0xbadbaad (0xa92e bytes) 2024-09-14T06:00:38.633 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:38.630+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:38.660 INFO:teuthology.orchestra.run.smithi006.stdout:5674 trunc from 0xee6b280 to 0x19b2764 2024-09-14T06:00:38.708 INFO:teuthology.orchestra.run.smithi006.stdout:5675 write 0x911aaad thru 0x9125e19 (0xb36d bytes) 2024-09-14T06:00:38.717 INFO:teuthology.orchestra.run.smithi006.stdout:5678 read 0x9105f74 thru 0x911508d (0xf11a bytes) 2024-09-14T06:00:38.718 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2024-09-14T06:00:38.722 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T06:00:38.734 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:38.730+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:38.744 INFO:teuthology.orchestra.run.smithi006.stdout:5679 writesame 0xcbaa8d7 thru 0xcbb283e data_size 0x4(0x7f68 bytes) 2024-09-14T06:00:38.745 INFO:teuthology.orchestra.run.smithi006.stdout:5680 read 0xae40c26 thru 0xae4b3cc (0xa7a7 bytes) 2024-09-14T06:00:38.745 INFO:teuthology.orchestra.run.smithi006.stdout:5683 read 0x84f6dc5 thru 0x85038c1 (0xcafd bytes) 2024-09-14T06:00:38.745 INFO:teuthology.orchestra.run.smithi006.stdout:5684 punch from 0xbfc6e53 to 0xbfd4fb3, (0xe160 bytes) 2024-09-14T06:00:38.745 INFO:teuthology.orchestra.run.smithi006.stdout:5685 read 0xbf4af37 thru 0xbf50b99 (0x5c63 bytes) 2024-09-14T06:00:38.745 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.745 INFO:teuthology.orchestra.run.smithi006.stdout:5687 read 0x243f6ff thru 0x244e215 (0xeb17 bytes) 2024-09-14T06:00:38.746 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T06:00:38.754 INFO:teuthology.orchestra.run.smithi006.stdout:5689 trunc from 0xcbb283f to 0x3ff0e3b 2024-09-14T06:00:38.771 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:38.771 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:38.789 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:00:38.790 INFO:teuthology.orchestra.run.smithi006.stdout:5690 write 0x59e40f6 thru 0x59eb59b (0x74a6 bytes) 2024-09-14T06:00:38.800 INFO:teuthology.orchestra.run.smithi006.stdout:5691 read 0x3170259 thru 0x317795b (0x7703 bytes) 2024-09-14T06:00:38.810 INFO:teuthology.orchestra.run.smithi006.stdout:5693 trunc from 0x59eb59c to 0xe79942a 2024-09-14T06:00:38.822 INFO:teuthology.orchestra.run.smithi006.stdout:5694 read 0x3fde6fb thru 0x3fed8e8 (0xf1ee bytes) 2024-09-14T06:00:38.824 INFO:teuthology.orchestra.run.smithi006.stdout:5697 trunc from 0xe79942a to 0xd5ff663 2024-09-14T06:00:38.835 INFO:teuthology.orchestra.run.smithi006.stdout:5698 read 0x6ad2e74 thru 0x6ade70d (0xb89a bytes) 2024-09-14T06:00:38.835 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.835 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.835 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:38.833+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:38.837 INFO:teuthology.orchestra.run.smithi006.stdout:5701 trunc from 0xd5ff663 to 0xb5cd0ce 2024-09-14T06:00:38.857 INFO:teuthology.orchestra.run.smithi006.stdout:5703 trunc from 0xb5cd0ce to 0x38c3e70 2024-09-14T06:00:38.883 INFO:teuthology.orchestra.run.smithi006.stdout:5704 trunc from 0x38c3e70 to 0x99c3500 2024-09-14T06:00:38.896 INFO:teuthology.orchestra.run.smithi006.stdout:5705 write 0x79c8153 thru 0x79cb88d (0x373b bytes) 2024-09-14T06:00:38.902 INFO:teuthology.orchestra.run.smithi006.stdout:5707 read 0xe3d504 thru 0xe4ae56 (0xd953 bytes) 2024-09-14T06:00:38.903 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.903 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.903 INFO:teuthology.orchestra.run.smithi006.stdout:5712 read 0x4f043ef thru 0x4f048bc (0x4ce bytes) 2024-09-14T06:00:38.904 INFO:teuthology.orchestra.run.smithi006.stdout:5714 punch from 0x11d9462 to 0x11e2dfb, (0x9999 bytes) 2024-09-14T06:00:38.904 INFO:teuthology.orchestra.run.smithi006.stdout:5716 punch from 0x4f3b0b9 to 0x4f40fa7, (0x5eee bytes) 2024-09-14T06:00:38.904 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.904 INFO:teuthology.orchestra.run.smithi006.stdout:5719 write 0x52284ff thru 0x5235891 (0xd393 bytes) 2024-09-14T06:00:38.915 INFO:teuthology.orchestra.run.smithi006.stdout:5721 punch from 0x8dbdf83 to 0x8dc411d, (0x619a bytes) 2024-09-14T06:00:38.915 INFO:teuthology.orchestra.run.smithi006.stdout:5722 punch from 0x3034531 to 0x3043b2b, (0xf5fa bytes) 2024-09-14T06:00:38.915 INFO:teuthology.orchestra.run.smithi006.stdout:5724 read 0x41241fd thru 0x4130625 (0xc429 bytes) 2024-09-14T06:00:38.915 INFO:teuthology.orchestra.run.smithi006.stdout:5725 write 0x772ba43 thru 0x773b9e9 (0xffa7 bytes) 2024-09-14T06:00:38.917 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:38.917 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:38.933 INFO:teuthology.orchestra.run.smithi006.stdout:5726 trunc from 0x99c3500 to 0xbaa603c 2024-09-14T06:00:38.934 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:00:38.936 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:38.930+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:38.944 INFO:teuthology.orchestra.run.smithi006.stdout:5727 punch from 0x51338a5 to 0x51400d9, (0xc834 bytes) 2024-09-14T06:00:38.944 INFO:teuthology.orchestra.run.smithi006.stdout:5728 writesame 0x5d066b7 thru 0x5d08d9e data_size 0x14(0x26e8 bytes) 2024-09-14T06:00:38.949 INFO:teuthology.orchestra.run.smithi006.stdout:5729 write 0xb8347e2 thru 0xb83933d (0x4b5c bytes) 2024-09-14T06:00:38.958 INFO:teuthology.orchestra.run.smithi006.stdout:5731 read 0x9e92b4c thru 0x9e9ab0a (0x7fbf bytes) 2024-09-14T06:00:38.958 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:38.958 INFO:teuthology.orchestra.run.smithi006.stdout:5734 write 0x48d97aa thru 0x48e6b53 (0xd3aa bytes) 2024-09-14T06:00:38.968 INFO:teuthology.orchestra.run.smithi006.stdout:5735 punch from 0x766dfc8 to 0x76721ef, (0x4227 bytes) 2024-09-14T06:00:38.968 INFO:teuthology.orchestra.run.smithi006.stdout:5736 read 0x9daf2fe thru 0x9dbb335 (0xc038 bytes) 2024-09-14T06:00:38.973 INFO:teuthology.orchestra.run.smithi006.stdout:5737 trunc from 0xbaa603c to 0x7428f39 2024-09-14T06:00:38.995 INFO:teuthology.orchestra.run.smithi006.stdout:5738 writesame 0x4e888d3 thru 0x4e96c24 data_size 0x9f(0xe352 bytes) 2024-09-14T06:00:39.002 INFO:teuthology.orchestra.run.smithi006.stdout:5740 writesame 0x24ebaf6 thru 0x24f98f4 data_size 0x1(0xddff bytes) 2024-09-14T06:00:39.037 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:39.033+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:39.040 INFO:teuthology.orchestra.run.smithi006.stdout:5741 trunc from 0x7428f39 to 0x48341ea 2024-09-14T06:00:39.073 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:39.073 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:39.079 INFO:teuthology.orchestra.run.smithi006.stdout:5742 write 0x94a8789 thru 0x94aaa9d (0x2315 bytes) 2024-09-14T06:00:39.084 INFO:teuthology.orchestra.run.smithi006.stdout:5743 write 0x1f09868 thru 0x1f197a6 (0xff3f bytes) 2024-09-14T06:00:39.088 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:00:39.090 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:39.090 INFO:teuthology.orchestra.run.smithi006.stdout:5745 writesame 0x7db87a8 thru 0x7dbab5c data_size 0xb(0x23b5 bytes) 2024-09-14T06:00:39.095 INFO:teuthology.orchestra.run.smithi006.stdout:5746 writesame 0x2c17ba6 thru 0x2c1ac5a data_size 0x1(0x30b5 bytes) 2024-09-14T06:00:39.105 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:39.105 INFO:teuthology.orchestra.run.smithi006.stdout:5750 read 0x3494212 thru 0x34a41bf (0xffae bytes) 2024-09-14T06:00:39.113 INFO:teuthology.orchestra.run.smithi006.stdout:5751 trunc from 0x94aaa9e to 0x2c5185f 2024-09-14T06:00:39.132 INFO:teuthology.orchestra.run.smithi006.stdout:5753 write 0x27dea48 thru 0x27e2efe (0x44b7 bytes) 2024-09-14T06:00:39.138 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:39.133+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:5755 writesame 0x8f88905 thru 0x8f91741 data_size 0x1(0x8e3d bytes) 2024-09-14T06:00:39.158 INFO:teuthology.orchestra.run.smithi006.stdout:5757 punch from 0x871e7b8 to 0x872e3f8, (0xfc40 bytes) 2024-09-14T06:00:39.159 INFO:teuthology.orchestra.run.smithi006.stdout:5758 writesame 0x4866a88 thru 0x486f93c data_size 0x11(0x8eb5 bytes) 2024-09-14T06:00:39.166 INFO:teuthology.orchestra.run.smithi006.stdout:5759 writesame 0x386b4a8 thru 0x387a798 data_size 0x1(0xf2f1 bytes) 2024-09-14T06:00:39.213 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:39.213 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:39.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:00:39.229 INFO:teuthology.orchestra.run.smithi006.stdout:5760 write 0xd09fced thru 0xd0ab9eb (0xbcff bytes) 2024-09-14T06:00:39.239 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:39.234+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:39.255 INFO:teuthology.orchestra.run.smithi006.stdout:5761 write 0xe17d57e thru 0xe17d696 (0x119 bytes) 2024-09-14T06:00:39.262 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:39.262 INFO:teuthology.orchestra.run.smithi006.stdout:5764 read 0x175f55e thru 0x17608a6 (0x1349 bytes) 2024-09-14T06:00:39.262 INFO:teuthology.orchestra.run.smithi006.stdout:5765 writesame 0x30c19c thru 0x30d1c5 data_size 0x1(0x102a bytes) 2024-09-14T06:00:39.268 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:39.269 INFO:teuthology.orchestra.run.smithi006.stdout:5767 writesame 0x2ef92ea thru 0x2f05966 data_size 0x3d(0xc67d bytes) 2024-09-14T06:00:39.275 INFO:teuthology.orchestra.run.smithi006.stdout:5768 punch from 0x72bf1eb to 0x72ca96b, (0xb780 bytes) 2024-09-14T06:00:39.275 INFO:teuthology.orchestra.run.smithi006.stdout:5769 write 0x7bee69 thru 0x7c88e8 (0x9a80 bytes) 2024-09-14T06:00:39.279 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:39.279 INFO:teuthology.orchestra.run.smithi006.stdout:5771 read 0xad03811 thru 0xad04090 (0x880 bytes) 2024-09-14T06:00:39.279 INFO:teuthology.orchestra.run.smithi006.stdout:5772 write 0xabaa52c thru 0xabb60b6 (0xbb8b bytes) 2024-09-14T06:00:39.291 INFO:teuthology.orchestra.run.smithi006.stdout:5773 writesame 0xbf6434 thru 0xc02345 data_size 0x25(0xbf12 bytes) 2024-09-14T06:00:39.296 INFO:teuthology.orchestra.run.smithi006.stdout:5774 write 0x475961d thru 0x47643a8 (0xad8c bytes) 2024-09-14T06:00:39.304 INFO:teuthology.orchestra.run.smithi006.stdout:5776 read 0x3ef561 thru 0x3f5d4d (0x67ed bytes) 2024-09-14T06:00:39.305 INFO:teuthology.orchestra.run.smithi006.stdout:5777 writesame 0x231e209 thru 0x231eecc data_size 0x26(0xcc4 bytes) 2024-09-14T06:00:39.317 INFO:teuthology.orchestra.run.smithi006.stdout:5778 trunc from 0xe17d697 to 0x823218d 2024-09-14T06:00:39.340 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:39.334+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:39.341 INFO:teuthology.orchestra.run.smithi006.stdout:5779 writesame 0x6002d3f thru 0x600afb6 data_size 0x64(0x8278 bytes) 2024-09-14T06:00:39.353 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:39.353 INFO:teuthology.orchestra.run.smithi006.stdout:5781 read 0x378fa6 thru 0x37fd92 (0x6ded bytes) 2024-09-14T06:00:39.354 INFO:teuthology.orchestra.run.smithi006.stdout:5782 read 0xa5f61d thru 0xa6e117 (0xeafb bytes) 2024-09-14T06:00:39.358 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:39.358 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:39.362 INFO:teuthology.orchestra.run.smithi006.stdout:5783 trunc from 0x823218d to 0xbcd93ce 2024-09-14T06:00:39.375 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:00:39.375 INFO:teuthology.orchestra.run.smithi006.stdout:5784 read 0x1067031 thru 0x106cef1 (0x5ec1 bytes) 2024-09-14T06:00:39.380 INFO:teuthology.orchestra.run.smithi006.stdout:5785 trunc from 0xbcd93ce to 0x7e0fea8 2024-09-14T06:00:39.390 INFO:teuthology.orchestra.run.smithi006.stdout:5786 read 0x3c35270 thru 0x3c40402 (0xb193 bytes) 2024-09-14T06:00:39.390 INFO:teuthology.orchestra.run.smithi006.stdout:5787 write 0x1d2d042 thru 0x1d2f2f7 (0x22b6 bytes) 2024-09-14T06:00:39.395 INFO:teuthology.orchestra.run.smithi006.stdout:5788 punch from 0x56a8c7d to 0x56b3e7d, (0xb200 bytes) 2024-09-14T06:00:39.395 INFO:teuthology.orchestra.run.smithi006.stdout:5791 write 0x492123c thru 0x4922762 (0x1527 bytes) 2024-09-14T06:00:39.413 INFO:teuthology.orchestra.run.smithi006.stdout:5792 write 0xaf65103 thru 0xaf6f5db (0xa4d9 bytes) 2024-09-14T06:00:39.420 INFO:teuthology.orchestra.run.smithi006.stdout:5794 punch from 0xf5911c to 0xf62af0, (0x99d4 bytes) 2024-09-14T06:00:39.420 INFO:teuthology.orchestra.run.smithi006.stdout:5795 read 0x1c3df1 thru 0x1c9ed6 (0x60e6 bytes) 2024-09-14T06:00:39.420 INFO:teuthology.orchestra.run.smithi006.stdout:5799 punch from 0x5cddf95 to 0x5ce547f, (0x74ea bytes) 2024-09-14T06:00:39.420 INFO:teuthology.orchestra.run.smithi006.stdout:5800 write 0x424575d thru 0x42537fe (0xe0a2 bytes) 2024-09-14T06:00:39.423 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:39.423 INFO:teuthology.orchestra.run.smithi006.stdout:5803 read 0x262499c thru 0x262a213 (0x5878 bytes) 2024-09-14T06:00:39.423 INFO:teuthology.orchestra.run.smithi006.stdout:5804 writesame 0x393d87e thru 0x394995a data_size 0x1(0xc0dd bytes) 2024-09-14T06:00:39.439 INFO:teuthology.orchestra.run.smithi006.stdout:5805 punch from 0x26a64a1 to 0x26b42eb, (0xde4a bytes) 2024-09-14T06:00:39.439 INFO:teuthology.orchestra.run.smithi006.stdout:5806 punch from 0x59fa1e to 0x5adae9, (0xe0cb bytes) 2024-09-14T06:00:39.439 INFO:teuthology.orchestra.run.smithi006.stdout:5807 read 0x699e67e thru 0x69ab2f8 (0xcc7b bytes) 2024-09-14T06:00:39.441 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:39.442+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:39.453 INFO:teuthology.orchestra.run.smithi006.stdout:5808 writesame 0xd1566f2 thru 0xd15ea94 data_size 0x2f(0x83a3 bytes) 2024-09-14T06:00:39.453 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:39.453 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:39.453 INFO:teuthology.orchestra.run.smithi006.stdout:5813 read 0x246558d thru 0x2470d48 (0xb7bc bytes) 2024-09-14T06:00:39.453 INFO:teuthology.orchestra.run.smithi006.stdout:5814 write 0x7bba948 thru 0x7bbf9d1 (0x508a bytes) 2024-09-14T06:00:39.460 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:39.460 INFO:teuthology.orchestra.run.smithi006.stdout:5816 writesame 0xa6c0d9e thru 0xa6cf4e7 data_size 0x9b(0xe74a bytes) 2024-09-14T06:00:39.471 INFO:teuthology.orchestra.run.smithi006.stdout:5817 punch from 0x84109f1 to 0x84138fc, (0x2f0b bytes) 2024-09-14T06:00:39.471 INFO:teuthology.orchestra.run.smithi006.stdout:5818 punch from 0xba99439 to 0xbaa14f3, (0x80ba bytes) 2024-09-14T06:00:39.471 INFO:teuthology.orchestra.run.smithi006.stdout:5819 write 0x403a208 thru 0x4046b71 (0xc96a bytes) 2024-09-14T06:00:39.481 INFO:teuthology.orchestra.run.smithi006.stdout:5820 write 0x833c6f2 thru 0x834214b (0x5a5a bytes) 2024-09-14T06:00:39.489 INFO:teuthology.orchestra.run.smithi006.stdout:5821 writesame 0x476ce89 thru 0x4774a50 data_size 0x44(0x7bc8 bytes) 2024-09-14T06:00:39.500 INFO:teuthology.orchestra.run.smithi006.stdout:5822 read 0xae6c137 thru 0xae6c686 (0x550 bytes) 2024-09-14T06:00:39.500 INFO:teuthology.orchestra.run.smithi006.stdout:5824 read 0x20e0f25 thru 0x20e35c0 (0x269c bytes) 2024-09-14T06:00:39.501 INFO:teuthology.orchestra.run.smithi006.stdout:5826 read 0xc3f4f8 thru 0xc48c7b (0x9784 bytes) 2024-09-14T06:00:39.504 INFO:teuthology.orchestra.run.smithi006.stdout:5828 trunc from 0xd15ea95 to 0xe6b7d27 2024-09-14T06:00:39.513 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:39.514 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:39.515 INFO:teuthology.orchestra.run.smithi006.stdout:5829 read 0xba7f481 thru 0xba8438c (0x4f0c bytes) 2024-09-14T06:00:39.515 INFO:teuthology.orchestra.run.smithi006.stdout:5830 clone 37 order 24 su 8388608 sc 14 2024-09-14T06:00:39.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:00:39.573 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:39.574+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:39.643 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:39.641+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:39.694 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:39.694 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:39.708 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:00:39.730 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T06:00:39.757 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:39.758+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:39.761 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-14T06:00:39.838 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:39.838 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:39.845 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:39.842+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:39.845 INFO:teuthology.orchestra.run.smithi006.stdout:leaving image image_client.0-clone36 intact 2024-09-14T06:00:39.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:00:39.945 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:39.946+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:40.022 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:40.022 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:40.039 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:00:40.046 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:40.041+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:40.055 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-14T06:00:40.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:00:40.147 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:40.146+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:40.218 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:40.219 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:40.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:00:40.267 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:40.273 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:40.274+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:40.284 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:40.285 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:40.302 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:40.302 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:40.320 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:40.320 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:40.340 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:40.340 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:40.344 INFO:teuthology.orchestra.run.smithi006.stdout:5831 read 0x9f66449 thru 0x9f6a0e4 (0x3c9c bytes) 2024-09-14T06:00:40.345 INFO:teuthology.orchestra.run.smithi006.stdout:5832 write 0xe254625 thru 0xe25fb7d (0xb559 bytes) 2024-09-14T06:00:40.348 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:40.345+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:40.361 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:40.362 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:40.380 INFO:teuthology.orchestra.run.smithi006.stdout:5833 trunc from 0xe6b7d27 to 0x17415 2024-09-14T06:00:40.386 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:40.386 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:40.402 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 68.852898869000001, 2024-09-14T06:00:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:00:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:00:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:00:40.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:00:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:00:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:00:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:00:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:00:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:00:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:00:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:00:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:00:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:00:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:00:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:00:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:00:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:00:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:00:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:00:40.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:00:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:00:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:00:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:00:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:00:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:00:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38842 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8257536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.877772147999998, 2024-09-14T06:00:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083698121, 2024-09-14T06:00:40.409 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38842 2024-09-14T06:00:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521562+0000", 2024-09-14T06:00:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521563+0000", 2024-09-14T06:00:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:00:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521566+0000", 2024-09-14T06:00:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1140000000000002e-06 2024-09-14T06:00:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521575+0000", 2024-09-14T06:00:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8769999999999999e-06 2024-09-14T06:00:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521581+0000", 2024-09-14T06:00:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2369999999999997e-06 2024-09-14T06:00:40.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605076+0000", 2024-09-14T06:00:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083494992000000004 2024-09-14T06:00:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605168+0000", 2024-09-14T06:00:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1731999999999995e-05 2024-09-14T06:00:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605260+0000", 2024-09-14T06:00:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2511999999999998e-05 2024-09-14T06:00:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38844 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9469952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.877744780999997, 2024-09-14T06:00:40.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084006762999999998, 2024-09-14T06:00:40.415 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.415 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.415 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.415 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.415 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.415 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.415 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38844 2024-09-14T06:00:40.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.415 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:40.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521589+0000", 2024-09-14T06:00:40.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521590+0000", 2024-09-14T06:00:40.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9699999999999996e-07 2024-09-14T06:00:40.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521593+0000", 2024-09-14T06:00:40.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5909999999999998e-06 2024-09-14T06:00:40.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521603+0000", 2024-09-14T06:00:40.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0642000000000001e-05 2024-09-14T06:00:40.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521609+0000", 2024-09-14T06:00:40.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1020000000000002e-06 2024-09-14T06:00:40.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605318+0000", 2024-09-14T06:00:40.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083709166000000002 2024-09-14T06:00:40.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605454+0000", 2024-09-14T06:00:40.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013557400000000001 2024-09-14T06:00:40.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605596+0000", 2024-09-14T06:00:40.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014209100000000001 2024-09-14T06:00:40.419 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.419 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.419 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.419 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38845 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9650176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.419 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:40.419 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.877716481, 2024-09-14T06:00:40.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084212700000000001, 2024-09-14T06:00:40.420 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.420 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.420 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.420 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.420 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.420 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.420 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38845 2024-09-14T06:00:40.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.420 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:40.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:40.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521618+0000", 2024-09-14T06:00:40.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1200000000000003e-07 2024-09-14T06:00:40.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521628+0000", 2024-09-14T06:00:40.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0196e-05 2024-09-14T06:00:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521637+0000", 2024-09-14T06:00:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6649999999999992e-06 2024-09-14T06:00:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521643+0000", 2024-09-14T06:00:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.285e-06 2024-09-14T06:00:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605652+0000", 2024-09-14T06:00:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084009025000000001 2024-09-14T06:00:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605741+0000", 2024-09-14T06:00:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8473000000000005e-05 2024-09-14T06:00:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605830+0000", 2024-09-14T06:00:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9444000000000006e-05 2024-09-14T06:00:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38848 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8536064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.877678471999999, 2024-09-14T06:00:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084375567999999998, 2024-09-14T06:00:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38848 2024-09-14T06:00:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521656+0000", 2024-09-14T06:00:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0200000000000002e-07 2024-09-14T06:00:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521659+0000", 2024-09-14T06:00:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7800000000000001e-06 2024-09-14T06:00:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521667+0000", 2024-09-14T06:00:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6599999999999995e-06 2024-09-14T06:00:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521674+0000", 2024-09-14T06:00:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4560000000000003e-06 2024-09-14T06:00:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605872+0000", 2024-09-14T06:00:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084198010000000004 2024-09-14T06:00:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.605945+0000", 2024-09-14T06:00:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2681000000000004e-05 2024-09-14T06:00:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606031+0000", 2024-09-14T06:00:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6378999999999994e-05 2024-09-14T06:00:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38849 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9748480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.877648045999997, 2024-09-14T06:00:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084581577000000005, 2024-09-14T06:00:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38849 2024-09-14T06:00:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521687+0000", 2024-09-14T06:00:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9400000000000005e-07 2024-09-14T06:00:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521729+0000", 2024-09-14T06:00:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2657000000000002e-05 2024-09-14T06:00:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521749+0000", 2024-09-14T06:00:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9264000000000001e-05 2024-09-14T06:00:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521761+0000", 2024-09-14T06:00:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2289999999999999e-05 2024-09-14T06:00:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606078+0000", 2024-09-14T06:00:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084316772999999998 2024-09-14T06:00:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606176+0000", 2024-09-14T06:00:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7992999999999995e-05 2024-09-14T06:00:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606268+0000", 2024-09-14T06:00:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2006e-05 2024-09-14T06:00:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38851 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9928704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.877552733999998, 2024-09-14T06:00:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084695081000000005, 2024-09-14T06:00:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38851 2024-09-14T06:00:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521783+0000", 2024-09-14T06:00:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1000000000000001e-06 2024-09-14T06:00:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521788+0000", 2024-09-14T06:00:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2619999999999998e-06 2024-09-14T06:00:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521803+0000", 2024-09-14T06:00:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5421999999999999e-05 2024-09-14T06:00:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521815+0000", 2024-09-14T06:00:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.171e-05 2024-09-14T06:00:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606320+0000", 2024-09-14T06:00:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084504698000000003 2024-09-14T06:00:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606404+0000", 2024-09-14T06:00:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4379e-05 2024-09-14T06:00:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606476+0000", 2024-09-14T06:00:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2509999999999995e-05 2024-09-14T06:00:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.877501983999998, 2024-09-14T06:00:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:00:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:00:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:00:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:00:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:00:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:00:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:00:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:00:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:00:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:00:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:00:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:00:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:00:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:00:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:00:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:00:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.877463661, 2024-09-14T06:00:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:00:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:00:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:00:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:00:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:00:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:00:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:00:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:00:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:00:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:00:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:00:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:00:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:00:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:00:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:00:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.877436969000001, 2024-09-14T06:00:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:00:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:00:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:00:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:00:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:00:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:00:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:00:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:00:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:00:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:00:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:00:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:00:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:00:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:00:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:00:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:00:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.877411103, 2024-09-14T06:00:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:00:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:00:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:00:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:00:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:00:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:00:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:00:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:00:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:00:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:00:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:00:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:00:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:00:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:00:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:00:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:00:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.876310734, 2024-09-14T06:00:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:00:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:00:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:00:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:00:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:00:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:00:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:00:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:00:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:00:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:00:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:00:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:00:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:00:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:00:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:00:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:00:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.876266755000003, 2024-09-14T06:00:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:00:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:00:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:00:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:00:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:00:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:00:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:00:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:00:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:00:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:00:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:00:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:00:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:00:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:00:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:00:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:00:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38865 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1392640~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.875288376999997, 2024-09-14T06:00:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084340500999999998, 2024-09-14T06:00:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38865 2024-09-14T06:00:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524046+0000", 2024-09-14T06:00:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524047+0000", 2024-09-14T06:00:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5290000000000001e-06 2024-09-14T06:00:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524054+0000", 2024-09-14T06:00:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1910000000000003e-06 2024-09-14T06:00:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524074+0000", 2024-09-14T06:00:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9383999999999999e-05 2024-09-14T06:00:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524089+0000", 2024-09-14T06:00:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4647000000000001e-05 2024-09-14T06:00:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608123+0000", 2024-09-14T06:00:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084034837000000001 2024-09-14T06:00:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608224+0000", 2024-09-14T06:00:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100182 2024-09-14T06:00:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608386+0000", 2024-09-14T06:00:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162731 2024-09-14T06:00:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.875204994999997, 2024-09-14T06:00:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:00:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:00:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:00:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:00:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:00:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:00:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:00:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:00:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:00:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:00:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:00:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:00:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:00:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:00:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:00:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:00:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38869 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.874799525, 2024-09-14T06:00:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084608905999999998, 2024-09-14T06:00:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38869 2024-09-14T06:00:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525138+0000", 2024-09-14T06:00:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00060367999999999999 2024-09-14T06:00:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525160+0000", 2024-09-14T06:00:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1875999999999999e-05 2024-09-14T06:00:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525182+0000", 2024-09-14T06:00:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1427e-05 2024-09-14T06:00:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525198+0000", 2024-09-14T06:00:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507e-05 2024-09-14T06:00:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608907+0000", 2024-09-14T06:00:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083708535000000001 2024-09-14T06:00:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609011+0000", 2024-09-14T06:00:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010461199999999999 2024-09-14T06:00:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609144+0000", 2024-09-14T06:00:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013226899999999999 2024-09-14T06:00:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38871 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1671168~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.874108315000001, 2024-09-14T06:00:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084308214000000006, 2024-09-14T06:00:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38871 2024-09-14T06:00:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525226+0000", 2024-09-14T06:00:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525487+0000", 2024-09-14T06:00:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026091100000000001 2024-09-14T06:00:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525493+0000", 2024-09-14T06:00:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.742e-06 2024-09-14T06:00:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525508+0000", 2024-09-14T06:00:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525518+0000", 2024-09-14T06:00:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8500000000000006e-06 2024-09-14T06:00:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609229+0000", 2024-09-14T06:00:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083711775000000002 2024-09-14T06:00:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609388+0000", 2024-09-14T06:00:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158286 2024-09-14T06:00:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609534+0000", 2024-09-14T06:00:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000146308 2024-09-14T06:00:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38873 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 737280~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.873796743, 2024-09-14T06:00:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084288875999999999, 2024-09-14T06:00:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38873 2024-09-14T06:00:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525537+0000", 2024-09-14T06:00:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526372+0000", 2024-09-14T06:00:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00083508200000000001 2024-09-14T06:00:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526383+0000", 2024-09-14T06:00:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0282000000000001e-05 2024-09-14T06:00:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526445+0000", 2024-09-14T06:00:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1975000000000002e-05 2024-09-14T06:00:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526460+0000", 2024-09-14T06:00:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5233e-05 2024-09-14T06:00:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609585+0000", 2024-09-14T06:00:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083125216000000002 2024-09-14T06:00:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609689+0000", 2024-09-14T06:00:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104126 2024-09-14T06:00:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609826+0000", 2024-09-14T06:00:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013696199999999999 2024-09-14T06:00:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38874 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 557056~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.872829809000002, 2024-09-14T06:00:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083631987000000005, 2024-09-14T06:00:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38874 2024-09-14T06:00:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526504+0000", 2024-09-14T06:00:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526505+0000", 2024-09-14T06:00:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7699999999999992e-07 2024-09-14T06:00:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526511+0000", 2024-09-14T06:00:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9139999999999996e-06 2024-09-14T06:00:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526525+0000", 2024-09-14T06:00:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3644e-05 2024-09-14T06:00:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526533+0000", 2024-09-14T06:00:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6510000000000001e-06 2024-09-14T06:00:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609897+0000", 2024-09-14T06:00:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083364173 2024-09-14T06:00:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610007+0000", 2024-09-14T06:00:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110707 2024-09-14T06:00:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610136+0000", 2024-09-14T06:00:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012892099999999999 2024-09-14T06:00:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38877 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 1949696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.872785116000003, 2024-09-14T06:00:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083886717, 2024-09-14T06:00:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38877 2024-09-14T06:00:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.526549+0000", 2024-09-14T06:00:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529354+0000", 2024-09-14T06:00:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028049170000000001 2024-09-14T06:00:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529373+0000", 2024-09-14T06:00:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.933e-05 2024-09-14T06:00:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529399+0000", 2024-09-14T06:00:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6129e-05 2024-09-14T06:00:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.529418+0000", 2024-09-14T06:00:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8944e-05 2024-09-14T06:00:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610197+0000", 2024-09-14T06:00:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080778271999999998 2024-09-14T06:00:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610300+0000", 2024-09-14T06:00:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103868 2024-09-14T06:00:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.610436+0000", 2024-09-14T06:00:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013525700000000001 2024-09-14T06:00:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:40.509 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:40.510 INFO:teuthology.orchestra.run.smithi006.stdout:5834 read 0x186c thru 0xd2eb (0xba80 bytes) 2024-09-14T06:00:40.511 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:40.511 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:40.512 INFO:teuthology.orchestra.run.smithi006.stdout:5835 write 0x7daa37d thru 0x7db14d2 (0x7156 bytes) 2024-09-14T06:00:40.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:00:40.513 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:40.510+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:40.515 INFO:teuthology.orchestra.run.smithi006.stdout:5837 write 0x3d69f53 thru 0x3d70ebe (0x6f6c bytes) 2024-09-14T06:00:40.515 INFO:teuthology.orchestra.run.smithi006.stdout:5838 read 0x45e2c64 thru 0x45e4933 (0x1cd0 bytes) 2024-09-14T06:00:40.515 INFO:teuthology.orchestra.run.smithi006.stdout:5839 writesame 0xa93520f thru 0xa9420c8 data_size 0x2f(0xceba bytes) 2024-09-14T06:00:40.515 INFO:teuthology.orchestra.run.smithi006.stdout:5840 read 0x24f6cc thru 0x2569bb (0x72f0 bytes) 2024-09-14T06:00:40.515 INFO:teuthology.orchestra.run.smithi006.stdout:5841 writesame 0x25e14d4 thru 0x25ecd50 data_size 0x5b(0xb87d bytes) 2024-09-14T06:00:40.515 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:40.515 INFO:teuthology.orchestra.run.smithi006.stdout:5847 read 0x8bbee05 thru 0x8bc0237 (0x1433 bytes) 2024-09-14T06:00:40.515 INFO:teuthology.orchestra.run.smithi006.stdout:5848 write 0xbb9bba2 thru 0xbb9f615 (0x3a74 bytes) 2024-09-14T06:00:40.515 INFO:teuthology.orchestra.run.smithi006.stdout:5849 read 0x2cca836 thru 0x2cd9ee6 (0xf6b1 bytes) 2024-09-14T06:00:40.516 INFO:teuthology.orchestra.run.smithi006.stdout:5850 trunc from 0xbb9f616 to 0x9524ed4 2024-09-14T06:00:40.516 INFO:teuthology.orchestra.run.smithi006.stdout:5851 punch from 0x9b5766 to 0x9c3ef6, (0xe790 bytes) 2024-09-14T06:00:40.516 INFO:teuthology.orchestra.run.smithi006.stdout:5852 write 0x2d4ea7b thru 0x2d4f6e1 (0xc67 bytes) 2024-09-14T06:00:40.538 INFO:teuthology.orchestra.run.smithi006.stdout:5853 trunc from 0x9524ed4 to 0x2315a5c 2024-09-14T06:00:40.572 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:40.572 INFO:teuthology.orchestra.run.smithi006.stdout:5856 writesame 0x401e3e thru 0x40e7ab data_size 0x3b(0xc96e bytes) 2024-09-14T06:00:40.595 INFO:teuthology.orchestra.run.smithi006.stdout:5857 writesame 0x42623dc thru 0x426393b data_size 0x9(0x1560 bytes) 2024-09-14T06:00:40.611 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:40.610+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:40.623 INFO:teuthology.orchestra.run.smithi006.stdout:5859 write 0xa050fac thru 0xa05fd93 (0xede8 bytes) 2024-09-14T06:00:40.630 INFO:teuthology.orchestra.run.smithi006.stdout:5861 write 0x1adff3f thru 0x1ae233b (0x23fd bytes) 2024-09-14T06:00:40.637 INFO:teuthology.orchestra.run.smithi006.stdout:5862 punch from 0x262e1e7 to 0x2635b6b, (0x7984 bytes) 2024-09-14T06:00:40.637 INFO:teuthology.orchestra.run.smithi006.stdout:5863 read 0x774ac18 thru 0x7759644 (0xea2d bytes) 2024-09-14T06:00:40.640 INFO:teuthology.orchestra.run.smithi006.stdout:5864 trunc from 0xa05fd94 to 0x97b0fd3 2024-09-14T06:00:40.654 INFO:teuthology.orchestra.run.smithi006.stdout:5865 write 0x1580d7e thru 0x1589800 (0x8a83 bytes) 2024-09-14T06:00:40.671 INFO:teuthology.orchestra.run.smithi006.stdout:5866 writesame 0x9988f55 thru 0x998f67b data_size 0x1(0x6727 bytes) 2024-09-14T06:00:40.671 INFO:teuthology.orchestra.run.smithi006.stdout:5867 write 0x2851e53 thru 0x285a56f (0x871d bytes) 2024-09-14T06:00:40.680 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:40.680 INFO:teuthology.orchestra.run.smithi006.stdout:5869 clone 38 order 21 su 16384 sc 3 2024-09-14T06:00:40.694 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:40.695 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:40.695 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:40.695 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:40.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:00:40.712 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:40.709+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:40.739 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.3 to 1 (10000) 2024-09-14T06:00:40.745 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T06:00:40.767 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T06:00:40.813 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:40.810+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:40.844 INFO:teuthology.orchestra.run.smithi006.stdout:truncating image image_client.0-clone37 from 0x998f67c (overlap 0x17415) to 0xba0a 2024-09-14T06:00:40.880 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:40.880 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:40.880 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:40.881 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:40.881 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:40.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:00:40.913 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:40.909+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:40.943 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-14T06:00:41.014 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:41.014+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:41.062 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:41.062 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:41.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:41.063 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:41.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.063 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59148 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 419840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.063 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:41.063 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.793156711999998, 2024-09-14T06:00:41.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072974285999999999, 2024-09-14T06:00:41.063 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.063 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.063 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.063 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59148 2024-09-14T06:00:41.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.064 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:41.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:41.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268521+0000", 2024-09-14T06:00:41.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4199999999999995e-07 2024-09-14T06:00:41.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268524+0000", 2024-09-14T06:00:41.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.05e-06 2024-09-14T06:00:41.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268534+0000", 2024-09-14T06:00:41.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8719999999999997e-06 2024-09-14T06:00:41.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268541+0000", 2024-09-14T06:00:41.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5349999999999999e-06 2024-09-14T06:00:41.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341108+0000", 2024-09-14T06:00:41.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072566624999999996 2024-09-14T06:00:41.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341169+0000", 2024-09-14T06:00:41.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1251e-05 2024-09-14T06:00:41.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341494+0000", 2024-09-14T06:00:41.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325311 2024-09-14T06:00:41.067 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.067 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.067 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.067 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59149 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 436224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.068 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:41.068 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.793117488, 2024-09-14T06:00:41.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073405053999999997, 2024-09-14T06:00:41.068 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.068 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.068 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.068 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.068 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.068 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.068 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59149 2024-09-14T06:00:41.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.068 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:41.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:41.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268560+0000", 2024-09-14T06:00:41.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9999999999999997e-07 2024-09-14T06:00:41.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268563+0000", 2024-09-14T06:00:41.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.292e-06 2024-09-14T06:00:41.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268573+0000", 2024-09-14T06:00:41.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3260000000000002e-06 2024-09-14T06:00:41.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268581+0000", 2024-09-14T06:00:41.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1960000000000008e-06 2024-09-14T06:00:41.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341537+0000", 2024-09-14T06:00:41.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072955916999999995 2024-09-14T06:00:41.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341641+0000", 2024-09-14T06:00:41.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104341 2024-09-14T06:00:41.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341964+0000", 2024-09-14T06:00:41.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032328199999999999 2024-09-14T06:00:41.072 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.072 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.072 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.072 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59150 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 452608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.072 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:41.072 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.793084248, 2024-09-14T06:00:41.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073829748000000001, 2024-09-14T06:00:41.072 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.072 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.073 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.073 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.073 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.073 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.073 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59150 2024-09-14T06:00:41.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.073 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:41.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:41.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:41.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0399999999999995e-07 2024-09-14T06:00:41.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268596+0000", 2024-09-14T06:00:41.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9859999999999999e-06 2024-09-14T06:00:41.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268606+0000", 2024-09-14T06:00:41.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0088000000000001e-05 2024-09-14T06:00:41.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268614+0000", 2024-09-14T06:00:41.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T06:00:41.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341999+0000", 2024-09-14T06:00:41.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073385011999999999 2024-09-14T06:00:41.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342093+0000", 2024-09-14T06:00:41.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3793000000000001e-05 2024-09-14T06:00:41.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342422+0000", 2024-09-14T06:00:41.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000329129 2024-09-14T06:00:41.076 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.076 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.076 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.077 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59151 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.077 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:41.077 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.79305188, 2024-09-14T06:00:41.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074207289999999995, 2024-09-14T06:00:41.077 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.077 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.077 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.077 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59151 2024-09-14T06:00:41.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.077 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:41.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:41.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268626+0000", 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268629+0000", 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.038e-06 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268638+0000", 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8139999999999995e-06 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268647+0000", 2024-09-14T06:00:41.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4889999999999995e-06 2024-09-14T06:00:41.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342457+0000", 2024-09-14T06:00:41.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073809890000000003 2024-09-14T06:00:41.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342545+0000", 2024-09-14T06:00:41.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8697999999999997e-05 2024-09-14T06:00:41.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342832+0000", 2024-09-14T06:00:41.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028681799999999999 2024-09-14T06:00:41.081 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.081 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.081 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.081 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59152 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.081 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:41.081 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.793019239000003, 2024-09-14T06:00:41.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074695176000000002, 2024-09-14T06:00:41.081 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.082 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.082 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.082 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.082 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.082 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.082 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59152 2024-09-14T06:00:41.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.082 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:41.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:41.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:41.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2900000000000003e-07 2024-09-14T06:00:41.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268661+0000", 2024-09-14T06:00:41.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0230000000000001e-06 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268670+0000", 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2129999999999997e-06 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268679+0000", 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342937+0000", 2024-09-14T06:00:41.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074258781999999995 2024-09-14T06:00:41.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343044+0000", 2024-09-14T06:00:41.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-09-14T06:00:41.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343353+0000", 2024-09-14T06:00:41.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030911099999999999 2024-09-14T06:00:41.085 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.085 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.085 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.086 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59153 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 501760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.086 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:41.086 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.792986468999999, 2024-09-14T06:00:41.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074997241000000006, 2024-09-14T06:00:41.086 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.086 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.086 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.086 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.086 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.086 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.087 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59153 2024-09-14T06:00:41.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.087 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:41.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:41.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268691+0000", 2024-09-14T06:00:41.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:00:41.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268693+0000", 2024-09-14T06:00:41.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3599999999999999e-06 2024-09-14T06:00:41.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268699+0000", 2024-09-14T06:00:41.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-09-14T06:00:41.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268704+0000", 2024-09-14T06:00:41.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5759999999999999e-06 2024-09-14T06:00:41.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343398+0000", 2024-09-14T06:00:41.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074694522999999999 2024-09-14T06:00:41.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343450+0000", 2024-09-14T06:00:41.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1350999999999997e-05 2024-09-14T06:00:41.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343688+0000", 2024-09-14T06:00:41.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023806500000000001 2024-09-14T06:00:41.090 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.090 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.090 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.090 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59154 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 518144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.091 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:41.091 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.792967402999999, 2024-09-14T06:00:41.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075389938000000004, 2024-09-14T06:00:41.091 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.091 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.091 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.091 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59154 2024-09-14T06:00:41.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.091 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:41.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:41.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268710+0000", 2024-09-14T06:00:41.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8000000000000001e-07 2024-09-14T06:00:41.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268712+0000", 2024-09-14T06:00:41.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T06:00:41.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268717+0000", 2024-09-14T06:00:41.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8570000000000003e-06 2024-09-14T06:00:41.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268721+0000", 2024-09-14T06:00:41.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2039999999999999e-06 2024-09-14T06:00:41.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343721+0000", 2024-09-14T06:00:41.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074999748000000005 2024-09-14T06:00:41.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343784+0000", 2024-09-14T06:00:41.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3174000000000002e-05 2024-09-14T06:00:41.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.344099+0000", 2024-09-14T06:00:41.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000315299 2024-09-14T06:00:41.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.095 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.095 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59398 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 323584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.095 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:41.095 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.782003154999998, 2024-09-14T06:00:41.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073326565999999996, 2024-09-14T06:00:41.096 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.096 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.096 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.096 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.096 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.096 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.096 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59398 2024-09-14T06:00:41.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.096 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:41.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279675+0000", 2024-09-14T06:00:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-14T06:00:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279681+0000", 2024-09-14T06:00:41.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-09-14T06:00:41.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279702+0000", 2024-09-14T06:00:41.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1259000000000001e-05 2024-09-14T06:00:41.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279718+0000", 2024-09-14T06:00:41.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5475999999999999e-05 2024-09-14T06:00:41.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352360+0000", 2024-09-14T06:00:41.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.07264226 2024-09-14T06:00:41.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352447+0000", 2024-09-14T06:00:41.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7381999999999998e-05 2024-09-14T06:00:41.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353000+0000", 2024-09-14T06:00:41.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055309200000000004 2024-09-14T06:00:41.099 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.099 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59399 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.781938791999998, 2024-09-14T06:00:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073824446000000002, 2024-09-14T06:00:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.100 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59399 2024-09-14T06:00:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279739+0000", 2024-09-14T06:00:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T06:00:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279745+0000", 2024-09-14T06:00:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T06:00:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279767+0000", 2024-09-14T06:00:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639000000000001e-05 2024-09-14T06:00:41.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279781+0000", 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4511999999999999e-05 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353045+0000", 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073263718000000005 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353168+0000", 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012314499999999999 2024-09-14T06:00:41.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353562+0000", 2024-09-14T06:00:41.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039435199999999999 2024-09-14T06:00:41.104 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.104 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.104 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.104 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59400 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.104 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:41.104 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.781875032000002, 2024-09-14T06:00:41.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074271465999999994, 2024-09-14T06:00:41.105 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.105 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.105 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.105 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.105 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.105 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.105 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59400 2024-09-14T06:00:41.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.105 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:41.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:41.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279803+0000", 2024-09-14T06:00:41.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2100000000000001e-06 2024-09-14T06:00:41.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279819+0000", 2024-09-14T06:00:41.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6409000000000002e-05 2024-09-14T06:00:41.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279841+0000", 2024-09-14T06:00:41.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1878e-05 2024-09-14T06:00:41.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279856+0000", 2024-09-14T06:00:41.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4392999999999999e-05 2024-09-14T06:00:41.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353650+0000", 2024-09-14T06:00:41.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073794144000000006 2024-09-14T06:00:41.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353757+0000", 2024-09-14T06:00:41.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010687 2024-09-14T06:00:41.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354073+0000", 2024-09-14T06:00:41.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000316562 2024-09-14T06:00:41.109 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.109 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.109 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.109 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59401 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 372736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.109 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:41.109 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.781800207000003, 2024-09-14T06:00:41.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074643900999999999, 2024-09-14T06:00:41.109 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.110 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.110 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.110 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.110 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.110 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.110 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59401 2024-09-14T06:00:41.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.110 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:41.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:41.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279878+0000", 2024-09-14T06:00:41.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.31e-06 2024-09-14T06:00:41.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279883+0000", 2024-09-14T06:00:41.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3770000000000004e-06 2024-09-14T06:00:41.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279906+0000", 2024-09-14T06:00:41.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2398000000000001e-05 2024-09-14T06:00:41.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279920+0000", 2024-09-14T06:00:41.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.402e-05 2024-09-14T06:00:41.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354125+0000", 2024-09-14T06:00:41.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074205750000000001 2024-09-14T06:00:41.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354227+0000", 2024-09-14T06:00:41.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101612 2024-09-14T06:00:41.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354521+0000", 2024-09-14T06:00:41.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029343400000000002 2024-09-14T06:00:41.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.114 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.114 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59402 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 389120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.114 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:41.114 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.781738623999999, 2024-09-14T06:00:41.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075017027999999999, 2024-09-14T06:00:41.114 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.114 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.114 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.115 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59402 2024-09-14T06:00:41.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.115 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:41.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:41.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279939+0000", 2024-09-14T06:00:41.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2470000000000001e-06 2024-09-14T06:00:41.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279945+0000", 2024-09-14T06:00:41.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-09-14T06:00:41.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279966+0000", 2024-09-14T06:00:41.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1801999999999999e-05 2024-09-14T06:00:41.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279980+0000", 2024-09-14T06:00:41.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3589e-05 2024-09-14T06:00:41.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354569+0000", 2024-09-14T06:00:41.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074588707000000004 2024-09-14T06:00:41.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354671+0000", 2024-09-14T06:00:41.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102398 2024-09-14T06:00:41.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354955+0000", 2024-09-14T06:00:41.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028406500000000001 2024-09-14T06:00:41.119 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.119 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.119 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.119 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59403 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 405504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.119 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:41.119 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.781676836999999, 2024-09-14T06:00:41.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075434395000000001, 2024-09-14T06:00:41.119 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.119 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.120 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.120 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59403 2024-09-14T06:00:41.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.120 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:41.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:41.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280001+0000", 2024-09-14T06:00:41.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2669999999999999e-06 2024-09-14T06:00:41.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280008+0000", 2024-09-14T06:00:41.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5849999999999996e-06 2024-09-14T06:00:41.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280030+0000", 2024-09-14T06:00:41.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2293000000000002e-05 2024-09-14T06:00:41.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280044+0000", 2024-09-14T06:00:41.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3974999999999999e-05 2024-09-14T06:00:41.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355013+0000", 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074969039000000001 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355144+0000", 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000131333 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355434+0000", 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028990299999999999 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.124 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59404 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.124 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:41.124 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.781611718000001, 2024-09-14T06:00:41.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075696103000000001, 2024-09-14T06:00:41.124 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.124 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.124 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.124 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59404 2024-09-14T06:00:41.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.125 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:41.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:41.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280066+0000", 2024-09-14T06:00:41.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2640000000000001e-06 2024-09-14T06:00:41.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280072+0000", 2024-09-14T06:00:41.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129999999999997e-06 2024-09-14T06:00:41.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280094+0000", 2024-09-14T06:00:41.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2608000000000001e-05 2024-09-14T06:00:41.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280109+0000", 2024-09-14T06:00:41.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:41.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355479+0000", 2024-09-14T06:00:41.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075370699999999999 2024-09-14T06:00:41.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355554+0000", 2024-09-14T06:00:41.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4674999999999999e-05 2024-09-14T06:00:41.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355761+0000", 2024-09-14T06:00:41.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-14T06:00:41.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.128 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.129 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59405 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.129 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:41.129 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.781547807999999, 2024-09-14T06:00:41.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076008867999999993, 2024-09-14T06:00:41.129 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.129 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.129 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.130 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.130 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.130 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59405 2024-09-14T06:00:41.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.130 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:41.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:41.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280130+0000", 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2500000000000001e-06 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280136+0000", 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280158+0000", 2024-09-14T06:00:41.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1795000000000001e-05 2024-09-14T06:00:41.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280172+0000", 2024-09-14T06:00:41.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4303e-05 2024-09-14T06:00:41.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355797+0000", 2024-09-14T06:00:41.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075624835000000001 2024-09-14T06:00:41.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355866+0000", 2024-09-14T06:00:41.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9043999999999998e-05 2024-09-14T06:00:41.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356138+0000", 2024-09-14T06:00:41.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027207799999999998 2024-09-14T06:00:41.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.133 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.133 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59406 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.133 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:41.133 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.781483866000002, 2024-09-14T06:00:41.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076435642999999998, 2024-09-14T06:00:41.134 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.134 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.134 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.134 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59406 2024-09-14T06:00:41.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.134 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:41.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:41.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280194+0000", 2024-09-14T06:00:41.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-14T06:00:41.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280200+0000", 2024-09-14T06:00:41.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6359999999999999e-06 2024-09-14T06:00:41.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280222+0000", 2024-09-14T06:00:41.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1628999999999999e-05 2024-09-14T06:00:41.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280236+0000", 2024-09-14T06:00:41.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4413000000000001e-05 2024-09-14T06:00:41.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356172+0000", 2024-09-14T06:00:41.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075936466999999994 2024-09-14T06:00:41.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356260+0000", 2024-09-14T06:00:41.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7437999999999999e-05 2024-09-14T06:00:41.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356629+0000", 2024-09-14T06:00:41.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036877600000000002 2024-09-14T06:00:41.138 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.138 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.138 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.138 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59407 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 471040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.138 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:41.138 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.781419632999999, 2024-09-14T06:00:41.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076820083999999997, 2024-09-14T06:00:41.138 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.138 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.138 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.139 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.139 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.139 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.139 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59407 2024-09-14T06:00:41.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.139 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280258+0000", 2024-09-14T06:00:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1370000000000001e-06 2024-09-14T06:00:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280264+0000", 2024-09-14T06:00:41.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6930000000000004e-06 2024-09-14T06:00:41.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280285+0000", 2024-09-14T06:00:41.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1455999999999999e-05 2024-09-14T06:00:41.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280300+0000", 2024-09-14T06:00:41.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4319e-05 2024-09-14T06:00:41.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356676+0000", 2024-09-14T06:00:41.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076376615999999994 2024-09-14T06:00:41.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356768+0000", 2024-09-14T06:00:41.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1234000000000001e-05 2024-09-14T06:00:41.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357077+0000", 2024-09-14T06:00:41.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030962900000000001 2024-09-14T06:00:41.143 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.143 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.143 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.143 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59408 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 487424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.143 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:41.143 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.781354632999999, 2024-09-14T06:00:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077185511999999998, 2024-09-14T06:00:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59408 2024-09-14T06:00:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280323+0000", 2024-09-14T06:00:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2860000000000001e-06 2024-09-14T06:00:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280329+0000", 2024-09-14T06:00:41.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.553e-06 2024-09-14T06:00:41.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280352+0000", 2024-09-14T06:00:41.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-14T06:00:41.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280366+0000", 2024-09-14T06:00:41.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-14T06:00:41.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357126+0000", 2024-09-14T06:00:41.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076760326000000004 2024-09-14T06:00:41.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357223+0000", 2024-09-14T06:00:41.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6490000000000006e-05 2024-09-14T06:00:41.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357508+0000", 2024-09-14T06:00:41.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028479900000000002 2024-09-14T06:00:41.148 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.148 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.148 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.149 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59409 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.149 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:41.149 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.781290403, 2024-09-14T06:00:41.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077536090000000002, 2024-09-14T06:00:41.149 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.149 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.149 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.149 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59409 2024-09-14T06:00:41.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.150 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:41.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:41.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280388+0000", 2024-09-14T06:00:41.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.096e-06 2024-09-14T06:00:41.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280393+0000", 2024-09-14T06:00:41.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T06:00:41.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280414+0000", 2024-09-14T06:00:41.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1175999999999999e-05 2024-09-14T06:00:41.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280427+0000", 2024-09-14T06:00:41.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3032e-05 2024-09-14T06:00:41.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357553+0000", 2024-09-14T06:00:41.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077125845999999998 2024-09-14T06:00:41.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357624+0000", 2024-09-14T06:00:41.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1062000000000005e-05 2024-09-14T06:00:41.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357923+0000", 2024-09-14T06:00:41.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029891199999999997 2024-09-14T06:00:41.154 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.154 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.154 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.154 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59410 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:41.154 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:41.154 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 45.781231091000002, 2024-09-14T06:00:41.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077854494999999996, 2024-09-14T06:00:41.154 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.154 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.154 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.154 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.154 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.155 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.155 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59410 2024-09-14T06:00:41.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.155 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:41.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:41.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280447+0000", 2024-09-14T06:00:41.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069999999999999e-06 2024-09-14T06:00:41.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280453+0000", 2024-09-14T06:00:41.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-06 2024-09-14T06:00:41.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280471+0000", 2024-09-14T06:00:41.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8295999999999999e-05 2024-09-14T06:00:41.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280484+0000", 2024-09-14T06:00:41.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2609000000000001e-05 2024-09-14T06:00:41.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357954+0000", 2024-09-14T06:00:41.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077470405000000006 2024-09-14T06:00:41.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358040+0000", 2024-09-14T06:00:41.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.551e-05 2024-09-14T06:00:41.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358300+0000", 2024-09-14T06:00:41.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026036800000000003 2024-09-14T06:00:41.158 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.158 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.158 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.159 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.159 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.159 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:41.160 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:00:41.161 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:41.157+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:41.261 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:41.257+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:41.326 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:41.326 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:41.327 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:41.327 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:41.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:00:41.362 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:41.357+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:41.398 INFO:teuthology.orchestra.run.smithi006.stdout:5871 read 0x538e2ec thru 0x538efbf (0xcd4 bytes) 2024-09-14T06:00:41.399 INFO:teuthology.orchestra.run.smithi006.stdout:5873 punch from 0x8673f6a to 0x86778bc, (0x3952 bytes) 2024-09-14T06:00:41.406 INFO:teuthology.orchestra.run.smithi006.stdout:5874 writesame 0x1dc6cad thru 0x1dceeba data_size 0x5d(0x820e bytes) 2024-09-14T06:00:41.462 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:41.462+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:41.471 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:41.471 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:41.471 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:41.471 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:41.472 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:41.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:00:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:5876 read 0x4df5128 thru 0x4dff4d9 (0xa3b2 bytes) 2024-09-14T06:00:41.523 INFO:teuthology.orchestra.run.smithi006.stdout:5877 punch from 0x9663136 to 0x966bdc8, (0x8c92 bytes) 2024-09-14T06:00:41.524 INFO:teuthology.orchestra.run.smithi006.stdout:5878 write 0x50c0d90 thru 0x50cbfd3 (0xb244 bytes) 2024-09-14T06:00:41.535 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:41.539 INFO:teuthology.orchestra.run.smithi006.stdout:5882 trunc from 0x998f67c to 0x82fe17f 2024-09-14T06:00:41.563 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:41.561+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:41.608 INFO:teuthology.orchestra.run.smithi006.stdout:5883 write 0x24bc781 thru 0x24be802 (0x2082 bytes) 2024-09-14T06:00:41.639 INFO:teuthology.orchestra.run.smithi006.stdout:5886 punch from 0x3979261 to 0x397e369, (0x5108 bytes) 2024-09-14T06:00:41.646 INFO:teuthology.orchestra.run.smithi006.stdout:5889 trunc from 0x82fe17f to 0xb63c437 2024-09-14T06:00:41.655 INFO:teuthology.orchestra.run.smithi006.stdout:5890 read 0x9380c5a thru 0x938a2bb (0x9662 bytes) 2024-09-14T06:00:41.664 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:41.661+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:41.669 INFO:teuthology.orchestra.run.smithi006.stdout:5892 trunc from 0xb63c437 to 0x3efe064 2024-09-14T06:00:41.679 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:41.680 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:41.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:41.680 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:41.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.680 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114752 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1458176~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.680 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:41.680 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3213528879999998, 2024-09-14T06:00:41.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11122652, 2024-09-14T06:00:41.680 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.680 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.680 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.680 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.681 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.681 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.681 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114752 2024-09-14T06:00:41.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.681 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:41.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:41.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:41.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.51e-07 2024-09-14T06:00:41.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357638+0000", 2024-09-14T06:00:41.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7540000000000001e-06 2024-09-14T06:00:41.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357643+0000", 2024-09-14T06:00:41.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1150000000000002e-06 2024-09-14T06:00:41.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357647+0000", 2024-09-14T06:00:41.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7979999999999999e-06 2024-09-14T06:00:41.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468136+0000", 2024-09-14T06:00:41.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.110488747 2024-09-14T06:00:41.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468353+0000", 2024-09-14T06:00:41.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000217166 2024-09-14T06:00:41.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468862+0000", 2024-09-14T06:00:41.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050938899999999996 2024-09-14T06:00:41.684 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.684 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.684 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.684 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114753 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1564672~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.685 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:41.685 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3213128249999997, 2024-09-14T06:00:41.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111972162, 2024-09-14T06:00:41.685 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.685 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.685 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.685 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.685 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.685 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.685 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114753 2024-09-14T06:00:41.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.685 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:41.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:41.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:41.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6599999999999996e-07 2024-09-14T06:00:41.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357678+0000", 2024-09-14T06:00:41.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.807e-06 2024-09-14T06:00:41.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357683+0000", 2024-09-14T06:00:41.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.933e-06 2024-09-14T06:00:41.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357687+0000", 2024-09-14T06:00:41.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8469999999999998e-06 2024-09-14T06:00:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468941+0000", 2024-09-14T06:00:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111254009 2024-09-14T06:00:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469159+0000", 2024-09-14T06:00:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021768800000000001 2024-09-14T06:00:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469648+0000", 2024-09-14T06:00:41.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048931199999999999 2024-09-14T06:00:41.689 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.689 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.689 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.689 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114754 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1671168~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.689 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:41.689 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3212731519999998, 2024-09-14T06:00:41.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.112607016, 2024-09-14T06:00:41.689 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.689 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.689 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.689 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.690 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.690 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.690 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114754 2024-09-14T06:00:41.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.690 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:41.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:41.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357716+0000", 2024-09-14T06:00:41.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-14T06:00:41.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357718+0000", 2024-09-14T06:00:41.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5910000000000001e-06 2024-09-14T06:00:41.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357725+0000", 2024-09-14T06:00:41.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9399999999999996e-06 2024-09-14T06:00:41.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357729+0000", 2024-09-14T06:00:41.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0439999999999997e-06 2024-09-14T06:00:41.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469752+0000", 2024-09-14T06:00:41.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11202385400000001 2024-09-14T06:00:41.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469889+0000", 2024-09-14T06:00:41.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136704 2024-09-14T06:00:41.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470322+0000", 2024-09-14T06:00:41.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000433337 2024-09-14T06:00:41.693 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.693 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.693 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.694 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114771 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 98304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.694 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:41.694 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3212320450000004, 2024-09-14T06:00:41.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11267808, 2024-09-14T06:00:41.694 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.694 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.694 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.694 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.694 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.694 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.694 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114771 2024-09-14T06:00:41.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.695 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:41.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:41.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:41.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.37e-07 2024-09-14T06:00:41.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357759+0000", 2024-09-14T06:00:41.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5650000000000001e-06 2024-09-14T06:00:41.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357764+0000", 2024-09-14T06:00:41.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T06:00:41.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357768+0000", 2024-09-14T06:00:41.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9580000000000001e-06 2024-09-14T06:00:41.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469739+0000", 2024-09-14T06:00:41.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111971591 2024-09-14T06:00:41.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469951+0000", 2024-09-14T06:00:41.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021185999999999999 2024-09-14T06:00:41.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470435+0000", 2024-09-14T06:00:41.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048335499999999998 2024-09-14T06:00:41.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.698 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.698 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114772 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.698 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:41.698 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.321191829, 2024-09-14T06:00:41.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11329244500000001, 2024-09-14T06:00:41.699 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.699 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.699 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.699 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114772 2024-09-14T06:00:41.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.699 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:41.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:41.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:41.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3099999999999998e-07 2024-09-14T06:00:41.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357799+0000", 2024-09-14T06:00:41.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0770000000000002e-06 2024-09-14T06:00:41.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357805+0000", 2024-09-14T06:00:41.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3329999999999996e-06 2024-09-14T06:00:41.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357816+0000", 2024-09-14T06:00:41.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0869999999999999e-05 2024-09-14T06:00:41.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470507+0000", 2024-09-14T06:00:41.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.112691635 2024-09-14T06:00:41.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470648+0000", 2024-09-14T06:00:41.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014075000000000001 2024-09-14T06:00:41.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471089+0000", 2024-09-14T06:00:41.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000441249 2024-09-14T06:00:41.703 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.703 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.703 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.703 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114773 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 311296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.703 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:41.703 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.321146283, 2024-09-14T06:00:41.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114111303, 2024-09-14T06:00:41.703 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.703 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.703 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.703 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.704 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114773 2024-09-14T06:00:41.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.704 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:41.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:41.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357843+0000", 2024-09-14T06:00:41.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4499999999999997e-07 2024-09-14T06:00:41.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357844+0000", 2024-09-14T06:00:41.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.612e-06 2024-09-14T06:00:41.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357851+0000", 2024-09-14T06:00:41.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7900000000000002e-06 2024-09-14T06:00:41.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357855+0000", 2024-09-14T06:00:41.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9310000000000001e-06 2024-09-14T06:00:41.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471187+0000", 2024-09-14T06:00:41.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.113332222 2024-09-14T06:00:41.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471425+0000", 2024-09-14T06:00:41.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000237412 2024-09-14T06:00:41.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471954+0000", 2024-09-14T06:00:41.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00052879100000000003 2024-09-14T06:00:41.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.707 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114774 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 417792~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3211052570000001, 2024-09-14T06:00:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114690902, 2024-09-14T06:00:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114774 2024-09-14T06:00:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:41.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:41.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357884+0000", 2024-09-14T06:00:41.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.37e-07 2024-09-14T06:00:41.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357886+0000", 2024-09-14T06:00:41.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7010000000000001e-06 2024-09-14T06:00:41.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357891+0000", 2024-09-14T06:00:41.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T06:00:41.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357896+0000", 2024-09-14T06:00:41.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5999999999999997e-06 2024-09-14T06:00:41.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472030+0000", 2024-09-14T06:00:41.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11413328 2024-09-14T06:00:41.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472157+0000", 2024-09-14T06:00:41.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012693900000000001 2024-09-14T06:00:41.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472574+0000", 2024-09-14T06:00:41.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041773100000000002 2024-09-14T06:00:41.712 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.712 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.712 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.712 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114775 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 524288~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.712 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:41.712 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3210655889999998, 2024-09-14T06:00:41.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.115518357, 2024-09-14T06:00:41.712 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.713 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.713 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.713 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114775 2024-09-14T06:00:41.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.713 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:41.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357924+0000", 2024-09-14T06:00:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3799999999999997e-07 2024-09-14T06:00:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357928+0000", 2024-09-14T06:00:41.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7700000000000001e-06 2024-09-14T06:00:41.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357934+0000", 2024-09-14T06:00:41.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6420000000000004e-06 2024-09-14T06:00:41.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357938+0000", 2024-09-14T06:00:41.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1899999999999997e-06 2024-09-14T06:00:41.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472667+0000", 2024-09-14T06:00:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114728409 2024-09-14T06:00:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472901+0000", 2024-09-14T06:00:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023484100000000001 2024-09-14T06:00:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473441+0000", 2024-09-14T06:00:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053996700000000003 2024-09-14T06:00:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.716 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.717 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114776 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 630784~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.717 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:41.717 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3210256930000002, 2024-09-14T06:00:41.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11610183, 2024-09-14T06:00:41.717 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.717 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.717 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.717 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.717 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.717 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.717 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114776 2024-09-14T06:00:41.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.718 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:41.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:41.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357964+0000", 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7700000000000004e-07 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357965+0000", 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.761e-06 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357970+0000", 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1429999999999997e-06 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357974+0000", 2024-09-14T06:00:41.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8879999999999999e-06 2024-09-14T06:00:41.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473514+0000", 2024-09-14T06:00:41.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11554007500000001 2024-09-14T06:00:41.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473641+0000", 2024-09-14T06:00:41.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000127088 2024-09-14T06:00:41.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474065+0000", 2024-09-14T06:00:41.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00042329800000000001 2024-09-14T06:00:41.721 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.721 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.721 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.721 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114777 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 737280~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.721 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:41.721 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3209865179999998, 2024-09-14T06:00:41.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11697975200000001, 2024-09-14T06:00:41.721 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.721 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.721 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114777 2024-09-14T06:00:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:41.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358003+0000", 2024-09-14T06:00:41.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-14T06:00:41.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358004+0000", 2024-09-14T06:00:41.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6950000000000001e-06 2024-09-14T06:00:41.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358010+0000", 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2410000000000003e-06 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358014+0000", 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9380000000000002e-06 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474156+0000", 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.116142597 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474386+0000", 2024-09-14T06:00:41.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023008999999999999 2024-09-14T06:00:41.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474982+0000", 2024-09-14T06:00:41.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059564500000000001 2024-09-14T06:00:41.725 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.725 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.725 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114778 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 843776~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3209461749999996, 2024-09-14T06:00:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11749908100000001, 2024-09-14T06:00:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114778 2024-09-14T06:00:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.726 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:41.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:41.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358043+0000", 2024-09-14T06:00:41.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3399999999999999e-07 2024-09-14T06:00:41.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358045+0000", 2024-09-14T06:00:41.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8789999999999999e-06 2024-09-14T06:00:41.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358052+0000", 2024-09-14T06:00:41.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.951e-06 2024-09-14T06:00:41.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358056+0000", 2024-09-14T06:00:41.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.121e-06 2024-09-14T06:00:41.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475018+0000", 2024-09-14T06:00:41.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11696224199999999 2024-09-14T06:00:41.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475141+0000", 2024-09-14T06:00:41.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012285099999999999 2024-09-14T06:00:41.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475542+0000", 2024-09-14T06:00:41.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00040050300000000002 2024-09-14T06:00:41.730 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.730 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.730 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.730 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114779 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 950272~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.730 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:41.730 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3209035760000001, 2024-09-14T06:00:41.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.118289098, 2024-09-14T06:00:41.731 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.731 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.731 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.731 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.731 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.731 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.731 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114779 2024-09-14T06:00:41.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.731 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:41.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:41.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358086+0000", 2024-09-14T06:00:41.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5300000000000004e-07 2024-09-14T06:00:41.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358087+0000", 2024-09-14T06:00:41.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.623e-06 2024-09-14T06:00:41.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358093+0000", 2024-09-14T06:00:41.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9510000000000003e-06 2024-09-14T06:00:41.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358097+0000", 2024-09-14T06:00:41.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1819999999999999e-06 2024-09-14T06:00:41.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475637+0000", 2024-09-14T06:00:41.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11753928600000001 2024-09-14T06:00:41.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475862+0000", 2024-09-14T06:00:41.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225336 2024-09-14T06:00:41.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476374+0000", 2024-09-14T06:00:41.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000512167 2024-09-14T06:00:41.735 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.735 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.735 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.735 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114780 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1056768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.735 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:41.735 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3208625520000004, 2024-09-14T06:00:41.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.119083513, 2024-09-14T06:00:41.735 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.735 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.735 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.735 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.736 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.736 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.736 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114780 2024-09-14T06:00:41.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.736 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:41.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:41.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358127+0000", 2024-09-14T06:00:41.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.44e-07 2024-09-14T06:00:41.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358128+0000", 2024-09-14T06:00:41.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.714e-06 2024-09-14T06:00:41.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358135+0000", 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358140+0000", 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1969999999999998e-06 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476456+0000", 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.118316717 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476674+0000", 2024-09-14T06:00:41.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021775200000000001 2024-09-14T06:00:41.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477210+0000", 2024-09-14T06:00:41.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053548400000000003 2024-09-14T06:00:41.739 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.739 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.739 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.739 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114781 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1163264~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.740 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:41.740 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.320817431, 2024-09-14T06:00:41.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11988966700000001, 2024-09-14T06:00:41.740 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.740 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.740 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.740 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114781 2024-09-14T06:00:41.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.740 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:41.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:41.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358172+0000", 2024-09-14T06:00:41.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.44e-07 2024-09-14T06:00:41.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358174+0000", 2024-09-14T06:00:41.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9920000000000002e-06 2024-09-14T06:00:41.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358179+0000", 2024-09-14T06:00:41.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.288e-06 2024-09-14T06:00:41.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358183+0000", 2024-09-14T06:00:41.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0489999999999997e-06 2024-09-14T06:00:41.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477294+0000", 2024-09-14T06:00:41.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11911132000000001 2024-09-14T06:00:41.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477516+0000", 2024-09-14T06:00:41.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022208500000000001 2024-09-14T06:00:41.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478061+0000", 2024-09-14T06:00:41.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00054438900000000005 2024-09-14T06:00:41.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.744 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.744 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114782 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1269760~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.744 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:41.744 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3207988640000003, 2024-09-14T06:00:41.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.120723238, 2024-09-14T06:00:41.744 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.744 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.744 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.744 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.745 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114782 2024-09-14T06:00:41.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.745 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:41.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:41.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:41.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4099999999999999e-07 2024-09-14T06:00:41.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358192+0000", 2024-09-14T06:00:41.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.559e-06 2024-09-14T06:00:41.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358197+0000", 2024-09-14T06:00:41.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6789999999999996e-06 2024-09-14T06:00:41.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358202+0000", 2024-09-14T06:00:41.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4779999999999999e-06 2024-09-14T06:00:41.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478140+0000", 2024-09-14T06:00:41.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11993833600000001 2024-09-14T06:00:41.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478358+0000", 2024-09-14T06:00:41.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021785700000000001 2024-09-14T06:00:41.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478913+0000", 2024-09-14T06:00:41.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055478799999999996 2024-09-14T06:00:41.748 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.748 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.748 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.749 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114783 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1376256~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.749 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:41.749 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3207805190000004, 2024-09-14T06:00:41.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121464831, 2024-09-14T06:00:41.749 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.749 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.749 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.749 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.749 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.749 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.749 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114783 2024-09-14T06:00:41.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.749 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4499999999999998e-07 2024-09-14T06:00:41.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358210+0000", 2024-09-14T06:00:41.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5880000000000001e-06 2024-09-14T06:00:41.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358214+0000", 2024-09-14T06:00:41.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3850000000000004e-06 2024-09-14T06:00:41.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358218+0000", 2024-09-14T06:00:41.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7799999999999998e-06 2024-09-14T06:00:41.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479024+0000", 2024-09-14T06:00:41.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.120805364 2024-09-14T06:00:41.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479177+0000", 2024-09-14T06:00:41.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153642 2024-09-14T06:00:41.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479673+0000", 2024-09-14T06:00:41.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049572699999999995 2024-09-14T06:00:41.753 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.753 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.753 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.753 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114784 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1482752~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.754 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:41.754 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3207658609999999, 2024-09-14T06:00:41.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.122316759, 2024-09-14T06:00:41.754 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.754 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.754 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.754 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114784 2024-09-14T06:00:41.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.754 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:41.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:41.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:41.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2399999999999999e-07 2024-09-14T06:00:41.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358225+0000", 2024-09-14T06:00:41.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5570000000000001e-06 2024-09-14T06:00:41.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358229+0000", 2024-09-14T06:00:41.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5589999999999999e-06 2024-09-14T06:00:41.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358233+0000", 2024-09-14T06:00:41.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7270000000000001e-06 2024-09-14T06:00:41.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479769+0000", 2024-09-14T06:00:41.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12153594299999999 2024-09-14T06:00:41.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480000+0000", 2024-09-14T06:00:41.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000230967 2024-09-14T06:00:41.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480540+0000", 2024-09-14T06:00:41.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053968199999999999 2024-09-14T06:00:41.758 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.758 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.758 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.758 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114785 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1589248~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.758 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:41.758 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3207496699999997, 2024-09-14T06:00:41.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123154237, 2024-09-14T06:00:41.758 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.758 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.759 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.759 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.759 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.759 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.759 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114785 2024-09-14T06:00:41.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.759 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:41.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:41.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:41.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3799999999999998e-07 2024-09-14T06:00:41.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358241+0000", 2024-09-14T06:00:41.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.457e-06 2024-09-14T06:00:41.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358245+0000", 2024-09-14T06:00:41.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.42e-06 2024-09-14T06:00:41.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358249+0000", 2024-09-14T06:00:41.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7740000000000002e-06 2024-09-14T06:00:41.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480626+0000", 2024-09-14T06:00:41.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12237743600000001 2024-09-14T06:00:41.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480844+0000", 2024-09-14T06:00:41.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021792299999999999 2024-09-14T06:00:41.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481393+0000", 2024-09-14T06:00:41.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000548889 2024-09-14T06:00:41.762 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.762 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.762 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.763 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114786 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1695744~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.763 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:41.763 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3207349659999998, 2024-09-14T06:00:41.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123995568, 2024-09-14T06:00:41.763 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.763 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.763 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:41.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.763 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114786 2024-09-14T06:00:41.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.764 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:41.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:41.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:41.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.27e-07 2024-09-14T06:00:41.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358256+0000", 2024-09-14T06:00:41.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5460000000000001e-06 2024-09-14T06:00:41.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358260+0000", 2024-09-14T06:00:41.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3819999999999997e-06 2024-09-14T06:00:41.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358264+0000", 2024-09-14T06:00:41.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7469999999999999e-06 2024-09-14T06:00:41.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481473+0000", 2024-09-14T06:00:41.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123209244 2024-09-14T06:00:41.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481686+0000", 2024-09-14T06:00:41.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000212957 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482249+0000", 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00056336500000000002 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114867 3.15 3:aea12e8e:::rbd_data.1127cb09e343.000000000000000b:head [stat,truncate 737280] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3207203810000001, 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12722582099999999, 2024-09-14T06:00:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:41.768 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:41.768 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:41.768 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:41.768 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:41.768 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.768 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114867 2024-09-14T06:00:41.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.768 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:41.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:41.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:41.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358269+0000", 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4799999999999999e-07 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358274+0000", 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.237e-06 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:41.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358279+0000", 2024-09-14T06:00:41.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7990000000000001e-06 2024-09-14T06:00:41.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358284+0000", 2024-09-14T06:00:41.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1900000000000003e-06 2024-09-14T06:00:41.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:41.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482355+0000", 2024-09-14T06:00:41.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.124070718 2024-09-14T06:00:41.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:41.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482496+0000", 2024-09-14T06:00:41.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014162699999999999 2024-09-14T06:00:41.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 3", 2024-09-14T06:00:41.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482722+0000", 2024-09-14T06:00:41.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225622 2024-09-14T06:00:41.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:41.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.484427+0000", 2024-09-14T06:00:41.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001704929 2024-09-14T06:00:41.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:41.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485332+0000", 2024-09-14T06:00:41.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00090576600000000001 2024-09-14T06:00:41.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:41.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485429+0000", 2024-09-14T06:00:41.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6540999999999996e-05 2024-09-14T06:00:41.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:41.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:41.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:41.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485494+0000", 2024-09-14T06:00:41.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5043999999999996e-05 2024-09-14T06:00:41.773 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.773 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.773 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.773 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:41.773 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:41.773 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:41.775 INFO:teuthology.orchestra.run.smithi006.stdout:5893 read 0x1927d1c thru 0x192dfbe (0x62a3 bytes) 2024-09-14T06:00:41.775 INFO:teuthology.orchestra.run.smithi006.stdout:5895 punch from 0x1a7a31d to 0x1a82f2b, (0x8c0e bytes) 2024-09-14T06:00:41.775 INFO:teuthology.orchestra.run.smithi006.stdout:5898 write 0x870645f thru 0x8711ada (0xb67c bytes) 2024-09-14T06:00:41.775 INFO:teuthology.orchestra.run.smithi006.stdout:5901 writesame 0xa3a45a8 thru 0xa3a4e02 data_size 0x1(0x85b bytes) 2024-09-14T06:00:41.775 INFO:teuthology.orchestra.run.smithi006.stdout:5902 trunc from 0xa3a4e03 to 0xe08449b 2024-09-14T06:00:41.775 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2024-09-14T06:00:41.776 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:00:41.776 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:41.774+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:41.776 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:41.776 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:41.777 INFO:teuthology.orchestra.run.smithi006.stdout:5906 writesame 0xd3e7967 thru 0xd3ef061 data_size 0x47(0x76fb bytes) 2024-09-14T06:00:41.777 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T06:00:41.781 INFO:teuthology.orchestra.run.smithi006.stdout:5908 read 0x9a33fce thru 0x9a3a2d8 (0x630b bytes) 2024-09-14T06:00:41.781 INFO:teuthology.orchestra.run.smithi006.stdout:5909 punch from 0x1b0b82d to 0x1b0ef13, (0x36e6 bytes) 2024-09-14T06:00:41.781 INFO:teuthology.orchestra.run.smithi006.stdout:5910 read 0x839fe13 thru 0x83abd5f (0xbf4d bytes) 2024-09-14T06:00:41.781 INFO:teuthology.orchestra.run.smithi006.stdout:5911 write 0x27f89fc thru 0x2801742 (0x8d47 bytes) 2024-09-14T06:00:41.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T06:00:41.876 INFO:teuthology.orchestra.run.smithi006.stdout:5912 writesame 0x2b9516d thru 0x2b99d34 data_size 0x61(0x4bc8 bytes) 2024-09-14T06:00:41.877 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:41.873+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:41.923 INFO:teuthology.orchestra.run.smithi006.stdout:5914 write 0xc73fe5 thru 0xc7c0e1 (0x80fd bytes) 2024-09-14T06:00:41.943 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:41.943 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:41.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.943 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118477 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.943 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.925816+0000", 2024-09-14T06:00:41.944 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0048638359999999999, 2024-09-14T06:00:41.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048891860000000002, 2024-09-14T06:00:41.944 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.944 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.944 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.944 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.944 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.944 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.944 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118477 2024-09-14T06:00:41.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.944 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:41.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:41.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925816+0000", 2024-09-14T06:00:41.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:41.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925816+0000", 2024-09-14T06:00:41.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:41.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925817+0000", 2024-09-14T06:00:41.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2399999999999999e-07 2024-09-14T06:00:41.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:41.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925819+0000", 2024-09-14T06:00:41.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.243e-06 2024-09-14T06:00:41.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:41.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925825+0000", 2024-09-14T06:00:41.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4520000000000002e-06 2024-09-14T06:00:41.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925831+0000", 2024-09-14T06:00:41.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4140000000000002e-06 2024-09-14T06:00:41.947 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.947 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:41.947 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.947 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118551 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.947 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926783+0000", 2024-09-14T06:00:41.947 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.003897546, 2024-09-14T06:00:41.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039965850000000004, 2024-09-14T06:00:41.948 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.948 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.948 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.948 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.948 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.948 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.948 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118551 2024-09-14T06:00:41.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.948 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:41.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:41.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926783+0000", 2024-09-14T06:00:41.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:41.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926783+0000", 2024-09-14T06:00:41.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:41.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926783+0000", 2024-09-14T06:00:41.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T06:00:41.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:41.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926785+0000", 2024-09-14T06:00:41.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0099999999999998e-06 2024-09-14T06:00:41.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:41.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926791+0000", 2024-09-14T06:00:41.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3090000000000001e-06 2024-09-14T06:00:41.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926797+0000", 2024-09-14T06:00:41.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1730000000000003e-06 2024-09-14T06:00:41.951 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.951 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:41.951 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.951 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118583 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.951 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927700+0000", 2024-09-14T06:00:41.951 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0029804979999999998, 2024-09-14T06:00:41.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00313379, 2024-09-14T06:00:41.952 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.952 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.952 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.952 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.952 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.952 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.952 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118583 2024-09-14T06:00:41.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.952 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:41.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:41.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927700+0000", 2024-09-14T06:00:41.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:41.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927700+0000", 2024-09-14T06:00:41.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:41.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927700+0000", 2024-09-14T06:00:41.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8199999999999999e-07 2024-09-14T06:00:41.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:41.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927703+0000", 2024-09-14T06:00:41.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6589999999999999e-06 2024-09-14T06:00:41.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:41.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927711+0000", 2024-09-14T06:00:41.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.525e-06 2024-09-14T06:00:41.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927716+0000", 2024-09-14T06:00:41.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7119999999999997e-06 2024-09-14T06:00:41.955 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.955 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:41.955 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.956 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118615 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.956 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928474+0000", 2024-09-14T06:00:41.956 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0022065029999999998, 2024-09-14T06:00:41.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002399408, 2024-09-14T06:00:41.956 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.956 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.956 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.956 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.956 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.957 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.957 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118615 2024-09-14T06:00:41.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.957 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:41.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:41.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928474+0000", 2024-09-14T06:00:41.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:41.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928474+0000", 2024-09-14T06:00:41.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:41.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928474+0000", 2024-09-14T06:00:41.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1399999999999997e-07 2024-09-14T06:00:41.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:41.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928477+0000", 2024-09-14T06:00:41.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.367e-06 2024-09-14T06:00:41.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:41.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928485+0000", 2024-09-14T06:00:41.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0830000000000004e-06 2024-09-14T06:00:41.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928490+0000", 2024-09-14T06:00:41.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5799999999999999e-06 2024-09-14T06:00:41.959 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.959 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:41.959 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.960 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118690 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.960 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929265+0000", 2024-09-14T06:00:41.960 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0014156279999999999, 2024-09-14T06:00:41.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0016367319999999999, 2024-09-14T06:00:41.960 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.960 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.960 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.960 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.960 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.961 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.961 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118690 2024-09-14T06:00:41.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.961 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:41.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:41.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929265+0000", 2024-09-14T06:00:41.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:41.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929265+0000", 2024-09-14T06:00:41.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:41.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929265+0000", 2024-09-14T06:00:41.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2099999999999997e-07 2024-09-14T06:00:41.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:41.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929267+0000", 2024-09-14T06:00:41.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.154e-06 2024-09-14T06:00:41.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:41.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929274+0000", 2024-09-14T06:00:41.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.669e-06 2024-09-14T06:00:41.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929279+0000", 2024-09-14T06:00:41.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9840000000000001e-06 2024-09-14T06:00:41.963 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.963 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:41.964 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.964 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118722 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.964 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930029+0000", 2024-09-14T06:00:41.964 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00065139099999999997, 2024-09-14T06:00:41.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00089918500000000005, 2024-09-14T06:00:41.964 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.964 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.964 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.964 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.965 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.965 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.965 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118722 2024-09-14T06:00:41.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.965 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:41.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:41.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930029+0000", 2024-09-14T06:00:41.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:41.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930029+0000", 2024-09-14T06:00:41.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:41.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930029+0000", 2024-09-14T06:00:41.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8100000000000003e-07 2024-09-14T06:00:41.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:41.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930039+0000", 2024-09-14T06:00:41.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6080000000000002e-06 2024-09-14T06:00:41.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:41.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930046+0000", 2024-09-14T06:00:41.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4909999999999999e-06 2024-09-14T06:00:41.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930052+0000", 2024-09-14T06:00:41.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5759999999999996e-06 2024-09-14T06:00:41.967 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.967 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:41.967 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.968 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118478 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.968 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.925839+0000", 2024-09-14T06:00:41.968 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0048411060000000004, 2024-09-14T06:00:41.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0051154989999999999, 2024-09-14T06:00:41.968 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.968 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.968 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.968 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.968 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.968 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.969 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118478 2024-09-14T06:00:41.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.969 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:41.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:41.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925839+0000", 2024-09-14T06:00:41.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:41.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925839+0000", 2024-09-14T06:00:41.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:41.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925840+0000", 2024-09-14T06:00:41.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5300000000000004e-07 2024-09-14T06:00:41.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:41.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925842+0000", 2024-09-14T06:00:41.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.384e-06 2024-09-14T06:00:41.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:41.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925849+0000", 2024-09-14T06:00:41.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0199999999999997e-06 2024-09-14T06:00:41.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925855+0000", 2024-09-14T06:00:41.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5470000000000004e-06 2024-09-14T06:00:41.971 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.971 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:41.971 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.972 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118552 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.972 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926804+0000", 2024-09-14T06:00:41.972 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.003875791, 2024-09-14T06:00:41.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041883270000000004, 2024-09-14T06:00:41.972 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.972 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.972 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.972 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.972 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.972 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.972 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118552 2024-09-14T06:00:41.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.973 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:41.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:41.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926804+0000", 2024-09-14T06:00:41.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:41.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926804+0000", 2024-09-14T06:00:41.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:41.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926805+0000", 2024-09-14T06:00:41.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6699999999999999e-07 2024-09-14T06:00:41.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:41.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926807+0000", 2024-09-14T06:00:41.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.018e-06 2024-09-14T06:00:41.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:41.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926813+0000", 2024-09-14T06:00:41.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1659999999999999e-06 2024-09-14T06:00:41.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926818+0000", 2024-09-14T06:00:41.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0830000000000003e-06 2024-09-14T06:00:41.975 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.975 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:41.975 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.975 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118584 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.975 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927730+0000", 2024-09-14T06:00:41.976 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0029505880000000001, 2024-09-14T06:00:41.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0033133279999999999, 2024-09-14T06:00:41.976 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.976 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.976 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.976 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.976 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.976 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.976 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118584 2024-09-14T06:00:41.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.976 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:41.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:41.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927730+0000", 2024-09-14T06:00:41.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:41.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927730+0000", 2024-09-14T06:00:41.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:41.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927730+0000", 2024-09-14T06:00:41.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0200000000000002e-07 2024-09-14T06:00:41.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:41.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927733+0000", 2024-09-14T06:00:41.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.836e-06 2024-09-14T06:00:41.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:41.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927742+0000", 2024-09-14T06:00:41.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4679999999999992e-06 2024-09-14T06:00:41.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.979 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.979 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927747+0000", 2024-09-14T06:00:41.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.964e-06 2024-09-14T06:00:41.979 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.979 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:41.979 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.979 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118616 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.979 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928499+0000", 2024-09-14T06:00:41.979 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0021812770000000001, 2024-09-14T06:00:41.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0025999859999999999, 2024-09-14T06:00:41.980 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.980 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.980 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.980 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.980 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.980 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.980 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118616 2024-09-14T06:00:41.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.980 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:41.980 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.980 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:41.980 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928499+0000", 2024-09-14T06:00:41.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:41.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928499+0000", 2024-09-14T06:00:41.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:41.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928499+0000", 2024-09-14T06:00:41.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8800000000000003e-07 2024-09-14T06:00:41.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:41.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928502+0000", 2024-09-14T06:00:41.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4849999999999999e-06 2024-09-14T06:00:41.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:41.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928509+0000", 2024-09-14T06:00:41.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3250000000000002e-06 2024-09-14T06:00:41.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928514+0000", 2024-09-14T06:00:41.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2530000000000004e-06 2024-09-14T06:00:41.983 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.983 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:41.983 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.983 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118691 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.983 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929288+0000", 2024-09-14T06:00:41.983 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0013922920000000001, 2024-09-14T06:00:41.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001861885, 2024-09-14T06:00:41.983 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.984 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.984 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.984 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.984 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.984 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.984 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118691 2024-09-14T06:00:41.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.984 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:41.984 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.984 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:41.984 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929288+0000", 2024-09-14T06:00:41.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:41.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929288+0000", 2024-09-14T06:00:41.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:41.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929288+0000", 2024-09-14T06:00:41.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7800000000000002e-07 2024-09-14T06:00:41.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:41.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929291+0000", 2024-09-14T06:00:41.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.295e-06 2024-09-14T06:00:41.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:41.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929297+0000", 2024-09-14T06:00:41.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5180000000000001e-06 2024-09-14T06:00:41.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929303+0000", 2024-09-14T06:00:41.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3159999999999996e-06 2024-09-14T06:00:41.987 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.987 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:41.987 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.987 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118723 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.987 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930069+0000", 2024-09-14T06:00:41.987 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00061170099999999998, 2024-09-14T06:00:41.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0011347130000000001, 2024-09-14T06:00:41.987 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.988 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.988 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.988 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.988 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.988 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.988 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118723 2024-09-14T06:00:41.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.988 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:41.988 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.988 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:41.988 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930069+0000", 2024-09-14T06:00:41.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:41.989 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930069+0000", 2024-09-14T06:00:41.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:41.989 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930069+0000", 2024-09-14T06:00:41.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2699999999999999e-07 2024-09-14T06:00:41.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:41.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930072+0000", 2024-09-14T06:00:41.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.52e-06 2024-09-14T06:00:41.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:41.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930081+0000", 2024-09-14T06:00:41.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6080000000000002e-06 2024-09-14T06:00:41.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930087+0000", 2024-09-14T06:00:41.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9059999999999999e-06 2024-09-14T06:00:41.991 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.991 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:41.991 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.991 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118479 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.991 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.925862+0000", 2024-09-14T06:00:41.991 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0048184209999999998, 2024-09-14T06:00:41.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053806909999999999, 2024-09-14T06:00:41.991 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.991 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.991 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.991 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.992 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.992 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.992 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118479 2024-09-14T06:00:41.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.992 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:41.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.992 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:41.992 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925862+0000", 2024-09-14T06:00:41.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.992 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:41.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925862+0000", 2024-09-14T06:00:41.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:41.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925862+0000", 2024-09-14T06:00:41.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1699999999999998e-07 2024-09-14T06:00:41.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:41.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925865+0000", 2024-09-14T06:00:41.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7489999999999999e-06 2024-09-14T06:00:41.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:41.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925872+0000", 2024-09-14T06:00:41.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6850000000000004e-06 2024-09-14T06:00:41.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925878+0000", 2024-09-14T06:00:41.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3779999999999998e-06 2024-09-14T06:00:41.994 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.994 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:41.995 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.995 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118553 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.995 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926826+0000", 2024-09-14T06:00:41.995 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0038546549999999998, 2024-09-14T06:00:41.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044429489999999999, 2024-09-14T06:00:41.995 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.995 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.995 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.995 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.995 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.996 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:41.996 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118553 2024-09-14T06:00:41.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.996 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:41.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:41.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926826+0000", 2024-09-14T06:00:41.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:41.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926826+0000", 2024-09-14T06:00:41.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:41.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:41.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926826+0000", 2024-09-14T06:00:41.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9499999999999998e-07 2024-09-14T06:00:41.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:41.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926828+0000", 2024-09-14T06:00:41.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5280000000000002e-06 2024-09-14T06:00:41.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:41.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926835+0000", 2024-09-14T06:00:41.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.844e-06 2024-09-14T06:00:41.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:41.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926841+0000", 2024-09-14T06:00:41.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4229999999999996e-06 2024-09-14T06:00:41.998 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.998 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:41.998 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:41.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:41.999 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:41.999 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118585 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:41.999 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927757+0000", 2024-09-14T06:00:41.999 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0029236819999999999, 2024-09-14T06:00:41.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035371809999999999, 2024-09-14T06:00:41.999 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:41.999 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:41.999 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:41.999 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:41.999 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:41.999 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.000 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118585 2024-09-14T06:00:42.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.000 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.000 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.000 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.000 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927757+0000", 2024-09-14T06:00:42.000 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.000 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.000 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.000 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927757+0000", 2024-09-14T06:00:42.000 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.001 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.001 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.001 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927757+0000", 2024-09-14T06:00:42.001 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1799999999999995e-07 2024-09-14T06:00:42.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.001 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.001 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.001 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927760+0000", 2024-09-14T06:00:42.001 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5780000000000001e-06 2024-09-14T06:00:42.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.001 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.002 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.002 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927766+0000", 2024-09-14T06:00:42.002 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5039999999999999e-06 2024-09-14T06:00:42.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.002 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.002 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927771+0000", 2024-09-14T06:00:42.002 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2719999999999997e-06 2024-09-14T06:00:42.002 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.002 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.002 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.003 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118617 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.003 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928522+0000", 2024-09-14T06:00:42.003 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0021583489999999999, 2024-09-14T06:00:42.003 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0027961599999999998, 2024-09-14T06:00:42.003 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.003 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.003 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.003 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.003 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.003 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.003 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118617 2024-09-14T06:00:42.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.004 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.004 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928522+0000", 2024-09-14T06:00:42.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.004 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928522+0000", 2024-09-14T06:00:42.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.005 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.005 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928522+0000", 2024-09-14T06:00:42.005 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3799999999999998e-07 2024-09-14T06:00:42.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.005 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.005 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.005 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928525+0000", 2024-09-14T06:00:42.005 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3640000000000002e-06 2024-09-14T06:00:42.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.005 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.005 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.005 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928531+0000", 2024-09-14T06:00:42.006 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7689999999999999e-06 2024-09-14T06:00:42.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.006 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.006 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928537+0000", 2024-09-14T06:00:42.006 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3650000000000003e-06 2024-09-14T06:00:42.006 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.006 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.006 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.006 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118692 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.007 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929311+0000", 2024-09-14T06:00:42.007 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0013694860000000001, 2024-09-14T06:00:42.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020372049999999998, 2024-09-14T06:00:42.007 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.007 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.007 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.007 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.007 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.007 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.007 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118692 2024-09-14T06:00:42.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.007 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929311+0000", 2024-09-14T06:00:42.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929311+0000", 2024-09-14T06:00:42.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929311+0000", 2024-09-14T06:00:42.009 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3799999999999998e-07 2024-09-14T06:00:42.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.009 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.009 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.009 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929314+0000", 2024-09-14T06:00:42.009 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7250000000000002e-06 2024-09-14T06:00:42.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.009 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.009 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.009 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929322+0000", 2024-09-14T06:00:42.009 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1470000000000001e-06 2024-09-14T06:00:42.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.010 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.010 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929328+0000", 2024-09-14T06:00:42.010 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5090000000000001e-06 2024-09-14T06:00:42.010 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.010 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.010 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.010 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118724 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.011 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930095+0000", 2024-09-14T06:00:42.011 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00058533299999999995, 2024-09-14T06:00:42.011 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0013078320000000001, 2024-09-14T06:00:42.011 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.011 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.011 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.011 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.011 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.011 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.011 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118724 2024-09-14T06:00:42.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.011 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.011 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.012 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930095+0000", 2024-09-14T06:00:42.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.012 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930095+0000", 2024-09-14T06:00:42.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.012 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930095+0000", 2024-09-14T06:00:42.013 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1199999999999998e-07 2024-09-14T06:00:42.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.013 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.013 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930098+0000", 2024-09-14T06:00:42.013 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3209999999999999e-06 2024-09-14T06:00:42.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.013 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.013 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930105+0000", 2024-09-14T06:00:42.013 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7130000000000005e-06 2024-09-14T06:00:42.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.014 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.014 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.014 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930111+0000", 2024-09-14T06:00:42.014 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1760000000000001e-06 2024-09-14T06:00:42.014 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.014 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.014 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.014 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.014 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118480 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.014 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.925886+0000", 2024-09-14T06:00:42.015 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0047943999999999999, 2024-09-14T06:00:42.015 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0055903380000000003, 2024-09-14T06:00:42.015 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.015 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.015 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.015 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.015 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.015 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.015 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118480 2024-09-14T06:00:42.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.015 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925886+0000", 2024-09-14T06:00:42.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925886+0000", 2024-09-14T06:00:42.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925886+0000", 2024-09-14T06:00:42.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.51e-07 2024-09-14T06:00:42.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925889+0000", 2024-09-14T06:00:42.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3520000000000001e-06 2024-09-14T06:00:42.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925895+0000", 2024-09-14T06:00:42.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.635e-06 2024-09-14T06:00:42.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.018 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.018 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925900+0000", 2024-09-14T06:00:42.018 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1109999999999999e-06 2024-09-14T06:00:42.018 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.018 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.018 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.018 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118554 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.018 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926857+0000", 2024-09-14T06:00:42.019 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0038237000000000002, 2024-09-14T06:00:42.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004671283, 2024-09-14T06:00:42.019 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.019 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.019 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.019 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.019 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.019 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.019 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118554 2024-09-14T06:00:42.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.019 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926857+0000", 2024-09-14T06:00:42.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926857+0000", 2024-09-14T06:00:42.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926857+0000", 2024-09-14T06:00:42.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.44e-07 2024-09-14T06:00:42.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926860+0000", 2024-09-14T06:00:42.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7319999999999998e-06 2024-09-14T06:00:42.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926867+0000", 2024-09-14T06:00:42.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5889999999999997e-06 2024-09-14T06:00:42.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.022 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.022 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926873+0000", 2024-09-14T06:00:42.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7989999999999999e-06 2024-09-14T06:00:42.022 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.022 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.022 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.022 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118586 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.022 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927779+0000", 2024-09-14T06:00:42.023 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0029009349999999999, 2024-09-14T06:00:42.023 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003799303, 2024-09-14T06:00:42.023 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.023 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.023 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.023 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118586 2024-09-14T06:00:42.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.023 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.023 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.024 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.024 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927779+0000", 2024-09-14T06:00:42.024 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.024 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.024 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927779+0000", 2024-09-14T06:00:42.024 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.024 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.024 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927780+0000", 2024-09-14T06:00:42.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4799999999999999e-07 2024-09-14T06:00:42.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927782+0000", 2024-09-14T06:00:42.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.238e-06 2024-09-14T06:00:42.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927789+0000", 2024-09-14T06:00:42.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0029999999999997e-06 2024-09-14T06:00:42.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.026 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.026 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927794+0000", 2024-09-14T06:00:42.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2800000000000003e-06 2024-09-14T06:00:42.026 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.026 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.026 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.026 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118618 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.026 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928545+0000", 2024-09-14T06:00:42.026 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0021356679999999999, 2024-09-14T06:00:42.027 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0030726519999999999, 2024-09-14T06:00:42.027 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.027 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.027 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.027 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.027 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.027 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.027 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118618 2024-09-14T06:00:42.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.027 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.027 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.028 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.028 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928545+0000", 2024-09-14T06:00:42.028 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.028 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.028 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.028 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928545+0000", 2024-09-14T06:00:42.028 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.028 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.028 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.029 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928545+0000", 2024-09-14T06:00:42.029 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.01e-07 2024-09-14T06:00:42.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.029 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.029 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.029 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928547+0000", 2024-09-14T06:00:42.029 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2419999999999999e-06 2024-09-14T06:00:42.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.029 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.029 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.029 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928553+0000", 2024-09-14T06:00:42.029 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2249999999999997e-06 2024-09-14T06:00:42.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.030 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.030 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928560+0000", 2024-09-14T06:00:42.030 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0690000000000004e-06 2024-09-14T06:00:42.030 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.030 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.030 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.030 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118693 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.031 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929335+0000", 2024-09-14T06:00:42.031 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0013447279999999999, 2024-09-14T06:00:42.031 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0023135450000000002, 2024-09-14T06:00:42.031 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.031 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.031 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.031 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.031 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.031 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.031 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118693 2024-09-14T06:00:42.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.031 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.032 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.032 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.032 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929335+0000", 2024-09-14T06:00:42.032 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.032 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.032 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.032 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929335+0000", 2024-09-14T06:00:42.032 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.032 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.032 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.032 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929336+0000", 2024-09-14T06:00:42.033 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2500000000000001e-07 2024-09-14T06:00:42.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.033 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.033 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929338+0000", 2024-09-14T06:00:42.033 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1720000000000001e-06 2024-09-14T06:00:42.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.033 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.033 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929345+0000", 2024-09-14T06:00:42.033 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5250000000000002e-06 2024-09-14T06:00:42.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.034 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.034 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929350+0000", 2024-09-14T06:00:42.034 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.152e-06 2024-09-14T06:00:42.034 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.034 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.034 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.034 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118725 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.034 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930117+0000", 2024-09-14T06:00:42.034 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00056332099999999998, 2024-09-14T06:00:42.035 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0015571840000000001, 2024-09-14T06:00:42.035 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.035 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.035 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.035 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.035 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.035 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.035 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118725 2024-09-14T06:00:42.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.035 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.035 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.036 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930117+0000", 2024-09-14T06:00:42.036 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.036 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.036 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.036 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930117+0000", 2024-09-14T06:00:42.036 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.036 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.036 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.036 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930117+0000", 2024-09-14T06:00:42.036 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6199999999999998e-07 2024-09-14T06:00:42.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.037 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.037 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.037 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930119+0000", 2024-09-14T06:00:42.037 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.001e-06 2024-09-14T06:00:42.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.037 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.037 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.037 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930126+0000", 2024-09-14T06:00:42.037 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1279999999999996e-06 2024-09-14T06:00:42.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.037 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.037 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.038 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930130+0000", 2024-09-14T06:00:42.038 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8369999999999996e-06 2024-09-14T06:00:42.038 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.038 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.038 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.038 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.038 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118481 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.038 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.925908+0000", 2024-09-14T06:00:42.038 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0047724489999999998, 2024-09-14T06:00:42.038 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0057927459999999997, 2024-09-14T06:00:42.038 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.039 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.039 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.039 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.039 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.039 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.039 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118481 2024-09-14T06:00:42.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.039 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.039 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.039 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.039 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925908+0000", 2024-09-14T06:00:42.039 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.040 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.040 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925908+0000", 2024-09-14T06:00:42.040 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.040 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.040 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925908+0000", 2024-09-14T06:00:42.040 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4400000000000001e-07 2024-09-14T06:00:42.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.041 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.041 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925910+0000", 2024-09-14T06:00:42.041 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2560000000000001e-06 2024-09-14T06:00:42.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.041 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.041 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.041 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925917+0000", 2024-09-14T06:00:42.041 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8419999999999999e-06 2024-09-14T06:00:42.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.041 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.041 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.041 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925923+0000", 2024-09-14T06:00:42.041 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4759999999999997e-06 2024-09-14T06:00:42.042 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.042 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.042 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.042 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.042 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118555 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.042 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926882+0000", 2024-09-14T06:00:42.042 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0037983219999999998, 2024-09-14T06:00:42.042 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048608649999999998, 2024-09-14T06:00:42.042 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.042 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.042 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.043 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.043 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.043 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.043 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118555 2024-09-14T06:00:42.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.043 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.043 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.043 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926882+0000", 2024-09-14T06:00:42.043 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.044 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.044 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926882+0000", 2024-09-14T06:00:42.044 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.044 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.044 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.044 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926882+0000", 2024-09-14T06:00:42.044 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0200000000000002e-07 2024-09-14T06:00:42.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.044 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.044 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.045 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926885+0000", 2024-09-14T06:00:42.045 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4329999999999998e-06 2024-09-14T06:00:42.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.045 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.045 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.045 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926894+0000", 2024-09-14T06:00:42.045 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5960000000000004e-06 2024-09-14T06:00:42.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.045 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.045 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.045 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926899+0000", 2024-09-14T06:00:42.046 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4099999999999999e-06 2024-09-14T06:00:42.046 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.046 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.046 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.046 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.046 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118587 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.046 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927801+0000", 2024-09-14T06:00:42.046 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0028787180000000002, 2024-09-14T06:00:42.046 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039958509999999999, 2024-09-14T06:00:42.046 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.046 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.047 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.047 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.047 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.047 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.047 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118587 2024-09-14T06:00:42.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.047 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.047 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.047 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.047 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927801+0000", 2024-09-14T06:00:42.047 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.048 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.048 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927801+0000", 2024-09-14T06:00:42.048 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.048 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.048 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927802+0000", 2024-09-14T06:00:42.048 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4999999999999998e-07 2024-09-14T06:00:42.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.049 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.049 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927804+0000", 2024-09-14T06:00:42.049 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2680000000000001e-06 2024-09-14T06:00:42.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.049 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.049 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927811+0000", 2024-09-14T06:00:42.049 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6499999999999999e-06 2024-09-14T06:00:42.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.049 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.049 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927816+0000", 2024-09-14T06:00:42.050 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9280000000000001e-06 2024-09-14T06:00:42.050 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.050 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.050 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.050 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.050 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118619 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.050 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928585+0000", 2024-09-14T06:00:42.050 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.002095385, 2024-09-14T06:00:42.050 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0032641530000000001, 2024-09-14T06:00:42.050 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.050 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.051 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.051 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.051 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.051 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.051 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118619 2024-09-14T06:00:42.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.051 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.051 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.051 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.051 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928585+0000", 2024-09-14T06:00:42.051 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.052 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.052 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.052 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928585+0000", 2024-09-14T06:00:42.052 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.052 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.052 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.052 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928585+0000", 2024-09-14T06:00:42.053 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5799999999999999e-07 2024-09-14T06:00:42.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.053 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928593+0000", 2024-09-14T06:00:42.053 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8310000000000001e-06 2024-09-14T06:00:42.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.053 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928601+0000", 2024-09-14T06:00:42.053 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8380000000000002e-06 2024-09-14T06:00:42.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.054 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928607+0000", 2024-09-14T06:00:42.054 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7529999999999998e-06 2024-09-14T06:00:42.054 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.054 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.054 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.054 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118694 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.054 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929370+0000", 2024-09-14T06:00:42.055 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00131036, 2024-09-14T06:00:42.055 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0025313670000000001, 2024-09-14T06:00:42.055 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.055 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.055 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.055 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.055 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.055 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.055 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118694 2024-09-14T06:00:42.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.055 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.055 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.055 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929370+0000", 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929370+0000", 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929370+0000", 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4000000000000001e-07 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.056 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.057 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929373+0000", 2024-09-14T06:00:42.057 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5849999999999998e-06 2024-09-14T06:00:42.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.057 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.057 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929381+0000", 2024-09-14T06:00:42.057 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5089999999999996e-06 2024-09-14T06:00:42.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.057 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.057 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929387+0000", 2024-09-14T06:00:42.057 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2740000000000004e-06 2024-09-14T06:00:42.057 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.058 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.058 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.058 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.058 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118726 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.058 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930138+0000", 2024-09-14T06:00:42.058 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00054259999999999996, 2024-09-14T06:00:42.058 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0018143860000000001, 2024-09-14T06:00:42.058 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.058 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.058 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.058 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.058 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.058 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.059 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118726 2024-09-14T06:00:42.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.059 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.059 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.059 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.059 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930138+0000", 2024-09-14T06:00:42.059 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.059 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.059 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.059 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930138+0000", 2024-09-14T06:00:42.059 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.059 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.060 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.060 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930138+0000", 2024-09-14T06:00:42.060 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.58e-07 2024-09-14T06:00:42.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.060 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.060 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.060 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930140+0000", 2024-09-14T06:00:42.060 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8729999999999999e-06 2024-09-14T06:00:42.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.060 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.060 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.060 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930146+0000", 2024-09-14T06:00:42.061 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9259999999999997e-06 2024-09-14T06:00:42.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.061 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.061 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.061 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930151+0000", 2024-09-14T06:00:42.061 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7650000000000001e-06 2024-09-14T06:00:42.061 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.061 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.061 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.061 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.061 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118482 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.062 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.925930+0000", 2024-09-14T06:00:42.062 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0047502639999999997, 2024-09-14T06:00:42.062 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0060650840000000001, 2024-09-14T06:00:42.062 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.062 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.062 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.062 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.062 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.062 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.062 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118482 2024-09-14T06:00:42.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.062 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.062 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.062 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925930+0000", 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925930+0000", 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925930+0000", 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.27e-07 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.063 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925955+0000", 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4474999999999999e-05 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925964+0000", 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0350000000000007e-06 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925970+0000", 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5080000000000002e-06 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.064 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.065 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.065 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118556 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.065 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926907+0000", 2024-09-14T06:00:42.065 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0037735120000000001, 2024-09-14T06:00:42.065 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0051144950000000002, 2024-09-14T06:00:42.065 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.065 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.065 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.065 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.065 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.065 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118556 2024-09-14T06:00:42.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.066 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.066 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.066 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926907+0000", 2024-09-14T06:00:42.066 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.066 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.066 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926907+0000", 2024-09-14T06:00:42.066 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.067 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.067 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926907+0000", 2024-09-14T06:00:42.067 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4900000000000001e-07 2024-09-14T06:00:42.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.067 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.067 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.067 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926910+0000", 2024-09-14T06:00:42.067 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4710000000000001e-06 2024-09-14T06:00:42.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.067 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.067 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.067 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926917+0000", 2024-09-14T06:00:42.067 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1060000000000002e-06 2024-09-14T06:00:42.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.068 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.068 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.068 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926922+0000", 2024-09-14T06:00:42.068 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4639999999999997e-06 2024-09-14T06:00:42.068 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.068 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.068 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.068 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.068 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118588 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.068 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927826+0000", 2024-09-14T06:00:42.068 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.002854133, 2024-09-14T06:00:42.068 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042219989999999997, 2024-09-14T06:00:42.069 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.069 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.069 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.069 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.069 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.069 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.069 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118588 2024-09-14T06:00:42.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.069 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.069 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.069 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.069 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927826+0000", 2024-09-14T06:00:42.069 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.070 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.070 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.070 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927826+0000", 2024-09-14T06:00:42.070 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.070 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.070 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.070 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927827+0000", 2024-09-14T06:00:42.070 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2300000000000001e-07 2024-09-14T06:00:42.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.070 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.070 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.070 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927829+0000", 2024-09-14T06:00:42.070 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6539999999999999e-06 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927837+0000", 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2420000000000003e-06 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927842+0000", 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4539999999999998e-06 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.071 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118620 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928615+0000", 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.002065365, 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003457519, 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118620 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.072 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.073 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928615+0000", 2024-09-14T06:00:42.073 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.073 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.073 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.073 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928615+0000", 2024-09-14T06:00:42.073 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.073 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.073 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.073 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928615+0000", 2024-09-14T06:00:42.073 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2799999999999996e-07 2024-09-14T06:00:42.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.074 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.074 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928617+0000", 2024-09-14T06:00:42.074 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0789999999999999e-06 2024-09-14T06:00:42.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.074 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.074 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928624+0000", 2024-09-14T06:00:42.074 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2299999999999996e-06 2024-09-14T06:00:42.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.074 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.074 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928629+0000", 2024-09-14T06:00:42.075 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0100000000000003e-06 2024-09-14T06:00:42.075 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.075 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.075 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.075 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.075 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118695 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.075 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929396+0000", 2024-09-14T06:00:42.075 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001284416, 2024-09-14T06:00:42.075 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00275647, 2024-09-14T06:00:42.075 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.075 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.075 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.075 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118695 2024-09-14T06:00:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929396+0000", 2024-09-14T06:00:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929396+0000", 2024-09-14T06:00:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.077 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.077 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.077 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929396+0000", 2024-09-14T06:00:42.077 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8299999999999997e-07 2024-09-14T06:00:42.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.077 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.077 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.077 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929399+0000", 2024-09-14T06:00:42.077 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1940000000000001e-06 2024-09-14T06:00:42.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.077 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.077 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.077 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929405+0000", 2024-09-14T06:00:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.703e-06 2024-09-14T06:00:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929410+0000", 2024-09-14T06:00:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0860000000000001e-06 2024-09-14T06:00:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118727 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930158+0000", 2024-09-14T06:00:42.078 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00052253200000000003, 2024-09-14T06:00:42.079 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0020477429999999999, 2024-09-14T06:00:42.079 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.079 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.079 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.079 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.079 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.079 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.079 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118727 2024-09-14T06:00:42.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.079 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.079 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.079 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.079 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930158+0000", 2024-09-14T06:00:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930158+0000", 2024-09-14T06:00:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930158+0000", 2024-09-14T06:00:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1399999999999997e-07 2024-09-14T06:00:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.080 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930161+0000", 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.379e-06 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930168+0000", 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3239999999999997e-06 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930173+0000", 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9899999999999997e-06 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.081 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118483 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.925981+0000", 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.004699384, 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0062790249999999997, 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118483 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.082 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925981+0000", 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925981+0000", 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925981+0000", 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1799999999999995e-07 2024-09-14T06:00:42.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.084 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.084 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.084 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925984+0000", 2024-09-14T06:00:42.084 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5720000000000001e-06 2024-09-14T06:00:42.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.084 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.084 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.084 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925992+0000", 2024-09-14T06:00:42.084 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0299999999999994e-06 2024-09-14T06:00:42.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.084 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.084 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.084 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.925997+0000", 2024-09-14T06:00:42.084 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5319999999999997e-06 2024-09-14T06:00:42.085 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.085 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.085 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.085 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118557 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.085 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926931+0000", 2024-09-14T06:00:42.085 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0037490549999999998, 2024-09-14T06:00:42.085 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053830479999999997, 2024-09-14T06:00:42.085 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.085 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.085 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.085 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.085 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.086 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.086 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118557 2024-09-14T06:00:42.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.086 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.086 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.086 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.086 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926931+0000", 2024-09-14T06:00:42.086 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.086 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.086 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.086 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926931+0000", 2024-09-14T06:00:42.086 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.087 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.087 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.087 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926932+0000", 2024-09-14T06:00:42.087 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.01e-07 2024-09-14T06:00:42.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.087 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.087 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.087 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926934+0000", 2024-09-14T06:00:42.087 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.486e-06 2024-09-14T06:00:42.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.087 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.087 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.087 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926942+0000", 2024-09-14T06:00:42.087 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0539999999999995e-06 2024-09-14T06:00:42.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.088 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.088 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.088 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926948+0000", 2024-09-14T06:00:42.088 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4609999999999999e-06 2024-09-14T06:00:42.088 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.088 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.088 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.088 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.088 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118589 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.088 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927850+0000", 2024-09-14T06:00:42.088 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0028306809999999998, 2024-09-14T06:00:42.088 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045158660000000003, 2024-09-14T06:00:42.089 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.089 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.089 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.089 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.089 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.089 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.089 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118589 2024-09-14T06:00:42.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.089 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.089 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.089 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.089 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927850+0000", 2024-09-14T06:00:42.089 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.090 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.090 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.090 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927850+0000", 2024-09-14T06:00:42.090 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.090 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.090 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.090 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927850+0000", 2024-09-14T06:00:42.090 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.89e-07 2024-09-14T06:00:42.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.090 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.090 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.090 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927852+0000", 2024-09-14T06:00:42.091 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1440000000000001e-06 2024-09-14T06:00:42.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.091 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.091 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.091 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927860+0000", 2024-09-14T06:00:42.091 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4449999999999999e-06 2024-09-14T06:00:42.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.091 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.091 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.091 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927865+0000", 2024-09-14T06:00:42.091 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2680000000000002e-06 2024-09-14T06:00:42.091 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.091 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.091 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.092 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.092 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118621 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.092 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928635+0000", 2024-09-14T06:00:42.092 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0020450630000000002, 2024-09-14T06:00:42.092 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037850100000000001, 2024-09-14T06:00:42.092 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.092 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.092 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.092 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.092 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.092 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.093 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118621 2024-09-14T06:00:42.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.093 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.093 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.093 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.093 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928635+0000", 2024-09-14T06:00:42.093 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.093 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.093 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.093 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928635+0000", 2024-09-14T06:00:42.093 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.093 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928636+0000", 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5999999999999999e-07 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928638+0000", 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0229999999999999e-06 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928644+0000", 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.251e-06 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.094 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928650+0000", 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0809999999999999e-06 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118696 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929417+0000", 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001263272, 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0030539930000000001, 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.095 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118696 2024-09-14T06:00:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929417+0000", 2024-09-14T06:00:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.096 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929417+0000", 2024-09-14T06:00:42.097 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.097 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.097 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.097 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929417+0000", 2024-09-14T06:00:42.097 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4400000000000001e-07 2024-09-14T06:00:42.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.097 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.097 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.097 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929419+0000", 2024-09-14T06:00:42.097 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.79e-06 2024-09-14T06:00:42.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.097 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929425+0000", 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0700000000000003e-06 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929430+0000", 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8189999999999999e-06 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118728 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.098 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930180+0000", 2024-09-14T06:00:42.099 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00050033399999999996, 2024-09-14T06:00:42.099 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0023464829999999999, 2024-09-14T06:00:42.099 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.099 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.099 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.099 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.099 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.099 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.099 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118728 2024-09-14T06:00:42.099 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.099 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.099 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.099 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930180+0000", 2024-09-14T06:00:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930180+0000", 2024-09-14T06:00:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930180+0000", 2024-09-14T06:00:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6800000000000001e-07 2024-09-14T06:00:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.101 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.101 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930182+0000", 2024-09-14T06:00:42.101 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.232e-06 2024-09-14T06:00:42.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.101 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.101 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.101 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930189+0000", 2024-09-14T06:00:42.101 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9290000000000001e-06 2024-09-14T06:00:42.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.101 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.101 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.101 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930194+0000", 2024-09-14T06:00:42.101 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4660000000000001e-06 2024-09-14T06:00:42.101 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.102 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.102 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.102 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.102 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118484 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.102 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926006+0000", 2024-09-14T06:00:42.102 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0046745399999999996, 2024-09-14T06:00:42.102 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0065734460000000002, 2024-09-14T06:00:42.102 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.102 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.102 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.102 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.102 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.103 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.103 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118484 2024-09-14T06:00:42.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.103 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.103 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.103 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.103 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926006+0000", 2024-09-14T06:00:42.103 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.103 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.103 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.103 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926006+0000", 2024-09-14T06:00:42.103 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.104 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.104 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.104 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926006+0000", 2024-09-14T06:00:42.104 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6400000000000002e-07 2024-09-14T06:00:42.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.104 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.104 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.104 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926009+0000", 2024-09-14T06:00:42.104 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3180000000000001e-06 2024-09-14T06:00:42.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.104 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.104 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.105 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926017+0000", 2024-09-14T06:00:42.105 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7329999999999992e-06 2024-09-14T06:00:42.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.105 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.105 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.105 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926023+0000", 2024-09-14T06:00:42.105 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2140000000000004e-06 2024-09-14T06:00:42.105 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.105 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.105 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.105 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.105 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118558 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.106 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926973+0000", 2024-09-14T06:00:42.106 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.003707573, 2024-09-14T06:00:42.106 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0057061350000000002, 2024-09-14T06:00:42.106 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.106 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.106 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.106 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.106 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.106 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.106 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118558 2024-09-14T06:00:42.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.106 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.106 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.106 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.107 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926973+0000", 2024-09-14T06:00:42.107 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.107 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.107 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.107 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926973+0000", 2024-09-14T06:00:42.107 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.107 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.107 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.107 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926973+0000", 2024-09-14T06:00:42.107 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.92e-07 2024-09-14T06:00:42.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.107 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.108 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.108 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926976+0000", 2024-09-14T06:00:42.108 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9129999999999999e-06 2024-09-14T06:00:42.108 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.108 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.108 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.108 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926984+0000", 2024-09-14T06:00:42.108 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1510000000000004e-06 2024-09-14T06:00:42.108 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.108 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.108 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.108 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926990+0000", 2024-09-14T06:00:42.108 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.857e-06 2024-09-14T06:00:42.109 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.109 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.109 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.109 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.109 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118590 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.109 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927874+0000", 2024-09-14T06:00:42.109 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0028062410000000001, 2024-09-14T06:00:42.109 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049254879999999996, 2024-09-14T06:00:42.109 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.109 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.109 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118590 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927874+0000", 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927874+0000", 2024-09-14T06:00:42.110 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.111 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.111 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.111 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927874+0000", 2024-09-14T06:00:42.111 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3700000000000001e-07 2024-09-14T06:00:42.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.111 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.111 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.111 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927877+0000", 2024-09-14T06:00:42.111 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2350000000000002e-06 2024-09-14T06:00:42.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.111 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.111 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.111 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927885+0000", 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9189999999999999e-06 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927892+0000", 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1269999999999997e-06 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118622 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928658+0000", 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0020221610000000002, 2024-09-14T06:00:42.112 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042238090000000002, 2024-09-14T06:00:42.113 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.113 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.113 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.113 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.113 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.113 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.113 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118622 2024-09-14T06:00:42.113 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.113 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.113 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.113 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.113 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928658+0000", 2024-09-14T06:00:42.113 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928658+0000", 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928659+0000", 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8500000000000002e-07 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928661+0000", 2024-09-14T06:00:42.114 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3870000000000002e-06 2024-09-14T06:00:42.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.115 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.115 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.115 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928668+0000", 2024-09-14T06:00:42.115 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9809999999999997e-06 2024-09-14T06:00:42.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.115 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.115 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.115 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928673+0000", 2024-09-14T06:00:42.115 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9710000000000003e-06 2024-09-14T06:00:42.115 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.115 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.115 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.116 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.116 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118697 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.116 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929436+0000", 2024-09-14T06:00:42.116 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001244141, 2024-09-14T06:00:42.116 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035107300000000001, 2024-09-14T06:00:42.116 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.116 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.116 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.116 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.116 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.116 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.116 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118697 2024-09-14T06:00:42.116 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.116 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.117 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.117 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.117 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929436+0000", 2024-09-14T06:00:42.117 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.117 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.117 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.117 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929436+0000", 2024-09-14T06:00:42.117 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.117 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.117 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.117 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929436+0000", 2024-09-14T06:00:42.117 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7599999999999998e-07 2024-09-14T06:00:42.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.118 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.118 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.118 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929438+0000", 2024-09-14T06:00:42.118 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.852e-06 2024-09-14T06:00:42.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.118 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.118 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.118 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929444+0000", 2024-09-14T06:00:42.118 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1530000000000002e-06 2024-09-14T06:00:42.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.118 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.118 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.118 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929449+0000", 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8029999999999996e-06 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118729 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930200+0000", 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00047972200000000003, 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0028044039999999999, 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.119 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.120 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.120 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118729 2024-09-14T06:00:42.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.120 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.120 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.120 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.120 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930200+0000", 2024-09-14T06:00:42.120 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.120 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.120 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.120 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930200+0000", 2024-09-14T06:00:42.120 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.121 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.121 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.121 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930201+0000", 2024-09-14T06:00:42.121 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6699999999999999e-07 2024-09-14T06:00:42.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.121 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.121 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.121 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930203+0000", 2024-09-14T06:00:42.121 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.001e-06 2024-09-14T06:00:42.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.121 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.121 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.122 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930209+0000", 2024-09-14T06:00:42.122 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5579999999999997e-06 2024-09-14T06:00:42.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.122 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.122 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.122 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930214+0000", 2024-09-14T06:00:42.122 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9010000000000002e-06 2024-09-14T06:00:42.122 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.122 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.122 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.122 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.122 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118485 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.122 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926030+0000", 2024-09-14T06:00:42.123 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.004650146, 2024-09-14T06:00:42.123 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070292749999999998, 2024-09-14T06:00:42.123 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.123 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.123 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.123 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.123 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.123 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.123 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118485 2024-09-14T06:00:42.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.123 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.123 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.123 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.123 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926030+0000", 2024-09-14T06:00:42.124 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.124 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.124 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.124 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926030+0000", 2024-09-14T06:00:42.124 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.124 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.124 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.124 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926031+0000", 2024-09-14T06:00:42.124 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7199999999999999e-07 2024-09-14T06:00:42.124 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.124 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.125 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.125 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926033+0000", 2024-09-14T06:00:42.125 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3999999999999999e-06 2024-09-14T06:00:42.125 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.125 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.125 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.125 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926041+0000", 2024-09-14T06:00:42.125 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0450000000000001e-06 2024-09-14T06:00:42.125 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.125 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.125 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.125 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926047+0000", 2024-09-14T06:00:42.125 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5459999999999999e-06 2024-09-14T06:00:42.125 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.126 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.126 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.126 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.126 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118559 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.126 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927000+0000", 2024-09-14T06:00:42.126 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0036804580000000002, 2024-09-14T06:00:42.126 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0061153379999999997, 2024-09-14T06:00:42.126 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.126 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.126 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.126 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.126 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.127 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.127 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118559 2024-09-14T06:00:42.127 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.127 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.127 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.127 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.127 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927000+0000", 2024-09-14T06:00:42.127 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.127 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.127 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.127 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.127 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927000+0000", 2024-09-14T06:00:42.127 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.127 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.128 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.128 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.128 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927000+0000", 2024-09-14T06:00:42.128 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7400000000000003e-07 2024-09-14T06:00:42.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.128 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.128 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.128 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927003+0000", 2024-09-14T06:00:42.128 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4490000000000002e-06 2024-09-14T06:00:42.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.128 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.128 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.128 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927010+0000", 2024-09-14T06:00:42.128 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3889999999999999e-06 2024-09-14T06:00:42.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.129 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.129 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.129 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927016+0000", 2024-09-14T06:00:42.129 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5550000000000002e-06 2024-09-14T06:00:42.129 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.129 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.129 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.129 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.129 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118591 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.129 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927900+0000", 2024-09-14T06:00:42.129 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0027806839999999998, 2024-09-14T06:00:42.130 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0052666730000000004, 2024-09-14T06:00:42.130 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.130 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.130 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.130 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.130 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.130 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.130 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118591 2024-09-14T06:00:42.130 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.130 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.130 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.130 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.130 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927900+0000", 2024-09-14T06:00:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927900+0000", 2024-09-14T06:00:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927900+0000", 2024-09-14T06:00:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2e-07 2024-09-14T06:00:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.131 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.132 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927902+0000", 2024-09-14T06:00:42.132 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2330000000000001e-06 2024-09-14T06:00:42.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.132 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.132 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.132 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927909+0000", 2024-09-14T06:00:42.132 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6749999999999996e-06 2024-09-14T06:00:42.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.132 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.132 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.132 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927914+0000", 2024-09-14T06:00:42.132 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0989999999999998e-06 2024-09-14T06:00:42.133 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.133 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.133 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.133 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.133 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118623 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.133 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928681+0000", 2024-09-14T06:00:42.133 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0019988559999999998, 2024-09-14T06:00:42.133 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045400639999999999, 2024-09-14T06:00:42.133 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.133 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.133 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.133 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118623 2024-09-14T06:00:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928681+0000", 2024-09-14T06:00:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928681+0000", 2024-09-14T06:00:42.134 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928682+0000", 2024-09-14T06:00:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7899999999999999e-07 2024-09-14T06:00:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928684+0000", 2024-09-14T06:00:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.306e-06 2024-09-14T06:00:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.135 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.136 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928691+0000", 2024-09-14T06:00:42.136 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.798e-06 2024-09-14T06:00:42.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.136 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.136 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.136 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928696+0000", 2024-09-14T06:00:42.136 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.378e-06 2024-09-14T06:00:42.136 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.136 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.136 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.136 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.136 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118698 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.137 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929456+0000", 2024-09-14T06:00:42.137 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0012239130000000001, 2024-09-14T06:00:42.137 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003794525, 2024-09-14T06:00:42.137 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.137 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.137 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.137 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.137 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.137 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.137 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118698 2024-09-14T06:00:42.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.137 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.137 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.137 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.138 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929456+0000", 2024-09-14T06:00:42.138 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.138 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.138 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929456+0000", 2024-09-14T06:00:42.138 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.138 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.138 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929457+0000", 2024-09-14T06:00:42.138 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6699999999999999e-07 2024-09-14T06:00:42.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.139 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.139 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929463+0000", 2024-09-14T06:00:42.139 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1109999999999996e-06 2024-09-14T06:00:42.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.139 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.139 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.139 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929469+0000", 2024-09-14T06:00:42.139 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6810000000000001e-06 2024-09-14T06:00:42.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.139 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.139 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.139 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929475+0000", 2024-09-14T06:00:42.139 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1050000000000003e-06 2024-09-14T06:00:42.139 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.140 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.140 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.140 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.140 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118730 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.140 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930222+0000", 2024-09-14T06:00:42.140 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00045819399999999998, 2024-09-14T06:00:42.140 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0030545070000000001, 2024-09-14T06:00:42.140 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.140 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.140 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.140 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.140 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118730 2024-09-14T06:00:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930222+0000", 2024-09-14T06:00:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930222+0000", 2024-09-14T06:00:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930222+0000", 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3099999999999998e-07 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930225+0000", 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.232e-06 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930230+0000", 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8050000000000003e-06 2024-09-14T06:00:42.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.143 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.143 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930235+0000", 2024-09-14T06:00:42.143 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7260000000000002e-06 2024-09-14T06:00:42.143 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.143 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.143 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.143 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118486 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.143 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926054+0000", 2024-09-14T06:00:42.143 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0046265239999999999, 2024-09-14T06:00:42.143 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0072524850000000004, 2024-09-14T06:00:42.143 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.144 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.144 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.144 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.144 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.144 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.144 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118486 2024-09-14T06:00:42.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.144 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.144 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.144 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.144 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926054+0000", 2024-09-14T06:00:42.144 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.145 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.145 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926054+0000", 2024-09-14T06:00:42.145 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.145 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.145 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926054+0000", 2024-09-14T06:00:42.145 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4400000000000001e-07 2024-09-14T06:00:42.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.145 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.145 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926056+0000", 2024-09-14T06:00:42.146 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2359999999999999e-06 2024-09-14T06:00:42.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.146 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.146 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926064+0000", 2024-09-14T06:00:42.146 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8359999999999992e-06 2024-09-14T06:00:42.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.146 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.146 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926070+0000", 2024-09-14T06:00:42.146 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3639999999999998e-06 2024-09-14T06:00:42.146 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.146 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.146 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.147 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118560 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.147 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927023+0000", 2024-09-14T06:00:42.147 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0036568849999999999, 2024-09-14T06:00:42.147 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0063152319999999996, 2024-09-14T06:00:42.147 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.147 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.147 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.147 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.147 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.147 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.147 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118560 2024-09-14T06:00:42.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.148 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.148 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.148 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927023+0000", 2024-09-14T06:00:42.148 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.148 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.148 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927023+0000", 2024-09-14T06:00:42.148 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.148 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.149 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927024+0000", 2024-09-14T06:00:42.149 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0200000000000003e-07 2024-09-14T06:00:42.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.149 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.149 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927058+0000", 2024-09-14T06:00:42.149 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4082999999999999e-05 2024-09-14T06:00:42.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.149 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.149 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927070+0000", 2024-09-14T06:00:42.149 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1708e-05 2024-09-14T06:00:42.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.150 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.150 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927077+0000", 2024-09-14T06:00:42.150 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.357e-06 2024-09-14T06:00:42.150 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.150 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.150 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.150 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118592 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.150 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927922+0000", 2024-09-14T06:00:42.150 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0027578569999999998, 2024-09-14T06:00:42.150 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054542540000000004, 2024-09-14T06:00:42.150 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.150 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118592 2024-09-14T06:00:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927922+0000", 2024-09-14T06:00:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.151 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927922+0000", 2024-09-14T06:00:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927923+0000", 2024-09-14T06:00:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.15e-07 2024-09-14T06:00:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927925+0000", 2024-09-14T06:00:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1739999999999999e-06 2024-09-14T06:00:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927932+0000", 2024-09-14T06:00:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6969999999999996e-06 2024-09-14T06:00:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927937+0000", 2024-09-14T06:00:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.169e-06 2024-09-14T06:00:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.153 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.154 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118624 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.154 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928722+0000", 2024-09-14T06:00:42.154 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0019578809999999999, 2024-09-14T06:00:42.154 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046907829999999996, 2024-09-14T06:00:42.154 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.154 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.154 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.154 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.154 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.155 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.155 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118624 2024-09-14T06:00:42.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.155 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.155 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.155 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928722+0000", 2024-09-14T06:00:42.155 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.155 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.155 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928722+0000", 2024-09-14T06:00:42.155 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.156 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.156 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928723+0000", 2024-09-14T06:00:42.156 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7000000000000004e-07 2024-09-14T06:00:42.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.156 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.156 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928726+0000", 2024-09-14T06:00:42.156 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6120000000000001e-06 2024-09-14T06:00:42.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.156 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.156 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928734+0000", 2024-09-14T06:00:42.157 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9680000000000006e-06 2024-09-14T06:00:42.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.157 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.157 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.157 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928739+0000", 2024-09-14T06:00:42.157 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7599999999999999e-06 2024-09-14T06:00:42.157 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.157 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.157 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.157 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.157 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118699 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.157 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929483+0000", 2024-09-14T06:00:42.157 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0011974920000000001, 2024-09-14T06:00:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039846580000000003, 2024-09-14T06:00:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118699 2024-09-14T06:00:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929483+0000", 2024-09-14T06:00:42.158 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929483+0000", 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929483+0000", 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5200000000000002e-07 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929485+0000", 2024-09-14T06:00:42.159 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2529999999999999e-06 2024-09-14T06:00:42.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.160 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.160 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929492+0000", 2024-09-14T06:00:42.160 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6719999999999998e-06 2024-09-14T06:00:42.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.160 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.160 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929497+0000", 2024-09-14T06:00:42.160 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2399999999999998e-06 2024-09-14T06:00:42.160 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.160 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.160 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.161 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118731 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.161 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930260+0000", 2024-09-14T06:00:42.161 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00041989799999999998, 2024-09-14T06:00:42.161 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003258496, 2024-09-14T06:00:42.161 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.161 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.161 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.162 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.162 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.162 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118731 2024-09-14T06:00:42.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.162 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.162 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.162 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930260+0000", 2024-09-14T06:00:42.162 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.162 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.163 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930260+0000", 2024-09-14T06:00:42.163 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.163 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.163 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930261+0000", 2024-09-14T06:00:42.163 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3e-07 2024-09-14T06:00:42.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.163 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.164 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930264+0000", 2024-09-14T06:00:42.164 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7779999999999999e-06 2024-09-14T06:00:42.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.164 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.164 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930272+0000", 2024-09-14T06:00:42.164 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.072e-06 2024-09-14T06:00:42.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.164 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.164 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930278+0000", 2024-09-14T06:00:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7710000000000003e-06 2024-09-14T06:00:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118487 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926077+0000", 2024-09-14T06:00:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0046029859999999999, 2024-09-14T06:00:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075008840000000002, 2024-09-14T06:00:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118487 2024-09-14T06:00:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926077+0000", 2024-09-14T06:00:42.167 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.167 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.167 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926077+0000", 2024-09-14T06:00:42.167 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.167 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.167 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926078+0000", 2024-09-14T06:00:42.167 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3399999999999999e-07 2024-09-14T06:00:42.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.168 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.168 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926080+0000", 2024-09-14T06:00:42.168 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.644e-06 2024-09-14T06:00:42.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.168 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.168 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926087+0000", 2024-09-14T06:00:42.168 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0829999999999998e-06 2024-09-14T06:00:42.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.169 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.169 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926093+0000", 2024-09-14T06:00:42.169 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0640000000000001e-06 2024-09-14T06:00:42.169 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.169 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.169 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.169 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118561 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.169 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927091+0000", 2024-09-14T06:00:42.170 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0035887169999999999, 2024-09-14T06:00:42.170 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0065395540000000004, 2024-09-14T06:00:42.170 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.170 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.170 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.170 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.170 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.170 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.170 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118561 2024-09-14T06:00:42.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.170 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.171 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.171 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927091+0000", 2024-09-14T06:00:42.171 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.171 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.171 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927091+0000", 2024-09-14T06:00:42.171 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.172 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.172 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927092+0000", 2024-09-14T06:00:42.172 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5799999999999998e-07 2024-09-14T06:00:42.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.172 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.172 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927095+0000", 2024-09-14T06:00:42.172 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9790000000000002e-06 2024-09-14T06:00:42.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.173 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.173 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927103+0000", 2024-09-14T06:00:42.173 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7659999999999998e-06 2024-09-14T06:00:42.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.173 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.173 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927109+0000", 2024-09-14T06:00:42.173 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6799999999999998e-06 2024-09-14T06:00:42.173 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.173 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.174 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.174 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118593 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.174 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927944+0000", 2024-09-14T06:00:42.174 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0027357839999999998, 2024-09-14T06:00:42.174 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0057309830000000003, 2024-09-14T06:00:42.174 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.174 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.174 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.175 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.175 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.175 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118593 2024-09-14T06:00:42.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.175 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.175 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.175 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927944+0000", 2024-09-14T06:00:42.175 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.175 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.176 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927944+0000", 2024-09-14T06:00:42.176 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.176 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.176 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927945+0000", 2024-09-14T06:00:42.176 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5499999999999998e-07 2024-09-14T06:00:42.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.176 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.176 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927947+0000", 2024-09-14T06:00:42.177 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5040000000000001e-06 2024-09-14T06:00:42.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.177 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.177 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927954+0000", 2024-09-14T06:00:42.177 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8630000000000002e-06 2024-09-14T06:00:42.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.177 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.177 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927960+0000", 2024-09-14T06:00:42.177 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.305e-06 2024-09-14T06:00:42.178 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.178 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.178 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.178 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118625 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.178 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928747+0000", 2024-09-14T06:00:42.178 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001932827, 2024-09-14T06:00:42.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049686069999999999, 2024-09-14T06:00:42.178 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.178 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118625 2024-09-14T06:00:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928747+0000", 2024-09-14T06:00:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.180 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.180 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928747+0000", 2024-09-14T06:00:42.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.180 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.180 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928748+0000", 2024-09-14T06:00:42.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6100000000000001e-07 2024-09-14T06:00:42.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.180 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.180 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928750+0000", 2024-09-14T06:00:42.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.255e-06 2024-09-14T06:00:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928756+0000", 2024-09-14T06:00:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1140000000000002e-06 2024-09-14T06:00:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928761+0000", 2024-09-14T06:00:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1039999999999998e-06 2024-09-14T06:00:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.181 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.182 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118700 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.182 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929506+0000", 2024-09-14T06:00:42.182 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001174455, 2024-09-14T06:00:42.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042448360000000001, 2024-09-14T06:00:42.182 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.182 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.182 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.182 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.182 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.182 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.182 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118700 2024-09-14T06:00:42.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.183 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929506+0000", 2024-09-14T06:00:42.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929506+0000", 2024-09-14T06:00:42.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929506+0000", 2024-09-14T06:00:42.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8899999999999999e-07 2024-09-14T06:00:42.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929509+0000", 2024-09-14T06:00:42.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.526e-06 2024-09-14T06:00:42.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929517+0000", 2024-09-14T06:00:42.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8110000000000003e-06 2024-09-14T06:00:42.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.185 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.185 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929522+0000", 2024-09-14T06:00:42.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0050000000000004e-06 2024-09-14T06:00:42.185 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.185 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.185 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.185 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118732 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.185 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930287+0000", 2024-09-14T06:00:42.185 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00039330099999999998, 2024-09-14T06:00:42.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0034945150000000001, 2024-09-14T06:00:42.185 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.186 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.186 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.186 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.186 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.186 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118732 2024-09-14T06:00:42.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.186 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930287+0000", 2024-09-14T06:00:42.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930287+0000", 2024-09-14T06:00:42.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930287+0000", 2024-09-14T06:00:42.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2e-07 2024-09-14T06:00:42.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930290+0000", 2024-09-14T06:00:42.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6410000000000002e-06 2024-09-14T06:00:42.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.188 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930297+0000", 2024-09-14T06:00:42.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8560000000000001e-06 2024-09-14T06:00:42.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.188 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930302+0000", 2024-09-14T06:00:42.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4040000000000003e-06 2024-09-14T06:00:42.189 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.189 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.189 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.189 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118488 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.189 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926131+0000", 2024-09-14T06:00:42.189 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0045488600000000001, 2024-09-14T06:00:42.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0076834440000000002, 2024-09-14T06:00:42.189 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.189 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.190 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.190 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.190 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.190 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118488 2024-09-14T06:00:42.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.190 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.190 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.190 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926131+0000", 2024-09-14T06:00:42.190 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926131+0000", 2024-09-14T06:00:42.191 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926132+0000", 2024-09-14T06:00:42.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5899999999999996e-07 2024-09-14T06:00:42.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926135+0000", 2024-09-14T06:00:42.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8700000000000001e-06 2024-09-14T06:00:42.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926143+0000", 2024-09-14T06:00:42.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5269999999999998e-06 2024-09-14T06:00:42.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.193 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.193 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926150+0000", 2024-09-14T06:00:42.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2339999999999999e-06 2024-09-14T06:00:42.193 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.193 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.193 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.194 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118562 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.194 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927117+0000", 2024-09-14T06:00:42.194 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0035632200000000002, 2024-09-14T06:00:42.194 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0067379509999999998, 2024-09-14T06:00:42.194 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.194 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.194 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.194 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.194 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.194 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118562 2024-09-14T06:00:42.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.195 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.195 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927117+0000", 2024-09-14T06:00:42.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.195 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927117+0000", 2024-09-14T06:00:42.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927117+0000", 2024-09-14T06:00:42.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9800000000000004e-07 2024-09-14T06:00:42.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927120+0000", 2024-09-14T06:00:42.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.486e-06 2024-09-14T06:00:42.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.197 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927127+0000", 2024-09-14T06:00:42.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0350000000000004e-06 2024-09-14T06:00:42.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.197 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.197 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927133+0000", 2024-09-14T06:00:42.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5470000000000004e-06 2024-09-14T06:00:42.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.197 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.198 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118594 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.198 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927967+0000", 2024-09-14T06:00:42.198 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0027133280000000001, 2024-09-14T06:00:42.198 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0060025440000000003, 2024-09-14T06:00:42.198 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.198 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.198 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.198 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.199 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.199 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118594 2024-09-14T06:00:42.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.199 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.199 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.199 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927967+0000", 2024-09-14T06:00:42.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.199 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.199 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927967+0000", 2024-09-14T06:00:42.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927968+0000", 2024-09-14T06:00:42.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2300000000000001e-07 2024-09-14T06:00:42.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927970+0000", 2024-09-14T06:00:42.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1100000000000001e-06 2024-09-14T06:00:42.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927976+0000", 2024-09-14T06:00:42.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.764e-06 2024-09-14T06:00:42.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927982+0000", 2024-09-14T06:00:42.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1279999999999999e-06 2024-09-14T06:00:42.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.201 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.201 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118626 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.202 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928768+0000", 2024-09-14T06:00:42.202 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001911886, 2024-09-14T06:00:42.202 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0052406859999999996, 2024-09-14T06:00:42.202 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.202 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.202 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.202 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.202 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.202 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118626 2024-09-14T06:00:42.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.202 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928768+0000", 2024-09-14T06:00:42.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928768+0000", 2024-09-14T06:00:42.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.204 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928769+0000", 2024-09-14T06:00:42.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6899999999999998e-07 2024-09-14T06:00:42.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.204 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928771+0000", 2024-09-14T06:00:42.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T06:00:42.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928778+0000", 2024-09-14T06:00:42.205 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1969999999999999e-06 2024-09-14T06:00:42.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928783+0000", 2024-09-14T06:00:42.205 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8940000000000001e-06 2024-09-14T06:00:42.205 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.205 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.205 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.206 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118701 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.206 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929529+0000", 2024-09-14T06:00:42.206 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001150807, 2024-09-14T06:00:42.206 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045113749999999998, 2024-09-14T06:00:42.206 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.206 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.206 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.206 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.206 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.206 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118701 2024-09-14T06:00:42.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.207 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.207 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.207 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929529+0000", 2024-09-14T06:00:42.207 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.207 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.207 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929529+0000", 2024-09-14T06:00:42.207 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929530+0000", 2024-09-14T06:00:42.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9200000000000001e-07 2024-09-14T06:00:42.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929532+0000", 2024-09-14T06:00:42.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1909999999999999e-06 2024-09-14T06:00:42.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929539+0000", 2024-09-14T06:00:42.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T06:00:42.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.209 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.209 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929544+0000", 2024-09-14T06:00:42.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9239999999999998e-06 2024-09-14T06:00:42.209 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.209 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.209 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.209 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118733 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.209 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930310+0000", 2024-09-14T06:00:42.210 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00037050899999999999, 2024-09-14T06:00:42.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037699040000000001, 2024-09-14T06:00:42.210 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.210 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.210 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.210 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.210 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.210 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118733 2024-09-14T06:00:42.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.210 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.210 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930310+0000", 2024-09-14T06:00:42.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.211 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.211 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930310+0000", 2024-09-14T06:00:42.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.211 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.211 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930310+0000", 2024-09-14T06:00:42.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.96e-07 2024-09-14T06:00:42.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930312+0000", 2024-09-14T06:00:42.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3250000000000002e-06 2024-09-14T06:00:42.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930318+0000", 2024-09-14T06:00:42.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9900000000000002e-06 2024-09-14T06:00:42.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930323+0000", 2024-09-14T06:00:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0300000000000001e-06 2024-09-14T06:00:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118489 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926160+0000", 2024-09-14T06:00:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0045199089999999999, 2024-09-14T06:00:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0079624399999999994, 2024-09-14T06:00:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.214 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.214 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.214 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118489 2024-09-14T06:00:42.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.214 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.214 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926160+0000", 2024-09-14T06:00:42.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.214 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926160+0000", 2024-09-14T06:00:42.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.215 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.215 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926161+0000", 2024-09-14T06:00:42.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4799999999999999e-07 2024-09-14T06:00:42.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.215 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.215 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926163+0000", 2024-09-14T06:00:42.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0760000000000001e-06 2024-09-14T06:00:42.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926169+0000", 2024-09-14T06:00:42.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2550000000000003e-06 2024-09-14T06:00:42.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926174+0000", 2024-09-14T06:00:42.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7979999999999996e-06 2024-09-14T06:00:42.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.216 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.217 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118563 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.217 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927141+0000", 2024-09-14T06:00:42.217 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0035389869999999999, 2024-09-14T06:00:42.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070192620000000001, 2024-09-14T06:00:42.217 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.217 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.217 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.217 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.217 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.217 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.217 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118563 2024-09-14T06:00:42.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.218 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927141+0000", 2024-09-14T06:00:42.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927141+0000", 2024-09-14T06:00:42.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.219 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.219 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927142+0000", 2024-09-14T06:00:42.219 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3600000000000004e-07 2024-09-14T06:00:42.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.219 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.219 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927144+0000", 2024-09-14T06:00:42.219 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3e-06 2024-09-14T06:00:42.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927150+0000", 2024-09-14T06:00:42.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3219999999999998e-06 2024-09-14T06:00:42.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927155+0000", 2024-09-14T06:00:42.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8999999999999997e-06 2024-09-14T06:00:42.220 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.220 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.220 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.221 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118595 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.221 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927989+0000", 2024-09-14T06:00:42.221 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.002691054, 2024-09-14T06:00:42.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0062122660000000001, 2024-09-14T06:00:42.221 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.221 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.221 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.221 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.221 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.222 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.222 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118595 2024-09-14T06:00:42.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.222 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.222 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927989+0000", 2024-09-14T06:00:42.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.223 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.223 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927989+0000", 2024-09-14T06:00:42.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.223 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.223 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927990+0000", 2024-09-14T06:00:42.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6199999999999998e-07 2024-09-14T06:00:42.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.223 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927996+0000", 2024-09-14T06:00:42.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.348e-06 2024-09-14T06:00:42.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928004+0000", 2024-09-14T06:00:42.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9000000000000006e-06 2024-09-14T06:00:42.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928009+0000", 2024-09-14T06:00:42.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1649999999999997e-06 2024-09-14T06:00:42.225 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.225 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.225 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.225 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118627 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.225 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928789+0000", 2024-09-14T06:00:42.225 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001891025, 2024-09-14T06:00:42.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054525570000000002, 2024-09-14T06:00:42.226 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.226 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.226 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.226 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.226 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.226 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.226 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118627 2024-09-14T06:00:42.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.226 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.227 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928789+0000", 2024-09-14T06:00:42.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.227 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.227 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928789+0000", 2024-09-14T06:00:42.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.227 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.227 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928790+0000", 2024-09-14T06:00:42.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4999999999999998e-07 2024-09-14T06:00:42.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.228 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928791+0000", 2024-09-14T06:00:42.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9460000000000001e-06 2024-09-14T06:00:42.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.228 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928798+0000", 2024-09-14T06:00:42.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0789999999999997e-06 2024-09-14T06:00:42.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928804+0000", 2024-09-14T06:00:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1099999999999999e-06 2024-09-14T06:00:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118702 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929555+0000", 2024-09-14T06:00:42.229 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0011256389999999999, 2024-09-14T06:00:42.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047282349999999999, 2024-09-14T06:00:42.230 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.230 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.230 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.230 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.230 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.230 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.230 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118702 2024-09-14T06:00:42.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.230 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.231 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.231 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929555+0000", 2024-09-14T06:00:42.231 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.231 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.231 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929555+0000", 2024-09-14T06:00:42.231 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.232 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.232 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929555+0000", 2024-09-14T06:00:42.232 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:00:42.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.232 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.232 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929557+0000", 2024-09-14T06:00:42.232 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.357e-06 2024-09-14T06:00:42.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.232 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929565+0000", 2024-09-14T06:00:42.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.272e-06 2024-09-14T06:00:42.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.233 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929570+0000", 2024-09-14T06:00:42.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9570000000000001e-06 2024-09-14T06:00:42.233 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.233 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.233 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.234 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118734 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.234 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930331+0000", 2024-09-14T06:00:42.234 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00034968500000000002, 2024-09-14T06:00:42.234 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0039909569999999998, 2024-09-14T06:00:42.234 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.234 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.234 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.234 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.234 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118734 2024-09-14T06:00:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930331+0000", 2024-09-14T06:00:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930331+0000", 2024-09-14T06:00:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930331+0000", 2024-09-14T06:00:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.8500000000000002e-07 2024-09-14T06:00:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930339+0000", 2024-09-14T06:00:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4489999999999999e-06 2024-09-14T06:00:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930346+0000", 2024-09-14T06:00:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8569999999999997e-06 2024-09-14T06:00:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930352+0000", 2024-09-14T06:00:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4480000000000002e-06 2024-09-14T06:00:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.237 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118490 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926181+0000", 2024-09-14T06:00:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0044989239999999996, 2024-09-14T06:00:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0081743389999999992, 2024-09-14T06:00:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.238 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118490 2024-09-14T06:00:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926181+0000", 2024-09-14T06:00:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926181+0000", 2024-09-14T06:00:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926182+0000", 2024-09-14T06:00:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.34e-07 2024-09-14T06:00:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926184+0000", 2024-09-14T06:00:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1569999999999998e-06 2024-09-14T06:00:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926190+0000", 2024-09-14T06:00:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4690000000000002e-06 2024-09-14T06:00:42.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926196+0000", 2024-09-14T06:00:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4299999999999997e-06 2024-09-14T06:00:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118564 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927162+0000", 2024-09-14T06:00:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0035186050000000002, 2024-09-14T06:00:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0072402969999999997, 2024-09-14T06:00:42.241 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118564 2024-09-14T06:00:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927162+0000", 2024-09-14T06:00:42.242 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927162+0000", 2024-09-14T06:00:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927162+0000", 2024-09-14T06:00:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.41e-07 2024-09-14T06:00:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927164+0000", 2024-09-14T06:00:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0729999999999999e-06 2024-09-14T06:00:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927170+0000", 2024-09-14T06:00:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.066e-06 2024-09-14T06:00:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.244 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.245 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927175+0000", 2024-09-14T06:00:42.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0780000000000003e-06 2024-09-14T06:00:42.245 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.245 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.245 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.245 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118596 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.245 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928017+0000", 2024-09-14T06:00:42.245 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0026630989999999999, 2024-09-14T06:00:42.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064204930000000002, 2024-09-14T06:00:42.245 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.246 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.246 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.246 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.246 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.246 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118596 2024-09-14T06:00:42.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.246 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.246 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.246 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928017+0000", 2024-09-14T06:00:42.246 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928017+0000", 2024-09-14T06:00:42.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928018+0000", 2024-09-14T06:00:42.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2300000000000001e-07 2024-09-14T06:00:42.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.248 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928020+0000", 2024-09-14T06:00:42.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2510000000000001e-06 2024-09-14T06:00:42.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.248 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928027+0000", 2024-09-14T06:00:42.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1010000000000003e-06 2024-09-14T06:00:42.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.248 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928033+0000", 2024-09-14T06:00:42.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6670000000000001e-06 2024-09-14T06:00:42.249 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.249 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.249 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.249 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118628 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.249 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928811+0000", 2024-09-14T06:00:42.249 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0018689150000000001, 2024-09-14T06:00:42.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0056589939999999997, 2024-09-14T06:00:42.250 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.250 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.250 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.250 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.250 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.250 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.250 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118628 2024-09-14T06:00:42.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.250 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928811+0000", 2024-09-14T06:00:42.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928811+0000", 2024-09-14T06:00:42.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928812+0000", 2024-09-14T06:00:42.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2399999999999999e-07 2024-09-14T06:00:42.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.252 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928814+0000", 2024-09-14T06:00:42.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3099999999999999e-06 2024-09-14T06:00:42.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.252 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928821+0000", 2024-09-14T06:00:42.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9399999999999996e-06 2024-09-14T06:00:42.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928826+0000", 2024-09-14T06:00:42.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3199999999999999e-06 2024-09-14T06:00:42.253 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.253 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.253 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.254 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118703 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.254 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929577+0000", 2024-09-14T06:00:42.254 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0011032889999999999, 2024-09-14T06:00:42.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004930551, 2024-09-14T06:00:42.254 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.254 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.254 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.254 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.254 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.254 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.254 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118703 2024-09-14T06:00:42.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.255 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929577+0000", 2024-09-14T06:00:42.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929577+0000", 2024-09-14T06:00:42.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929577+0000", 2024-09-14T06:00:42.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4799999999999999e-07 2024-09-14T06:00:42.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929579+0000", 2024-09-14T06:00:42.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1150000000000001e-06 2024-09-14T06:00:42.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929586+0000", 2024-09-14T06:00:42.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5969999999999997e-06 2024-09-14T06:00:42.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929591+0000", 2024-09-14T06:00:42.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3199999999999999e-06 2024-09-14T06:00:42.257 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.257 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.258 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.258 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118735 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.258 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930362+0000", 2024-09-14T06:00:42.258 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.000318208, 2024-09-14T06:00:42.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041785670000000002, 2024-09-14T06:00:42.258 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.258 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.258 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.258 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.258 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.259 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.259 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118735 2024-09-14T06:00:42.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.259 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930362+0000", 2024-09-14T06:00:42.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930362+0000", 2024-09-14T06:00:42.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930363+0000", 2024-09-14T06:00:42.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5899999999999996e-07 2024-09-14T06:00:42.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930365+0000", 2024-09-14T06:00:42.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4959999999999999e-06 2024-09-14T06:00:42.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930372+0000", 2024-09-14T06:00:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5060000000000001e-06 2024-09-14T06:00:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930377+0000", 2024-09-14T06:00:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1100000000000002e-06 2024-09-14T06:00:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118491 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926204+0000", 2024-09-14T06:00:42.261 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.004476425, 2024-09-14T06:00:42.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0083758970000000002, 2024-09-14T06:00:42.262 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.262 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.262 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.262 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.262 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.262 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.262 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118491 2024-09-14T06:00:42.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.263 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926204+0000", 2024-09-14T06:00:42.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926204+0000", 2024-09-14T06:00:42.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926204+0000", 2024-09-14T06:00:42.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9100000000000004e-07 2024-09-14T06:00:42.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926207+0000", 2024-09-14T06:00:42.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6079999999999998e-06 2024-09-14T06:00:42.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926215+0000", 2024-09-14T06:00:42.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9969999999999998e-06 2024-09-14T06:00:42.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.265 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926220+0000", 2024-09-14T06:00:42.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.604e-06 2024-09-14T06:00:42.265 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.265 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.265 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.265 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118565 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.266 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927182+0000", 2024-09-14T06:00:42.266 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.003498653, 2024-09-14T06:00:42.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0074365159999999998, 2024-09-14T06:00:42.266 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.266 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.266 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.266 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.266 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.266 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.266 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118565 2024-09-14T06:00:42.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.266 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.267 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927182+0000", 2024-09-14T06:00:42.267 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.267 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.267 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927182+0000", 2024-09-14T06:00:42.267 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.267 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.267 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927182+0000", 2024-09-14T06:00:42.267 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5900000000000003e-07 2024-09-14T06:00:42.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927184+0000", 2024-09-14T06:00:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.843e-06 2024-09-14T06:00:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927190+0000", 2024-09-14T06:00:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2219999999999999e-06 2024-09-14T06:00:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927195+0000", 2024-09-14T06:00:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1880000000000001e-06 2024-09-14T06:00:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.269 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.269 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.269 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118597 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.269 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928040+0000", 2024-09-14T06:00:42.269 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0026402819999999999, 2024-09-14T06:00:42.269 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0066135389999999999, 2024-09-14T06:00:42.269 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.269 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.269 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.269 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.269 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.269 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118597 2024-09-14T06:00:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928040+0000", 2024-09-14T06:00:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928040+0000", 2024-09-14T06:00:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.271 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.271 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928040+0000", 2024-09-14T06:00:42.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:00:42.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.271 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.271 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928042+0000", 2024-09-14T06:00:42.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0710000000000002e-06 2024-09-14T06:00:42.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.271 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.271 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928057+0000", 2024-09-14T06:00:42.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4596000000000001e-05 2024-09-14T06:00:42.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.272 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.272 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928063+0000", 2024-09-14T06:00:42.272 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7010000000000001e-06 2024-09-14T06:00:42.272 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.272 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.272 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.272 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118629 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.272 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928837+0000", 2024-09-14T06:00:42.272 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001843414, 2024-09-14T06:00:42.272 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0058538679999999999, 2024-09-14T06:00:42.272 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.273 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.273 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.273 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.273 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.273 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.273 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118629 2024-09-14T06:00:42.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.273 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.273 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.273 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928837+0000", 2024-09-14T06:00:42.273 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928837+0000", 2024-09-14T06:00:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928837+0000", 2024-09-14T06:00:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5099999999999999e-07 2024-09-14T06:00:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928840+0000", 2024-09-14T06:00:42.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.509e-06 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928847+0000", 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1829999999999997e-06 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928853+0000", 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3909999999999997e-06 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.276 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118704 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.276 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929599+0000", 2024-09-14T06:00:42.276 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0010812790000000001, 2024-09-14T06:00:42.276 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0051311120000000002, 2024-09-14T06:00:42.276 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.276 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.276 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.276 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.276 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.276 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.276 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118704 2024-09-14T06:00:42.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.276 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.277 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.277 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929599+0000", 2024-09-14T06:00:42.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.277 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.277 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929599+0000", 2024-09-14T06:00:42.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.277 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929599+0000", 2024-09-14T06:00:42.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4299999999999998e-07 2024-09-14T06:00:42.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929602+0000", 2024-09-14T06:00:42.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2460000000000002e-06 2024-09-14T06:00:42.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929608+0000", 2024-09-14T06:00:42.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7669999999999998e-06 2024-09-14T06:00:42.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929613+0000", 2024-09-14T06:00:42.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9799999999999998e-06 2024-09-14T06:00:42.279 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.279 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.279 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.279 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118736 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.279 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930384+0000", 2024-09-14T06:00:42.280 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00029588100000000001, 2024-09-14T06:00:42.280 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043906600000000002, 2024-09-14T06:00:42.280 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.280 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.280 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.280 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.280 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.280 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118736 2024-09-14T06:00:42.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.280 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930384+0000", 2024-09-14T06:00:42.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930384+0000", 2024-09-14T06:00:42.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930385+0000", 2024-09-14T06:00:42.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5899999999999996e-07 2024-09-14T06:00:42.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930387+0000", 2024-09-14T06:00:42.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2350000000000002e-06 2024-09-14T06:00:42.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930394+0000", 2024-09-14T06:00:42.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9280000000000004e-06 2024-09-14T06:00:42.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.283 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.283 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930399+0000", 2024-09-14T06:00:42.283 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2979999999999999e-06 2024-09-14T06:00:42.283 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.283 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.283 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.283 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118492 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.283 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926229+0000", 2024-09-14T06:00:42.284 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0044515509999999998, 2024-09-14T06:00:42.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0085837050000000005, 2024-09-14T06:00:42.284 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.284 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.284 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.284 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.284 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.284 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118492 2024-09-14T06:00:42.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.284 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926229+0000", 2024-09-14T06:00:42.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926229+0000", 2024-09-14T06:00:42.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926229+0000", 2024-09-14T06:00:42.286 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2e-07 2024-09-14T06:00:42.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926231+0000", 2024-09-14T06:00:42.286 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1689999999999999e-06 2024-09-14T06:00:42.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.287 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926238+0000", 2024-09-14T06:00:42.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2620000000000004e-06 2024-09-14T06:00:42.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.287 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926243+0000", 2024-09-14T06:00:42.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4040000000000003e-06 2024-09-14T06:00:42.287 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.287 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.287 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.288 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118566 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.288 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927202+0000", 2024-09-14T06:00:42.288 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0034784920000000001, 2024-09-14T06:00:42.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0076361689999999999, 2024-09-14T06:00:42.288 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.288 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.288 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.288 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.288 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.288 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118566 2024-09-14T06:00:42.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.289 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927202+0000", 2024-09-14T06:00:42.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927202+0000", 2024-09-14T06:00:42.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.290 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927202+0000", 2024-09-14T06:00:42.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1199999999999998e-07 2024-09-14T06:00:42.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.290 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927204+0000", 2024-09-14T06:00:42.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0669999999999999e-06 2024-09-14T06:00:42.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927212+0000", 2024-09-14T06:00:42.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5820000000000004e-06 2024-09-14T06:00:42.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927218+0000", 2024-09-14T06:00:42.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8329999999999999e-06 2024-09-14T06:00:42.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.291 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.292 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118598 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.292 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928070+0000", 2024-09-14T06:00:42.292 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0026099460000000001, 2024-09-14T06:00:42.292 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.006799678, 2024-09-14T06:00:42.292 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.292 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.293 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.293 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.293 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.293 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.293 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118598 2024-09-14T06:00:42.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.293 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.293 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.293 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928070+0000", 2024-09-14T06:00:42.293 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928070+0000", 2024-09-14T06:00:42.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928071+0000", 2024-09-14T06:00:42.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4700000000000002e-07 2024-09-14T06:00:42.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928073+0000", 2024-09-14T06:00:42.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1849999999999998e-06 2024-09-14T06:00:42.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928079+0000", 2024-09-14T06:00:42.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:00:42.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928084+0000", 2024-09-14T06:00:42.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1240000000000004e-06 2024-09-14T06:00:42.296 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.296 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.296 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.296 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118630 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.296 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928860+0000", 2024-09-14T06:00:42.296 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001819974, 2024-09-14T06:00:42.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0060402600000000004, 2024-09-14T06:00:42.296 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.296 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.296 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.296 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.297 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.297 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.297 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118630 2024-09-14T06:00:42.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.297 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.297 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928860+0000", 2024-09-14T06:00:42.297 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.297 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928860+0000", 2024-09-14T06:00:42.297 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.298 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928861+0000", 2024-09-14T06:00:42.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2699999999999999e-07 2024-09-14T06:00:42.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.298 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928863+0000", 2024-09-14T06:00:42.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.181e-06 2024-09-14T06:00:42.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.299 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.299 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928870+0000", 2024-09-14T06:00:42.299 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6340000000000003e-06 2024-09-14T06:00:42.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.299 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.299 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928875+0000", 2024-09-14T06:00:42.299 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3349999999999997e-06 2024-09-14T06:00:42.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.299 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.300 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118705 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.300 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929623+0000", 2024-09-14T06:00:42.300 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0010570480000000001, 2024-09-14T06:00:42.300 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053056570000000001, 2024-09-14T06:00:42.300 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.300 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.300 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.300 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.300 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.300 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118705 2024-09-14T06:00:42.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.300 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.301 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.301 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929623+0000", 2024-09-14T06:00:42.301 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.301 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.301 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929623+0000", 2024-09-14T06:00:42.301 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.301 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.301 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929624+0000", 2024-09-14T06:00:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6400000000000002e-07 2024-09-14T06:00:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929626+0000", 2024-09-14T06:00:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2929999999999999e-06 2024-09-14T06:00:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929633+0000", 2024-09-14T06:00:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9140000000000002e-06 2024-09-14T06:00:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.303 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929639+0000", 2024-09-14T06:00:42.303 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6169999999999998e-06 2024-09-14T06:00:42.303 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.303 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.303 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.303 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.303 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.303 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118737 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.303 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930407+0000", 2024-09-14T06:00:42.303 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00027298699999999998, 2024-09-14T06:00:42.303 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045510619999999998, 2024-09-14T06:00:42.303 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.304 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.304 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.304 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.304 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.304 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.304 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118737 2024-09-14T06:00:42.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.304 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.304 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.304 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.304 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930407+0000", 2024-09-14T06:00:42.304 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.305 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.305 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930407+0000", 2024-09-14T06:00:42.305 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.305 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.305 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930408+0000", 2024-09-14T06:00:42.305 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.46e-07 2024-09-14T06:00:42.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.305 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.306 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.306 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930410+0000", 2024-09-14T06:00:42.306 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2400000000000002e-06 2024-09-14T06:00:42.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.306 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.306 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930416+0000", 2024-09-14T06:00:42.306 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4679999999999997e-06 2024-09-14T06:00:42.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.306 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.306 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.307 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930422+0000", 2024-09-14T06:00:42.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3469999999999998e-06 2024-09-14T06:00:42.307 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.307 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.307 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.307 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118493 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.307 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926251+0000", 2024-09-14T06:00:42.307 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0044296200000000004, 2024-09-14T06:00:42.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0087436130000000008, 2024-09-14T06:00:42.307 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.308 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.308 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.308 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.308 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.308 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.308 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118493 2024-09-14T06:00:42.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.308 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.308 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.308 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926251+0000", 2024-09-14T06:00:42.308 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.309 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.309 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926251+0000", 2024-09-14T06:00:42.309 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.309 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.309 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926251+0000", 2024-09-14T06:00:42.309 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.75e-07 2024-09-14T06:00:42.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.310 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926254+0000", 2024-09-14T06:00:42.310 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5000000000000002e-06 2024-09-14T06:00:42.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.310 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926260+0000", 2024-09-14T06:00:42.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.798e-06 2024-09-14T06:00:42.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.311 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.311 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926267+0000", 2024-09-14T06:00:42.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4200000000000004e-06 2024-09-14T06:00:42.311 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.311 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.311 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.312 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118567 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.312 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927225+0000", 2024-09-14T06:00:42.312 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.003455021, 2024-09-14T06:00:42.312 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0077955960000000001, 2024-09-14T06:00:42.312 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.312 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.312 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.312 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.312 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.312 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.313 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118567 2024-09-14T06:00:42.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.313 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.313 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.313 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927225+0000", 2024-09-14T06:00:42.313 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.313 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.313 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927225+0000", 2024-09-14T06:00:42.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927226+0000", 2024-09-14T06:00:42.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5600000000000001e-07 2024-09-14T06:00:42.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927228+0000", 2024-09-14T06:00:42.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.153e-06 2024-09-14T06:00:42.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.315 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.315 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927234+0000", 2024-09-14T06:00:42.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5200000000000003e-06 2024-09-14T06:00:42.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.315 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.315 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927239+0000", 2024-09-14T06:00:42.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0259999999999998e-06 2024-09-14T06:00:42.315 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.315 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.315 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.316 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118599 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.316 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928091+0000", 2024-09-14T06:00:42.316 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.002589109, 2024-09-14T06:00:42.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0069639460000000004, 2024-09-14T06:00:42.316 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.316 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.316 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.316 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.316 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.317 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.317 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118599 2024-09-14T06:00:42.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.317 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928091+0000", 2024-09-14T06:00:42.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928091+0000", 2024-09-14T06:00:42.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.318 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928092+0000", 2024-09-14T06:00:42.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T06:00:42.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928094+0000", 2024-09-14T06:00:42.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9350000000000001e-06 2024-09-14T06:00:42.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928099+0000", 2024-09-14T06:00:42.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9220000000000002e-06 2024-09-14T06:00:42.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928105+0000", 2024-09-14T06:00:42.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0390000000000004e-06 2024-09-14T06:00:42.320 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.321 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.321 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.321 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118631 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.321 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928882+0000", 2024-09-14T06:00:42.321 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0017980590000000001, 2024-09-14T06:00:42.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0062004699999999996, 2024-09-14T06:00:42.321 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.321 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.321 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.322 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.322 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.322 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118631 2024-09-14T06:00:42.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.322 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928882+0000", 2024-09-14T06:00:42.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928882+0000", 2024-09-14T06:00:42.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928883+0000", 2024-09-14T06:00:42.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2800000000000002e-07 2024-09-14T06:00:42.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928890+0000", 2024-09-14T06:00:42.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6040000000000004e-06 2024-09-14T06:00:42.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928897+0000", 2024-09-14T06:00:42.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5200000000000003e-06 2024-09-14T06:00:42.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928902+0000", 2024-09-14T06:00:42.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.118e-06 2024-09-14T06:00:42.324 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.324 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.324 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.325 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118706 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.325 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929646+0000", 2024-09-14T06:00:42.325 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0010338700000000001, 2024-09-14T06:00:42.325 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054639320000000003, 2024-09-14T06:00:42.325 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.325 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.325 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.325 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.325 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.325 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118706 2024-09-14T06:00:42.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929646+0000", 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929646+0000", 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929647+0000", 2024-09-14T06:00:42.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6400000000000002e-07 2024-09-14T06:00:42.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929649+0000", 2024-09-14T06:00:42.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.119e-06 2024-09-14T06:00:42.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929656+0000", 2024-09-14T06:00:42.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8070000000000002e-06 2024-09-14T06:00:42.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929661+0000", 2024-09-14T06:00:42.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0069999999999997e-06 2024-09-14T06:00:42.328 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.328 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.328 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.328 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118738 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.328 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930429+0000", 2024-09-14T06:00:42.328 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00025080399999999998, 2024-09-14T06:00:42.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047114430000000001, 2024-09-14T06:00:42.328 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.328 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.328 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.328 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.329 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.329 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.329 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118738 2024-09-14T06:00:42.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.329 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930429+0000", 2024-09-14T06:00:42.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930429+0000", 2024-09-14T06:00:42.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930430+0000", 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3700000000000001e-07 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930432+0000", 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1600000000000001e-06 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930439+0000", 2024-09-14T06:00:42.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5719999999999999e-06 2024-09-14T06:00:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930444+0000", 2024-09-14T06:00:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3750000000000002e-06 2024-09-14T06:00:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118494 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.331 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926280+0000", 2024-09-14T06:00:42.332 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.004399951, 2024-09-14T06:00:42.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0088882730000000004, 2024-09-14T06:00:42.332 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.332 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.332 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.332 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.332 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.332 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.332 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118494 2024-09-14T06:00:42.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.332 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926280+0000", 2024-09-14T06:00:42.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926280+0000", 2024-09-14T06:00:42.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926281+0000", 2024-09-14T06:00:42.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9100000000000004e-07 2024-09-14T06:00:42.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.334 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926301+0000", 2024-09-14T06:00:42.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0630000000000001e-05 2024-09-14T06:00:42.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.334 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926314+0000", 2024-09-14T06:00:42.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2462e-05 2024-09-14T06:00:42.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.334 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926321+0000", 2024-09-14T06:00:42.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7599999999999997e-06 2024-09-14T06:00:42.335 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.335 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.335 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.335 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118568 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.335 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927247+0000", 2024-09-14T06:00:42.335 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.003433518, 2024-09-14T06:00:42.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0079528819999999997, 2024-09-14T06:00:42.335 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.335 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.335 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.336 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.336 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.336 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.336 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118568 2024-09-14T06:00:42.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.336 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.336 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.336 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927247+0000", 2024-09-14T06:00:42.336 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.336 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.336 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927247+0000", 2024-09-14T06:00:42.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927247+0000", 2024-09-14T06:00:42.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9499999999999998e-07 2024-09-14T06:00:42.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927249+0000", 2024-09-14T06:00:42.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3429999999999998e-06 2024-09-14T06:00:42.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927258+0000", 2024-09-14T06:00:42.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6400000000000003e-06 2024-09-14T06:00:42.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927264+0000", 2024-09-14T06:00:42.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6200000000000004e-06 2024-09-14T06:00:42.338 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.338 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.338 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.339 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118600 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.339 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928112+0000", 2024-09-14T06:00:42.339 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00256828, 2024-09-14T06:00:42.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0071131739999999999, 2024-09-14T06:00:42.339 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.339 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.339 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.339 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.339 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.339 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.339 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118600 2024-09-14T06:00:42.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.339 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.340 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.340 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928112+0000", 2024-09-14T06:00:42.340 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.340 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.340 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928112+0000", 2024-09-14T06:00:42.340 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.340 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928112+0000", 2024-09-14T06:00:42.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0399999999999996e-07 2024-09-14T06:00:42.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928115+0000", 2024-09-14T06:00:42.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.181e-06 2024-09-14T06:00:42.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928121+0000", 2024-09-14T06:00:42.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6680000000000004e-06 2024-09-14T06:00:42.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928126+0000", 2024-09-14T06:00:42.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0490000000000003e-06 2024-09-14T06:00:42.342 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.342 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.342 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.342 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118632 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.342 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928910+0000", 2024-09-14T06:00:42.342 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001770286, 2024-09-14T06:00:42.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.006342472, 2024-09-14T06:00:42.343 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.343 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.343 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.343 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.343 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.343 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118632 2024-09-14T06:00:42.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.343 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928910+0000", 2024-09-14T06:00:42.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928910+0000", 2024-09-14T06:00:42.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928910+0000", 2024-09-14T06:00:42.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.51e-07 2024-09-14T06:00:42.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928913+0000", 2024-09-14T06:00:42.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2620000000000001e-06 2024-09-14T06:00:42.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928919+0000", 2024-09-14T06:00:42.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7479999999999996e-06 2024-09-14T06:00:42.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928924+0000", 2024-09-14T06:00:42.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9450000000000001e-06 2024-09-14T06:00:42.346 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.346 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.346 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.346 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118707 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.346 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929668+0000", 2024-09-14T06:00:42.346 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001011725, 2024-09-14T06:00:42.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0056092570000000003, 2024-09-14T06:00:42.347 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.347 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.347 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.347 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.347 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.347 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.347 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118707 2024-09-14T06:00:42.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.347 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.348 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929668+0000", 2024-09-14T06:00:42.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.348 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929668+0000", 2024-09-14T06:00:42.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.349 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.349 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929669+0000", 2024-09-14T06:00:42.349 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4700000000000001e-07 2024-09-14T06:00:42.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.349 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.349 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929671+0000", 2024-09-14T06:00:42.349 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T06:00:42.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929679+0000", 2024-09-14T06:00:42.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6750000000000002e-06 2024-09-14T06:00:42.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929684+0000", 2024-09-14T06:00:42.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5690000000000004e-06 2024-09-14T06:00:42.350 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.350 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.350 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.351 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118739 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.351 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930452+0000", 2024-09-14T06:00:42.351 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00022813999999999999, 2024-09-14T06:00:42.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048526239999999998, 2024-09-14T06:00:42.351 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.351 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.351 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.351 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.351 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.351 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.352 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118739 2024-09-14T06:00:42.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.352 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930452+0000", 2024-09-14T06:00:42.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930452+0000", 2024-09-14T06:00:42.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.353 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930453+0000", 2024-09-14T06:00:42.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5600000000000001e-07 2024-09-14T06:00:42.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.353 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930455+0000", 2024-09-14T06:00:42.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2919999999999998e-06 2024-09-14T06:00:42.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930462+0000", 2024-09-14T06:00:42.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7229999999999998e-06 2024-09-14T06:00:42.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930467+0000", 2024-09-14T06:00:42.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2340000000000002e-06 2024-09-14T06:00:42.354 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.354 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.354 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.355 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118495 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.355 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926331+0000", 2024-09-14T06:00:42.355 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0043490309999999997, 2024-09-14T06:00:42.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0089983879999999995, 2024-09-14T06:00:42.355 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.355 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.355 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.355 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.355 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.355 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.355 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118495 2024-09-14T06:00:42.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.356 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926331+0000", 2024-09-14T06:00:42.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926331+0000", 2024-09-14T06:00:42.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926332+0000", 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5799999999999999e-07 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926334+0000", 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.706e-06 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926344+0000", 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6069999999999997e-06 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.358 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926350+0000", 2024-09-14T06:00:42.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5659999999999997e-06 2024-09-14T06:00:42.358 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.358 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.358 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.358 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118569 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.358 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927292+0000", 2024-09-14T06:00:42.358 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0033886929999999999, 2024-09-14T06:00:42.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0080701669999999996, 2024-09-14T06:00:42.358 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.358 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118569 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927292+0000", 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927292+0000", 2024-09-14T06:00:42.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927292+0000", 2024-09-14T06:00:42.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2300000000000001e-07 2024-09-14T06:00:42.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927295+0000", 2024-09-14T06:00:42.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7879999999999998e-06 2024-09-14T06:00:42.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927303+0000", 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.841e-06 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927308+0000", 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7049999999999996e-06 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118601 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.361 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928134+0000", 2024-09-14T06:00:42.362 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0025457510000000002, 2024-09-14T06:00:42.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0072529270000000002, 2024-09-14T06:00:42.362 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.362 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.362 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.362 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.362 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.362 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.362 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118601 2024-09-14T06:00:42.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.362 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928134+0000", 2024-09-14T06:00:42.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928134+0000", 2024-09-14T06:00:42.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928135+0000", 2024-09-14T06:00:42.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2800000000000002e-07 2024-09-14T06:00:42.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928137+0000", 2024-09-14T06:00:42.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.368e-06 2024-09-14T06:00:42.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928144+0000", 2024-09-14T06:00:42.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1130000000000003e-06 2024-09-14T06:00:42.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928150+0000", 2024-09-14T06:00:42.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4319999999999998e-06 2024-09-14T06:00:42.365 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.365 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.365 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118633 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928931+0000", 2024-09-14T06:00:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00174956, 2024-09-14T06:00:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064934490000000001, 2024-09-14T06:00:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118633 2024-09-14T06:00:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.367 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928931+0000", 2024-09-14T06:00:42.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928931+0000", 2024-09-14T06:00:42.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928931+0000", 2024-09-14T06:00:42.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6300000000000001e-07 2024-09-14T06:00:42.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928933+0000", 2024-09-14T06:00:42.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.916e-06 2024-09-14T06:00:42.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928939+0000", 2024-09-14T06:00:42.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0310000000000004e-06 2024-09-14T06:00:42.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928944+0000", 2024-09-14T06:00:42.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7040000000000002e-06 2024-09-14T06:00:42.369 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.369 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.370 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.370 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118708 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.370 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929692+0000", 2024-09-14T06:00:42.370 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0009879559999999999, 2024-09-14T06:00:42.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0057583620000000004, 2024-09-14T06:00:42.370 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.370 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.370 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.370 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118708 2024-09-14T06:00:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929692+0000", 2024-09-14T06:00:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929692+0000", 2024-09-14T06:00:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929693+0000", 2024-09-14T06:00:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3099999999999998e-07 2024-09-14T06:00:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929695+0000", 2024-09-14T06:00:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1519999999999999e-06 2024-09-14T06:00:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929701+0000", 2024-09-14T06:00:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3879999999999997e-06 2024-09-14T06:00:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929706+0000", 2024-09-14T06:00:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.921e-06 2024-09-14T06:00:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118740 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930475+0000", 2024-09-14T06:00:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.000205713, 2024-09-14T06:00:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0050035349999999999, 2024-09-14T06:00:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118740 2024-09-14T06:00:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930475+0000", 2024-09-14T06:00:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930475+0000", 2024-09-14T06:00:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930475+0000", 2024-09-14T06:00:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4099999999999999e-07 2024-09-14T06:00:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930477+0000", 2024-09-14T06:00:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2259999999999999e-06 2024-09-14T06:00:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930484+0000", 2024-09-14T06:00:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7719999999999997e-06 2024-09-14T06:00:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930489+0000", 2024-09-14T06:00:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2240000000000003e-06 2024-09-14T06:00:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118496 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926389+0000", 2024-09-14T06:00:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.004291296, 2024-09-14T06:00:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0091206859999999994, 2024-09-14T06:00:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118496 2024-09-14T06:00:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926389+0000", 2024-09-14T06:00:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926389+0000", 2024-09-14T06:00:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926390+0000", 2024-09-14T06:00:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5799999999999999e-07 2024-09-14T06:00:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926393+0000", 2024-09-14T06:00:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1709999999999998e-06 2024-09-14T06:00:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926402+0000", 2024-09-14T06:00:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0939999999999997e-06 2024-09-14T06:00:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926408+0000", 2024-09-14T06:00:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3579999999999999e-06 2024-09-14T06:00:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118570 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927317+0000", 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0033635050000000001, 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0082222609999999998, 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118570 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927317+0000", 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927317+0000", 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927317+0000", 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4799999999999999e-07 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927319+0000", 2024-09-14T06:00:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9920000000000002e-06 2024-09-14T06:00:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927332+0000", 2024-09-14T06:00:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3326000000000001e-05 2024-09-14T06:00:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927338+0000", 2024-09-14T06:00:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4199999999999998e-06 2024-09-14T06:00:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118602 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928157+0000", 2024-09-14T06:00:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0025232610000000002, 2024-09-14T06:00:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0074149630000000001, 2024-09-14T06:00:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118602 2024-09-14T06:00:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928157+0000", 2024-09-14T06:00:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928157+0000", 2024-09-14T06:00:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928157+0000", 2024-09-14T06:00:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1899999999999998e-07 2024-09-14T06:00:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928160+0000", 2024-09-14T06:00:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1909999999999999e-06 2024-09-14T06:00:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928166+0000", 2024-09-14T06:00:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5479999999999998e-06 2024-09-14T06:00:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928171+0000", 2024-09-14T06:00:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.135e-06 2024-09-14T06:00:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118634 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928950+0000", 2024-09-14T06:00:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0017302750000000001, 2024-09-14T06:00:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0066501049999999999, 2024-09-14T06:00:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118634 2024-09-14T06:00:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928950+0000", 2024-09-14T06:00:42.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928950+0000", 2024-09-14T06:00:42.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928950+0000", 2024-09-14T06:00:42.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3600000000000004e-07 2024-09-14T06:00:42.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928952+0000", 2024-09-14T06:00:42.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9259999999999999e-06 2024-09-14T06:00:42.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928960+0000", 2024-09-14T06:00:42.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3259999999999998e-06 2024-09-14T06:00:42.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928965+0000", 2024-09-14T06:00:42.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.955e-06 2024-09-14T06:00:42.392 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.392 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.392 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.392 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118709 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.392 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929714+0000", 2024-09-14T06:00:42.392 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00096661100000000003, 2024-09-14T06:00:42.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0059130550000000004, 2024-09-14T06:00:42.393 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.393 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.393 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.393 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.393 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.393 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.393 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118709 2024-09-14T06:00:42.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.393 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929714+0000", 2024-09-14T06:00:42.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929714+0000", 2024-09-14T06:00:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929714+0000", 2024-09-14T06:00:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2800000000000002e-07 2024-09-14T06:00:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929716+0000", 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2309999999999999e-06 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929723+0000", 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8589999999999999e-06 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929729+0000", 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4210000000000003e-06 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.396 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118741 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.396 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930508+0000", 2024-09-14T06:00:42.396 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00017213499999999999, 2024-09-14T06:00:42.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0051516299999999999, 2024-09-14T06:00:42.396 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.396 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.396 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.396 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.396 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.396 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.396 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118741 2024-09-14T06:00:42.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.397 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930508+0000", 2024-09-14T06:00:42.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930508+0000", 2024-09-14T06:00:42.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930509+0000", 2024-09-14T06:00:42.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6700000000000003e-07 2024-09-14T06:00:42.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930512+0000", 2024-09-14T06:00:42.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:42.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930519+0000", 2024-09-14T06:00:42.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.277e-06 2024-09-14T06:00:42.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930524+0000", 2024-09-14T06:00:42.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3000000000000001e-06 2024-09-14T06:00:42.399 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.399 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.399 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.400 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118497 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.400 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926419+0000", 2024-09-14T06:00:42.400 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0042614660000000002, 2024-09-14T06:00:42.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0092686699999999997, 2024-09-14T06:00:42.400 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.400 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.400 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.400 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.400 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.400 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.400 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118497 2024-09-14T06:00:42.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.401 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926419+0000", 2024-09-14T06:00:42.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926419+0000", 2024-09-14T06:00:42.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926419+0000", 2024-09-14T06:00:42.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1799999999999995e-07 2024-09-14T06:00:42.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926422+0000", 2024-09-14T06:00:42.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5059999999999998e-06 2024-09-14T06:00:42.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926429+0000", 2024-09-14T06:00:42.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.973e-06 2024-09-14T06:00:42.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926434+0000", 2024-09-14T06:00:42.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5210000000000002e-06 2024-09-14T06:00:42.404 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.404 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.404 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.404 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118571 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.404 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927345+0000", 2024-09-14T06:00:42.404 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0033348700000000002, 2024-09-14T06:00:42.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0083682640000000003, 2024-09-14T06:00:42.404 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.404 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.405 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.405 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118571 2024-09-14T06:00:42.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.405 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927345+0000", 2024-09-14T06:00:42.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927345+0000", 2024-09-14T06:00:42.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927346+0000", 2024-09-14T06:00:42.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9200000000000002e-07 2024-09-14T06:00:42.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927348+0000", 2024-09-14T06:00:42.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2010000000000002e-06 2024-09-14T06:00:42.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927354+0000", 2024-09-14T06:00:42.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3130000000000004e-06 2024-09-14T06:00:42.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927360+0000", 2024-09-14T06:00:42.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2939999999999996e-06 2024-09-14T06:00:42.408 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.408 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.408 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.408 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118603 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.408 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928179+0000", 2024-09-14T06:00:42.408 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0025012649999999999, 2024-09-14T06:00:42.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.007561412, 2024-09-14T06:00:42.408 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.408 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.409 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.409 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.409 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.409 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.409 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118603 2024-09-14T06:00:42.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.409 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928179+0000", 2024-09-14T06:00:42.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928179+0000", 2024-09-14T06:00:42.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928179+0000", 2024-09-14T06:00:42.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6699999999999999e-07 2024-09-14T06:00:42.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928182+0000", 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1459999999999999e-06 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928188+0000", 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7719999999999997e-06 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928194+0000", 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2669999999999997e-06 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.411 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.412 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118635 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.412 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928972+0000", 2024-09-14T06:00:42.412 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001707823, 2024-09-14T06:00:42.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00679351, 2024-09-14T06:00:42.412 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.412 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.412 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.412 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.412 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.412 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.412 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118635 2024-09-14T06:00:42.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.413 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928972+0000", 2024-09-14T06:00:42.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928972+0000", 2024-09-14T06:00:42.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928973+0000", 2024-09-14T06:00:42.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3999999999999997e-07 2024-09-14T06:00:42.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928975+0000", 2024-09-14T06:00:42.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8899999999999999e-06 2024-09-14T06:00:42.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928980+0000", 2024-09-14T06:00:42.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7640000000000002e-06 2024-09-14T06:00:42.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928985+0000", 2024-09-14T06:00:42.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8799999999999999e-06 2024-09-14T06:00:42.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.415 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.415 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118710 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.415 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929736+0000", 2024-09-14T06:00:42.415 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00094456, 2024-09-14T06:00:42.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0060627520000000002, 2024-09-14T06:00:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118710 2024-09-14T06:00:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929736+0000", 2024-09-14T06:00:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929736+0000", 2024-09-14T06:00:42.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929736+0000", 2024-09-14T06:00:42.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9200000000000002e-07 2024-09-14T06:00:42.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929742+0000", 2024-09-14T06:00:42.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2099999999999998e-06 2024-09-14T06:00:42.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929749+0000", 2024-09-14T06:00:42.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1930000000000004e-06 2024-09-14T06:00:42.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929755+0000", 2024-09-14T06:00:42.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4779999999999999e-06 2024-09-14T06:00:42.418 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.418 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.418 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.419 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118742 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.419 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930532+0000", 2024-09-14T06:00:42.419 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00014773100000000001, 2024-09-14T06:00:42.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0052918000000000001, 2024-09-14T06:00:42.419 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.419 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.419 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.419 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.419 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.419 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.420 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118742 2024-09-14T06:00:42.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.420 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930532+0000", 2024-09-14T06:00:42.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930532+0000", 2024-09-14T06:00:42.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930533+0000", 2024-09-14T06:00:42.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6800000000000001e-07 2024-09-14T06:00:42.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930535+0000", 2024-09-14T06:00:42.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3010000000000001e-06 2024-09-14T06:00:42.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930542+0000", 2024-09-14T06:00:42.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7710000000000001e-06 2024-09-14T06:00:42.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930547+0000", 2024-09-14T06:00:42.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.51e-06 2024-09-14T06:00:42.422 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.422 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.422 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.422 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118498 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.423 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926442+0000", 2024-09-14T06:00:42.423 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0042377489999999999, 2024-09-14T06:00:42.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0094093719999999992, 2024-09-14T06:00:42.423 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.423 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.423 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.423 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.423 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.423 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.423 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118498 2024-09-14T06:00:42.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.423 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926442+0000", 2024-09-14T06:00:42.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926442+0000", 2024-09-14T06:00:42.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926443+0000", 2024-09-14T06:00:42.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5999999999999999e-07 2024-09-14T06:00:42.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926445+0000", 2024-09-14T06:00:42.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.305e-06 2024-09-14T06:00:42.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926452+0000", 2024-09-14T06:00:42.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0249999999999997e-06 2024-09-14T06:00:42.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926458+0000", 2024-09-14T06:00:42.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3410000000000002e-06 2024-09-14T06:00:42.426 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.426 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.426 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.427 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118572 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.427 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927367+0000", 2024-09-14T06:00:42.427 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0033133780000000001, 2024-09-14T06:00:42.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0085100309999999995, 2024-09-14T06:00:42.427 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.427 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.427 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.427 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.427 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.427 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.427 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118572 2024-09-14T06:00:42.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.428 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927367+0000", 2024-09-14T06:00:42.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927367+0000", 2024-09-14T06:00:42.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927367+0000", 2024-09-14T06:00:42.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.53e-07 2024-09-14T06:00:42.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927391+0000", 2024-09-14T06:00:42.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3479e-05 2024-09-14T06:00:42.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927400+0000", 2024-09-14T06:00:42.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6579999999999997e-06 2024-09-14T06:00:42.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927407+0000", 2024-09-14T06:00:42.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5529999999999998e-06 2024-09-14T06:00:42.430 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.430 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.430 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.431 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118604 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.431 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928204+0000", 2024-09-14T06:00:42.431 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0024763659999999998, 2024-09-14T06:00:42.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0076993019999999999, 2024-09-14T06:00:42.431 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.431 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.431 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.431 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.431 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.431 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.431 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118604 2024-09-14T06:00:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928204+0000", 2024-09-14T06:00:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928204+0000", 2024-09-14T06:00:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928204+0000", 2024-09-14T06:00:42.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:00:42.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928207+0000", 2024-09-14T06:00:42.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3089999999999998e-06 2024-09-14T06:00:42.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928214+0000", 2024-09-14T06:00:42.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8009999999999998e-06 2024-09-14T06:00:42.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928219+0000", 2024-09-14T06:00:42.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4909999999999996e-06 2024-09-14T06:00:42.434 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.434 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.434 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.435 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118679 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.435 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928992+0000", 2024-09-14T06:00:42.435 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0016879099999999999, 2024-09-14T06:00:42.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0069457579999999998, 2024-09-14T06:00:42.435 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.435 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.435 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.435 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.435 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.435 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.436 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118679 2024-09-14T06:00:42.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.436 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928992+0000", 2024-09-14T06:00:42.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928992+0000", 2024-09-14T06:00:42.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928993+0000", 2024-09-14T06:00:42.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.89e-07 2024-09-14T06:00:42.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928995+0000", 2024-09-14T06:00:42.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.199e-06 2024-09-14T06:00:42.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929001+0000", 2024-09-14T06:00:42.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4980000000000003e-06 2024-09-14T06:00:42.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929007+0000", 2024-09-14T06:00:42.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2109999999999997e-06 2024-09-14T06:00:42.438 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.438 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.438 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.439 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118711 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.439 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929763+0000", 2024-09-14T06:00:42.439 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00091740500000000004, 2024-09-14T06:00:42.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0062064160000000002, 2024-09-14T06:00:42.439 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.439 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.439 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.439 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.439 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.439 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.439 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118711 2024-09-14T06:00:42.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.439 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.440 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.440 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929763+0000", 2024-09-14T06:00:42.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.440 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.440 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929763+0000", 2024-09-14T06:00:42.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.440 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.440 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929763+0000", 2024-09-14T06:00:42.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1699999999999998e-07 2024-09-14T06:00:42.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929766+0000", 2024-09-14T06:00:42.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1789999999999998e-06 2024-09-14T06:00:42.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929772+0000", 2024-09-14T06:00:42.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4359999999999999e-06 2024-09-14T06:00:42.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929778+0000", 2024-09-14T06:00:42.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0800000000000002e-06 2024-09-14T06:00:42.442 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.442 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.442 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.442 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118743 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.442 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930554+0000", 2024-09-14T06:00:42.442 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00012659100000000001, 2024-09-14T06:00:42.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0054407559999999997, 2024-09-14T06:00:42.442 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.442 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118743 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930554+0000", 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930554+0000", 2024-09-14T06:00:42.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930554+0000", 2024-09-14T06:00:42.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.15e-07 2024-09-14T06:00:42.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930556+0000", 2024-09-14T06:00:42.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0480000000000001e-06 2024-09-14T06:00:42.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930563+0000", 2024-09-14T06:00:42.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5370000000000003e-06 2024-09-14T06:00:42.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930567+0000", 2024-09-14T06:00:42.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5360000000000003e-06 2024-09-14T06:00:42.445 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.445 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.445 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.446 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118499 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.446 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926465+0000", 2024-09-14T06:00:42.446 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00421486, 2024-09-14T06:00:42.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0095561420000000001, 2024-09-14T06:00:42.446 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.446 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.446 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.446 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.446 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.446 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.446 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118499 2024-09-14T06:00:42.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.447 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926465+0000", 2024-09-14T06:00:42.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926465+0000", 2024-09-14T06:00:42.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926466+0000", 2024-09-14T06:00:42.448 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5200000000000002e-07 2024-09-14T06:00:42.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926468+0000", 2024-09-14T06:00:42.448 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1689999999999999e-06 2024-09-14T06:00:42.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926477+0000", 2024-09-14T06:00:42.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7679999999999997e-06 2024-09-14T06:00:42.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926482+0000", 2024-09-14T06:00:42.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3120000000000001e-06 2024-09-14T06:00:42.449 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.449 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.449 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.450 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118573 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.450 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927428+0000", 2024-09-14T06:00:42.450 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0032524009999999998, 2024-09-14T06:00:42.450 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0086287169999999993, 2024-09-14T06:00:42.450 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.450 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.450 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.450 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.450 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.450 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.451 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118573 2024-09-14T06:00:42.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.451 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927428+0000", 2024-09-14T06:00:42.451 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927428+0000", 2024-09-14T06:00:42.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927428+0000", 2024-09-14T06:00:42.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5899999999999996e-07 2024-09-14T06:00:42.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927431+0000", 2024-09-14T06:00:42.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9639999999999999e-06 2024-09-14T06:00:42.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.453 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927441+0000", 2024-09-14T06:00:42.453 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6339999999999996e-06 2024-09-14T06:00:42.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.453 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927447+0000", 2024-09-14T06:00:42.453 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7710000000000003e-06 2024-09-14T06:00:42.453 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.453 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.453 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.454 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118605 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.454 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928227+0000", 2024-09-14T06:00:42.454 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0024533879999999999, 2024-09-14T06:00:42.454 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0078640370000000008, 2024-09-14T06:00:42.454 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.454 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.454 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.454 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.454 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.454 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.454 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118605 2024-09-14T06:00:42.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.454 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928227+0000", 2024-09-14T06:00:42.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928227+0000", 2024-09-14T06:00:42.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928227+0000", 2024-09-14T06:00:42.456 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:00:42.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928229+0000", 2024-09-14T06:00:42.456 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1220000000000002e-06 2024-09-14T06:00:42.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928236+0000", 2024-09-14T06:00:42.456 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7689999999999999e-06 2024-09-14T06:00:42.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.457 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.457 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928241+0000", 2024-09-14T06:00:42.457 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2320000000000001e-06 2024-09-14T06:00:42.457 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.457 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.457 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.457 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.457 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118680 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.457 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929014+0000", 2024-09-14T06:00:42.457 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001666313, 2024-09-14T06:00:42.457 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0071030720000000002, 2024-09-14T06:00:42.457 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.458 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.458 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.458 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.458 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.458 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.458 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118680 2024-09-14T06:00:42.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.458 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929014+0000", 2024-09-14T06:00:42.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929014+0000", 2024-09-14T06:00:42.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929014+0000", 2024-09-14T06:00:42.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.7099999999999997e-07 2024-09-14T06:00:42.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.460 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.460 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.460 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929016+0000", 2024-09-14T06:00:42.460 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1009999999999999e-06 2024-09-14T06:00:42.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.460 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.460 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.460 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929023+0000", 2024-09-14T06:00:42.460 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3570000000000003e-06 2024-09-14T06:00:42.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.461 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929029+0000", 2024-09-14T06:00:42.461 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4860000000000002e-06 2024-09-14T06:00:42.461 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.461 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.461 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.461 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118712 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.462 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929784+0000", 2024-09-14T06:00:42.462 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00089590100000000005, 2024-09-14T06:00:42.462 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064832839999999997, 2024-09-14T06:00:42.462 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.462 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.462 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.462 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.462 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.462 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.462 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118712 2024-09-14T06:00:42.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.463 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.463 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.463 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.463 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929784+0000", 2024-09-14T06:00:42.463 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.463 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.463 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.463 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929784+0000", 2024-09-14T06:00:42.463 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929785+0000", 2024-09-14T06:00:42.464 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8400000000000005e-07 2024-09-14T06:00:42.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929787+0000", 2024-09-14T06:00:42.464 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0040000000000002e-06 2024-09-14T06:00:42.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929793+0000", 2024-09-14T06:00:42.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0900000000000001e-06 2024-09-14T06:00:42.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929798+0000", 2024-09-14T06:00:42.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8539999999999996e-06 2024-09-14T06:00:42.465 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.465 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.465 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118744 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930574+0000", 2024-09-14T06:00:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.000106492, 2024-09-14T06:00:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00572677, 2024-09-14T06:00:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.466 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118744 2024-09-14T06:00:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930574+0000", 2024-09-14T06:00:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930574+0000", 2024-09-14T06:00:42.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930574+0000", 2024-09-14T06:00:42.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3700000000000001e-07 2024-09-14T06:00:42.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930576+0000", 2024-09-14T06:00:42.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9429999999999999e-06 2024-09-14T06:00:42.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930581+0000", 2024-09-14T06:00:42.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4620000000000004e-06 2024-09-14T06:00:42.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930586+0000", 2024-09-14T06:00:42.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6639999999999997e-06 2024-09-14T06:00:42.469 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.469 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.469 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.469 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118500 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.469 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926490+0000", 2024-09-14T06:00:42.469 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0041898270000000001, 2024-09-14T06:00:42.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0098361100000000003, 2024-09-14T06:00:42.470 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.470 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.470 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.470 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.470 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.470 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.470 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118500 2024-09-14T06:00:42.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.470 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926490+0000", 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926490+0000", 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926491+0000", 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4900000000000001e-07 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926493+0000", 2024-09-14T06:00:42.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.447e-06 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926500+0000", 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2089999999999999e-06 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926508+0000", 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.294e-06 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.472 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.473 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118574 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.473 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927457+0000", 2024-09-14T06:00:42.473 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0032234799999999999, 2024-09-14T06:00:42.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0088987589999999991, 2024-09-14T06:00:42.473 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.473 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.473 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.473 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.473 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.473 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.473 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118574 2024-09-14T06:00:42.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.473 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927457+0000", 2024-09-14T06:00:42.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927457+0000", 2024-09-14T06:00:42.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927457+0000", 2024-09-14T06:00:42.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1399999999999997e-07 2024-09-14T06:00:42.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927460+0000", 2024-09-14T06:00:42.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6220000000000001e-06 2024-09-14T06:00:42.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927467+0000", 2024-09-14T06:00:42.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.345e-06 2024-09-14T06:00:42.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.476 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.476 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927473+0000", 2024-09-14T06:00:42.476 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6980000000000003e-06 2024-09-14T06:00:42.476 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.476 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.476 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.476 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.476 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118606 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.476 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928249+0000", 2024-09-14T06:00:42.476 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00243151, 2024-09-14T06:00:42.476 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0081318720000000001, 2024-09-14T06:00:42.476 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.476 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.477 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.477 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.477 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.477 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.477 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118606 2024-09-14T06:00:42.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.477 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.477 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.477 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.477 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928249+0000", 2024-09-14T06:00:42.477 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.478 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928249+0000", 2024-09-14T06:00:42.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.478 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928249+0000", 2024-09-14T06:00:42.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6899999999999998e-07 2024-09-14T06:00:42.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.479 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928251+0000", 2024-09-14T06:00:42.479 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1150000000000001e-06 2024-09-14T06:00:42.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.479 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.479 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928258+0000", 2024-09-14T06:00:42.479 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.489e-06 2024-09-14T06:00:42.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.479 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.479 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928264+0000", 2024-09-14T06:00:42.480 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3629999999999999e-06 2024-09-14T06:00:42.480 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.480 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.480 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.480 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.480 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118681 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.480 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929037+0000", 2024-09-14T06:00:42.480 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0016433229999999999, 2024-09-14T06:00:42.480 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073767210000000001, 2024-09-14T06:00:42.480 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.480 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.481 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.481 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.481 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.481 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.481 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118681 2024-09-14T06:00:42.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.481 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.481 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.481 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.481 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929037+0000", 2024-09-14T06:00:42.481 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.482 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.482 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.482 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929037+0000", 2024-09-14T06:00:42.482 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.482 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.482 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.482 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929037+0000", 2024-09-14T06:00:42.482 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.58e-07 2024-09-14T06:00:42.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.482 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.482 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.483 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929040+0000", 2024-09-14T06:00:42.483 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2579999999999998e-06 2024-09-14T06:00:42.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.483 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.483 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.483 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929046+0000", 2024-09-14T06:00:42.483 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6880000000000002e-06 2024-09-14T06:00:42.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.483 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.483 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.483 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929051+0000", 2024-09-14T06:00:42.483 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8670000000000002e-06 2024-09-14T06:00:42.484 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.484 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.484 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.484 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.484 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118713 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.484 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929804+0000", 2024-09-14T06:00:42.484 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00087640299999999999, 2024-09-14T06:00:42.484 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0066356339999999996, 2024-09-14T06:00:42.484 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.484 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.485 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.485 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.485 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.485 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.485 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118713 2024-09-14T06:00:42.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.485 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.485 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.485 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.485 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929804+0000", 2024-09-14T06:00:42.485 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.485 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.486 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.486 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929804+0000", 2024-09-14T06:00:42.486 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.486 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.486 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.486 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929804+0000", 2024-09-14T06:00:42.486 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.5199999999999998e-07 2024-09-14T06:00:42.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.486 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.486 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.487 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929806+0000", 2024-09-14T06:00:42.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.889e-06 2024-09-14T06:00:42.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.487 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.487 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.487 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929812+0000", 2024-09-14T06:00:42.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0789999999999997e-06 2024-09-14T06:00:42.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.487 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.487 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.487 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929818+0000", 2024-09-14T06:00:42.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1929999999999998e-06 2024-09-14T06:00:42.488 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.488 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.488 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.488 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118745 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.488 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930593+0000", 2024-09-14T06:00:42.488 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.7668000000000002e-05, 2024-09-14T06:00:42.488 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.005874242, 2024-09-14T06:00:42.488 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.488 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.489 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.489 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.489 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.489 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.489 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118745 2024-09-14T06:00:42.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.489 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.489 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.489 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930593+0000", 2024-09-14T06:00:42.489 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.490 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.490 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930593+0000", 2024-09-14T06:00:42.490 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.490 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.490 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930593+0000", 2024-09-14T06:00:42.490 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6000000000000004e-07 2024-09-14T06:00:42.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.491 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930595+0000", 2024-09-14T06:00:42.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.001e-06 2024-09-14T06:00:42.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.491 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930601+0000", 2024-09-14T06:00:42.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9170000000000003e-06 2024-09-14T06:00:42.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.491 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930606+0000", 2024-09-14T06:00:42.492 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8459999999999999e-06 2024-09-14T06:00:42.492 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.492 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.492 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.492 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118501 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.492 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926517+0000", 2024-09-14T06:00:42.492 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0041633779999999997, 2024-09-14T06:00:42.492 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0099754330000000006, 2024-09-14T06:00:42.492 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.493 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.493 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.493 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.493 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.493 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.493 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118501 2024-09-14T06:00:42.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.493 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.493 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.493 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926517+0000", 2024-09-14T06:00:42.493 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.494 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.494 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926517+0000", 2024-09-14T06:00:42.494 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.494 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.494 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926517+0000", 2024-09-14T06:00:42.494 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T06:00:42.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.495 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.495 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926520+0000", 2024-09-14T06:00:42.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.334e-06 2024-09-14T06:00:42.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.495 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.495 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926526+0000", 2024-09-14T06:00:42.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7410000000000003e-06 2024-09-14T06:00:42.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.495 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.496 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926532+0000", 2024-09-14T06:00:42.496 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4299999999999997e-06 2024-09-14T06:00:42.496 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.496 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.496 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.496 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.496 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118575 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.496 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927480+0000", 2024-09-14T06:00:42.496 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0031997269999999999, 2024-09-14T06:00:42.496 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0090386660000000008, 2024-09-14T06:00:42.496 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.496 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118575 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927480+0000", 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.497 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927480+0000", 2024-09-14T06:00:42.498 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.498 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.498 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927481+0000", 2024-09-14T06:00:42.498 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2399999999999999e-07 2024-09-14T06:00:42.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.498 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.498 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927483+0000", 2024-09-14T06:00:42.498 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.339e-06 2024-09-14T06:00:42.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.499 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.499 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927490+0000", 2024-09-14T06:00:42.499 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6549999999999998e-06 2024-09-14T06:00:42.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.499 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.499 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927495+0000", 2024-09-14T06:00:42.499 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0499999999999999e-06 2024-09-14T06:00:42.499 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.499 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.499 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.499 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118607 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928272+0000", 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0024085259999999998, 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0082778220000000007, 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118607 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.500 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928272+0000", 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928272+0000", 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928272+0000", 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2500000000000001e-07 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.501 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928278+0000", 2024-09-14T06:00:42.502 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3539999999999996e-06 2024-09-14T06:00:42.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.502 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.502 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928285+0000", 2024-09-14T06:00:42.502 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6030000000000001e-06 2024-09-14T06:00:42.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.502 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.502 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928290+0000", 2024-09-14T06:00:42.502 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9969999999999998e-06 2024-09-14T06:00:42.502 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.502 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.502 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.503 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118682 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.503 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929058+0000", 2024-09-14T06:00:42.503 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0016219730000000001, 2024-09-14T06:00:42.503 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075207579999999998, 2024-09-14T06:00:42.503 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.503 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.503 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.503 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.504 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.504 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.504 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118682 2024-09-14T06:00:42.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.504 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.504 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.504 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929058+0000", 2024-09-14T06:00:42.504 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.504 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929058+0000", 2024-09-14T06:00:42.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.505 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929059+0000", 2024-09-14T06:00:42.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2500000000000001e-07 2024-09-14T06:00:42.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.505 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929061+0000", 2024-09-14T06:00:42.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0470000000000001e-06 2024-09-14T06:00:42.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.506 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.506 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929067+0000", 2024-09-14T06:00:42.506 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5209999999999999e-06 2024-09-14T06:00:42.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.506 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.506 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929072+0000", 2024-09-14T06:00:42.506 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1270000000000002e-06 2024-09-14T06:00:42.506 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.506 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.507 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.507 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118714 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.507 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929825+0000", 2024-09-14T06:00:42.507 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00085548700000000004, 2024-09-14T06:00:42.507 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0067790649999999999, 2024-09-14T06:00:42.507 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.507 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.507 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.508 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.508 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.508 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.508 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118714 2024-09-14T06:00:42.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.508 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.508 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929825+0000", 2024-09-14T06:00:42.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.509 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.509 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929825+0000", 2024-09-14T06:00:42.509 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.509 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.509 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929825+0000", 2024-09-14T06:00:42.509 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9400000000000001e-07 2024-09-14T06:00:42.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.509 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929827+0000", 2024-09-14T06:00:42.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1440000000000001e-06 2024-09-14T06:00:42.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.510 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929833+0000", 2024-09-14T06:00:42.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2249999999999997e-06 2024-09-14T06:00:42.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.510 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929839+0000", 2024-09-14T06:00:42.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9479999999999996e-06 2024-09-14T06:00:42.511 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.511 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.511 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.511 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118746 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.511 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930610+0000", 2024-09-14T06:00:42.511 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 6.9748999999999999e-05, 2024-09-14T06:00:42.511 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.006025936, 2024-09-14T06:00:42.511 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.511 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.511 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118746 2024-09-14T06:00:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930610+0000", 2024-09-14T06:00:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930610+0000", 2024-09-14T06:00:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930611+0000", 2024-09-14T06:00:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6100000000000002e-07 2024-09-14T06:00:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930616+0000", 2024-09-14T06:00:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4240000000000001e-06 2024-09-14T06:00:42.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930620+0000", 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9360000000000001e-06 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930623+0000", 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9409999999999999e-06 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118502 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.514 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926540+0000", 2024-09-14T06:00:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0041404559999999998, 2024-09-14T06:00:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.010123484, 2024-09-14T06:00:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118502 2024-09-14T06:00:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.515 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926540+0000", 2024-09-14T06:00:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926540+0000", 2024-09-14T06:00:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926540+0000", 2024-09-14T06:00:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4799999999999999e-07 2024-09-14T06:00:42.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926543+0000", 2024-09-14T06:00:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.306e-06 2024-09-14T06:00:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926549+0000", 2024-09-14T06:00:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8220000000000001e-06 2024-09-14T06:00:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926554+0000", 2024-09-14T06:00:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9779999999999996e-06 2024-09-14T06:00:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118576 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927503+0000", 2024-09-14T06:00:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0031774199999999998, 2024-09-14T06:00:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0091873509999999999, 2024-09-14T06:00:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118576 2024-09-14T06:00:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927503+0000", 2024-09-14T06:00:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927503+0000", 2024-09-14T06:00:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927503+0000", 2024-09-14T06:00:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3300000000000003e-07 2024-09-14T06:00:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927506+0000", 2024-09-14T06:00:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.311e-06 2024-09-14T06:00:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927514+0000", 2024-09-14T06:00:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6589999999999996e-06 2024-09-14T06:00:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927520+0000", 2024-09-14T06:00:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7930000000000003e-06 2024-09-14T06:00:42.522 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118608 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928297+0000", 2024-09-14T06:00:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0023834989999999999, 2024-09-14T06:00:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0084242940000000006, 2024-09-14T06:00:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.524 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.525 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.525 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.525 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.525 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.525 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118608 2024-09-14T06:00:42.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.525 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.525 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.525 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928297+0000", 2024-09-14T06:00:42.525 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.526 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928297+0000", 2024-09-14T06:00:42.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.526 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928297+0000", 2024-09-14T06:00:42.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1100000000000001e-07 2024-09-14T06:00:42.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.526 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928299+0000", 2024-09-14T06:00:42.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9269999999999999e-06 2024-09-14T06:00:42.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928305+0000", 2024-09-14T06:00:42.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8889999999999999e-06 2024-09-14T06:00:42.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928310+0000", 2024-09-14T06:00:42.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7940000000000002e-06 2024-09-14T06:00:42.527 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.527 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.527 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.528 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118683 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.528 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929081+0000", 2024-09-14T06:00:42.528 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0015991130000000001, 2024-09-14T06:00:42.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.007667826, 2024-09-14T06:00:42.528 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.528 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.528 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.528 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.528 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.528 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.528 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118683 2024-09-14T06:00:42.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.529 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.529 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.529 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929081+0000", 2024-09-14T06:00:42.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.529 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.529 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929081+0000", 2024-09-14T06:00:42.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.530 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.530 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929082+0000", 2024-09-14T06:00:42.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0499999999999999e-07 2024-09-14T06:00:42.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.530 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.530 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929084+0000", 2024-09-14T06:00:42.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.001e-06 2024-09-14T06:00:42.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.530 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.530 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929091+0000", 2024-09-14T06:00:42.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0199999999999997e-06 2024-09-14T06:00:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929095+0000", 2024-09-14T06:00:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8879999999999996e-06 2024-09-14T06:00:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118715 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929848+0000", 2024-09-14T06:00:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00083185900000000001, 2024-09-14T06:00:42.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0069258059999999996, 2024-09-14T06:00:42.532 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.532 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.532 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.532 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.532 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.532 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.532 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118715 2024-09-14T06:00:42.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.532 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.532 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929848+0000", 2024-09-14T06:00:42.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929848+0000", 2024-09-14T06:00:42.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929849+0000", 2024-09-14T06:00:42.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6600000000000002e-07 2024-09-14T06:00:42.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929851+0000", 2024-09-14T06:00:42.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2929999999999999e-06 2024-09-14T06:00:42.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929858+0000", 2024-09-14T06:00:42.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6200000000000001e-06 2024-09-14T06:00:42.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929863+0000", 2024-09-14T06:00:42.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8550000000000001e-06 2024-09-14T06:00:42.535 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.535 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.535 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.535 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118747 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.535 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930627+0000", 2024-09-14T06:00:42.535 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.3403999999999999e-05, 2024-09-14T06:00:42.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0061725010000000004, 2024-09-14T06:00:42.535 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.535 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.535 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.536 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.536 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.536 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.536 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118747 2024-09-14T06:00:42.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.536 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930627+0000", 2024-09-14T06:00:42.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930627+0000", 2024-09-14T06:00:42.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930627+0000", 2024-09-14T06:00:42.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9999999999999998e-07 2024-09-14T06:00:42.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930628+0000", 2024-09-14T06:00:42.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2279999999999999e-06 2024-09-14T06:00:42.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930632+0000", 2024-09-14T06:00:42.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1829999999999998e-06 2024-09-14T06:00:42.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930635+0000", 2024-09-14T06:00:42.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.428e-06 2024-09-14T06:00:42.539 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.539 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.539 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.539 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118503 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.539 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926562+0000", 2024-09-14T06:00:42.539 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.004118516, 2024-09-14T06:00:42.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.010264498, 2024-09-14T06:00:42.539 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.539 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118503 2024-09-14T06:00:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926562+0000", 2024-09-14T06:00:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926562+0000", 2024-09-14T06:00:42.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926562+0000", 2024-09-14T06:00:42.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3700000000000001e-07 2024-09-14T06:00:42.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926564+0000", 2024-09-14T06:00:42.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2400000000000002e-06 2024-09-14T06:00:42.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926575+0000", 2024-09-14T06:00:42.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0305e-05 2024-09-14T06:00:42.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926582+0000", 2024-09-14T06:00:42.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0559999999999999e-06 2024-09-14T06:00:42.543 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.543 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.543 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.543 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118577 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.543 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927547+0000", 2024-09-14T06:00:42.543 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0031327849999999999, 2024-09-14T06:00:42.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0093060690000000001, 2024-09-14T06:00:42.543 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.544 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.544 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.544 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.544 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.544 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.544 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118577 2024-09-14T06:00:42.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.544 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927547+0000", 2024-09-14T06:00:42.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927547+0000", 2024-09-14T06:00:42.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927548+0000", 2024-09-14T06:00:42.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1799999999999995e-07 2024-09-14T06:00:42.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927551+0000", 2024-09-14T06:00:42.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.762e-06 2024-09-14T06:00:42.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927559+0000", 2024-09-14T06:00:42.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.875e-06 2024-09-14T06:00:42.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927564+0000", 2024-09-14T06:00:42.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.468e-06 2024-09-14T06:00:42.547 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.547 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.547 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.547 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118609 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.547 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928332+0000", 2024-09-14T06:00:42.547 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0023478140000000002, 2024-09-14T06:00:42.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0085529100000000004, 2024-09-14T06:00:42.548 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.548 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.548 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.548 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.548 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.548 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.548 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118609 2024-09-14T06:00:42.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.548 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928332+0000", 2024-09-14T06:00:42.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928332+0000", 2024-09-14T06:00:42.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928333+0000", 2024-09-14T06:00:42.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2099999999999996e-07 2024-09-14T06:00:42.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928335+0000", 2024-09-14T06:00:42.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.402e-06 2024-09-14T06:00:42.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928344+0000", 2024-09-14T06:00:42.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.619e-06 2024-09-14T06:00:42.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928350+0000", 2024-09-14T06:00:42.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9379999999999997e-06 2024-09-14T06:00:42.551 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.551 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.551 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.551 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118684 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.551 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929114+0000", 2024-09-14T06:00:42.552 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0015663470000000001, 2024-09-14T06:00:42.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0077967419999999997, 2024-09-14T06:00:42.552 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.552 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.552 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.552 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.552 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.552 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.552 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118684 2024-09-14T06:00:42.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.552 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929114+0000", 2024-09-14T06:00:42.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929114+0000", 2024-09-14T06:00:42.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929114+0000", 2024-09-14T06:00:42.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.37e-07 2024-09-14T06:00:42.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929117+0000", 2024-09-14T06:00:42.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3379999999999999e-06 2024-09-14T06:00:42.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929124+0000", 2024-09-14T06:00:42.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9999999999999999e-06 2024-09-14T06:00:42.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929129+0000", 2024-09-14T06:00:42.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2100000000000001e-06 2024-09-14T06:00:42.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.555 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.555 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118716 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.555 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929885+0000", 2024-09-14T06:00:42.555 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00079473900000000004, 2024-09-14T06:00:42.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070516260000000001, 2024-09-14T06:00:42.555 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.555 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.555 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.555 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.556 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.556 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.556 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118716 2024-09-14T06:00:42.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.556 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929885+0000", 2024-09-14T06:00:42.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929885+0000", 2024-09-14T06:00:42.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929886+0000", 2024-09-14T06:00:42.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6899999999999997e-07 2024-09-14T06:00:42.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929889+0000", 2024-09-14T06:00:42.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5119999999999998e-06 2024-09-14T06:00:42.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929896+0000", 2024-09-14T06:00:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4610000000000002e-06 2024-09-14T06:00:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929902+0000", 2024-09-14T06:00:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5790000000000003e-06 2024-09-14T06:00:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118748 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930642+0000", 2024-09-14T06:00:42.558 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.8651e-05, 2024-09-14T06:00:42.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0063224149999999996, 2024-09-14T06:00:42.559 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.559 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.559 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.559 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.559 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.559 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.559 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118748 2024-09-14T06:00:42.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.559 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930642+0000", 2024-09-14T06:00:42.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930642+0000", 2024-09-14T06:00:42.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930642+0000", 2024-09-14T06:00:42.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2499999999999995e-07 2024-09-14T06:00:42.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930644+0000", 2024-09-14T06:00:42.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5090000000000001e-06 2024-09-14T06:00:42.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930647+0000", 2024-09-14T06:00:42.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.76e-06 2024-09-14T06:00:42.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930650+0000", 2024-09-14T06:00:42.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.914e-06 2024-09-14T06:00:42.562 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.562 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.562 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.562 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118504 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.562 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926602+0000", 2024-09-14T06:00:42.562 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0040780089999999996, 2024-09-14T06:00:42.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.010394659000000001, 2024-09-14T06:00:42.562 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.562 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.562 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.562 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.563 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.563 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.563 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118504 2024-09-14T06:00:42.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.563 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926602+0000", 2024-09-14T06:00:42.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926602+0000", 2024-09-14T06:00:42.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926603+0000", 2024-09-14T06:00:42.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5300000000000004e-07 2024-09-14T06:00:42.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926605+0000", 2024-09-14T06:00:42.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6900000000000001e-06 2024-09-14T06:00:42.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926614+0000", 2024-09-14T06:00:42.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1140000000000006e-06 2024-09-14T06:00:42.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926619+0000", 2024-09-14T06:00:42.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7570000000000001e-06 2024-09-14T06:00:42.565 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.566 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.566 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.566 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118578 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.566 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927576+0000", 2024-09-14T06:00:42.566 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.003104192, 2024-09-14T06:00:42.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0094515559999999998, 2024-09-14T06:00:42.566 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.566 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.566 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.567 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.567 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.567 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.567 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118578 2024-09-14T06:00:42.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.567 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927576+0000", 2024-09-14T06:00:42.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927576+0000", 2024-09-14T06:00:42.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927577+0000", 2024-09-14T06:00:42.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1600000000000001e-07 2024-09-14T06:00:42.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927579+0000", 2024-09-14T06:00:42.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4569999999999999e-06 2024-09-14T06:00:42.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927586+0000", 2024-09-14T06:00:42.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1960000000000002e-06 2024-09-14T06:00:42.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927591+0000", 2024-09-14T06:00:42.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.074e-06 2024-09-14T06:00:42.570 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.570 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.570 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.570 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118610 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.570 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928359+0000", 2024-09-14T06:00:42.570 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.002321245, 2024-09-14T06:00:42.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0086964309999999993, 2024-09-14T06:00:42.570 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.570 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.571 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.571 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.571 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.571 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.571 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118610 2024-09-14T06:00:42.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.571 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928359+0000", 2024-09-14T06:00:42.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928359+0000", 2024-09-14T06:00:42.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928360+0000", 2024-09-14T06:00:42.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6000000000000004e-07 2024-09-14T06:00:42.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928362+0000", 2024-09-14T06:00:42.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2450000000000001e-06 2024-09-14T06:00:42.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928369+0000", 2024-09-14T06:00:42.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3769999999999998e-06 2024-09-14T06:00:42.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928375+0000", 2024-09-14T06:00:42.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3870000000000003e-06 2024-09-14T06:00:42.574 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.574 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.574 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.574 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118685 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.574 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929136+0000", 2024-09-14T06:00:42.574 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0015443729999999999, 2024-09-14T06:00:42.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0079451169999999998, 2024-09-14T06:00:42.574 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118685 2024-09-14T06:00:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929136+0000", 2024-09-14T06:00:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929136+0000", 2024-09-14T06:00:42.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929136+0000", 2024-09-14T06:00:42.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T06:00:42.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929138+0000", 2024-09-14T06:00:42.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0320000000000002e-06 2024-09-14T06:00:42.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.577 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.577 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929144+0000", 2024-09-14T06:00:42.577 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0310000000000004e-06 2024-09-14T06:00:42.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.577 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.577 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929149+0000", 2024-09-14T06:00:42.577 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9359999999999998e-06 2024-09-14T06:00:42.577 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.577 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.577 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.578 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118717 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.578 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929911+0000", 2024-09-14T06:00:42.578 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00076947099999999998, 2024-09-14T06:00:42.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0072024879999999999, 2024-09-14T06:00:42.578 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.578 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.578 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.578 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.578 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.579 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.579 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118717 2024-09-14T06:00:42.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.579 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.579 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.579 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929911+0000", 2024-09-14T06:00:42.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.579 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929911+0000", 2024-09-14T06:00:42.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929911+0000", 2024-09-14T06:00:42.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8100000000000003e-07 2024-09-14T06:00:42.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929914+0000", 2024-09-14T06:00:42.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4499999999999998e-06 2024-09-14T06:00:42.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.581 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.581 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929921+0000", 2024-09-14T06:00:42.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8689999999999998e-06 2024-09-14T06:00:42.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.581 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.581 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929926+0000", 2024-09-14T06:00:42.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2070000000000003e-06 2024-09-14T06:00:42.581 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.582 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.582 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.582 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118749 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.582 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930654+0000", 2024-09-14T06:00:42.582 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 2.6225999999999999e-05, 2024-09-14T06:00:42.582 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064925959999999998, 2024-09-14T06:00:42.582 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.582 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.582 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118749 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930654+0000", 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930654+0000", 2024-09-14T06:00:42.583 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930654+0000", 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.11e-07 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930655+0000", 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.127e-06 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930659+0000", 2024-09-14T06:00:42.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.174e-06 2024-09-14T06:00:42.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.585 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.585 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.585 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930661+0000", 2024-09-14T06:00:42.585 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7250000000000002e-06 2024-09-14T06:00:42.585 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.585 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.585 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.585 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.585 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118505 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.585 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926629+0000", 2024-09-14T06:00:42.586 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.004050985, 2024-09-14T06:00:42.586 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.010557405000000001, 2024-09-14T06:00:42.586 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.586 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.586 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.586 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.586 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.586 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.586 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118505 2024-09-14T06:00:42.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.586 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.586 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926629+0000", 2024-09-14T06:00:42.587 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926629+0000", 2024-09-14T06:00:42.587 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926630+0000", 2024-09-14T06:00:42.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.68e-07 2024-09-14T06:00:42.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.588 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926632+0000", 2024-09-14T06:00:42.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4509999999999999e-06 2024-09-14T06:00:42.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.588 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926639+0000", 2024-09-14T06:00:42.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9360000000000002e-06 2024-09-14T06:00:42.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.589 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926644+0000", 2024-09-14T06:00:42.589 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1900000000000003e-06 2024-09-14T06:00:42.589 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.589 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.589 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.589 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.589 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118579 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.589 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927599+0000", 2024-09-14T06:00:42.589 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0030809029999999999, 2024-09-14T06:00:42.589 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0096144579999999993, 2024-09-14T06:00:42.589 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.590 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.590 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.590 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.590 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.590 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.590 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118579 2024-09-14T06:00:42.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.590 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.590 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.590 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927599+0000", 2024-09-14T06:00:42.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927599+0000", 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927600+0000", 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2e-07 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927602+0000", 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4310000000000001e-06 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927609+0000", 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6850000000000004e-06 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927614+0000", 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2259999999999996e-06 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118611 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.592 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928383+0000", 2024-09-14T06:00:42.593 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.002297655, 2024-09-14T06:00:42.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0088584479999999997, 2024-09-14T06:00:42.593 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.593 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.593 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.593 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.593 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.593 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.593 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118611 2024-09-14T06:00:42.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.593 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928383+0000", 2024-09-14T06:00:42.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928383+0000", 2024-09-14T06:00:42.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928383+0000", 2024-09-14T06:00:42.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5499999999999998e-07 2024-09-14T06:00:42.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.595 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928385+0000", 2024-09-14T06:00:42.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T06:00:42.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.595 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928392+0000", 2024-09-14T06:00:42.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5320000000000003e-06 2024-09-14T06:00:42.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.595 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928397+0000", 2024-09-14T06:00:42.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1270000000000002e-06 2024-09-14T06:00:42.596 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.596 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.596 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.596 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118686 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.596 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929157+0000", 2024-09-14T06:00:42.596 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0015231419999999999, 2024-09-14T06:00:42.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0081091919999999994, 2024-09-14T06:00:42.597 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.597 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.597 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.597 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.597 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.597 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.597 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118686 2024-09-14T06:00:42.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.597 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929157+0000", 2024-09-14T06:00:42.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929157+0000", 2024-09-14T06:00:42.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929158+0000", 2024-09-14T06:00:42.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2200000000000004e-07 2024-09-14T06:00:42.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929164+0000", 2024-09-14T06:00:42.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5270000000000004e-06 2024-09-14T06:00:42.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929171+0000", 2024-09-14T06:00:42.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.08e-06 2024-09-14T06:00:42.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.600 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.600 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929177+0000", 2024-09-14T06:00:42.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T06:00:42.600 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.600 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.600 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.600 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118718 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.601 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929936+0000", 2024-09-14T06:00:42.601 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00074463800000000005, 2024-09-14T06:00:42.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073550200000000003, 2024-09-14T06:00:42.601 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.601 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.601 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.601 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.601 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.601 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.601 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118718 2024-09-14T06:00:42.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.602 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929936+0000", 2024-09-14T06:00:42.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929936+0000", 2024-09-14T06:00:42.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.603 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.603 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929936+0000", 2024-09-14T06:00:42.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4000000000000002e-07 2024-09-14T06:00:42.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.603 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.603 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929938+0000", 2024-09-14T06:00:42.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.356e-06 2024-09-14T06:00:42.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.603 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929946+0000", 2024-09-14T06:00:42.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9419999999999995e-06 2024-09-14T06:00:42.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929951+0000", 2024-09-14T06:00:42.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9599999999999999e-06 2024-09-14T06:00:42.604 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.604 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.604 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.605 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118750 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.605 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930664+0000", 2024-09-14T06:00:42.605 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 1.5761999999999999e-05, 2024-09-14T06:00:42.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0066581799999999997, 2024-09-14T06:00:42.605 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.605 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.605 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.605 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.605 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.605 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.605 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118750 2024-09-14T06:00:42.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.606 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930664+0000", 2024-09-14T06:00:42.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930664+0000", 2024-09-14T06:00:42.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930665+0000", 2024-09-14T06:00:42.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2899999999999999e-07 2024-09-14T06:00:42.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930666+0000", 2024-09-14T06:00:42.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1820000000000001e-06 2024-09-14T06:00:42.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930669+0000", 2024-09-14T06:00:42.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0929999999999999e-06 2024-09-14T06:00:42.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930672+0000", 2024-09-14T06:00:42.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6529999999999998e-06 2024-09-14T06:00:42.608 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.609 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.609 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.609 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118506 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.609 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926652+0000", 2024-09-14T06:00:42.609 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0040283599999999999, 2024-09-14T06:00:42.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.010701988000000001, 2024-09-14T06:00:42.609 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.610 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.610 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.610 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.610 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.610 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.610 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118506 2024-09-14T06:00:42.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.610 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926652+0000", 2024-09-14T06:00:42.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926652+0000", 2024-09-14T06:00:42.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926652+0000", 2024-09-14T06:00:42.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4999999999999998e-07 2024-09-14T06:00:42.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926681+0000", 2024-09-14T06:00:42.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8439999999999999e-05 2024-09-14T06:00:42.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926690+0000", 2024-09-14T06:00:42.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7030000000000001e-06 2024-09-14T06:00:42.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926699+0000", 2024-09-14T06:00:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4780000000000008e-06 2024-09-14T06:00:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118580 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927623+0000", 2024-09-14T06:00:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0030575289999999998, 2024-09-14T06:00:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0097587530000000002, 2024-09-14T06:00:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.613 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118580 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927623+0000", 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927623+0000", 2024-09-14T06:00:42.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927623+0000", 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9500000000000003e-07 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927626+0000", 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4080000000000001e-06 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927633+0000", 2024-09-14T06:00:42.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1980000000000004e-06 2024-09-14T06:00:42.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927639+0000", 2024-09-14T06:00:42.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8470000000000001e-06 2024-09-14T06:00:42.616 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.616 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.616 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.616 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118612 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.616 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928405+0000", 2024-09-14T06:00:42.616 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0022750180000000002, 2024-09-14T06:00:42.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0090013090000000007, 2024-09-14T06:00:42.617 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.617 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.617 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.617 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.617 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.617 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.617 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118612 2024-09-14T06:00:42.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.617 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928405+0000", 2024-09-14T06:00:42.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928405+0000", 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928406+0000", 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9500000000000003e-07 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928408+0000", 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3360000000000002e-06 2024-09-14T06:00:42.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928415+0000", 2024-09-14T06:00:42.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0940000000000002e-06 2024-09-14T06:00:42.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928420+0000", 2024-09-14T06:00:42.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2700000000000004e-06 2024-09-14T06:00:42.619 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.619 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.619 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.620 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118687 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.620 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929186+0000", 2024-09-14T06:00:42.620 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.001494544, 2024-09-14T06:00:42.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0082477829999999999, 2024-09-14T06:00:42.620 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.620 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.620 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.620 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.620 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.620 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118687 2024-09-14T06:00:42.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.620 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929186+0000", 2024-09-14T06:00:42.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929186+0000", 2024-09-14T06:00:42.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929186+0000", 2024-09-14T06:00:42.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8299999999999997e-07 2024-09-14T06:00:42.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929189+0000", 2024-09-14T06:00:42.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3860000000000001e-06 2024-09-14T06:00:42.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929196+0000", 2024-09-14T06:00:42.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6990000000000003e-06 2024-09-14T06:00:42.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.623 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.623 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929202+0000", 2024-09-14T06:00:42.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2850000000000002e-06 2024-09-14T06:00:42.623 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.623 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.623 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.623 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118719 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.624 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929959+0000", 2024-09-14T06:00:42.624 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00072122699999999996, 2024-09-14T06:00:42.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0074996719999999998, 2024-09-14T06:00:42.624 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.624 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.624 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.624 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.624 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.624 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.624 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118719 2024-09-14T06:00:42.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.624 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929959+0000", 2024-09-14T06:00:42.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929959+0000", 2024-09-14T06:00:42.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929959+0000", 2024-09-14T06:00:42.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9700000000000002e-07 2024-09-14T06:00:42.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929962+0000", 2024-09-14T06:00:42.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3010000000000001e-06 2024-09-14T06:00:42.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929968+0000", 2024-09-14T06:00:42.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7320000000000001e-06 2024-09-14T06:00:42.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929974+0000", 2024-09-14T06:00:42.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1789999999999999e-06 2024-09-14T06:00:42.627 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.627 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.627 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.627 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118751 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.628 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930675+0000", 2024-09-14T06:00:42.628 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 5.152e-06, 2024-09-14T06:00:42.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0068158180000000004, 2024-09-14T06:00:42.628 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.628 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.628 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.628 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.628 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.628 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.628 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118751 2024-09-14T06:00:42.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.629 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930675+0000", 2024-09-14T06:00:42.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930675+0000", 2024-09-14T06:00:42.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.630 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930675+0000", 2024-09-14T06:00:42.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1400000000000001e-07 2024-09-14T06:00:42.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.630 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930676+0000", 2024-09-14T06:00:42.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.144e-06 2024-09-14T06:00:42.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930680+0000", 2024-09-14T06:00:42.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3019999999999999e-06 2024-09-14T06:00:42.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930682+0000", 2024-09-14T06:00:42.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7329999999999999e-06 2024-09-14T06:00:42.631 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.631 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.631 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.632 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118507 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.632 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926732+0000", 2024-09-14T06:00:42.632 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0039479839999999999, 2024-09-14T06:00:42.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.010785912999999999, 2024-09-14T06:00:42.632 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.632 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.632 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.632 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.632 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.633 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.633 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118507 2024-09-14T06:00:42.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.633 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.633 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.633 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926732+0000", 2024-09-14T06:00:42.633 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926732+0000", 2024-09-14T06:00:42.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926733+0000", 2024-09-14T06:00:42.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4799999999999998e-07 2024-09-14T06:00:42.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926736+0000", 2024-09-14T06:00:42.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9849999999999998e-06 2024-09-14T06:00:42.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926745+0000", 2024-09-14T06:00:42.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6999999999999997e-06 2024-09-14T06:00:42.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926751+0000", 2024-09-14T06:00:42.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2009999999999996e-06 2024-09-14T06:00:42.635 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.635 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.636 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.636 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118581 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.636 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927646+0000", 2024-09-14T06:00:42.636 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.003034092, 2024-09-14T06:00:42.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0099006019999999997, 2024-09-14T06:00:42.636 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.636 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.636 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.636 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.636 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.636 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.637 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118581 2024-09-14T06:00:42.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.637 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.637 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.637 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927646+0000", 2024-09-14T06:00:42.637 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.637 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927646+0000", 2024-09-14T06:00:42.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927647+0000", 2024-09-14T06:00:42.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2599999999999998e-07 2024-09-14T06:00:42.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927649+0000", 2024-09-14T06:00:42.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1619999999999998e-06 2024-09-14T06:00:42.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.639 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.639 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927655+0000", 2024-09-14T06:00:42.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7449999999999998e-06 2024-09-14T06:00:42.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.639 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.639 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927661+0000", 2024-09-14T06:00:42.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1660000000000002e-06 2024-09-14T06:00:42.639 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.639 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.640 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.640 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118613 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.640 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928427+0000", 2024-09-14T06:00:42.640 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.002252754, 2024-09-14T06:00:42.640 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0091444660000000004, 2024-09-14T06:00:42.640 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.640 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.640 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.640 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.640 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.640 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.640 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118613 2024-09-14T06:00:42.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.641 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928427+0000", 2024-09-14T06:00:42.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928427+0000", 2024-09-14T06:00:42.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928428+0000", 2024-09-14T06:00:42.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2300000000000002e-07 2024-09-14T06:00:42.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928430+0000", 2024-09-14T06:00:42.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2560000000000001e-06 2024-09-14T06:00:42.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928437+0000", 2024-09-14T06:00:42.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5699999999999998e-06 2024-09-14T06:00:42.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928442+0000", 2024-09-14T06:00:42.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5180000000000004e-06 2024-09-14T06:00:42.643 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.643 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.643 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.643 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118688 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.643 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929209+0000", 2024-09-14T06:00:42.643 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0014711240000000001, 2024-09-14T06:00:42.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0083895910000000001, 2024-09-14T06:00:42.644 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.644 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.644 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.644 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.644 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.644 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.644 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118688 2024-09-14T06:00:42.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.644 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929209+0000", 2024-09-14T06:00:42.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929209+0000", 2024-09-14T06:00:42.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929209+0000", 2024-09-14T06:00:42.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6100000000000002e-07 2024-09-14T06:00:42.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929211+0000", 2024-09-14T06:00:42.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.962e-06 2024-09-14T06:00:42.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929218+0000", 2024-09-14T06:00:42.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1059999999999996e-06 2024-09-14T06:00:42.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929222+0000", 2024-09-14T06:00:42.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.763e-06 2024-09-14T06:00:42.646 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.646 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.647 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.647 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118720 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.647 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929981+0000", 2024-09-14T06:00:42.647 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00069910299999999996, 2024-09-14T06:00:42.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0076484559999999997, 2024-09-14T06:00:42.647 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.647 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.647 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.647 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.647 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.647 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.647 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118720 2024-09-14T06:00:42.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.648 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929981+0000", 2024-09-14T06:00:42.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929981+0000", 2024-09-14T06:00:42.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929982+0000", 2024-09-14T06:00:42.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9799999999999999e-07 2024-09-14T06:00:42.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929984+0000", 2024-09-14T06:00:42.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3369999999999998e-06 2024-09-14T06:00:42.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929992+0000", 2024-09-14T06:00:42.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0919999999999998e-06 2024-09-14T06:00:42.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.650 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.650 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929999+0000", 2024-09-14T06:00:42.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6610000000000003e-06 2024-09-14T06:00:42.650 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.650 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.650 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.650 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118752 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.650 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930686+0000", 2024-09-14T06:00:42.650 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9999948, 2024-09-14T06:00:42.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0069734610000000002, 2024-09-14T06:00:42.650 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118752 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930686+0000", 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930686+0000", 2024-09-14T06:00:42.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930686+0000", 2024-09-14T06:00:42.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.16e-07 2024-09-14T06:00:42.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930687+0000", 2024-09-14T06:00:42.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.113e-06 2024-09-14T06:00:42.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930690+0000", 2024-09-14T06:00:42.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1370000000000002e-06 2024-09-14T06:00:42.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930693+0000", 2024-09-14T06:00:42.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7030000000000002e-06 2024-09-14T06:00:42.653 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.653 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.654 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.654 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118508 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.654 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.926760+0000", 2024-09-14T06:00:42.654 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0039202940000000004, 2024-09-14T06:00:42.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.010930199, 2024-09-14T06:00:42.654 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.654 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.654 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.654 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.655 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.655 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.655 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118508 2024-09-14T06:00:42.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.655 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.655 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.655 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926760+0000", 2024-09-14T06:00:42.655 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.655 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926760+0000", 2024-09-14T06:00:42.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926760+0000", 2024-09-14T06:00:42.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.13e-07 2024-09-14T06:00:42.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926763+0000", 2024-09-14T06:00:42.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1900000000000002e-06 2024-09-14T06:00:42.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.657 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.657 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926769+0000", 2024-09-14T06:00:42.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6850000000000004e-06 2024-09-14T06:00:42.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.657 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.657 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.926776+0000", 2024-09-14T06:00:42.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7259999999999996e-06 2024-09-14T06:00:42.657 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.657 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.658 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.658 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118582 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.658 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.927668+0000", 2024-09-14T06:00:42.658 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.003011798, 2024-09-14T06:00:42.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0100499, 2024-09-14T06:00:42.658 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.658 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.658 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.659 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.659 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.659 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.659 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118582 2024-09-14T06:00:42.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.659 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.659 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.659 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927668+0000", 2024-09-14T06:00:42.659 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.660 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.660 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927668+0000", 2024-09-14T06:00:42.660 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.660 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.660 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927669+0000", 2024-09-14T06:00:42.660 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5200000000000002e-07 2024-09-14T06:00:42.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.660 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927671+0000", 2024-09-14T06:00:42.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.289e-06 2024-09-14T06:00:42.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.661 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927678+0000", 2024-09-14T06:00:42.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7499999999999997e-06 2024-09-14T06:00:42.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.661 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.927683+0000", 2024-09-14T06:00:42.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.254e-06 2024-09-14T06:00:42.662 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.662 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.662 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.662 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118614 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.662 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.928450+0000", 2024-09-14T06:00:42.662 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0022303240000000001, 2024-09-14T06:00:42.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.009294086, 2024-09-14T06:00:42.662 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.663 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.663 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.663 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.663 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.663 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.663 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118614 2024-09-14T06:00:42.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.663 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.663 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928450+0000", 2024-09-14T06:00:42.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.664 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928450+0000", 2024-09-14T06:00:42.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.664 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928450+0000", 2024-09-14T06:00:42.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8999999999999996e-07 2024-09-14T06:00:42.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.665 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.665 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928453+0000", 2024-09-14T06:00:42.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1119999999999999e-06 2024-09-14T06:00:42.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.665 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.665 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928460+0000", 2024-09-14T06:00:42.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8250000000000005e-06 2024-09-14T06:00:42.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.666 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.666 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.928465+0000", 2024-09-14T06:00:42.666 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0050000000000004e-06 2024-09-14T06:00:42.666 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.666 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.666 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.666 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118689 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.666 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.929241+0000", 2024-09-14T06:00:42.667 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.0014396050000000001, 2024-09-14T06:00:42.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0085285980000000001, 2024-09-14T06:00:42.667 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.667 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.667 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.667 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.667 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.667 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.667 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118689 2024-09-14T06:00:42.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.667 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929241+0000", 2024-09-14T06:00:42.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929241+0000", 2024-09-14T06:00:42.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929241+0000", 2024-09-14T06:00:42.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2399999999999998e-07 2024-09-14T06:00:42.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929244+0000", 2024-09-14T06:00:42.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3140000000000002e-06 2024-09-14T06:00:42.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929252+0000", 2024-09-14T06:00:42.670 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3210000000000005e-06 2024-09-14T06:00:42.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.670 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.670 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.929257+0000", 2024-09-14T06:00:42.670 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3820000000000003e-06 2024-09-14T06:00:42.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.670 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.671 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118721 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.671 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930007+0000", 2024-09-14T06:00:42.671 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00067324099999999999, 2024-09-14T06:00:42.671 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0077944640000000001, 2024-09-14T06:00:42.671 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.671 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.671 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.671 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.671 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.671 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.671 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118721 2024-09-14T06:00:42.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.672 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.672 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.672 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930007+0000", 2024-09-14T06:00:42.672 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.672 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.672 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930007+0000", 2024-09-14T06:00:42.672 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930008+0000", 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0100000000000005e-07 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930010+0000", 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.289e-06 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930016+0000", 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5749999999999997e-06 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.674 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.674 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930022+0000", 2024-09-14T06:00:42.674 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2959999999999998e-06 2024-09-14T06:00:42.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.674 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.674 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:118753 3.17 3.ea74737 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:42.674 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:41.930696+0000", 2024-09-14T06:00:42.674 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9999843, 2024-09-14T06:00:42.674 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0071316749999999996, 2024-09-14T06:00:42.674 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:42.674 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:42.675 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "queued for pg", 2024-09-14T06:00:42.675 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:42.675 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:42.675 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:42.675 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 118753 2024-09-14T06:00:42.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.675 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:42.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.675 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:42.675 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930696+0000", 2024-09-14T06:00:42.675 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.675 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:42.676 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930696+0000", 2024-09-14T06:00:42.676 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:42.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.676 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:42.676 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930696+0000", 2024-09-14T06:00:42.676 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0800000000000001e-07 2024-09-14T06:00:42.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.676 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:42.676 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930697+0000", 2024-09-14T06:00:42.676 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.085e-06 2024-09-14T06:00:42.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.677 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:42.677 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930700+0000", 2024-09-14T06:00:42.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0709999999999999e-06 2024-09-14T06:00:42.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:42.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:42.677 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:42.677 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:41.930703+0000", 2024-09-14T06:00:42.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6589999999999999e-06 2024-09-14T06:00:42.677 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.677 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:42.677 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.678 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:42.678 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:00:42.678 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 192 2024-09-14T06:00:42.678 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:42.678 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:00:42.679 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:42.678+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:42.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:00:42.684 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:42.685 INFO:teuthology.orchestra.run.smithi006.stdout:5918 write 0x373e9e7 thru 0x374965d (0xac77 bytes) 2024-09-14T06:00:42.685 INFO:teuthology.orchestra.run.smithi006.stdout:5919 write 0xb901f6b thru 0xb90e176 (0xc20c bytes) 2024-09-14T06:00:42.685 INFO:teuthology.orchestra.run.smithi006.stdout:5920 write 0x19cb952 thru 0x19d0eea (0x5599 bytes) 2024-09-14T06:00:42.685 INFO:teuthology.orchestra.run.smithi006.stdout:5921 punch from 0x249b152 to 0x24a089c, (0x574a bytes) 2024-09-14T06:00:42.685 INFO:teuthology.orchestra.run.smithi006.stdout:5922 punch from 0xbcde0f1 to 0xbce2dd1, (0x4ce0 bytes) 2024-09-14T06:00:42.685 INFO:teuthology.orchestra.run.smithi006.stdout:5923 writesame 0x34a0efe thru 0x34a561e data_size 0x1(0x4721 bytes) 2024-09-14T06:00:42.685 INFO:teuthology.orchestra.run.smithi006.stdout:5924 write 0x600b7ab thru 0x6019232 (0xda88 bytes) 2024-09-14T06:00:42.685 INFO:teuthology.orchestra.run.smithi006.stdout:5925 read 0xbac2588 thru 0xbac6e8b (0x4904 bytes) 2024-09-14T06:00:42.685 INFO:teuthology.orchestra.run.smithi006.stdout:5927 writesame 0x1cc51df thru 0x1cc6b56 data_size 0x14(0x1978 bytes) 2024-09-14T06:00:42.685 INFO:teuthology.orchestra.run.smithi006.stdout:5928 read 0xdb4e480 thru 0xdb5b58b (0xd10c bytes) 2024-09-14T06:00:42.685 INFO:teuthology.orchestra.run.smithi006.stdout:5929 trunc from 0xe08449b to 0x5632466 2024-09-14T06:00:42.686 INFO:teuthology.orchestra.run.smithi006.stdout:5930 writesame 0x1c5cc3a thru 0x1c6b0eb data_size 0x2(0xe4b2 bytes) 2024-09-14T06:00:42.686 INFO:teuthology.orchestra.run.smithi006.stdout:5931 write 0x58f16c4 thru 0x58f63de (0x4d1b bytes) 2024-09-14T06:00:42.686 INFO:teuthology.orchestra.run.smithi006.stdout:5932 write 0x5539ef7 thru 0x553f9fc (0x5b06 bytes) 2024-09-14T06:00:42.686 INFO:teuthology.orchestra.run.smithi006.stdout:5934 write 0x4c25e3e thru 0x4c34872 (0xea35 bytes) 2024-09-14T06:00:42.686 INFO:teuthology.orchestra.run.smithi006.stdout:5935 write 0x89039c7 thru 0x8910d89 (0xd3c3 bytes) 2024-09-14T06:00:42.686 INFO:teuthology.orchestra.run.smithi006.stdout:5936 read 0x6f94138 thru 0x6f9e7e6 (0xa6af bytes) 2024-09-14T06:00:42.686 INFO:teuthology.orchestra.run.smithi006.stdout:5937 writesame 0x4b03a72 thru 0x4b0a08c data_size 0x1(0x661b bytes) 2024-09-14T06:00:42.686 INFO:teuthology.orchestra.run.smithi006.stdout:5939 write 0xc39a0ed thru 0xc39ee07 (0x4d1b bytes) 2024-09-14T06:00:42.686 INFO:teuthology.orchestra.run.smithi006.stdout:5940 trunc from 0xc39ee08 to 0xcb6e573 2024-09-14T06:00:42.686 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:42.687 INFO:teuthology.orchestra.run.smithi006.stdout:5943 punch from 0x47b4483 to 0x47bb168, (0x6ce5 bytes) 2024-09-14T06:00:42.687 INFO:teuthology.orchestra.run.smithi006.stdout:5944 writesame 0x5e47709 thru 0x5e47a6f data_size 0x1(0x367 bytes) 2024-09-14T06:00:42.687 INFO:teuthology.orchestra.run.smithi006.stdout:5945 write 0x1721b46 thru 0x1723ced (0x21a8 bytes) 2024-09-14T06:00:42.687 INFO:teuthology.orchestra.run.smithi006.stdout:5946 read 0xb91dec2 thru 0xb924081 (0x61c0 bytes) 2024-09-14T06:00:42.687 INFO:teuthology.orchestra.run.smithi006.stdout:5947 writesame 0x8057215 thru 0x8063380 data_size 0x2(0xc16c bytes) 2024-09-14T06:00:42.687 INFO:teuthology.orchestra.run.smithi006.stdout:5950 read 0x826b610 thru 0x826c78f (0x1180 bytes) 2024-09-14T06:00:42.687 INFO:teuthology.orchestra.run.smithi006.stdout:5951 write 0x5a1758f thru 0x5a1760b (0x7d bytes) 2024-09-14T06:00:42.687 INFO:teuthology.orchestra.run.smithi006.stdout:5952 trunc from 0xcb6e573 to 0xcc4ac4a 2024-09-14T06:00:42.687 INFO:teuthology.orchestra.run.smithi006.stdout:5954 writesame 0x6ec46f2 thru 0x6ed0297 data_size 0x1(0xbba6 bytes) 2024-09-14T06:00:42.687 INFO:teuthology.orchestra.run.smithi006.stdout:5955 write 0xe213100 thru 0xe215f60 (0x2e61 bytes) 2024-09-14T06:00:42.687 INFO:teuthology.orchestra.run.smithi006.stdout:5956 writesame 0x42f52a9 thru 0x42ff90d data_size 0x3(0xa665 bytes) 2024-09-14T06:00:42.687 INFO:teuthology.orchestra.run.smithi006.stdout:5957 write 0xb899887 thru 0xb8a28f0 (0x906a bytes) 2024-09-14T06:00:42.688 INFO:teuthology.orchestra.run.smithi006.stdout:5958 writesame 0xb041d48 thru 0xb04b78f data_size 0x4(0x9a48 bytes) 2024-09-14T06:00:42.688 INFO:teuthology.orchestra.run.smithi006.stdout:5960 write 0xedd2ccf thru 0xedd7b3a (0x4e6c bytes) 2024-09-14T06:00:42.693 INFO:teuthology.orchestra.run.smithi006.stdout:5961 punch from 0xbc860d2 to 0xbc86754, (0x682 bytes) 2024-09-14T06:00:42.693 INFO:teuthology.orchestra.run.smithi006.stdout:5964 writesame 0x85a959a thru 0x85b27a6 data_size 0xb(0x920d bytes) 2024-09-14T06:00:42.699 INFO:teuthology.orchestra.run.smithi006.stdout:5965 punch from 0x331ffd7 to 0x332e989, (0xe9b2 bytes) 2024-09-14T06:00:42.699 INFO:teuthology.orchestra.run.smithi006.stdout:5968 writesame 0x757a238 thru 0x7583992 data_size 0x1(0x975b bytes) 2024-09-14T06:00:42.740 INFO:teuthology.orchestra.run.smithi006.stdout:5969 punch from 0x4cedfc9 to 0x4cf7674, (0x96ab bytes) 2024-09-14T06:00:42.740 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:42.740 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:42.740 INFO:teuthology.orchestra.run.smithi006.stdout:5972 writesame 0x3cf242 thru 0x3d790c data_size 0x1(0x86cb bytes) 2024-09-14T06:00:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T06:00:42.780 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:42.777+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:42.793 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-14T06:00:42.849 INFO:teuthology.orchestra.run.smithi006.stdout:5973 trunc from 0xedd7b3b to 0x248f5e8 2024-09-14T06:00:42.857 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:42.858 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:42.858 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:42.858 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:42.858 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:42.879 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:00:42.880 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:42.880 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:42.881 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:42.882+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:42.897 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:42.898 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:42.913 INFO:teuthology.orchestra.run.smithi006.stdout:5976 writesame 0x4a0de05 thru 0x4a13cac data_size 0x1a(0x5ea8 bytes) 2024-09-14T06:00:42.913 INFO:teuthology.orchestra.run.smithi006.stdout:5977 writesame 0x464f86a thru 0x46562b0 data_size 0x3(0x6a47 bytes) 2024-09-14T06:00:42.923 INFO:teuthology.orchestra.run.smithi006.stdout:5978 punch from 0x49f17ee to 0x49fdc7f, (0xc491 bytes) 2024-09-14T06:00:42.924 INFO:teuthology.orchestra.run.smithi006.stdout:5979 writesame 0x1319ec2 thru 0x131e5e8 data_size 0x1(0x4727 bytes) 2024-09-14T06:00:42.932 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:42.932 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:42.951 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:42.978 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:42.978 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:42.982 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:42.982+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:42.995 INFO:teuthology.orchestra.run.smithi006.stdout:5980 punch from 0x29216e6 to 0x292c676, (0xaf90 bytes) 2024-09-14T06:00:42.995 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:42.995 INFO:teuthology.orchestra.run.smithi006.stdout:5984 punch from 0x253a7d1 to 0x2540771, (0x5fa0 bytes) 2024-09-14T06:00:42.995 INFO:teuthology.orchestra.run.smithi006.stdout:5985 read 0x4053b02 thru 0x405a460 (0x695f bytes) 2024-09-14T06:00:43.002 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:43.002 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:43.021 INFO:teuthology.orchestra.run.smithi006.stdout:5986 write 0xe5b3b96 thru 0xe5ba450 (0x68bb bytes) 2024-09-14T06:00:43.029 INFO:teuthology.orchestra.run.smithi006.stdout:5987 write 0x5e8f593 thru 0x5e98c17 (0x9685 bytes) 2024-09-14T06:00:43.038 INFO:teuthology.orchestra.run.smithi006.stdout:5988 write 0xa770327 thru 0xa77d1e2 (0xcebc bytes) 2024-09-14T06:00:43.040 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:43.040 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:43.045 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:43.045 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:43.047 INFO:teuthology.orchestra.run.smithi006.stdout:5989 writesame 0x322d755 thru 0x3238e68 data_size 0x2(0xb714 bytes) 2024-09-14T06:00:43.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:00:43.066 INFO:teuthology.orchestra.run.smithi006.stdout:5990 read 0x19e19a2 thru 0x19e64a6 (0x4b05 bytes) 2024-09-14T06:00:43.068 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:43.068 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:43.068 INFO:teuthology.orchestra.run.smithi006.stdout:compare and write disabled 2024-09-14T06:00:43.068 INFO:teuthology.orchestra.run.smithi006.stdout:5993 writesame 0x6909e24 thru 0x69189fd data_size 0x57(0xebda bytes) 2024-09-14T06:00:43.076 INFO:teuthology.orchestra.run.smithi006.stdout:5994 punch from 0x36dcb46 to 0x36e4934, (0x7dee bytes) 2024-09-14T06:00:43.077 INFO:teuthology.orchestra.run.smithi006.stdout:5996 read 0xad4786e thru 0xad515c8 (0x9d5b bytes) 2024-09-14T06:00:43.077 INFO:teuthology.orchestra.run.smithi006.stdout:5997 write 0x482bd51 thru 0x483a649 (0xe8f9 bytes) 2024-09-14T06:00:43.083 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:43.081+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:43.085 INFO:teuthology.orchestra.run.smithi006.stdout:5998 writesame 0x4e8b8e3 thru 0x4e91151 data_size 0x1(0x586f bytes) 2024-09-14T06:00:43.127 INFO:teuthology.orchestra.run.smithi006.stdout:5999 trunc from 0xe5ba451 to 0x8a5de28 2024-09-14T06:00:43.152 INFO:teuthology.orchestra.run.smithi006.stdout:6000 trunc from 0x8a5de28 to 0xa26e874 2024-09-14T06:00:43.184 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:43.182+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:43.193 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:43.193 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:43.208 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:00:43.236 INFO:teuthology.orchestra.run.smithi006.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-14T06:00:43.285 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:43.281+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:43.360 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:43.361 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:43.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:00:43.423 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:43.421+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:43.487 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:43.485+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:43.561 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:43.562 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:43.577 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:00:43.619 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:43.617+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:43.688 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:43.685+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:43.740 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:43.740 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:43.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:00:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.6 to 1 (10000) 2024-09-14T06:00:43.793 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T06:00:43.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-14T06:00:43.805 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:43.801+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:43.899 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:43.897+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:43.905 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:43.905 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:43.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:00:44.011 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:44.009+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:44.088 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:44.088 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:44.092 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:44.090+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:44.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:00:44.193 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:44.189+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:44.278 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:44.278 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:44.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:00:44.335 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:44.333+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:44.395 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:44.394+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:44.460 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:44.460 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:44.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:00:44.496 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:44.494+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:44.596 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:44.596 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:44.597 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:44.594+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:44.611 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:00:44.697 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:44.693+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:44.744 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:44.744 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:44.758 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:00:44.793 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2024-09-14T06:00:44.793 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.7 to 1 (10000) 2024-09-14T06:00:44.802 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:44.802+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:44.825 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T06:00:44.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T06:00:44.891 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:44.892 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:44.908 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:00:44.915 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:44.913+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:45.000 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:44.997+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:45.068 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:45.068 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:45.082 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:00:45.092 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:00:45.129 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:45.130+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:45.189 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:00:45.190 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T06:00:45.202 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:45.202+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:45.204 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:45.204 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:45.209 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-14T06:00:44.798102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1136490124,"num_objects":2495,"num_object_clones":369,"num_object_copies":4990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2495,"num_whiteouts":1273,"num_read":155435,"num_read_kb":804787,"num_write":22440,"num_write_kb":436481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":433,"num_bytes_recovered":10220769,"num_keys_recovered":69,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18116,"ondisk_log_size":18116,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":806460,"kb_used_data":461568,"kb_used_omap":15,"kb_used_meta":344688,"kb_avail":754168260,"statfs":{"total":773094113280,"available":772268298240,"internally_reserved":0,"allocated":472645632,"data_stored":603956901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":352961308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":97676445,"num_objects":85,"num_object_clones":7,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":6,"num_read":10046,"num_read_kb":152366,"num_write":1179,"num_write_kb":21731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.056242"},"pg_stats":[{"pgid":"3.1f","version":"99'699","reported_seq":2370,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.471251+0000","last_change":"2024-09-14T05:59:43.763150+0000","last_active":"2024-09-14T06:00:43.471251+0000","last_peered":"2024-09-14T06:00:43.471251+0000","last_clean":"2024-09-14T06:00:43.471251+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T06:00:43.471251+0000","last_undegraded":"2024-09-14T06:00:43.471251+0000","last_fullsized":"2024-09-14T06:00:43.471251+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:42.525356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001224482,"stat_sum":{"num_bytes":41895251,"num_objects":80,"num_object_clones":9,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":42,"num_read":4174,"num_read_kb":14503,"num_write":899,"num_write_kb":5420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"95'532","reported_seq":2931,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.752988+0000","last_change":"2024-09-14T05:59:08.299658+0000","last_active":"2024-09-14T06:00:40.752988+0000","last_peered":"2024-09-14T06:00:40.752988+0000","last_clean":"2024-09-14T06:00:40.752988+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T06:00:40.752988+0000","last_undegraded":"2024-09-14T06:00:40.752988+0000","last_fullsized":"2024-09-14T06:00:40.752988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:05.694873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882171,"stat_sum":{"num_bytes":25424971,"num_objects":70,"num_object_clones":13,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":31,"num_read":3453,"num_read_kb":12249,"num_write":675,"num_write_kb":12326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"97'347","reported_seq":5507,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.596126+0000","last_change":"2024-09-14T05:59:08.293155+0000","last_active":"2024-09-14T06:00:41.596126+0000","last_peered":"2024-09-14T06:00:41.596126+0000","last_clean":"2024-09-14T06:00:41.596126+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T06:00:41.596126+0000","last_undegraded":"2024-09-14T06:00:41.596126+0000","last_fullsized":"2024-09-14T06:00:41.596126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:02.551851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000618802,"stat_sum":{"num_bytes":27526886,"num_objects":74,"num_object_clones":7,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":44,"num_read":5159,"num_read_kb":31126,"num_write":348,"num_write_kb":26838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"97'472","reported_seq":3883,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.059107+0000","last_change":"2024-09-14T05:59:08.294498+0000","last_active":"2024-09-14T06:00:41.059107+0000","last_peered":"2024-09-14T06:00:41.059107+0000","last_clean":"2024-09-14T06:00:41.059107+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T06:00:41.059107+0000","last_undegraded":"2024-09-14T06:00:41.059107+0000","last_fullsized":"2024-09-14T06:00:41.059107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:12.322268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014905350000000001,"stat_sum":{"num_bytes":28601988,"num_objects":72,"num_object_clones":11,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":39,"num_read":4145,"num_read_kb":14081,"num_write":523,"num_write_kb":8642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"99'502","reported_seq":1300,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.030499+0000","last_change":"2024-09-14T05:59:40.834308+0000","last_active":"2024-09-14T06:00:43.030499+0000","last_peered":"2024-09-14T06:00:43.030499+0000","last_clean":"2024-09-14T06:00:43.030499+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T06:00:43.030499+0000","last_undegraded":"2024-09-14T06:00:43.030499+0000","last_fullsized":"2024-09-14T06:00:43.030499+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:22.578137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11129328,"num_objects":70,"num_object_clones":13,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":35,"num_read":2219,"num_read_kb":6040,"num_write":557,"num_write_kb":6276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"97'872","reported_seq":5361,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.940536+0000","last_change":"2024-09-14T05:59:08.282710+0000","last_active":"2024-09-14T06:00:40.940536+0000","last_peered":"2024-09-14T06:00:40.940536+0000","last_clean":"2024-09-14T06:00:40.940536+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T06:00:40.940536+0000","last_undegraded":"2024-09-14T06:00:40.940536+0000","last_fullsized":"2024-09-14T06:00:40.940536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:48.365630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078735700000000003,"stat_sum":{"num_bytes":23664870,"num_objects":77,"num_object_clones":10,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":44,"num_read":7738,"num_read_kb":44004,"num_write":1201,"num_write_kb":19820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"97'454","reported_seq":2818,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.050080+0000","last_change":"2024-09-14T05:59:08.283122+0000","last_active":"2024-09-14T06:00:41.050080+0000","last_peered":"2024-09-14T06:00:41.050080+0000","last_clean":"2024-09-14T06:00:41.050080+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T06:00:41.050080+0000","last_undegraded":"2024-09-14T06:00:41.050080+0000","last_fullsized":"2024-09-14T06:00:41.050080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:44.549320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020244989999999999,"stat_sum":{"num_bytes":34017297,"num_objects":70,"num_object_clones":5,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":34,"num_read":3301,"num_read_kb":21523,"num_write":532,"num_write_kb":15097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"95'476","reported_seq":5768,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.060078+0000","last_change":"2024-09-14T05:59:43.761389+0000","last_active":"2024-09-14T06:00:41.060078+0000","last_peered":"2024-09-14T06:00:41.060078+0000","last_clean":"2024-09-14T06:00:41.060078+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T06:00:41.060078+0000","last_undegraded":"2024-09-14T06:00:41.060078+0000","last_fullsized":"2024-09-14T06:00:41.060078+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:09.833097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090099400000000001,"stat_sum":{"num_bytes":59866913,"num_objects":82,"num_object_clones":13,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":40,"num_read":6953,"num_read_kb":51188,"num_write":471,"num_write_kb":14144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"99'365","reported_seq":2964,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.077185+0000","last_change":"2024-09-14T05:59:40.929839+0000","last_active":"2024-09-14T06:00:43.077185+0000","last_peered":"2024-09-14T06:00:43.077185+0000","last_clean":"2024-09-14T06:00:43.077185+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T06:00:43.077185+0000","last_undegraded":"2024-09-14T06:00:43.077185+0000","last_fullsized":"2024-09-14T06:00:43.077185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:41.552583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30644976,"num_objects":71,"num_object_clones":14,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":38,"num_read":3386,"num_read_kb":21115,"num_write":329,"num_write_kb":6970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"97'1428","reported_seq":3531,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.055001+0000","last_change":"2024-09-14T05:59:08.293088+0000","last_active":"2024-09-14T06:00:41.055001+0000","last_peered":"2024-09-14T06:00:41.055001+0000","last_clean":"2024-09-14T06:00:41.055001+0000","last_became_active":"2024-09-14T05:59:06.296607+0000","last_became_peered":"2024-09-14T05:59:06.296607+0000","last_unstale":"2024-09-14T06:00:41.055001+0000","last_undegraded":"2024-09-14T06:00:41.055001+0000","last_fullsized":"2024-09-14T06:00:41.055001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1428,"log_dups_size":0,"ondisk_log_size":1428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:58.281385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056627299999999995,"stat_sum":{"num_bytes":41826361,"num_objects":68,"num_object_clones":10,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":34,"num_read":8231,"num_read_kb":22548,"num_write":2433,"num_write_kb":21381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"97'652","reported_seq":5814,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.055475+0000","last_change":"2024-09-14T05:59:08.370304+0000","last_active":"2024-09-14T06:00:41.055475+0000","last_peered":"2024-09-14T06:00:41.055475+0000","last_clean":"2024-09-14T06:00:41.055475+0000","last_became_active":"2024-09-14T05:59:06.295335+0000","last_became_peered":"2024-09-14T05:59:06.295335+0000","last_unstale":"2024-09-14T06:00:41.055475+0000","last_undegraded":"2024-09-14T06:00:41.055475+0000","last_fullsized":"2024-09-14T06:00:41.055475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:44:36.118339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001779487,"stat_sum":{"num_bytes":63917922,"num_objects":107,"num_object_clones":24,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":53,"num_read":7172,"num_read_kb":54437,"num_write":775,"num_write_kb":20105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"97'556","reported_seq":4821,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.055150+0000","last_change":"2024-09-14T05:59:08.282513+0000","last_active":"2024-09-14T06:00:41.055150+0000","last_peered":"2024-09-14T06:00:41.055150+0000","last_clean":"2024-09-14T06:00:41.055150+0000","last_became_active":"2024-09-14T05:59:06.307548+0000","last_became_peered":"2024-09-14T05:59:06.307548+0000","last_unstale":"2024-09-14T06:00:41.055150+0000","last_undegraded":"2024-09-14T06:00:41.055150+0000","last_fullsized":"2024-09-14T06:00:41.055150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:09.549075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061538200000000004,"stat_sum":{"num_bytes":27180998,"num_objects":70,"num_object_clones":12,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":35,"num_read":5513,"num_read_kb":30465,"num_write":772,"num_write_kb":15959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":170,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.834287+0000","last_change":"2024-09-14T05:58:56.312544+0000","last_active":"2024-09-14T06:00:40.834287+0000","last_peered":"2024-09-14T06:00:40.834287+0000","last_clean":"2024-09-14T06:00:40.834287+0000","last_became_active":"2024-09-14T05:58:54.103612+0000","last_became_peered":"2024-09-14T05:58:54.103612+0000","last_unstale":"2024-09-14T06:00:40.834287+0000","last_undegraded":"2024-09-14T06:00:40.834287+0000","last_fullsized":"2024-09-14T06:00:40.834287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:08.678742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"99'988","reported_seq":4862,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.459973+0000","last_change":"2024-09-14T05:59:43.762927+0000","last_active":"2024-09-14T06:00:43.459973+0000","last_peered":"2024-09-14T06:00:43.459973+0000","last_clean":"2024-09-14T06:00:43.459973+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T06:00:43.459973+0000","last_undegraded":"2024-09-14T06:00:43.459973+0000","last_fullsized":"2024-09-14T06:00:43.459973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:36.940253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26004745,"num_objects":76,"num_object_clones":9,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":36,"num_read":8027,"num_read_kb":25118,"num_write":1373,"num_write_kb":13665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.744550+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T06:00:40.744550+0000","last_peered":"2024-09-14T06:00:40.744550+0000","last_clean":"2024-09-14T06:00:40.744550+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T06:00:40.744550+0000","last_undegraded":"2024-09-14T06:00:40.744550+0000","last_fullsized":"2024-09-14T06:00:40.744550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"95'383","reported_seq":4437,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.050937+0000","last_change":"2024-09-14T06:00:35.709017+0000","last_active":"2024-09-14T06:00:41.050937+0000","last_peered":"2024-09-14T06:00:41.050937+0000","last_clean":"2024-09-14T06:00:41.050937+0000","last_became_active":"2024-09-14T06:00:35.707129+0000","last_became_peered":"2024-09-14T06:00:35.707129+0000","last_unstale":"2024-09-14T06:00:41.050937+0000","last_undegraded":"2024-09-14T06:00:41.050937+0000","last_fullsized":"2024-09-14T06:00:41.050937+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:11.681443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001533155,"stat_sum":{"num_bytes":65575771,"num_objects":75,"num_object_clones":10,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":34,"num_read":3976,"num_read_kb":32296,"num_write":387,"num_write_kb":16552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":125,"num_bytes_recovered":4610315,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789427+0000","last_change":"2024-09-14T05:59:40.765463+0000","last_active":"2024-09-14T06:00:40.789427+0000","last_peered":"2024-09-14T06:00:40.789427+0000","last_clean":"2024-09-14T06:00:40.789427+0000","last_became_active":"2024-09-14T05:59:40.764785+0000","last_became_peered":"2024-09-14T05:59:40.764785+0000","last_unstale":"2024-09-14T06:00:40.789427+0000","last_undegraded":"2024-09-14T06:00:40.789427+0000","last_fullsized":"2024-09-14T06:00:40.789427+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:47.547246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"95'361","reported_seq":3880,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.054161+0000","last_change":"2024-09-14T05:59:08.282105+0000","last_active":"2024-09-14T06:00:41.054161+0000","last_peered":"2024-09-14T06:00:41.054161+0000","last_clean":"2024-09-14T06:00:41.054161+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T06:00:41.054161+0000","last_undegraded":"2024-09-14T06:00:41.054161+0000","last_fullsized":"2024-09-14T06:00:41.054161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:51.251847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010945919999999999,"stat_sum":{"num_bytes":28806714,"num_objects":72,"num_object_clones":8,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":41,"num_read":3732,"num_read_kb":24815,"num_write":407,"num_write_kb":9879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":179,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.744277+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T06:00:40.744277+0000","last_peered":"2024-09-14T06:00:40.744277+0000","last_clean":"2024-09-14T06:00:40.744277+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T06:00:40.744277+0000","last_undegraded":"2024-09-14T06:00:40.744277+0000","last_fullsized":"2024-09-14T06:00:40.744277+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'428","reported_seq":3776,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.054950+0000","last_change":"2024-09-14T05:59:08.293368+0000","last_active":"2024-09-14T06:00:41.054950+0000","last_peered":"2024-09-14T06:00:41.054950+0000","last_clean":"2024-09-14T06:00:41.054950+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T06:00:41.054950+0000","last_undegraded":"2024-09-14T06:00:41.054950+0000","last_fullsized":"2024-09-14T06:00:41.054950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:25.635807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072033799999999995,"stat_sum":{"num_bytes":18930470,"num_objects":73,"num_object_clones":12,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":35,"num_read":4769,"num_read_kb":19471,"num_write":427,"num_write_kb":8496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"97'422","reported_seq":2647,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.608981+0000","last_change":"2024-09-14T05:59:40.846399+0000","last_active":"2024-09-14T06:00:41.608981+0000","last_peered":"2024-09-14T06:00:41.608981+0000","last_clean":"2024-09-14T06:00:41.608981+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T06:00:41.608981+0000","last_undegraded":"2024-09-14T06:00:41.608981+0000","last_fullsized":"2024-09-14T06:00:41.608981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:45.965970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047912600000000002,"stat_sum":{"num_bytes":68265765,"num_objects":79,"num_object_clones":12,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":40,"num_read":3063,"num_read_kb":38618,"num_write":422,"num_write_kb":15815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":172,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.743191+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T06:00:40.743191+0000","last_peered":"2024-09-14T06:00:40.743191+0000","last_clean":"2024-09-14T06:00:40.743191+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T06:00:40.743191+0000","last_undegraded":"2024-09-14T06:00:40.743191+0000","last_fullsized":"2024-09-14T06:00:40.743191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"96'927","reported_seq":2654,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.050175+0000","last_change":"2024-09-14T05:59:08.281926+0000","last_active":"2024-09-14T06:00:41.050175+0000","last_peered":"2024-09-14T06:00:41.050175+0000","last_clean":"2024-09-14T06:00:41.050175+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T06:00:41.050175+0000","last_undegraded":"2024-09-14T06:00:41.050175+0000","last_fullsized":"2024-09-14T06:00:41.050175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:47.567426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096925799999999997,"stat_sum":{"num_bytes":24728497,"num_objects":82,"num_object_clones":10,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":47,"num_read":4787,"num_read_kb":20107,"num_write":1380,"num_write_kb":15105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.752270+0000","last_change":"2024-09-14T06:00:25.625653+0000","last_active":"2024-09-14T06:00:40.752270+0000","last_peered":"2024-09-14T06:00:40.752270+0000","last_clean":"2024-09-14T06:00:40.752270+0000","last_became_active":"2024-09-14T06:00:25.625192+0000","last_became_peered":"2024-09-14T06:00:25.625192+0000","last_unstale":"2024-09-14T06:00:40.752270+0000","last_undegraded":"2024-09-14T06:00:40.752270+0000","last_fullsized":"2024-09-14T06:00:40.752270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:36.805054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"99'433","reported_seq":2405,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.236997+0000","last_change":"2024-09-14T05:59:40.894081+0000","last_active":"2024-09-14T06:00:43.236997+0000","last_peered":"2024-09-14T06:00:43.236997+0000","last_clean":"2024-09-14T06:00:43.236997+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T06:00:43.236997+0000","last_undegraded":"2024-09-14T06:00:43.236997+0000","last_fullsized":"2024-09-14T06:00:43.236997+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:08.012059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39767518,"num_objects":80,"num_object_clones":12,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":38,"num_read":2723,"num_read_kb":23883,"num_write":422,"num_write_kb":10961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":170,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789070+0000","last_change":"2024-09-14T05:58:56.593338+0000","last_active":"2024-09-14T06:00:40.789070+0000","last_peered":"2024-09-14T06:00:40.789070+0000","last_clean":"2024-09-14T06:00:40.789070+0000","last_became_active":"2024-09-14T05:58:54.099699+0000","last_became_peered":"2024-09-14T05:58:54.099699+0000","last_unstale":"2024-09-14T06:00:40.789070+0000","last_undegraded":"2024-09-14T06:00:40.789070+0000","last_fullsized":"2024-09-14T06:00:40.789070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:40.481832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"97'314","reported_seq":2209,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.922365+0000","last_change":"2024-09-14T05:59:08.298483+0000","last_active":"2024-09-14T06:00:40.922365+0000","last_peered":"2024-09-14T06:00:40.922365+0000","last_clean":"2024-09-14T06:00:40.922365+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T06:00:40.922365+0000","last_undegraded":"2024-09-14T06:00:40.922365+0000","last_fullsized":"2024-09-14T06:00:40.922365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:02.980942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011244670000000001,"stat_sum":{"num_bytes":17388833,"num_objects":67,"num_object_clones":9,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":35,"num_read":1842,"num_read_kb":21994,"num_write":347,"num_write_kb":9639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":171,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.743214+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T06:00:40.743214+0000","last_peered":"2024-09-14T06:00:40.743214+0000","last_clean":"2024-09-14T06:00:40.743214+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T06:00:40.743214+0000","last_undegraded":"2024-09-14T06:00:40.743214+0000","last_fullsized":"2024-09-14T06:00:40.743214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":270,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789093+0000","last_change":"2024-09-14T05:59:40.766729+0000","last_active":"2024-09-14T06:00:40.789093+0000","last_peered":"2024-09-14T06:00:40.789093+0000","last_clean":"2024-09-14T06:00:40.789093+0000","last_became_active":"2024-09-14T05:59:40.765914+0000","last_became_peered":"2024-09-14T05:59:40.765914+0000","last_unstale":"2024-09-14T06:00:40.789093+0000","last_undegraded":"2024-09-14T06:00:40.789093+0000","last_fullsized":"2024-09-14T06:00:40.789093+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:02.407639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"95'646","reported_seq":1921,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.058136+0000","last_change":"2024-09-14T05:59:08.298535+0000","last_active":"2024-09-14T06:00:41.058136+0000","last_peered":"2024-09-14T06:00:41.058136+0000","last_clean":"2024-09-14T06:00:41.058136+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T06:00:41.058136+0000","last_undegraded":"2024-09-14T06:00:41.058136+0000","last_fullsized":"2024-09-14T06:00:41.058136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:36.188811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085964400000000001,"stat_sum":{"num_bytes":33538526,"num_objects":78,"num_object_clones":9,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":39,"num_read":3108,"num_read_kb":6457,"num_write":857,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"95'315","reported_seq":4430,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.928840+0000","last_change":"2024-09-14T05:59:08.282238+0000","last_active":"2024-09-14T06:00:40.928840+0000","last_peered":"2024-09-14T06:00:40.928840+0000","last_clean":"2024-09-14T06:00:40.928840+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T06:00:40.928840+0000","last_undegraded":"2024-09-14T06:00:40.928840+0000","last_fullsized":"2024-09-14T06:00:40.928840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:38.558086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052576800000000003,"stat_sum":{"num_bytes":39045175,"num_objects":67,"num_object_clones":6,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":32,"num_read":4366,"num_read_kb":34279,"num_write":311,"num_write_kb":27449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"97'565","reported_seq":2187,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.054293+0000","last_change":"2024-09-14T05:59:08.303592+0000","last_active":"2024-09-14T06:00:41.054293+0000","last_peered":"2024-09-14T06:00:41.054293+0000","last_clean":"2024-09-14T06:00:41.054293+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T06:00:41.054293+0000","last_undegraded":"2024-09-14T06:00:41.054293+0000","last_fullsized":"2024-09-14T06:00:41.054293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:18.641775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035228000000000001,"stat_sum":{"num_bytes":34977382,"num_objects":82,"num_object_clones":16,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":42,"num_read":3046,"num_read_kb":12200,"num_write":683,"num_write_kb":6045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"96'799","reported_seq":3278,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.055165+0000","last_change":"2024-09-14T05:59:40.885530+0000","last_active":"2024-09-14T06:00:41.055165+0000","last_peered":"2024-09-14T06:00:41.055165+0000","last_clean":"2024-09-14T06:00:41.055165+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T06:00:41.055165+0000","last_undegraded":"2024-09-14T06:00:41.055165+0000","last_fullsized":"2024-09-14T06:00:41.055165+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:40.216253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083256200000000002,"stat_sum":{"num_bytes":17577951,"num_objects":66,"num_object_clones":9,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":33,"num_read":5489,"num_read_kb":26813,"num_write":1225,"num_write_kb":12847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"97'501","reported_seq":4723,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.056922+0000","last_change":"2024-09-14T05:59:08.294210+0000","last_active":"2024-09-14T06:00:41.056922+0000","last_peered":"2024-09-14T06:00:41.056922+0000","last_clean":"2024-09-14T06:00:41.056922+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T06:00:41.056922+0000","last_undegraded":"2024-09-14T06:00:41.056922+0000","last_fullsized":"2024-09-14T06:00:41.056922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:38:06.478409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013095159999999999,"stat_sum":{"num_bytes":41881017,"num_objects":92,"num_object_clones":16,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":51,"num_read":5766,"num_read_kb":23374,"num_write":452,"num_write_kb":12831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"93'352","reported_seq":3101,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789391+0000","last_change":"2024-09-14T05:59:08.371003+0000","last_active":"2024-09-14T06:00:40.789391+0000","last_peered":"2024-09-14T06:00:40.789391+0000","last_clean":"2024-09-14T06:00:40.789391+0000","last_became_active":"2024-09-14T05:59:06.300360+0000","last_became_peered":"2024-09-14T05:59:06.300360+0000","last_unstale":"2024-09-14T06:00:40.789391+0000","last_undegraded":"2024-09-14T06:00:40.789391+0000","last_fullsized":"2024-09-14T06:00:40.789391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:10.608706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022610920000000001,"stat_sum":{"num_bytes":21979692,"num_objects":70,"num_object_clones":10,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":40,"num_read":3513,"num_read_kb":21590,"num_write":366,"num_write_kb":11964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"97'484","reported_seq":3944,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.202749+0000","last_change":"2024-09-14T05:59:08.370421+0000","last_active":"2024-09-14T06:00:41.202749+0000","last_peered":"2024-09-14T06:00:41.202749+0000","last_clean":"2024-09-14T06:00:41.202749+0000","last_became_active":"2024-09-14T05:59:06.308504+0000","last_became_peered":"2024-09-14T05:59:06.308504+0000","last_unstale":"2024-09-14T06:00:41.202749+0000","last_undegraded":"2024-09-14T06:00:41.202749+0000","last_fullsized":"2024-09-14T06:00:41.202749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:25.247897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001798163,"stat_sum":{"num_bytes":25897479,"num_objects":93,"num_object_clones":17,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":42,"num_read":5199,"num_read_kb":24114,"num_write":486,"num_write_kb":11294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"97'515","reported_seq":5827,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789795+0000","last_change":"2024-09-14T05:59:08.370940+0000","last_active":"2024-09-14T06:00:40.789795+0000","last_peered":"2024-09-14T06:00:40.789795+0000","last_clean":"2024-09-14T06:00:40.789795+0000","last_became_active":"2024-09-14T05:59:06.302019+0000","last_became_peered":"2024-09-14T05:59:06.302019+0000","last_unstale":"2024-09-14T06:00:40.789795+0000","last_undegraded":"2024-09-14T06:00:40.789795+0000","last_fullsized":"2024-09-14T06:00:40.789795+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:06.070256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022861499999999998,"stat_sum":{"num_bytes":29797455,"num_objects":73,"num_object_clones":6,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":36,"num_read":6844,"num_read_kb":14371,"num_write":588,"num_write_kb":6253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"97'814","reported_seq":3773,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.518589+0000","last_change":"2024-09-14T05:59:43.767147+0000","last_active":"2024-09-14T06:00:41.518589+0000","last_peered":"2024-09-14T06:00:41.518589+0000","last_clean":"2024-09-14T06:00:41.518589+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T06:00:41.518589+0000","last_undegraded":"2024-09-14T06:00:41.518589+0000","last_fullsized":"2024-09-14T06:00:41.518589+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:58.724976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047002699999999998,"stat_sum":{"num_bytes":46655135,"num_objects":102,"num_object_clones":16,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":56,"num_read":6050,"num_read_kb":18836,"num_write":1103,"num_write_kb":11758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"97'475","reported_seq":5797,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.056162+0000","last_change":"2024-09-14T05:59:08.369705+0000","last_active":"2024-09-14T06:00:41.056162+0000","last_peered":"2024-09-14T06:00:41.056162+0000","last_clean":"2024-09-14T06:00:41.056162+0000","last_became_active":"2024-09-14T05:59:06.311716+0000","last_became_peered":"2024-09-14T05:59:06.311716+0000","last_unstale":"2024-09-14T06:00:41.056162+0000","last_undegraded":"2024-09-14T06:00:41.056162+0000","last_fullsized":"2024-09-14T06:00:41.056162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:54.305085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001347256,"stat_sum":{"num_bytes":48540760,"num_objects":84,"num_object_clones":10,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":44,"num_read":6068,"num_read_kb":33997,"num_write":567,"num_write_kb":30994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"99'600","reported_seq":5323,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:42.857395+0000","last_change":"2024-09-14T05:59:43.765786+0000","last_active":"2024-09-14T06:00:42.857395+0000","last_peered":"2024-09-14T06:00:42.857395+0000","last_clean":"2024-09-14T06:00:42.857395+0000","last_became_active":"2024-09-14T05:59:43.763983+0000","last_became_peered":"2024-09-14T05:59:43.763983+0000","last_unstale":"2024-09-14T06:00:42.857395+0000","last_undegraded":"2024-09-14T06:00:42.857395+0000","last_fullsized":"2024-09-14T06:00:42.857395+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:52.456491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26832145,"num_objects":78,"num_object_clones":11,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":45,"num_read":6250,"num_read_kb":28668,"num_write":633,"num_write_kb":10819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":767927,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"97'364","reported_seq":5675,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.625112+0000","last_change":"2024-09-14T05:59:08.369685+0000","last_active":"2024-09-14T06:00:41.625112+0000","last_peered":"2024-09-14T06:00:41.625112+0000","last_clean":"2024-09-14T06:00:41.625112+0000","last_became_active":"2024-09-14T05:59:06.302125+0000","last_became_peered":"2024-09-14T05:59:06.302125+0000","last_unstale":"2024-09-14T06:00:41.625112+0000","last_undegraded":"2024-09-14T06:00:41.625112+0000","last_fullsized":"2024-09-14T06:00:41.625112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:18.895000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012750369999999999,"stat_sum":{"num_bytes":64010946,"num_objects":91,"num_object_clones":20,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":38,"num_read":5307,"num_read_kb":30452,"num_write":386,"num_write_kb":15118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1135899737,"num_objects":2491,"num_object_clones":369,"num_object_copies":4982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2491,"num_whiteouts":1273,"num_read":155369,"num_read_kb":804732,"num_write":22337,"num_write_kb":434851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":433,"num_bytes_recovered":10220769,"num_keys_recovered":69,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":465973248,"data_stored":602227992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18041,"ondisk_log_size":18041,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60576,"kb_used_data":25232,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94311264,"statfs":{"total":96636764160,"available":96574734336,"internally_reserved":0,"allocated":25837568,"data_stored":30231785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495630,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94748,"kb_used_data":66744,"kb_used_omap":4,"kb_used_meta":27963,"kb_avail":94277092,"statfs":{"total":96636764160,"available":96539742208,"internally_reserved":0,"allocated":68345856,"data_stored":92145896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":28634800},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":129560,"kb_used_data":80316,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94242280,"statfs":{"total":96636764160,"available":96504094720,"internally_reserved":0,"allocated":82243584,"data_stored":104646869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51340,"kb_used_data":15988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94320500,"statfs":{"total":96636764160,"available":96584192000,"internally_reserved":0,"allocated":16371712,"data_stored":23235571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109456,"kb_used_data":60216,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94262384,"statfs":{"total":96636764160,"available":96524681216,"internally_reserved":0,"allocated":61661184,"data_stored":77918606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151484,"kb_used_data":98088,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94220356,"statfs":{"total":96636764160,"available":96481644544,"internally_reserved":0,"allocated":100442112,"data_stored":130992204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116840,"kb_used_data":67600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94255000,"statfs":{"total":96636764160,"available":96517120000,"internally_reserved":0,"allocated":69222400,"data_stored":84894281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92456,"kb_used_data":47384,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94279384,"statfs":{"total":96636764160,"available":96542089216,"internally_reserved":0,"allocated":48521216,"data_stored":59891689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":66584576,"data_stored":91016817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":47374336,"data_stored":59364643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24686592,"data_stored":29702756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":68112384,"data_stored":84399978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":100356096,"data_stored":131514877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":62050304,"data_stored":78924816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15228928,"data_stored":22708544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81580032,"data_stored":104595561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T06:00:45.213 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T06:00:45.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:00:45.240 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:45.240 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:45.257 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:45.257 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:45.275 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:45.291 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:45.292 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:45.303 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:45.301+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:45.309 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:45.309 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:45.328 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:45.328 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:45.353 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:45.373 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:45.384 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:45.384 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:45.384 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:45.385 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:45.385 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:45.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:00:45.435 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:45.433+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:45.504 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:45.501+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:45.524 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:00:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T06:00:45.527 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.979111801000002, 2024-09-14T06:00:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:00:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:00:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:00:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:00:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:00:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:00:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:00:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:00:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:00:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:00:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:00:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:00:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:00:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:00:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:00:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:00:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:00:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:00:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:00:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:00:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:00:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:00:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:00:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:00:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:00:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38849 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9748480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.003860977999999, 2024-09-14T06:00:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084581577000000005, 2024-09-14T06:00:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38849 2024-09-14T06:00:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:45.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521687+0000", 2024-09-14T06:00:45.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9400000000000005e-07 2024-09-14T06:00:45.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521729+0000", 2024-09-14T06:00:45.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2657000000000002e-05 2024-09-14T06:00:45.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521749+0000", 2024-09-14T06:00:45.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9264000000000001e-05 2024-09-14T06:00:45.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521761+0000", 2024-09-14T06:00:45.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2289999999999999e-05 2024-09-14T06:00:45.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606078+0000", 2024-09-14T06:00:45.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084316772999999998 2024-09-14T06:00:45.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606176+0000", 2024-09-14T06:00:45.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7992999999999995e-05 2024-09-14T06:00:45.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606268+0000", 2024-09-14T06:00:45.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2006e-05 2024-09-14T06:00:45.538 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.538 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.539 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.539 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38851 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9928704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:45.539 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:45.539 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.003765666, 2024-09-14T06:00:45.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084695081000000005, 2024-09-14T06:00:45.539 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.539 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.539 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.539 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.539 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.540 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.540 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38851 2024-09-14T06:00:45.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.540 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:45.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:45.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521783+0000", 2024-09-14T06:00:45.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1000000000000001e-06 2024-09-14T06:00:45.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521788+0000", 2024-09-14T06:00:45.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2619999999999998e-06 2024-09-14T06:00:45.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521803+0000", 2024-09-14T06:00:45.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5421999999999999e-05 2024-09-14T06:00:45.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521815+0000", 2024-09-14T06:00:45.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.171e-05 2024-09-14T06:00:45.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606320+0000", 2024-09-14T06:00:45.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084504698000000003 2024-09-14T06:00:45.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606404+0000", 2024-09-14T06:00:45.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4379e-05 2024-09-14T06:00:45.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606476+0000", 2024-09-14T06:00:45.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2509999999999995e-05 2024-09-14T06:00:45.543 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.543 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.543 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.543 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:45.544 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:45.544 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.003714916, 2024-09-14T06:00:45.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:00:45.544 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.544 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.544 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.544 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.544 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.544 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.544 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:00:45.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.544 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:00:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:00:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:00:45.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:00:45.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:00:45.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:00:45.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:00:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:00:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:00:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:00:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:00:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:00:45.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:00:45.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:00:45.548 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.548 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.548 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.548 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:45.548 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:45.548 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.003676593000002, 2024-09-14T06:00:45.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:00:45.548 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.549 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.549 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.549 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.549 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.549 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.549 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:00:45.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.549 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:45.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:45.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:00:45.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:00:45.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:00:45.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:45.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:00:45.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:00:45.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:00:45.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:00:45.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:00:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:00:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:00:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:00:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:00:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:00:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.553 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:45.553 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:45.553 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.003649901000003, 2024-09-14T06:00:45.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:00:45.553 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.553 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.553 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.553 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:00:45.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.554 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:45.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:45.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:00:45.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:00:45.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:00:45.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:00:45.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:00:45.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:00:45.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:00:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:00:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:00:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:00:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:00:45.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:00:45.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:00:45.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:00:45.557 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.557 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.557 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.557 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:45.557 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:45.557 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.003624035000001, 2024-09-14T06:00:45.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:00:45.558 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.558 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.558 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.559 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:00:45.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.559 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:45.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:45.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:00:45.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:00:45.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:00:45.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:00:45.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:00:45.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:00:45.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:00:45.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:00:45.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:00:45.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:00:45.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:00:45.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:00:45.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:00:45.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:00:45.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.563 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.563 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:45.563 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:45.563 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.002523666000002, 2024-09-14T06:00:45.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:00:45.563 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.564 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.564 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.564 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:00:45.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.564 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:45.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:45.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:00:45.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:00:45.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:00:45.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:00:45.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:00:45.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:00:45.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:00:45.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:00:45.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:00:45.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:00:45.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:00:45.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:00:45.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:00:45.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:00:45.568 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.568 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.568 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.568 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:45.568 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:45.568 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.002479686999997, 2024-09-14T06:00:45.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:00:45.568 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.568 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.568 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.568 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.569 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.569 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.569 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:00:45.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.569 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:45.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:45.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:00:45.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:00:45.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:00:45.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:00:45.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:00:45.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:00:45.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:00:45.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:00:45.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:00:45.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:00:45.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:00:45.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:00:45.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:00:45.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:00:45.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.572 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.001417926999999, 2024-09-14T06:00:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:00:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:00:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.573 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:00:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:00:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:00:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:00:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:00:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:00:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:00:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:00:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:00:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:00:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:00:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:00:45.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:00:45.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:00:45.577 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.577 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.577 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.577 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38869 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:45.577 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:45.578 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.001012457000002, 2024-09-14T06:00:45.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084608905999999998, 2024-09-14T06:00:45.578 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.578 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.578 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.578 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.578 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.578 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.578 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38869 2024-09-14T06:00:45.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.578 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:45.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:45.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525138+0000", 2024-09-14T06:00:45.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00060367999999999999 2024-09-14T06:00:45.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525160+0000", 2024-09-14T06:00:45.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1875999999999999e-05 2024-09-14T06:00:45.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525182+0000", 2024-09-14T06:00:45.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1427e-05 2024-09-14T06:00:45.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525198+0000", 2024-09-14T06:00:45.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507e-05 2024-09-14T06:00:45.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608907+0000", 2024-09-14T06:00:45.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083708535000000001 2024-09-14T06:00:45.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609011+0000", 2024-09-14T06:00:45.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010461199999999999 2024-09-14T06:00:45.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609144+0000", 2024-09-14T06:00:45.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013226899999999999 2024-09-14T06:00:45.582 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.582 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.582 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.582 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119203 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5881856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:45.582 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:00:45.582 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.460044897, 2024-09-14T06:00:45.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084813824999999995, 2024-09-14T06:00:45.582 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.582 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.583 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.583 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.583 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.583 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.583 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119203 2024-09-14T06:00:45.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.583 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:00:45.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:00:45.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065503+0000", 2024-09-14T06:00:45.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.054e-06 2024-09-14T06:00:45.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065509+0000", 2024-09-14T06:00:45.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9939999999999997e-06 2024-09-14T06:00:45.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065528+0000", 2024-09-14T06:00:45.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8736000000000002e-05 2024-09-14T06:00:45.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065540+0000", 2024-09-14T06:00:45.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2427e-05 2024-09-14T06:00:45.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.149851+0000", 2024-09-14T06:00:45.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084310806000000002 2024-09-14T06:00:45.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150073+0000", 2024-09-14T06:00:45.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022202999999999999 2024-09-14T06:00:45.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150316+0000", 2024-09-14T06:00:45.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000242778 2024-09-14T06:00:45.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.586 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.587 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.587 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119204 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5931008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:45.587 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:00:45.587 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.4599893900000001, 2024-09-14T06:00:45.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085122164, 2024-09-14T06:00:45.587 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.587 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.587 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.588 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.588 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119204 2024-09-14T06:00:45.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.588 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:00:45.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:00:45.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065559+0000", 2024-09-14T06:00:45.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.068e-06 2024-09-14T06:00:45.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065564+0000", 2024-09-14T06:00:45.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1089999999999997e-06 2024-09-14T06:00:45.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065580+0000", 2024-09-14T06:00:45.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6438000000000001e-05 2024-09-14T06:00:45.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065592+0000", 2024-09-14T06:00:45.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1739000000000001e-05 2024-09-14T06:00:45.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150396+0000", 2024-09-14T06:00:45.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084803859999999995 2024-09-14T06:00:45.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150524+0000", 2024-09-14T06:00:45.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012805600000000001 2024-09-14T06:00:45.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150680+0000", 2024-09-14T06:00:45.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015589400000000001 2024-09-14T06:00:45.591 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.591 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.591 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.592 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119205 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5980160~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:45.592 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:00:45.592 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.4598935150000001, 2024-09-14T06:00:45.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085597655999999994, 2024-09-14T06:00:45.592 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.592 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.592 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.592 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119205 2024-09-14T06:00:45.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.593 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:00:45.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:00:45.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065656+0000", 2024-09-14T06:00:45.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9829999999999999e-06 2024-09-14T06:00:45.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065661+0000", 2024-09-14T06:00:45.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9510000000000003e-06 2024-09-14T06:00:45.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065680+0000", 2024-09-14T06:00:45.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8947e-05 2024-09-14T06:00:45.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065694+0000", 2024-09-14T06:00:45.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3433e-05 2024-09-14T06:00:45.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150778+0000", 2024-09-14T06:00:45.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085083856999999999 2024-09-14T06:00:45.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151007+0000", 2024-09-14T06:00:45.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022914499999999999 2024-09-14T06:00:45.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151251+0000", 2024-09-14T06:00:45.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024434000000000001 2024-09-14T06:00:45.596 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.596 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.596 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.597 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119206 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6029312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:45.597 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:00:45.597 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.459832086, 2024-09-14T06:00:45.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086002258999999998, 2024-09-14T06:00:45.597 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.597 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.597 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.597 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.597 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.597 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.598 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119206 2024-09-14T06:00:45.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.598 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:00:45.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:00:45.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065716+0000", 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230000000000001e-06 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065722+0000", 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5219999999999998e-06 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065739+0000", 2024-09-14T06:00:45.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7122e-05 2024-09-14T06:00:45.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065752+0000", 2024-09-14T06:00:45.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2639e-05 2024-09-14T06:00:45.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151384+0000", 2024-09-14T06:00:45.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085632514000000007 2024-09-14T06:00:45.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151532+0000", 2024-09-14T06:00:45.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000147761 2024-09-14T06:00:45.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151717+0000", 2024-09-14T06:00:45.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018537800000000001 2024-09-14T06:00:45.601 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.601 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.601 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.601 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119207 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6078464~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.459778741, 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086515080999999994, 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119207 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:00:45.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:00:45.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065770+0000", 2024-09-14T06:00:45.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5770000000000001e-06 2024-09-14T06:00:45.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065775+0000", 2024-09-14T06:00:45.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1930000000000001e-06 2024-09-14T06:00:45.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065791+0000", 2024-09-14T06:00:45.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6351e-05 2024-09-14T06:00:45.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065804+0000", 2024-09-14T06:00:45.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.259e-05 2024-09-14T06:00:45.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151820+0000", 2024-09-14T06:00:45.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086016398999999993 2024-09-14T06:00:45.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152043+0000", 2024-09-14T06:00:45.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022236200000000001 2024-09-14T06:00:45.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152283+0000", 2024-09-14T06:00:45.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000240609 2024-09-14T06:00:45.606 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.606 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.606 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.606 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119208 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:45.606 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:00:45.606 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.459726243, 2024-09-14T06:00:45.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086932403000000005, 2024-09-14T06:00:45.606 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.606 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.606 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.607 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.607 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.607 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.607 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119208 2024-09-14T06:00:45.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.607 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:00:45.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:00:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065822+0000", 2024-09-14T06:00:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.032e-06 2024-09-14T06:00:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065827+0000", 2024-09-14T06:00:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5790000000000003e-06 2024-09-14T06:00:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065843+0000", 2024-09-14T06:00:45.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5801999999999999e-05 2024-09-14T06:00:45.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065856+0000", 2024-09-14T06:00:45.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2267e-05 2024-09-14T06:00:45.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152416+0000", 2024-09-14T06:00:45.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086560893999999999 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152568+0000", 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151664 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152753+0000", 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018516499999999999 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119209 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6176768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:00:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.4596743729999999, 2024-09-14T06:00:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087450828999999994, 2024-09-14T06:00:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119209 2024-09-14T06:00:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:00:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:00:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065874+0000", 2024-09-14T06:00:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.097e-06 2024-09-14T06:00:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065879+0000", 2024-09-14T06:00:45.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.254e-06 2024-09-14T06:00:45.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065895+0000", 2024-09-14T06:00:45.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6373000000000001e-05 2024-09-14T06:00:45.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065908+0000", 2024-09-14T06:00:45.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2656e-05 2024-09-14T06:00:45.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152854+0000", 2024-09-14T06:00:45.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086946078999999996 2024-09-14T06:00:45.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153080+0000", 2024-09-14T06:00:45.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022582200000000001 2024-09-14T06:00:45.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153324+0000", 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024354800000000001 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119210 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6225920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.459622446, 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087773166, 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.615 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.616 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.616 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.616 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119210 2024-09-14T06:00:45.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.616 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:00:45.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:00:45.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065926+0000", 2024-09-14T06:00:45.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3799999999999999e-06 2024-09-14T06:00:45.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065931+0000", 2024-09-14T06:00:45.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9629999999999997e-06 2024-09-14T06:00:45.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065950+0000", 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9369999999999999e-05 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065963+0000", 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2164000000000001e-05 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153404+0000", 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087441840000000007 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153537+0000", 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013305500000000001 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153698+0000", 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016039400000000001 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119211 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6275072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:00:45.620 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.4595666789999999, 2024-09-14T06:00:45.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088244734000000005, 2024-09-14T06:00:45.620 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:45.620 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:45.620 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:45.620 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:45.620 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:45.620 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:45.620 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119211 2024-09-14T06:00:45.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.620 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:45.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:45.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:00:45.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:45.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:00:45.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:45.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:45.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065981+0000", 2024-09-14T06:00:45.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.012e-06 2024-09-14T06:00:45.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:45.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065987+0000", 2024-09-14T06:00:45.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5450000000000003e-06 2024-09-14T06:00:45.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:45.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.066003+0000", 2024-09-14T06:00:45.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6198999999999999e-05 2024-09-14T06:00:45.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:45.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.066016+0000", 2024-09-14T06:00:45.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2595999999999999e-05 2024-09-14T06:00:45.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153758+0000", 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087742610999999998 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153983+0000", 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000224336 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.154225+0000", 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024243499999999999 2024-09-14T06:00:45.623 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.624 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.624 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.624 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:45.624 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:45.624 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:45.626 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-14T06:00:45.494911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1136490124,"num_objects":2495,"num_object_clones":369,"num_object_copies":4990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2495,"num_whiteouts":1273,"num_read":155435,"num_read_kb":804787,"num_write":22440,"num_write_kb":436481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":433,"num_bytes_recovered":10220769,"num_keys_recovered":69,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18116,"ondisk_log_size":18116,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":806460,"kb_used_data":461568,"kb_used_omap":15,"kb_used_meta":344688,"kb_avail":754168260,"statfs":{"total":773094113280,"available":772268298240,"internally_reserved":0,"allocated":472645632,"data_stored":603956901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":352961308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":97676445,"num_objects":85,"num_object_clones":7,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":6,"num_read":10046,"num_read_kb":152366,"num_write":1179,"num_write_kb":21731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000744"},"pg_stats":[{"pgid":"3.1f","version":"99'699","reported_seq":2370,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.471251+0000","last_change":"2024-09-14T05:59:43.763150+0000","last_active":"2024-09-14T06:00:43.471251+0000","last_peered":"2024-09-14T06:00:43.471251+0000","last_clean":"2024-09-14T06:00:43.471251+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T06:00:43.471251+0000","last_undegraded":"2024-09-14T06:00:43.471251+0000","last_fullsized":"2024-09-14T06:00:43.471251+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:42.525356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001224482,"stat_sum":{"num_bytes":41895251,"num_objects":80,"num_object_clones":9,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":42,"num_read":4174,"num_read_kb":14503,"num_write":899,"num_write_kb":5420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"95'532","reported_seq":2931,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.752988+0000","last_change":"2024-09-14T05:59:08.299658+0000","last_active":"2024-09-14T06:00:40.752988+0000","last_peered":"2024-09-14T06:00:40.752988+0000","last_clean":"2024-09-14T06:00:40.752988+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T06:00:40.752988+0000","last_undegraded":"2024-09-14T06:00:40.752988+0000","last_fullsized":"2024-09-14T06:00:40.752988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:05.694873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882171,"stat_sum":{"num_bytes":25424971,"num_objects":70,"num_object_clones":13,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":31,"num_read":3453,"num_read_kb":12249,"num_write":675,"num_write_kb":12326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"97'347","reported_seq":5507,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.596126+0000","last_change":"2024-09-14T05:59:08.293155+0000","last_active":"2024-09-14T06:00:41.596126+0000","last_peered":"2024-09-14T06:00:41.596126+0000","last_clean":"2024-09-14T06:00:41.596126+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T06:00:41.596126+0000","last_undegraded":"2024-09-14T06:00:41.596126+0000","last_fullsized":"2024-09-14T06:00:41.596126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:02.551851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000618802,"stat_sum":{"num_bytes":27526886,"num_objects":74,"num_object_clones":7,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":44,"num_read":5159,"num_read_kb":31126,"num_write":348,"num_write_kb":26838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"97'472","reported_seq":3883,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.059107+0000","last_change":"2024-09-14T05:59:08.294498+0000","last_active":"2024-09-14T06:00:41.059107+0000","last_peered":"2024-09-14T06:00:41.059107+0000","last_clean":"2024-09-14T06:00:41.059107+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T06:00:41.059107+0000","last_undegraded":"2024-09-14T06:00:41.059107+0000","last_fullsized":"2024-09-14T06:00:41.059107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:12.322268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014905350000000001,"stat_sum":{"num_bytes":28601988,"num_objects":72,"num_object_clones":11,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":39,"num_read":4145,"num_read_kb":14081,"num_write":523,"num_write_kb":8642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"99'502","reported_seq":1300,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.030499+0000","last_change":"2024-09-14T05:59:40.834308+0000","last_active":"2024-09-14T06:00:43.030499+0000","last_peered":"2024-09-14T06:00:43.030499+0000","last_clean":"2024-09-14T06:00:43.030499+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T06:00:43.030499+0000","last_undegraded":"2024-09-14T06:00:43.030499+0000","last_fullsized":"2024-09-14T06:00:43.030499+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:22.578137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11129328,"num_objects":70,"num_object_clones":13,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":35,"num_read":2219,"num_read_kb":6040,"num_write":557,"num_write_kb":6276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"97'872","reported_seq":5361,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.940536+0000","last_change":"2024-09-14T05:59:08.282710+0000","last_active":"2024-09-14T06:00:40.940536+0000","last_peered":"2024-09-14T06:00:40.940536+0000","last_clean":"2024-09-14T06:00:40.940536+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T06:00:40.940536+0000","last_undegraded":"2024-09-14T06:00:40.940536+0000","last_fullsized":"2024-09-14T06:00:40.940536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:48.365630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078735700000000003,"stat_sum":{"num_bytes":23664870,"num_objects":77,"num_object_clones":10,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":44,"num_read":7738,"num_read_kb":44004,"num_write":1201,"num_write_kb":19820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"97'454","reported_seq":2818,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.050080+0000","last_change":"2024-09-14T05:59:08.283122+0000","last_active":"2024-09-14T06:00:41.050080+0000","last_peered":"2024-09-14T06:00:41.050080+0000","last_clean":"2024-09-14T06:00:41.050080+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T06:00:41.050080+0000","last_undegraded":"2024-09-14T06:00:41.050080+0000","last_fullsized":"2024-09-14T06:00:41.050080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:44.549320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020244989999999999,"stat_sum":{"num_bytes":34017297,"num_objects":70,"num_object_clones":5,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":34,"num_read":3301,"num_read_kb":21523,"num_write":532,"num_write_kb":15097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"95'476","reported_seq":5768,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.060078+0000","last_change":"2024-09-14T05:59:43.761389+0000","last_active":"2024-09-14T06:00:41.060078+0000","last_peered":"2024-09-14T06:00:41.060078+0000","last_clean":"2024-09-14T06:00:41.060078+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T06:00:41.060078+0000","last_undegraded":"2024-09-14T06:00:41.060078+0000","last_fullsized":"2024-09-14T06:00:41.060078+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:09.833097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090099400000000001,"stat_sum":{"num_bytes":59866913,"num_objects":82,"num_object_clones":13,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":40,"num_read":6953,"num_read_kb":51188,"num_write":471,"num_write_kb":14144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"99'365","reported_seq":2964,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.077185+0000","last_change":"2024-09-14T05:59:40.929839+0000","last_active":"2024-09-14T06:00:43.077185+0000","last_peered":"2024-09-14T06:00:43.077185+0000","last_clean":"2024-09-14T06:00:43.077185+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T06:00:43.077185+0000","last_undegraded":"2024-09-14T06:00:43.077185+0000","last_fullsized":"2024-09-14T06:00:43.077185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:41.552583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30644976,"num_objects":71,"num_object_clones":14,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":38,"num_read":3386,"num_read_kb":21115,"num_write":329,"num_write_kb":6970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"97'1428","reported_seq":3531,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.055001+0000","last_change":"2024-09-14T05:59:08.293088+0000","last_active":"2024-09-14T06:00:41.055001+0000","last_peered":"2024-09-14T06:00:41.055001+0000","last_clean":"2024-09-14T06:00:41.055001+0000","last_became_active":"2024-09-14T05:59:06.296607+0000","last_became_peered":"2024-09-14T05:59:06.296607+0000","last_unstale":"2024-09-14T06:00:41.055001+0000","last_undegraded":"2024-09-14T06:00:41.055001+0000","last_fullsized":"2024-09-14T06:00:41.055001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1428,"log_dups_size":0,"ondisk_log_size":1428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:58.281385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056627299999999995,"stat_sum":{"num_bytes":41826361,"num_objects":68,"num_object_clones":10,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":34,"num_read":8231,"num_read_kb":22548,"num_write":2433,"num_write_kb":21381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"97'652","reported_seq":5814,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.055475+0000","last_change":"2024-09-14T05:59:08.370304+0000","last_active":"2024-09-14T06:00:41.055475+0000","last_peered":"2024-09-14T06:00:41.055475+0000","last_clean":"2024-09-14T06:00:41.055475+0000","last_became_active":"2024-09-14T05:59:06.295335+0000","last_became_peered":"2024-09-14T05:59:06.295335+0000","last_unstale":"2024-09-14T06:00:41.055475+0000","last_undegraded":"2024-09-14T06:00:41.055475+0000","last_fullsized":"2024-09-14T06:00:41.055475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:44:36.118339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001779487,"stat_sum":{"num_bytes":63917922,"num_objects":107,"num_object_clones":24,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":53,"num_read":7172,"num_read_kb":54437,"num_write":775,"num_write_kb":20105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"97'556","reported_seq":4821,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.055150+0000","last_change":"2024-09-14T05:59:08.282513+0000","last_active":"2024-09-14T06:00:41.055150+0000","last_peered":"2024-09-14T06:00:41.055150+0000","last_clean":"2024-09-14T06:00:41.055150+0000","last_became_active":"2024-09-14T05:59:06.307548+0000","last_became_peered":"2024-09-14T05:59:06.307548+0000","last_unstale":"2024-09-14T06:00:41.055150+0000","last_undegraded":"2024-09-14T06:00:41.055150+0000","last_fullsized":"2024-09-14T06:00:41.055150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:09.549075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061538200000000004,"stat_sum":{"num_bytes":27180998,"num_objects":70,"num_object_clones":12,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":35,"num_read":5513,"num_read_kb":30465,"num_write":772,"num_write_kb":15959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":170,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.834287+0000","last_change":"2024-09-14T05:58:56.312544+0000","last_active":"2024-09-14T06:00:40.834287+0000","last_peered":"2024-09-14T06:00:40.834287+0000","last_clean":"2024-09-14T06:00:40.834287+0000","last_became_active":"2024-09-14T05:58:54.103612+0000","last_became_peered":"2024-09-14T05:58:54.103612+0000","last_unstale":"2024-09-14T06:00:40.834287+0000","last_undegraded":"2024-09-14T06:00:40.834287+0000","last_fullsized":"2024-09-14T06:00:40.834287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:08.678742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"99'988","reported_seq":4862,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.459973+0000","last_change":"2024-09-14T05:59:43.762927+0000","last_active":"2024-09-14T06:00:43.459973+0000","last_peered":"2024-09-14T06:00:43.459973+0000","last_clean":"2024-09-14T06:00:43.459973+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T06:00:43.459973+0000","last_undegraded":"2024-09-14T06:00:43.459973+0000","last_fullsized":"2024-09-14T06:00:43.459973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:36.940253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26004745,"num_objects":76,"num_object_clones":9,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":36,"num_read":8027,"num_read_kb":25118,"num_write":1373,"num_write_kb":13665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.744550+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T06:00:40.744550+0000","last_peered":"2024-09-14T06:00:40.744550+0000","last_clean":"2024-09-14T06:00:40.744550+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T06:00:40.744550+0000","last_undegraded":"2024-09-14T06:00:40.744550+0000","last_fullsized":"2024-09-14T06:00:40.744550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"95'383","reported_seq":4437,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.050937+0000","last_change":"2024-09-14T06:00:35.709017+0000","last_active":"2024-09-14T06:00:41.050937+0000","last_peered":"2024-09-14T06:00:41.050937+0000","last_clean":"2024-09-14T06:00:41.050937+0000","last_became_active":"2024-09-14T06:00:35.707129+0000","last_became_peered":"2024-09-14T06:00:35.707129+0000","last_unstale":"2024-09-14T06:00:41.050937+0000","last_undegraded":"2024-09-14T06:00:41.050937+0000","last_fullsized":"2024-09-14T06:00:41.050937+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:11.681443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001533155,"stat_sum":{"num_bytes":65575771,"num_objects":75,"num_object_clones":10,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":34,"num_read":3976,"num_read_kb":32296,"num_write":387,"num_write_kb":16552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":125,"num_bytes_recovered":4610315,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789427+0000","last_change":"2024-09-14T05:59:40.765463+0000","last_active":"2024-09-14T06:00:40.789427+0000","last_peered":"2024-09-14T06:00:40.789427+0000","last_clean":"2024-09-14T06:00:40.789427+0000","last_became_active":"2024-09-14T05:59:40.764785+0000","last_became_peered":"2024-09-14T05:59:40.764785+0000","last_unstale":"2024-09-14T06:00:40.789427+0000","last_undegraded":"2024-09-14T06:00:40.789427+0000","last_fullsized":"2024-09-14T06:00:40.789427+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:47.547246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"95'361","reported_seq":3880,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.054161+0000","last_change":"2024-09-14T05:59:08.282105+0000","last_active":"2024-09-14T06:00:41.054161+0000","last_peered":"2024-09-14T06:00:41.054161+0000","last_clean":"2024-09-14T06:00:41.054161+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T06:00:41.054161+0000","last_undegraded":"2024-09-14T06:00:41.054161+0000","last_fullsized":"2024-09-14T06:00:41.054161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:51.251847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010945919999999999,"stat_sum":{"num_bytes":28806714,"num_objects":72,"num_object_clones":8,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":41,"num_read":3732,"num_read_kb":24815,"num_write":407,"num_write_kb":9879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":179,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.744277+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T06:00:40.744277+0000","last_peered":"2024-09-14T06:00:40.744277+0000","last_clean":"2024-09-14T06:00:40.744277+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T06:00:40.744277+0000","last_undegraded":"2024-09-14T06:00:40.744277+0000","last_fullsized":"2024-09-14T06:00:40.744277+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'428","reported_seq":3776,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.054950+0000","last_change":"2024-09-14T05:59:08.293368+0000","last_active":"2024-09-14T06:00:41.054950+0000","last_peered":"2024-09-14T06:00:41.054950+0000","last_clean":"2024-09-14T06:00:41.054950+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T06:00:41.054950+0000","last_undegraded":"2024-09-14T06:00:41.054950+0000","last_fullsized":"2024-09-14T06:00:41.054950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:25.635807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072033799999999995,"stat_sum":{"num_bytes":18930470,"num_objects":73,"num_object_clones":12,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":35,"num_read":4769,"num_read_kb":19471,"num_write":427,"num_write_kb":8496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"97'422","reported_seq":2647,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.608981+0000","last_change":"2024-09-14T05:59:40.846399+0000","last_active":"2024-09-14T06:00:41.608981+0000","last_peered":"2024-09-14T06:00:41.608981+0000","last_clean":"2024-09-14T06:00:41.608981+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T06:00:41.608981+0000","last_undegraded":"2024-09-14T06:00:41.608981+0000","last_fullsized":"2024-09-14T06:00:41.608981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:45.965970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047912600000000002,"stat_sum":{"num_bytes":68265765,"num_objects":79,"num_object_clones":12,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":40,"num_read":3063,"num_read_kb":38618,"num_write":422,"num_write_kb":15815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":172,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.743191+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T06:00:40.743191+0000","last_peered":"2024-09-14T06:00:40.743191+0000","last_clean":"2024-09-14T06:00:40.743191+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T06:00:40.743191+0000","last_undegraded":"2024-09-14T06:00:40.743191+0000","last_fullsized":"2024-09-14T06:00:40.743191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"96'927","reported_seq":2654,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.050175+0000","last_change":"2024-09-14T05:59:08.281926+0000","last_active":"2024-09-14T06:00:41.050175+0000","last_peered":"2024-09-14T06:00:41.050175+0000","last_clean":"2024-09-14T06:00:41.050175+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T06:00:41.050175+0000","last_undegraded":"2024-09-14T06:00:41.050175+0000","last_fullsized":"2024-09-14T06:00:41.050175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:47.567426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096925799999999997,"stat_sum":{"num_bytes":24728497,"num_objects":82,"num_object_clones":10,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":47,"num_read":4787,"num_read_kb":20107,"num_write":1380,"num_write_kb":15105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.752270+0000","last_change":"2024-09-14T06:00:25.625653+0000","last_active":"2024-09-14T06:00:40.752270+0000","last_peered":"2024-09-14T06:00:40.752270+0000","last_clean":"2024-09-14T06:00:40.752270+0000","last_became_active":"2024-09-14T06:00:25.625192+0000","last_became_peered":"2024-09-14T06:00:25.625192+0000","last_unstale":"2024-09-14T06:00:40.752270+0000","last_undegraded":"2024-09-14T06:00:40.752270+0000","last_fullsized":"2024-09-14T06:00:40.752270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:36.805054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"99'433","reported_seq":2405,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.236997+0000","last_change":"2024-09-14T05:59:40.894081+0000","last_active":"2024-09-14T06:00:43.236997+0000","last_peered":"2024-09-14T06:00:43.236997+0000","last_clean":"2024-09-14T06:00:43.236997+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T06:00:43.236997+0000","last_undegraded":"2024-09-14T06:00:43.236997+0000","last_fullsized":"2024-09-14T06:00:43.236997+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:08.012059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39767518,"num_objects":80,"num_object_clones":12,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":38,"num_read":2723,"num_read_kb":23883,"num_write":422,"num_write_kb":10961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":170,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789070+0000","last_change":"2024-09-14T05:58:56.593338+0000","last_active":"2024-09-14T06:00:40.789070+0000","last_peered":"2024-09-14T06:00:40.789070+0000","last_clean":"2024-09-14T06:00:40.789070+0000","last_became_active":"2024-09-14T05:58:54.099699+0000","last_became_peered":"2024-09-14T05:58:54.099699+0000","last_unstale":"2024-09-14T06:00:40.789070+0000","last_undegraded":"2024-09-14T06:00:40.789070+0000","last_fullsized":"2024-09-14T06:00:40.789070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:40.481832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"97'314","reported_seq":2209,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.922365+0000","last_change":"2024-09-14T05:59:08.298483+0000","last_active":"2024-09-14T06:00:40.922365+0000","last_peered":"2024-09-14T06:00:40.922365+0000","last_clean":"2024-09-14T06:00:40.922365+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T06:00:40.922365+0000","last_undegraded":"2024-09-14T06:00:40.922365+0000","last_fullsized":"2024-09-14T06:00:40.922365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:02.980942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011244670000000001,"stat_sum":{"num_bytes":17388833,"num_objects":67,"num_object_clones":9,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":35,"num_read":1842,"num_read_kb":21994,"num_write":347,"num_write_kb":9639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":171,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.743214+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T06:00:40.743214+0000","last_peered":"2024-09-14T06:00:40.743214+0000","last_clean":"2024-09-14T06:00:40.743214+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T06:00:40.743214+0000","last_undegraded":"2024-09-14T06:00:40.743214+0000","last_fullsized":"2024-09-14T06:00:40.743214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":270,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789093+0000","last_change":"2024-09-14T05:59:40.766729+0000","last_active":"2024-09-14T06:00:40.789093+0000","last_peered":"2024-09-14T06:00:40.789093+0000","last_clean":"2024-09-14T06:00:40.789093+0000","last_became_active":"2024-09-14T05:59:40.765914+0000","last_became_peered":"2024-09-14T05:59:40.765914+0000","last_unstale":"2024-09-14T06:00:40.789093+0000","last_undegraded":"2024-09-14T06:00:40.789093+0000","last_fullsized":"2024-09-14T06:00:40.789093+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:02.407639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"95'646","reported_seq":1921,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.058136+0000","last_change":"2024-09-14T05:59:08.298535+0000","last_active":"2024-09-14T06:00:41.058136+0000","last_peered":"2024-09-14T06:00:41.058136+0000","last_clean":"2024-09-14T06:00:41.058136+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T06:00:41.058136+0000","last_undegraded":"2024-09-14T06:00:41.058136+0000","last_fullsized":"2024-09-14T06:00:41.058136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:36.188811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085964400000000001,"stat_sum":{"num_bytes":33538526,"num_objects":78,"num_object_clones":9,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":39,"num_read":3108,"num_read_kb":6457,"num_write":857,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"95'315","reported_seq":4430,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.928840+0000","last_change":"2024-09-14T05:59:08.282238+0000","last_active":"2024-09-14T06:00:40.928840+0000","last_peered":"2024-09-14T06:00:40.928840+0000","last_clean":"2024-09-14T06:00:40.928840+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T06:00:40.928840+0000","last_undegraded":"2024-09-14T06:00:40.928840+0000","last_fullsized":"2024-09-14T06:00:40.928840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:38.558086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052576800000000003,"stat_sum":{"num_bytes":39045175,"num_objects":67,"num_object_clones":6,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":32,"num_read":4366,"num_read_kb":34279,"num_write":311,"num_write_kb":27449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"97'565","reported_seq":2187,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.054293+0000","last_change":"2024-09-14T05:59:08.303592+0000","last_active":"2024-09-14T06:00:41.054293+0000","last_peered":"2024-09-14T06:00:41.054293+0000","last_clean":"2024-09-14T06:00:41.054293+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T06:00:41.054293+0000","last_undegraded":"2024-09-14T06:00:41.054293+0000","last_fullsized":"2024-09-14T06:00:41.054293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:18.641775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035228000000000001,"stat_sum":{"num_bytes":34977382,"num_objects":82,"num_object_clones":16,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":42,"num_read":3046,"num_read_kb":12200,"num_write":683,"num_write_kb":6045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"96'799","reported_seq":3278,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.055165+0000","last_change":"2024-09-14T05:59:40.885530+0000","last_active":"2024-09-14T06:00:41.055165+0000","last_peered":"2024-09-14T06:00:41.055165+0000","last_clean":"2024-09-14T06:00:41.055165+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T06:00:41.055165+0000","last_undegraded":"2024-09-14T06:00:41.055165+0000","last_fullsized":"2024-09-14T06:00:41.055165+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:40.216253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083256200000000002,"stat_sum":{"num_bytes":17577951,"num_objects":66,"num_object_clones":9,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":33,"num_read":5489,"num_read_kb":26813,"num_write":1225,"num_write_kb":12847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"97'501","reported_seq":4723,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.056922+0000","last_change":"2024-09-14T05:59:08.294210+0000","last_active":"2024-09-14T06:00:41.056922+0000","last_peered":"2024-09-14T06:00:41.056922+0000","last_clean":"2024-09-14T06:00:41.056922+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T06:00:41.056922+0000","last_undegraded":"2024-09-14T06:00:41.056922+0000","last_fullsized":"2024-09-14T06:00:41.056922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:38:06.478409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013095159999999999,"stat_sum":{"num_bytes":41881017,"num_objects":92,"num_object_clones":16,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":51,"num_read":5766,"num_read_kb":23374,"num_write":452,"num_write_kb":12831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"93'352","reported_seq":3101,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789391+0000","last_change":"2024-09-14T05:59:08.371003+0000","last_active":"2024-09-14T06:00:40.789391+0000","last_peered":"2024-09-14T06:00:40.789391+0000","last_clean":"2024-09-14T06:00:40.789391+0000","last_became_active":"2024-09-14T05:59:06.300360+0000","last_became_peered":"2024-09-14T05:59:06.300360+0000","last_unstale":"2024-09-14T06:00:40.789391+0000","last_undegraded":"2024-09-14T06:00:40.789391+0000","last_fullsized":"2024-09-14T06:00:40.789391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:10.608706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022610920000000001,"stat_sum":{"num_bytes":21979692,"num_objects":70,"num_object_clones":10,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":40,"num_read":3513,"num_read_kb":21590,"num_write":366,"num_write_kb":11964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"97'484","reported_seq":3944,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.202749+0000","last_change":"2024-09-14T05:59:08.370421+0000","last_active":"2024-09-14T06:00:41.202749+0000","last_peered":"2024-09-14T06:00:41.202749+0000","last_clean":"2024-09-14T06:00:41.202749+0000","last_became_active":"2024-09-14T05:59:06.308504+0000","last_became_peered":"2024-09-14T05:59:06.308504+0000","last_unstale":"2024-09-14T06:00:41.202749+0000","last_undegraded":"2024-09-14T06:00:41.202749+0000","last_fullsized":"2024-09-14T06:00:41.202749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:25.247897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001798163,"stat_sum":{"num_bytes":25897479,"num_objects":93,"num_object_clones":17,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":42,"num_read":5199,"num_read_kb":24114,"num_write":486,"num_write_kb":11294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"97'515","reported_seq":5827,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789795+0000","last_change":"2024-09-14T05:59:08.370940+0000","last_active":"2024-09-14T06:00:40.789795+0000","last_peered":"2024-09-14T06:00:40.789795+0000","last_clean":"2024-09-14T06:00:40.789795+0000","last_became_active":"2024-09-14T05:59:06.302019+0000","last_became_peered":"2024-09-14T05:59:06.302019+0000","last_unstale":"2024-09-14T06:00:40.789795+0000","last_undegraded":"2024-09-14T06:00:40.789795+0000","last_fullsized":"2024-09-14T06:00:40.789795+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:06.070256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022861499999999998,"stat_sum":{"num_bytes":29797455,"num_objects":73,"num_object_clones":6,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":36,"num_read":6844,"num_read_kb":14371,"num_write":588,"num_write_kb":6253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"97'814","reported_seq":3773,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.518589+0000","last_change":"2024-09-14T05:59:43.767147+0000","last_active":"2024-09-14T06:00:41.518589+0000","last_peered":"2024-09-14T06:00:41.518589+0000","last_clean":"2024-09-14T06:00:41.518589+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T06:00:41.518589+0000","last_undegraded":"2024-09-14T06:00:41.518589+0000","last_fullsized":"2024-09-14T06:00:41.518589+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:58.724976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047002699999999998,"stat_sum":{"num_bytes":46655135,"num_objects":102,"num_object_clones":16,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":56,"num_read":6050,"num_read_kb":18836,"num_write":1103,"num_write_kb":11758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"97'475","reported_seq":5797,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.056162+0000","last_change":"2024-09-14T05:59:08.369705+0000","last_active":"2024-09-14T06:00:41.056162+0000","last_peered":"2024-09-14T06:00:41.056162+0000","last_clean":"2024-09-14T06:00:41.056162+0000","last_became_active":"2024-09-14T05:59:06.311716+0000","last_became_peered":"2024-09-14T05:59:06.311716+0000","last_unstale":"2024-09-14T06:00:41.056162+0000","last_undegraded":"2024-09-14T06:00:41.056162+0000","last_fullsized":"2024-09-14T06:00:41.056162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:54.305085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001347256,"stat_sum":{"num_bytes":48540760,"num_objects":84,"num_object_clones":10,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":44,"num_read":6068,"num_read_kb":33997,"num_write":567,"num_write_kb":30994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"99'600","reported_seq":5323,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:42.857395+0000","last_change":"2024-09-14T05:59:43.765786+0000","last_active":"2024-09-14T06:00:42.857395+0000","last_peered":"2024-09-14T06:00:42.857395+0000","last_clean":"2024-09-14T06:00:42.857395+0000","last_became_active":"2024-09-14T05:59:43.763983+0000","last_became_peered":"2024-09-14T05:59:43.763983+0000","last_unstale":"2024-09-14T06:00:42.857395+0000","last_undegraded":"2024-09-14T06:00:42.857395+0000","last_fullsized":"2024-09-14T06:00:42.857395+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:52.456491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26832145,"num_objects":78,"num_object_clones":11,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":45,"num_read":6250,"num_read_kb":28668,"num_write":633,"num_write_kb":10819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":767927,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"97'364","reported_seq":5675,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.625112+0000","last_change":"2024-09-14T05:59:08.369685+0000","last_active":"2024-09-14T06:00:41.625112+0000","last_peered":"2024-09-14T06:00:41.625112+0000","last_clean":"2024-09-14T06:00:41.625112+0000","last_became_active":"2024-09-14T05:59:06.302125+0000","last_became_peered":"2024-09-14T05:59:06.302125+0000","last_unstale":"2024-09-14T06:00:41.625112+0000","last_undegraded":"2024-09-14T06:00:41.625112+0000","last_fullsized":"2024-09-14T06:00:41.625112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:18.895000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012750369999999999,"stat_sum":{"num_bytes":64010946,"num_objects":91,"num_object_clones":20,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":38,"num_read":5307,"num_read_kb":30452,"num_write":386,"num_write_kb":15118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1135899737,"num_objects":2491,"num_object_clones":369,"num_object_copies":4982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2491,"num_whiteouts":1273,"num_read":155369,"num_read_kb":804732,"num_write":22337,"num_write_kb":434851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":433,"num_bytes_recovered":10220769,"num_keys_recovered":69,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":465973248,"data_stored":602227992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18041,"ondisk_log_size":18041,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60576,"kb_used_data":25232,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94311264,"statfs":{"total":96636764160,"available":96574734336,"internally_reserved":0,"allocated":25837568,"data_stored":30231785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495630,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94748,"kb_used_data":66744,"kb_used_omap":4,"kb_used_meta":27963,"kb_avail":94277092,"statfs":{"total":96636764160,"available":96539742208,"internally_reserved":0,"allocated":68345856,"data_stored":92145896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":28634800},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":129560,"kb_used_data":80316,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94242280,"statfs":{"total":96636764160,"available":96504094720,"internally_reserved":0,"allocated":82243584,"data_stored":104646869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51340,"kb_used_data":15988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94320500,"statfs":{"total":96636764160,"available":96584192000,"internally_reserved":0,"allocated":16371712,"data_stored":23235571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109456,"kb_used_data":60216,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94262384,"statfs":{"total":96636764160,"available":96524681216,"internally_reserved":0,"allocated":61661184,"data_stored":77918606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151484,"kb_used_data":98088,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94220356,"statfs":{"total":96636764160,"available":96481644544,"internally_reserved":0,"allocated":100442112,"data_stored":130992204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116840,"kb_used_data":67600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94255000,"statfs":{"total":96636764160,"available":96517120000,"internally_reserved":0,"allocated":69222400,"data_stored":84894281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92456,"kb_used_data":47384,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94279384,"statfs":{"total":96636764160,"available":96542089216,"internally_reserved":0,"allocated":48521216,"data_stored":59891689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":66584576,"data_stored":91016817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":47374336,"data_stored":59364643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24686592,"data_stored":29702756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":68112384,"data_stored":84399978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":100356096,"data_stored":131514877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":62050304,"data_stored":78924816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15228928,"data_stored":22708544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81580032,"data_stored":104595561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T06:00:45.628 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T06:00:45.628 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:00:45.628 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:45.622+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:45.629 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T06:00:45.629 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T06:00:45.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T06:00:45.726 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:45.726+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:45.796 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:45.797 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:45.797 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:45.797 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:45.818 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:00:45.826 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:45.821+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:45.926 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:45.926+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:45.995 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:45.996 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:45.996 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:46.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:00:46.027 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:46.025+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:46.030 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:00:46.030 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:46.030 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 102, 2024-09-14T06:00:46.030 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "8db933fa-392d-4966-864a-b73b8a91dd2d", 2024-09-14T06:00:46.030 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2024-09-14T05:58:34.536616+0000", 2024-09-14T06:00:46.030 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2024-09-14T06:00:45.793505+0000", 2024-09-14T06:00:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2024-09-14T05:59:39.727882+0000", 2024-09-14T06:00:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2024-09-14T05:58:36.841702+0000", 2024-09-14T06:00:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T06:00:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5806080, 2024-09-14T06:00:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2024-09-14T06:00:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: "nodeep-scrub", 2024-09-14T06:00:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: "noscrub", 2024-09-14T06:00:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2024-09-14T06:00:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2024-09-14T06:00:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2024-09-14T06:00:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2024-09-14T06:00:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:00:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 6, 2024-09-14T06:00:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T06:00:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T06:00:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T06:00:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2024-09-14T06:00:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 3, 2024-09-14T06:00:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2024-09-14T06:00:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2024-09-14T06:00:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "luminous", 2024-09-14T06:00:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "squid", 2024-09-14T06:00:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_crimson": false, 2024-09-14T06:00:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2024-09-14T06:00:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2024-09-14T06:00:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2024-09-14T06:00:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2024-09-14T05:58:47.505149+0000", 2024-09-14T06:00:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-14T06:00:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2024-09-14T06:00:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2024-09-14T06:00:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2024-09-14T06:00:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2024-09-14T06:00:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2024-09-14T06:00:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2024-09-14T06:00:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2024-09-14T06:00:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T06:00:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T06:00:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "is_stretch_pool": false, 2024-09-14T06:00:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2024-09-14T06:00:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2024-09-14T06:00:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2024-09-14T06:00:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2024-09-14T06:00:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2024-09-14T06:00:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2024-09-14T06:00:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2024-09-14T06:00:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2024-09-14T06:00:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2024-09-14T06:00:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2024-09-14T06:00:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2024-09-14T06:00:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2024-09-14T06:00:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2024-09-14T06:00:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2024-09-14T06:00:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "18", 2024-09-14T06:00:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2024-09-14T06:00:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T06:00:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T06:00:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2024-09-14T06:00:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2024-09-14T06:00:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2024-09-14T06:00:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2024-09-14T06:00:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2024-09-14T06:00:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2024-09-14T06:00:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2024-09-14T06:00:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2024-09-14T06:00:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2024-09-14T06:00:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2024-09-14T06:00:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2024-09-14T06:00:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2024-09-14T06:00:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2024-09-14T06:00:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2024-09-14T06:00:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2024-09-14T06:00:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T06:00:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T06:00:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T06:00:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2024-09-14T06:00:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2024-09-14T06:00:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2024-09-14T06:00:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2024-09-14T06:00:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2024-09-14T06:00:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2024-09-14T06:00:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2024-09-14T06:00:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2024-09-14T06:00:46.038 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2024-09-14T06:00:46.038 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2024-09-14T06:00:46.038 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T06:00:46.038 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2024-09-14T06:00:46.038 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2024-09-14T06:00:46.038 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2024-09-14T06:00:46.038 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2024-09-14T06:00:46.038 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2024-09-14T06:00:46.038 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2024-09-14T06:00:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2024-09-14T06:00:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2024-09-14T06:00:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2024-09-14T06:00:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2024-09-14T06:00:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "read_balance": { 2024-09-14T06:00:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "score_type": "Fair distribution", 2024-09-14T06:00:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "score_acting": 6.9000000953674316, 2024-09-14T06:00:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "score_stable": 6.9000000953674316, 2024-09-14T06:00:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "optimal_score": 0.28999999165534973, 2024-09-14T06:00:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_acting": 2, 2024-09-14T06:00:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_stable": 2, 2024-09-14T06:00:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity_weighted": 0.875, 2024-09-14T06:00:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity": 1, 2024-09-14T06:00:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-14T06:00:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 2, 2024-09-14T06:00:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "rbd", 2024-09-14T06:00:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2024-09-14T05:58:52.779258+0000", 2024-09-14T06:00:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 8193, 2024-09-14T06:00:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T06:00:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2024-09-14T06:00:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2024-09-14T06:00:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2024-09-14T06:00:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2024-09-14T06:00:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2024-09-14T06:00:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2024-09-14T06:00:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T06:00:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T06:00:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "is_stretch_pool": false, 2024-09-14T06:00:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2024-09-14T06:00:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2024-09-14T06:00:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 8, 2024-09-14T06:00:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 8, 2024-09-14T06:00:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 8, 2024-09-14T06:00:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 8, 2024-09-14T06:00:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 8, 2024-09-14T06:00:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2024-09-14T06:00:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2024-09-14T06:00:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2024-09-14T06:00:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2024-09-14T06:00:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2024-09-14T06:00:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2024-09-14T06:00:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2024-09-14T06:00:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "22", 2024-09-14T06:00:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2024-09-14T06:00:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T06:00:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T06:00:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2024-09-14T06:00:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2024-09-14T06:00:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 2, 2024-09-14T06:00:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 22, 2024-09-14T06:00:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2024-09-14T06:00:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2024-09-14T06:00:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2024-09-14T06:00:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2024-09-14T06:00:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2024-09-14T06:00:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2024-09-14T06:00:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2024-09-14T06:00:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2024-09-14T06:00:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2024-09-14T06:00:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2024-09-14T06:00:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2024-09-14T06:00:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T06:00:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T06:00:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T06:00:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2024-09-14T06:00:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2024-09-14T06:00:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2024-09-14T06:00:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2024-09-14T06:00:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2024-09-14T06:00:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2024-09-14T06:00:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2024-09-14T06:00:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2024-09-14T06:00:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2024-09-14T06:00:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2024-09-14T06:00:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T06:00:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2024-09-14T06:00:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2024-09-14T06:00:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2024-09-14T06:00:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2024-09-14T06:00:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2024-09-14T06:00:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2024-09-14T06:00:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2024-09-14T06:00:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2024-09-14T06:00:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: "read_balance": { 2024-09-14T06:00:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: "score_type": "Fair distribution", 2024-09-14T06:00:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: "score_acting": 1.75, 2024-09-14T06:00:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: "score_stable": 1.75, 2024-09-14T06:00:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: "optimal_score": 1, 2024-09-14T06:00:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_acting": 1.75, 2024-09-14T06:00:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_stable": 1.75, 2024-09-14T06:00:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity_weighted": 0.875, 2024-09-14T06:00:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity": 1, 2024-09-14T06:00:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-14T06:00:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2024-09-14T06:00:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "pool_client.0", 2024-09-14T06:00:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2024-09-14T05:59:04.433909+0000", 2024-09-14T06:00:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 8193, 2024-09-14T06:00:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T06:00:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2024-09-14T06:00:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2024-09-14T06:00:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2024-09-14T06:00:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2024-09-14T06:00:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2024-09-14T06:00:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2024-09-14T06:00:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T06:00:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T06:00:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "is_stretch_pool": false, 2024-09-14T06:00:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2024-09-14T06:00:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2024-09-14T06:00:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2024-09-14T06:00:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2024-09-14T06:00:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2024-09-14T06:00:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2024-09-14T06:00:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2024-09-14T06:00:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2024-09-14T06:00:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2024-09-14T06:00:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2024-09-14T06:00:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2024-09-14T06:00:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2024-09-14T06:00:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2024-09-14T06:00:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2024-09-14T06:00:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "102", 2024-09-14T06:00:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2024-09-14T06:00:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T06:00:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T06:00:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2024-09-14T06:00:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2024-09-14T06:00:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 40, 2024-09-14T06:00:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 102, 2024-09-14T06:00:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2024-09-14T06:00:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2024-09-14T06:00:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2024-09-14T06:00:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2024-09-14T06:00:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2024-09-14T06:00:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2024-09-14T06:00:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2024-09-14T06:00:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2024-09-14T06:00:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2024-09-14T06:00:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2024-09-14T06:00:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2024-09-14T06:00:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T06:00:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T06:00:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T06:00:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2024-09-14T06:00:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2024-09-14T06:00:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2024-09-14T06:00:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2024-09-14T06:00:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2024-09-14T06:00:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2024-09-14T06:00:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2024-09-14T06:00:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2024-09-14T06:00:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2024-09-14T06:00:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2024-09-14T06:00:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T06:00:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2024-09-14T06:00:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2024-09-14T06:00:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2024-09-14T06:00:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2024-09-14T06:00:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2024-09-14T06:00:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2024-09-14T06:00:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2024-09-14T06:00:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2024-09-14T06:00:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "read_balance": { 2024-09-14T06:00:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "score_type": "Fair distribution", 2024-09-14T06:00:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "score_acting": 1.3200000524520874, 2024-09-14T06:00:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: "score_stable": 1.3200000524520874, 2024-09-14T06:00:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: "optimal_score": 1.1399999856948853, 2024-09-14T06:00:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_acting": 1.5, 2024-09-14T06:00:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_stable": 1.5, 2024-09-14T06:00:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity_weighted": 0.875, 2024-09-14T06:00:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity": 1, 2024-09-14T06:00:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-14T06:00:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:00:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2024-09-14T06:00:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2024-09-14T06:00:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "9ef61ed5-359d-4de3-be54-41d3a66c393a", 2024-09-14T06:00:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:00:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 15, 2024-09-14T06:00:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 27, 2024-09-14T06:00:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 46, 2024-09-14T06:00:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 49, 2024-09-14T06:00:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 28, 2024-09-14T06:00:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2024-09-14T06:00:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2024-09-14T06:00:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2024-09-14T06:00:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2024-09-14T06:00:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2024-09-14T06:00:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2024-09-14T06:00:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:00:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6825/643732088", 2024-09-14T06:00:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6827/643732088", 2024-09-14T06:00:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/643732088", 2024-09-14T06:00:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/643732088", 2024-09-14T06:00:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2024-09-14T06:00:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "f180c483-9b53-4808-b5ec-537bf956087d", 2024-09-14T06:00:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:00:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:00:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:00:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:00:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 48, 2024-09-14T06:00:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:00:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.061 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.061 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2024-09-14T06:00:46.061 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:46.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.061 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.061 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.061 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2024-09-14T06:00:46.061 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:46.062 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.062 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.062 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:46.062 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.062 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.062 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.062 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2024-09-14T06:00:46.062 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2024-09-14T06:00:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2024-09-14T06:00:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2024-09-14T06:00:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2024-09-14T06:00:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2024-09-14T06:00:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:00:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6815/1278360579", 2024-09-14T06:00:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/1278360579", 2024-09-14T06:00:46.066 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6823/1278360579", 2024-09-14T06:00:46.066 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6821/1278360579", 2024-09-14T06:00:46.066 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:46.066 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:46.066 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:46.066 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.066 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2024-09-14T06:00:46.067 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "bc59bb00-b3b0-4483-a5b1-cc5907cf660a", 2024-09-14T06:00:46.067 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:46.067 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:46.067 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:46.067 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 0, 2024-09-14T06:00:46.067 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:00:46.068 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:00:46.068 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 15, 2024-09-14T06:00:46.068 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 19, 2024-09-14T06:00:46.068 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:00:46.068 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:46.068 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:46.068 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.069 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.069 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.069 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2024-09-14T06:00:46.069 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:46.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.070 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.070 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.070 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2024-09-14T06:00:46.070 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:46.070 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.070 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2024-09-14T06:00:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2024-09-14T06:00:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2024-09-14T06:00:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2024-09-14T06:00:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/4171349592", 2024-09-14T06:00:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/4171349592", 2024-09-14T06:00:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6817/4171349592", 2024-09-14T06:00:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6814/4171349592", 2024-09-14T06:00:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2024-09-14T06:00:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "7aa9fc3b-29c5-4e9a-a894-e2abfb586263", 2024-09-14T06:00:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:00:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:00:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:00:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:00:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 91, 2024-09-14T06:00:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:00:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:46.076 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:46.076 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.076 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.076 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.076 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2024-09-14T06:00:46.076 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:46.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.076 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.076 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.077 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2024-09-14T06:00:46.077 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:46.077 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.077 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2024-09-14T06:00:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2024-09-14T06:00:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2024-09-14T06:00:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2024-09-14T06:00:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:00:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/3999210088", 2024-09-14T06:00:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/3999210088", 2024-09-14T06:00:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/3999210088", 2024-09-14T06:00:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/3999210088", 2024-09-14T06:00:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "a0665f54-f53d-4536-a322-4974c2f23aa1", 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 46, 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6824", 2024-09-14T06:00:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6825", 2024-09-14T06:00:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6826", 2024-09-14T06:00:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6827", 2024-09-14T06:00:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6830", 2024-09-14T06:00:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6831", 2024-09-14T06:00:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6828", 2024-09-14T06:00:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6829", 2024-09-14T06:00:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:00:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6825/575863621", 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6827/575863621", 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6831/575863621", 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6829/575863621", 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "302ab31c-c228-44da-a0d2-58505ad571cf", 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:00:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:00:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:00:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:00:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 92, 2024-09-14T06:00:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:00:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6808", 2024-09-14T06:00:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6809", 2024-09-14T06:00:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6810", 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6811", 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6814", 2024-09-14T06:00:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6815", 2024-09-14T06:00:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6812", 2024-09-14T06:00:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6813", 2024-09-14T06:00:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:00:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6809/2498345645", 2024-09-14T06:00:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6811/2498345645", 2024-09-14T06:00:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6815/2498345645", 2024-09-14T06:00:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6813/2498345645", 2024-09-14T06:00:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2024-09-14T06:00:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "1adbca34-daef-4229-b25e-40dec6800f85", 2024-09-14T06:00:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:00:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:00:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:00:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:00:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 49, 2024-09-14T06:00:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:00:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6816", 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6817", 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6818", 2024-09-14T06:00:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6819", 2024-09-14T06:00:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6822", 2024-09-14T06:00:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6823", 2024-09-14T06:00:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6820", 2024-09-14T06:00:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6821", 2024-09-14T06:00:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:00:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6817/267756224", 2024-09-14T06:00:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6819/267756224", 2024-09-14T06:00:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6823/267756224", 2024-09-14T06:00:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6821/267756224", 2024-09-14T06:00:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "a75d9794-68bf-4e8c-bf75-448a7a783769", 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:00:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 48, 2024-09-14T06:00:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:00:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:00:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:00:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6800", 2024-09-14T06:00:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6801", 2024-09-14T06:00:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:00:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6802", 2024-09-14T06:00:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6803", 2024-09-14T06:00:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:00:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6806", 2024-09-14T06:00:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6807", 2024-09-14T06:00:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:00:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:00:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:00:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6804", 2024-09-14T06:00:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:00:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6805", 2024-09-14T06:00:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:00:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.105 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.105 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6801/4119173763", 2024-09-14T06:00:46.105 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6803/4119173763", 2024-09-14T06:00:46.105 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6807/4119173763", 2024-09-14T06:00:46.105 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6805/4119173763", 2024-09-14T06:00:46.105 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:00:46.105 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:00:46.106 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:00:46.106 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.106 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.106 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:00:46.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2024-09-14T06:00:46.106 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2024-09-14T06:00:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.791330+0000", 2024-09-14T06:00:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 28 2024-09-14T06:00:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2024-09-14T06:00:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.526550+0000", 2024-09-14T06:00:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:00:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2024-09-14T06:00:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.664242+0000", 2024-09-14T06:00:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:00:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2024-09-14T06:00:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.327736+0000", 2024-09-14T06:00:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:00:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2024-09-14T06:00:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.687393+0000", 2024-09-14T06:00:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:00:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2024-09-14T06:00:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.314438+0000", 2024-09-14T06:00:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:00:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2024-09-14T06:00:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.487578+0000", 2024-09-14T06:00:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:00:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2024-09-14T06:00:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:00:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:00:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:00:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:00:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:00:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.106833+0000", 2024-09-14T06:00:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:00:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:00:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [ 2024-09-14T06:00:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: "pgid": "3.7", 2024-09-14T06:00:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2024-09-14T06:00:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: 5, 2024-09-14T06:00:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: 7 2024-09-14T06:00:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:00:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2024-09-14T06:00:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_primaries": [], 2024-09-14T06:00:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2024-09-14T06:00:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2024-09-14T06:00:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2024-09-14T06:00:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2024-09-14T06:00:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2024-09-14T06:00:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2024-09-14T06:00:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2024-09-14T06:00:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2024-09-14T06:00:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2024-09-14T06:00:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2024-09-14T06:00:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [ 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: "snaps": [ 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: "begin": 38, 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: "length": 3 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [ 2024-09-14T06:00:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: "snaps": [ 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: "begin": 38, 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: "length": 1 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2024-09-14T06:00:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2024-09-14T06:00:46.117 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2024-09-14T06:00:46.117 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2024-09-14T06:00:46.117 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2024-09-14T06:00:46.117 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:46.117 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:46.119 INFO:tasks.thrashosds.thrasher:j is {'epoch': 102, 'fsid': '8db933fa-392d-4966-864a-b73b8a91dd2d', 'created': '2024-09-14T05:58:34.536616+0000', 'modified': '2024-09-14T06:00:45.793505+0000', 'last_up_change': '2024-09-14T05:59:39.727882+0000', 'last_in_change': '2024-09-14T05:58:36.841702+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T05:58:47.505149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T05:58:52.779258+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T05:59:04.433909+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 40, 'snap_epoch': 102, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3200000524520874, 'score_stable': 1.3200000524520874, 'optimal_score': 1.1399999856948853, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}], 'osds': [{'osd': 0, 'uuid': '9ef61ed5-359d-4de3-be54-41d3a66c393a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 15, 'last_clean_end': 27, 'up_from': 46, 'up_thru': 49, 'down_at': 28, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6824', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6825', 'nonce': 643732088}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6826', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6827', 'nonce': 643732088}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6830', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6831', 'nonce': 643732088}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6828', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6829', 'nonce': 643732088}]}, 'public_addr': '172.21.15.6:6825/643732088', 'cluster_addr': '172.21.15.6:6827/643732088', 'heartbeat_back_addr': '172.21.15.6:6831/643732088', 'heartbeat_front_addr': '172.21.15.6:6829/643732088', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f180c483-9b53-4808-b5ec-537bf956087d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6812', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6815', 'nonce': 1278360579}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6818', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6819', 'nonce': 1278360579}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6822', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6823', 'nonce': 1278360579}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6820', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6821', 'nonce': 1278360579}]}, 'public_addr': '172.21.15.6:6815/1278360579', 'cluster_addr': '172.21.15.6:6819/1278360579', 'heartbeat_back_addr': '172.21.15.6:6823/1278360579', 'heartbeat_front_addr': '172.21.15.6:6821/1278360579', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'bc59bb00-b3b0-4483-a5b1-cc5907cf660a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6808', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6809', 'nonce': 4171349592}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6810', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6811', 'nonce': 4171349592}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6816', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6817', 'nonce': 4171349592}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6813', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6814', 'nonce': 4171349592}]}, 'public_addr': '172.21.15.6:6809/4171349592', 'cluster_addr': '172.21.15.6:6811/4171349592', 'heartbeat_back_addr': '172.21.15.6:6817/4171349592', 'heartbeat_front_addr': '172.21.15.6:6814/4171349592', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '7aa9fc3b-29c5-4e9a-a894-e2abfb586263', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 91, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6800', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6801', 'nonce': 3999210088}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6802', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6803', 'nonce': 3999210088}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6806', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6807', 'nonce': 3999210088}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6804', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6805', 'nonce': 3999210088}]}, 'public_addr': '172.21.15.6:6801/3999210088', 'cluster_addr': '172.21.15.6:6803/3999210088', 'heartbeat_back_addr': '172.21.15.6:6807/3999210088', 'heartbeat_front_addr': '172.21.15.6:6805/3999210088', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'a0665f54-f53d-4536-a322-4974c2f23aa1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6824', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6825', 'nonce': 575863621}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6826', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6827', 'nonce': 575863621}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6830', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6831', 'nonce': 575863621}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6828', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6829', 'nonce': 575863621}]}, 'public_addr': '172.21.15.154:6825/575863621', 'cluster_addr': '172.21.15.154:6827/575863621', 'heartbeat_back_addr': '172.21.15.154:6831/575863621', 'heartbeat_front_addr': '172.21.15.154:6829/575863621', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '302ab31c-c228-44da-a0d2-58505ad571cf', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 92, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6808', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6809', 'nonce': 2498345645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6810', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6811', 'nonce': 2498345645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6814', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6815', 'nonce': 2498345645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6812', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6813', 'nonce': 2498345645}]}, 'public_addr': '172.21.15.154:6809/2498345645', 'cluster_addr': '172.21.15.154:6811/2498345645', 'heartbeat_back_addr': '172.21.15.154:6815/2498345645', 'heartbeat_front_addr': '172.21.15.154:6813/2498345645', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '1adbca34-daef-4229-b25e-40dec6800f85', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 49, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6816', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6817', 'nonce': 267756224}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6818', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6819', 'nonce': 267756224}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6822', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6823', 'nonce': 267756224}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6820', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6821', 'nonce': 267756224}]}, 'public_addr': '172.21.15.154:6817/267756224', 'cluster_addr': '172.21.15.154:6819/267756224', 'heartbeat_back_addr': '172.21.15.154:6823/267756224', 'heartbeat_front_addr': '172.21.15.154:6821/267756224', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a75d9794-68bf-4e8c-bf75-448a7a783769', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 4119173763}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 4119173763}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 4119173763}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 4119173763}]}, 'public_addr': '172.21.15.154:6801/4119173763', 'cluster_addr': '172.21.15.154:6803/4119173763', 'heartbeat_back_addr': '172.21.15.154:6807/4119173763', 'heartbeat_front_addr': '172.21.15.154:6805/4119173763', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.791330+0000', 'dead_epoch': 28}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.526550+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.664242+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.327736+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.687393+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.314438+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.487578+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.106833+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.7', 'osds': [5, 7]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 38, 'length': 3}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 38, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T06:00:46.119 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T06:00:46.162 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:46.162+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:46.230 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:46.225+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:46.248 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:46.249 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:46.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:46.249 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:46.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.249 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59148 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 419840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.249 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:46.249 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.978022291999999, 2024-09-14T06:00:46.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072974285999999999, 2024-09-14T06:00:46.250 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.250 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.250 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.250 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.250 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.250 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.250 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59148 2024-09-14T06:00:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268521+0000", 2024-09-14T06:00:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4199999999999995e-07 2024-09-14T06:00:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268524+0000", 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.05e-06 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268534+0000", 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8719999999999997e-06 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268541+0000", 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5349999999999999e-06 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341108+0000", 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072566624999999996 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341169+0000", 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1251e-05 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341494+0000", 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325311 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59149 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 436224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.977983068, 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073405053999999997, 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59149 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268560+0000", 2024-09-14T06:00:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9999999999999997e-07 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268563+0000", 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.292e-06 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268573+0000", 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3260000000000002e-06 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268581+0000", 2024-09-14T06:00:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1960000000000008e-06 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341537+0000", 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072955916999999995 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341641+0000", 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104341 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341964+0000", 2024-09-14T06:00:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032328199999999999 2024-09-14T06:00:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59150 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 452608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.977949828, 2024-09-14T06:00:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073829748000000001, 2024-09-14T06:00:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59150 2024-09-14T06:00:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0399999999999995e-07 2024-09-14T06:00:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268596+0000", 2024-09-14T06:00:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9859999999999999e-06 2024-09-14T06:00:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268606+0000", 2024-09-14T06:00:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0088000000000001e-05 2024-09-14T06:00:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268614+0000", 2024-09-14T06:00:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341999+0000", 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073385011999999999 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342093+0000", 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3793000000000001e-05 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342422+0000", 2024-09-14T06:00:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000329129 2024-09-14T06:00:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59151 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.97791746, 2024-09-14T06:00:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074207289999999995, 2024-09-14T06:00:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59151 2024-09-14T06:00:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268626+0000", 2024-09-14T06:00:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T06:00:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268629+0000", 2024-09-14T06:00:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.038e-06 2024-09-14T06:00:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268638+0000", 2024-09-14T06:00:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8139999999999995e-06 2024-09-14T06:00:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268647+0000", 2024-09-14T06:00:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4889999999999995e-06 2024-09-14T06:00:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342457+0000", 2024-09-14T06:00:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073809890000000003 2024-09-14T06:00:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342545+0000", 2024-09-14T06:00:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8697999999999997e-05 2024-09-14T06:00:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342832+0000", 2024-09-14T06:00:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028681799999999999 2024-09-14T06:00:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59152 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.977884819000003, 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074695176000000002, 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59152 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2900000000000003e-07 2024-09-14T06:00:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268661+0000", 2024-09-14T06:00:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0230000000000001e-06 2024-09-14T06:00:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268670+0000", 2024-09-14T06:00:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2129999999999997e-06 2024-09-14T06:00:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268679+0000", 2024-09-14T06:00:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-09-14T06:00:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342937+0000", 2024-09-14T06:00:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074258781999999995 2024-09-14T06:00:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343044+0000", 2024-09-14T06:00:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-09-14T06:00:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343353+0000", 2024-09-14T06:00:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030911099999999999 2024-09-14T06:00:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59153 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 501760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.977852048999999, 2024-09-14T06:00:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074997241000000006, 2024-09-14T06:00:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59153 2024-09-14T06:00:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268691+0000", 2024-09-14T06:00:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:00:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268693+0000", 2024-09-14T06:00:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3599999999999999e-06 2024-09-14T06:00:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268699+0000", 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268704+0000", 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5759999999999999e-06 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343398+0000", 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074694522999999999 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343450+0000", 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1350999999999997e-05 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343688+0000", 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023806500000000001 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59154 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 518144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.977832982999999, 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075389938000000004, 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59154 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268710+0000", 2024-09-14T06:00:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8000000000000001e-07 2024-09-14T06:00:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268712+0000", 2024-09-14T06:00:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T06:00:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268717+0000", 2024-09-14T06:00:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8570000000000003e-06 2024-09-14T06:00:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268721+0000", 2024-09-14T06:00:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2039999999999999e-06 2024-09-14T06:00:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343721+0000", 2024-09-14T06:00:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074999748000000005 2024-09-14T06:00:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343784+0000", 2024-09-14T06:00:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3174000000000002e-05 2024-09-14T06:00:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.344099+0000", 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000315299 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59398 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 323584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.966868734999998, 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073326565999999996, 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59398 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279675+0000", 2024-09-14T06:00:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-14T06:00:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279681+0000", 2024-09-14T06:00:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-09-14T06:00:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279702+0000", 2024-09-14T06:00:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1259000000000001e-05 2024-09-14T06:00:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279718+0000", 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5475999999999999e-05 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352360+0000", 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.07264226 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352447+0000", 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7381999999999998e-05 2024-09-14T06:00:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353000+0000", 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055309200000000004 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59399 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.966804371999999, 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073824446000000002, 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59399 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279739+0000", 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279745+0000", 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279767+0000", 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639000000000001e-05 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279781+0000", 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4511999999999999e-05 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353045+0000", 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073263718000000005 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353168+0000", 2024-09-14T06:00:46.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012314499999999999 2024-09-14T06:00:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353562+0000", 2024-09-14T06:00:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039435199999999999 2024-09-14T06:00:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59400 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.966740612000002, 2024-09-14T06:00:46.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074271465999999994, 2024-09-14T06:00:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59400 2024-09-14T06:00:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279803+0000", 2024-09-14T06:00:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2100000000000001e-06 2024-09-14T06:00:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279819+0000", 2024-09-14T06:00:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6409000000000002e-05 2024-09-14T06:00:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279841+0000", 2024-09-14T06:00:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1878e-05 2024-09-14T06:00:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279856+0000", 2024-09-14T06:00:46.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4392999999999999e-05 2024-09-14T06:00:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353650+0000", 2024-09-14T06:00:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073794144000000006 2024-09-14T06:00:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353757+0000", 2024-09-14T06:00:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010687 2024-09-14T06:00:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354073+0000", 2024-09-14T06:00:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000316562 2024-09-14T06:00:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59401 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 372736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.296 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.966665786999997, 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074643900999999999, 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59401 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:46.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279878+0000", 2024-09-14T06:00:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.31e-06 2024-09-14T06:00:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279883+0000", 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3770000000000004e-06 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279906+0000", 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2398000000000001e-05 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279920+0000", 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.402e-05 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354125+0000", 2024-09-14T06:00:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074205750000000001 2024-09-14T06:00:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354227+0000", 2024-09-14T06:00:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101612 2024-09-14T06:00:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354521+0000", 2024-09-14T06:00:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029343400000000002 2024-09-14T06:00:46.300 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59402 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 389120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.966604203999999, 2024-09-14T06:00:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075017027999999999, 2024-09-14T06:00:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59402 2024-09-14T06:00:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279939+0000", 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2470000000000001e-06 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279945+0000", 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-09-14T06:00:46.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279966+0000", 2024-09-14T06:00:46.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1801999999999999e-05 2024-09-14T06:00:46.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279980+0000", 2024-09-14T06:00:46.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3589e-05 2024-09-14T06:00:46.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354569+0000", 2024-09-14T06:00:46.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074588707000000004 2024-09-14T06:00:46.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354671+0000", 2024-09-14T06:00:46.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102398 2024-09-14T06:00:46.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354955+0000", 2024-09-14T06:00:46.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028406500000000001 2024-09-14T06:00:46.305 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.305 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.305 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.306 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59403 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 405504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.306 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:46.306 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.966542416999999, 2024-09-14T06:00:46.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075434395000000001, 2024-09-14T06:00:46.306 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.306 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.306 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.306 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.306 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.306 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.306 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59403 2024-09-14T06:00:46.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.307 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:46.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:46.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280001+0000", 2024-09-14T06:00:46.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2669999999999999e-06 2024-09-14T06:00:46.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280008+0000", 2024-09-14T06:00:46.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5849999999999996e-06 2024-09-14T06:00:46.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280030+0000", 2024-09-14T06:00:46.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2293000000000002e-05 2024-09-14T06:00:46.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280044+0000", 2024-09-14T06:00:46.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3974999999999999e-05 2024-09-14T06:00:46.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355013+0000", 2024-09-14T06:00:46.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074969039000000001 2024-09-14T06:00:46.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355144+0000", 2024-09-14T06:00:46.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000131333 2024-09-14T06:00:46.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355434+0000", 2024-09-14T06:00:46.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028990299999999999 2024-09-14T06:00:46.311 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.311 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.311 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.311 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59404 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.311 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:46.311 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.966477298000001, 2024-09-14T06:00:46.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075696103000000001, 2024-09-14T06:00:46.311 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.312 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.312 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.312 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.312 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.312 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.312 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59404 2024-09-14T06:00:46.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.312 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:46.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:46.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280066+0000", 2024-09-14T06:00:46.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2640000000000001e-06 2024-09-14T06:00:46.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280072+0000", 2024-09-14T06:00:46.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129999999999997e-06 2024-09-14T06:00:46.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280094+0000", 2024-09-14T06:00:46.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2608000000000001e-05 2024-09-14T06:00:46.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280109+0000", 2024-09-14T06:00:46.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:46.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355479+0000", 2024-09-14T06:00:46.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075370699999999999 2024-09-14T06:00:46.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355554+0000", 2024-09-14T06:00:46.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4674999999999999e-05 2024-09-14T06:00:46.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355761+0000", 2024-09-14T06:00:46.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-14T06:00:46.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.316 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.316 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59405 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.316 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:46.317 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.966413387999999, 2024-09-14T06:00:46.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076008867999999993, 2024-09-14T06:00:46.317 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.317 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.317 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.317 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59405 2024-09-14T06:00:46.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.317 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280130+0000", 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2500000000000001e-06 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280136+0000", 2024-09-14T06:00:46.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-09-14T06:00:46.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280158+0000", 2024-09-14T06:00:46.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1795000000000001e-05 2024-09-14T06:00:46.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280172+0000", 2024-09-14T06:00:46.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4303e-05 2024-09-14T06:00:46.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355797+0000", 2024-09-14T06:00:46.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075624835000000001 2024-09-14T06:00:46.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355866+0000", 2024-09-14T06:00:46.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9043999999999998e-05 2024-09-14T06:00:46.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356138+0000", 2024-09-14T06:00:46.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027207799999999998 2024-09-14T06:00:46.321 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.321 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.321 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.321 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59406 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.321 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:46.321 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.966349446000002, 2024-09-14T06:00:46.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076435642999999998, 2024-09-14T06:00:46.321 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.321 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.321 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59406 2024-09-14T06:00:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:46.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280194+0000", 2024-09-14T06:00:46.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-14T06:00:46.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280200+0000", 2024-09-14T06:00:46.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6359999999999999e-06 2024-09-14T06:00:46.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280222+0000", 2024-09-14T06:00:46.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1628999999999999e-05 2024-09-14T06:00:46.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280236+0000", 2024-09-14T06:00:46.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4413000000000001e-05 2024-09-14T06:00:46.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356172+0000", 2024-09-14T06:00:46.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075936466999999994 2024-09-14T06:00:46.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356260+0000", 2024-09-14T06:00:46.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7437999999999999e-05 2024-09-14T06:00:46.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356629+0000", 2024-09-14T06:00:46.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036877600000000002 2024-09-14T06:00:46.326 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.326 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.326 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.326 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59407 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 471040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.326 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:46.326 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.966285212999999, 2024-09-14T06:00:46.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076820083999999997, 2024-09-14T06:00:46.326 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.327 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.327 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.327 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.327 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.327 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.327 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59407 2024-09-14T06:00:46.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.327 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:46.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:46.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280258+0000", 2024-09-14T06:00:46.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1370000000000001e-06 2024-09-14T06:00:46.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280264+0000", 2024-09-14T06:00:46.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6930000000000004e-06 2024-09-14T06:00:46.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280285+0000", 2024-09-14T06:00:46.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1455999999999999e-05 2024-09-14T06:00:46.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280300+0000", 2024-09-14T06:00:46.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4319e-05 2024-09-14T06:00:46.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356676+0000", 2024-09-14T06:00:46.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076376615999999994 2024-09-14T06:00:46.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356768+0000", 2024-09-14T06:00:46.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1234000000000001e-05 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357077+0000", 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030962900000000001 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59408 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 487424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.966220213, 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077185511999999998, 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.331 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.332 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.332 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.332 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.332 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.332 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59408 2024-09-14T06:00:46.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.332 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:46.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:46.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280323+0000", 2024-09-14T06:00:46.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2860000000000001e-06 2024-09-14T06:00:46.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280329+0000", 2024-09-14T06:00:46.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.553e-06 2024-09-14T06:00:46.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280352+0000", 2024-09-14T06:00:46.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-14T06:00:46.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280366+0000", 2024-09-14T06:00:46.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-14T06:00:46.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357126+0000", 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076760326000000004 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357223+0000", 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6490000000000006e-05 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357508+0000", 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028479900000000002 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59409 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.966155983, 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077536090000000002, 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59409 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:46.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:46.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280388+0000", 2024-09-14T06:00:46.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.096e-06 2024-09-14T06:00:46.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280393+0000", 2024-09-14T06:00:46.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T06:00:46.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280414+0000", 2024-09-14T06:00:46.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1175999999999999e-05 2024-09-14T06:00:46.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280427+0000", 2024-09-14T06:00:46.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3032e-05 2024-09-14T06:00:46.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357553+0000", 2024-09-14T06:00:46.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077125845999999998 2024-09-14T06:00:46.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357624+0000", 2024-09-14T06:00:46.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1062000000000005e-05 2024-09-14T06:00:46.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357923+0000", 2024-09-14T06:00:46.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029891199999999997 2024-09-14T06:00:46.340 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.340 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.340 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.340 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59410 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:46.340 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:46.340 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.966096671000003, 2024-09-14T06:00:46.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077854494999999996, 2024-09-14T06:00:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59410 2024-09-14T06:00:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280447+0000", 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069999999999999e-06 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280453+0000", 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-06 2024-09-14T06:00:46.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280471+0000", 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8295999999999999e-05 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280484+0000", 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2609000000000001e-05 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357954+0000", 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077470405000000006 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358040+0000", 2024-09-14T06:00:46.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.551e-05 2024-09-14T06:00:46.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358300+0000", 2024-09-14T06:00:46.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026036800000000003 2024-09-14T06:00:46.344 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.344 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.344 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.344 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.344 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.344 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:46.346 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:00:46.346 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:46.346+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:46.446 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:46.446+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:46.479 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:00:46.480 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T06:00:46.499 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-14T06:00:45.799941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1136490124,"num_objects":2495,"num_object_clones":369,"num_object_copies":4990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2495,"num_whiteouts":1273,"num_read":155435,"num_read_kb":804787,"num_write":22440,"num_write_kb":436481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":433,"num_bytes_recovered":10220769,"num_keys_recovered":69,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18116,"ondisk_log_size":18116,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":806460,"kb_used_data":461568,"kb_used_omap":15,"kb_used_meta":344688,"kb_avail":754168260,"statfs":{"total":773094113280,"available":772268298240,"internally_reserved":0,"allocated":472645632,"data_stored":603956901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":352961308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23340586,"num_objects":14,"num_object_clones":3,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":2533,"num_read_kb":20361,"num_write":536,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038036"},"pg_stats":[{"pgid":"3.1f","version":"99'699","reported_seq":2370,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.471251+0000","last_change":"2024-09-14T05:59:43.763150+0000","last_active":"2024-09-14T06:00:43.471251+0000","last_peered":"2024-09-14T06:00:43.471251+0000","last_clean":"2024-09-14T06:00:43.471251+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T06:00:43.471251+0000","last_undegraded":"2024-09-14T06:00:43.471251+0000","last_fullsized":"2024-09-14T06:00:43.471251+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:42.525356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001224482,"stat_sum":{"num_bytes":41895251,"num_objects":80,"num_object_clones":9,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":42,"num_read":4174,"num_read_kb":14503,"num_write":899,"num_write_kb":5420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"95'532","reported_seq":2931,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.752988+0000","last_change":"2024-09-14T05:59:08.299658+0000","last_active":"2024-09-14T06:00:40.752988+0000","last_peered":"2024-09-14T06:00:40.752988+0000","last_clean":"2024-09-14T06:00:40.752988+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T06:00:40.752988+0000","last_undegraded":"2024-09-14T06:00:40.752988+0000","last_fullsized":"2024-09-14T06:00:40.752988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:05.694873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882171,"stat_sum":{"num_bytes":25424971,"num_objects":70,"num_object_clones":13,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":31,"num_read":3453,"num_read_kb":12249,"num_write":675,"num_write_kb":12326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"97'347","reported_seq":5507,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.596126+0000","last_change":"2024-09-14T05:59:08.293155+0000","last_active":"2024-09-14T06:00:41.596126+0000","last_peered":"2024-09-14T06:00:41.596126+0000","last_clean":"2024-09-14T06:00:41.596126+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T06:00:41.596126+0000","last_undegraded":"2024-09-14T06:00:41.596126+0000","last_fullsized":"2024-09-14T06:00:41.596126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:02.551851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000618802,"stat_sum":{"num_bytes":27526886,"num_objects":74,"num_object_clones":7,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":44,"num_read":5159,"num_read_kb":31126,"num_write":348,"num_write_kb":26838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"97'472","reported_seq":3883,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.059107+0000","last_change":"2024-09-14T05:59:08.294498+0000","last_active":"2024-09-14T06:00:41.059107+0000","last_peered":"2024-09-14T06:00:41.059107+0000","last_clean":"2024-09-14T06:00:41.059107+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T06:00:41.059107+0000","last_undegraded":"2024-09-14T06:00:41.059107+0000","last_fullsized":"2024-09-14T06:00:41.059107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:12.322268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014905350000000001,"stat_sum":{"num_bytes":28601988,"num_objects":72,"num_object_clones":11,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":39,"num_read":4145,"num_read_kb":14081,"num_write":523,"num_write_kb":8642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"99'502","reported_seq":1300,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.030499+0000","last_change":"2024-09-14T05:59:40.834308+0000","last_active":"2024-09-14T06:00:43.030499+0000","last_peered":"2024-09-14T06:00:43.030499+0000","last_clean":"2024-09-14T06:00:43.030499+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T06:00:43.030499+0000","last_undegraded":"2024-09-14T06:00:43.030499+0000","last_fullsized":"2024-09-14T06:00:43.030499+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:22.578137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11129328,"num_objects":70,"num_object_clones":13,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":35,"num_read":2219,"num_read_kb":6040,"num_write":557,"num_write_kb":6276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"97'872","reported_seq":5361,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.940536+0000","last_change":"2024-09-14T05:59:08.282710+0000","last_active":"2024-09-14T06:00:40.940536+0000","last_peered":"2024-09-14T06:00:40.940536+0000","last_clean":"2024-09-14T06:00:40.940536+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T06:00:40.940536+0000","last_undegraded":"2024-09-14T06:00:40.940536+0000","last_fullsized":"2024-09-14T06:00:40.940536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:48.365630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078735700000000003,"stat_sum":{"num_bytes":23664870,"num_objects":77,"num_object_clones":10,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":44,"num_read":7738,"num_read_kb":44004,"num_write":1201,"num_write_kb":19820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"97'454","reported_seq":2818,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.050080+0000","last_change":"2024-09-14T05:59:08.283122+0000","last_active":"2024-09-14T06:00:41.050080+0000","last_peered":"2024-09-14T06:00:41.050080+0000","last_clean":"2024-09-14T06:00:41.050080+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T06:00:41.050080+0000","last_undegraded":"2024-09-14T06:00:41.050080+0000","last_fullsized":"2024-09-14T06:00:41.050080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:44.549320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020244989999999999,"stat_sum":{"num_bytes":34017297,"num_objects":70,"num_object_clones":5,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":34,"num_read":3301,"num_read_kb":21523,"num_write":532,"num_write_kb":15097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"95'476","reported_seq":5768,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.060078+0000","last_change":"2024-09-14T05:59:43.761389+0000","last_active":"2024-09-14T06:00:41.060078+0000","last_peered":"2024-09-14T06:00:41.060078+0000","last_clean":"2024-09-14T06:00:41.060078+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T06:00:41.060078+0000","last_undegraded":"2024-09-14T06:00:41.060078+0000","last_fullsized":"2024-09-14T06:00:41.060078+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:09.833097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090099400000000001,"stat_sum":{"num_bytes":59866913,"num_objects":82,"num_object_clones":13,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":40,"num_read":6953,"num_read_kb":51188,"num_write":471,"num_write_kb":14144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"99'365","reported_seq":2964,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.077185+0000","last_change":"2024-09-14T05:59:40.929839+0000","last_active":"2024-09-14T06:00:43.077185+0000","last_peered":"2024-09-14T06:00:43.077185+0000","last_clean":"2024-09-14T06:00:43.077185+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T06:00:43.077185+0000","last_undegraded":"2024-09-14T06:00:43.077185+0000","last_fullsized":"2024-09-14T06:00:43.077185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:41.552583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30644976,"num_objects":71,"num_object_clones":14,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":38,"num_read":3386,"num_read_kb":21115,"num_write":329,"num_write_kb":6970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"97'1428","reported_seq":3531,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.055001+0000","last_change":"2024-09-14T05:59:08.293088+0000","last_active":"2024-09-14T06:00:41.055001+0000","last_peered":"2024-09-14T06:00:41.055001+0000","last_clean":"2024-09-14T06:00:41.055001+0000","last_became_active":"2024-09-14T05:59:06.296607+0000","last_became_peered":"2024-09-14T05:59:06.296607+0000","last_unstale":"2024-09-14T06:00:41.055001+0000","last_undegraded":"2024-09-14T06:00:41.055001+0000","last_fullsized":"2024-09-14T06:00:41.055001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1428,"log_dups_size":0,"ondisk_log_size":1428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:58.281385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056627299999999995,"stat_sum":{"num_bytes":41826361,"num_objects":68,"num_object_clones":10,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":34,"num_read":8231,"num_read_kb":22548,"num_write":2433,"num_write_kb":21381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"97'652","reported_seq":5814,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.055475+0000","last_change":"2024-09-14T05:59:08.370304+0000","last_active":"2024-09-14T06:00:41.055475+0000","last_peered":"2024-09-14T06:00:41.055475+0000","last_clean":"2024-09-14T06:00:41.055475+0000","last_became_active":"2024-09-14T05:59:06.295335+0000","last_became_peered":"2024-09-14T05:59:06.295335+0000","last_unstale":"2024-09-14T06:00:41.055475+0000","last_undegraded":"2024-09-14T06:00:41.055475+0000","last_fullsized":"2024-09-14T06:00:41.055475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:44:36.118339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001779487,"stat_sum":{"num_bytes":63917922,"num_objects":107,"num_object_clones":24,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":53,"num_read":7172,"num_read_kb":54437,"num_write":775,"num_write_kb":20105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"97'556","reported_seq":4821,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.055150+0000","last_change":"2024-09-14T05:59:08.282513+0000","last_active":"2024-09-14T06:00:41.055150+0000","last_peered":"2024-09-14T06:00:41.055150+0000","last_clean":"2024-09-14T06:00:41.055150+0000","last_became_active":"2024-09-14T05:59:06.307548+0000","last_became_peered":"2024-09-14T05:59:06.307548+0000","last_unstale":"2024-09-14T06:00:41.055150+0000","last_undegraded":"2024-09-14T06:00:41.055150+0000","last_fullsized":"2024-09-14T06:00:41.055150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:09.549075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061538200000000004,"stat_sum":{"num_bytes":27180998,"num_objects":70,"num_object_clones":12,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":35,"num_read":5513,"num_read_kb":30465,"num_write":772,"num_write_kb":15959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":170,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.834287+0000","last_change":"2024-09-14T05:58:56.312544+0000","last_active":"2024-09-14T06:00:40.834287+0000","last_peered":"2024-09-14T06:00:40.834287+0000","last_clean":"2024-09-14T06:00:40.834287+0000","last_became_active":"2024-09-14T05:58:54.103612+0000","last_became_peered":"2024-09-14T05:58:54.103612+0000","last_unstale":"2024-09-14T06:00:40.834287+0000","last_undegraded":"2024-09-14T06:00:40.834287+0000","last_fullsized":"2024-09-14T06:00:40.834287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:08.678742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"99'988","reported_seq":4862,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.459973+0000","last_change":"2024-09-14T05:59:43.762927+0000","last_active":"2024-09-14T06:00:43.459973+0000","last_peered":"2024-09-14T06:00:43.459973+0000","last_clean":"2024-09-14T06:00:43.459973+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T06:00:43.459973+0000","last_undegraded":"2024-09-14T06:00:43.459973+0000","last_fullsized":"2024-09-14T06:00:43.459973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:36.940253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26004745,"num_objects":76,"num_object_clones":9,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":36,"num_read":8027,"num_read_kb":25118,"num_write":1373,"num_write_kb":13665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.744550+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T06:00:40.744550+0000","last_peered":"2024-09-14T06:00:40.744550+0000","last_clean":"2024-09-14T06:00:40.744550+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T06:00:40.744550+0000","last_undegraded":"2024-09-14T06:00:40.744550+0000","last_fullsized":"2024-09-14T06:00:40.744550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"95'383","reported_seq":4437,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.050937+0000","last_change":"2024-09-14T06:00:35.709017+0000","last_active":"2024-09-14T06:00:41.050937+0000","last_peered":"2024-09-14T06:00:41.050937+0000","last_clean":"2024-09-14T06:00:41.050937+0000","last_became_active":"2024-09-14T06:00:35.707129+0000","last_became_peered":"2024-09-14T06:00:35.707129+0000","last_unstale":"2024-09-14T06:00:41.050937+0000","last_undegraded":"2024-09-14T06:00:41.050937+0000","last_fullsized":"2024-09-14T06:00:41.050937+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:11.681443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001533155,"stat_sum":{"num_bytes":65575771,"num_objects":75,"num_object_clones":10,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":34,"num_read":3976,"num_read_kb":32296,"num_write":387,"num_write_kb":16552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":125,"num_bytes_recovered":4610315,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789427+0000","last_change":"2024-09-14T05:59:40.765463+0000","last_active":"2024-09-14T06:00:40.789427+0000","last_peered":"2024-09-14T06:00:40.789427+0000","last_clean":"2024-09-14T06:00:40.789427+0000","last_became_active":"2024-09-14T05:59:40.764785+0000","last_became_peered":"2024-09-14T05:59:40.764785+0000","last_unstale":"2024-09-14T06:00:40.789427+0000","last_undegraded":"2024-09-14T06:00:40.789427+0000","last_fullsized":"2024-09-14T06:00:40.789427+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:47.547246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"95'361","reported_seq":3880,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.054161+0000","last_change":"2024-09-14T05:59:08.282105+0000","last_active":"2024-09-14T06:00:41.054161+0000","last_peered":"2024-09-14T06:00:41.054161+0000","last_clean":"2024-09-14T06:00:41.054161+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T06:00:41.054161+0000","last_undegraded":"2024-09-14T06:00:41.054161+0000","last_fullsized":"2024-09-14T06:00:41.054161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:51.251847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010945919999999999,"stat_sum":{"num_bytes":28806714,"num_objects":72,"num_object_clones":8,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":41,"num_read":3732,"num_read_kb":24815,"num_write":407,"num_write_kb":9879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":179,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.744277+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T06:00:40.744277+0000","last_peered":"2024-09-14T06:00:40.744277+0000","last_clean":"2024-09-14T06:00:40.744277+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T06:00:40.744277+0000","last_undegraded":"2024-09-14T06:00:40.744277+0000","last_fullsized":"2024-09-14T06:00:40.744277+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'428","reported_seq":3776,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.054950+0000","last_change":"2024-09-14T05:59:08.293368+0000","last_active":"2024-09-14T06:00:41.054950+0000","last_peered":"2024-09-14T06:00:41.054950+0000","last_clean":"2024-09-14T06:00:41.054950+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T06:00:41.054950+0000","last_undegraded":"2024-09-14T06:00:41.054950+0000","last_fullsized":"2024-09-14T06:00:41.054950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:25.635807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072033799999999995,"stat_sum":{"num_bytes":18930470,"num_objects":73,"num_object_clones":12,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":35,"num_read":4769,"num_read_kb":19471,"num_write":427,"num_write_kb":8496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"97'422","reported_seq":2647,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.608981+0000","last_change":"2024-09-14T05:59:40.846399+0000","last_active":"2024-09-14T06:00:41.608981+0000","last_peered":"2024-09-14T06:00:41.608981+0000","last_clean":"2024-09-14T06:00:41.608981+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T06:00:41.608981+0000","last_undegraded":"2024-09-14T06:00:41.608981+0000","last_fullsized":"2024-09-14T06:00:41.608981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:45.965970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047912600000000002,"stat_sum":{"num_bytes":68265765,"num_objects":79,"num_object_clones":12,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":40,"num_read":3063,"num_read_kb":38618,"num_write":422,"num_write_kb":15815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":172,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.743191+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T06:00:40.743191+0000","last_peered":"2024-09-14T06:00:40.743191+0000","last_clean":"2024-09-14T06:00:40.743191+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T06:00:40.743191+0000","last_undegraded":"2024-09-14T06:00:40.743191+0000","last_fullsized":"2024-09-14T06:00:40.743191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"96'927","reported_seq":2654,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.050175+0000","last_change":"2024-09-14T05:59:08.281926+0000","last_active":"2024-09-14T06:00:41.050175+0000","last_peered":"2024-09-14T06:00:41.050175+0000","last_clean":"2024-09-14T06:00:41.050175+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T06:00:41.050175+0000","last_undegraded":"2024-09-14T06:00:41.050175+0000","last_fullsized":"2024-09-14T06:00:41.050175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:47.567426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096925799999999997,"stat_sum":{"num_bytes":24728497,"num_objects":82,"num_object_clones":10,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":47,"num_read":4787,"num_read_kb":20107,"num_write":1380,"num_write_kb":15105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.752270+0000","last_change":"2024-09-14T06:00:25.625653+0000","last_active":"2024-09-14T06:00:40.752270+0000","last_peered":"2024-09-14T06:00:40.752270+0000","last_clean":"2024-09-14T06:00:40.752270+0000","last_became_active":"2024-09-14T06:00:25.625192+0000","last_became_peered":"2024-09-14T06:00:25.625192+0000","last_unstale":"2024-09-14T06:00:40.752270+0000","last_undegraded":"2024-09-14T06:00:40.752270+0000","last_fullsized":"2024-09-14T06:00:40.752270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:36.805054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"99'433","reported_seq":2405,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:43.236997+0000","last_change":"2024-09-14T05:59:40.894081+0000","last_active":"2024-09-14T06:00:43.236997+0000","last_peered":"2024-09-14T06:00:43.236997+0000","last_clean":"2024-09-14T06:00:43.236997+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T06:00:43.236997+0000","last_undegraded":"2024-09-14T06:00:43.236997+0000","last_fullsized":"2024-09-14T06:00:43.236997+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:08.012059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39767518,"num_objects":80,"num_object_clones":12,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":38,"num_read":2723,"num_read_kb":23883,"num_write":422,"num_write_kb":10961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":170,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789070+0000","last_change":"2024-09-14T05:58:56.593338+0000","last_active":"2024-09-14T06:00:40.789070+0000","last_peered":"2024-09-14T06:00:40.789070+0000","last_clean":"2024-09-14T06:00:40.789070+0000","last_became_active":"2024-09-14T05:58:54.099699+0000","last_became_peered":"2024-09-14T05:58:54.099699+0000","last_unstale":"2024-09-14T06:00:40.789070+0000","last_undegraded":"2024-09-14T06:00:40.789070+0000","last_fullsized":"2024-09-14T06:00:40.789070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:40.481832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001022202,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"97'314","reported_seq":2209,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.922365+0000","last_change":"2024-09-14T05:59:08.298483+0000","last_active":"2024-09-14T06:00:40.922365+0000","last_peered":"2024-09-14T06:00:40.922365+0000","last_clean":"2024-09-14T06:00:40.922365+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T06:00:40.922365+0000","last_undegraded":"2024-09-14T06:00:40.922365+0000","last_fullsized":"2024-09-14T06:00:40.922365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:02.980942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011244670000000001,"stat_sum":{"num_bytes":17388833,"num_objects":67,"num_object_clones":9,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":35,"num_read":1842,"num_read_kb":21994,"num_write":347,"num_write_kb":9639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":171,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.743214+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T06:00:40.743214+0000","last_peered":"2024-09-14T06:00:40.743214+0000","last_clean":"2024-09-14T06:00:40.743214+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T06:00:40.743214+0000","last_undegraded":"2024-09-14T06:00:40.743214+0000","last_fullsized":"2024-09-14T06:00:40.743214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":270,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789093+0000","last_change":"2024-09-14T05:59:40.766729+0000","last_active":"2024-09-14T06:00:40.789093+0000","last_peered":"2024-09-14T06:00:40.789093+0000","last_clean":"2024-09-14T06:00:40.789093+0000","last_became_active":"2024-09-14T05:59:40.765914+0000","last_became_peered":"2024-09-14T05:59:40.765914+0000","last_unstale":"2024-09-14T06:00:40.789093+0000","last_undegraded":"2024-09-14T06:00:40.789093+0000","last_fullsized":"2024-09-14T06:00:40.789093+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:02.407639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"95'646","reported_seq":1921,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.058136+0000","last_change":"2024-09-14T05:59:08.298535+0000","last_active":"2024-09-14T06:00:41.058136+0000","last_peered":"2024-09-14T06:00:41.058136+0000","last_clean":"2024-09-14T06:00:41.058136+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T06:00:41.058136+0000","last_undegraded":"2024-09-14T06:00:41.058136+0000","last_fullsized":"2024-09-14T06:00:41.058136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:36.188811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085964400000000001,"stat_sum":{"num_bytes":33538526,"num_objects":78,"num_object_clones":9,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":39,"num_read":3108,"num_read_kb":6457,"num_write":857,"num_write_kb":4389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"95'315","reported_seq":4430,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.928840+0000","last_change":"2024-09-14T05:59:08.282238+0000","last_active":"2024-09-14T06:00:40.928840+0000","last_peered":"2024-09-14T06:00:40.928840+0000","last_clean":"2024-09-14T06:00:40.928840+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T06:00:40.928840+0000","last_undegraded":"2024-09-14T06:00:40.928840+0000","last_fullsized":"2024-09-14T06:00:40.928840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":315,"log_dups_size":0,"ondisk_log_size":315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:38.558086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052576800000000003,"stat_sum":{"num_bytes":39045175,"num_objects":67,"num_object_clones":6,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":32,"num_read":4366,"num_read_kb":34279,"num_write":311,"num_write_kb":27449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"97'565","reported_seq":2187,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.054293+0000","last_change":"2024-09-14T05:59:08.303592+0000","last_active":"2024-09-14T06:00:41.054293+0000","last_peered":"2024-09-14T06:00:41.054293+0000","last_clean":"2024-09-14T06:00:41.054293+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T06:00:41.054293+0000","last_undegraded":"2024-09-14T06:00:41.054293+0000","last_fullsized":"2024-09-14T06:00:41.054293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:18.641775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00035228000000000001,"stat_sum":{"num_bytes":34977382,"num_objects":82,"num_object_clones":16,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":42,"num_read":3046,"num_read_kb":12200,"num_write":683,"num_write_kb":6045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"96'799","reported_seq":3278,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.055165+0000","last_change":"2024-09-14T05:59:40.885530+0000","last_active":"2024-09-14T06:00:41.055165+0000","last_peered":"2024-09-14T06:00:41.055165+0000","last_clean":"2024-09-14T06:00:41.055165+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T06:00:41.055165+0000","last_undegraded":"2024-09-14T06:00:41.055165+0000","last_fullsized":"2024-09-14T06:00:41.055165+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:40.216253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083256200000000002,"stat_sum":{"num_bytes":17577951,"num_objects":66,"num_object_clones":9,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":33,"num_read":5489,"num_read_kb":26813,"num_write":1225,"num_write_kb":12847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"97'501","reported_seq":4723,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.056922+0000","last_change":"2024-09-14T05:59:08.294210+0000","last_active":"2024-09-14T06:00:41.056922+0000","last_peered":"2024-09-14T06:00:41.056922+0000","last_clean":"2024-09-14T06:00:41.056922+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T06:00:41.056922+0000","last_undegraded":"2024-09-14T06:00:41.056922+0000","last_fullsized":"2024-09-14T06:00:41.056922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:38:06.478409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013095159999999999,"stat_sum":{"num_bytes":41881017,"num_objects":92,"num_object_clones":16,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":51,"num_read":5766,"num_read_kb":23374,"num_write":452,"num_write_kb":12831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"93'352","reported_seq":3101,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789391+0000","last_change":"2024-09-14T05:59:08.371003+0000","last_active":"2024-09-14T06:00:40.789391+0000","last_peered":"2024-09-14T06:00:40.789391+0000","last_clean":"2024-09-14T06:00:40.789391+0000","last_became_active":"2024-09-14T05:59:06.300360+0000","last_became_peered":"2024-09-14T05:59:06.300360+0000","last_unstale":"2024-09-14T06:00:40.789391+0000","last_undegraded":"2024-09-14T06:00:40.789391+0000","last_fullsized":"2024-09-14T06:00:40.789391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:10.608706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022610920000000001,"stat_sum":{"num_bytes":21979692,"num_objects":70,"num_object_clones":10,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":40,"num_read":3513,"num_read_kb":21590,"num_write":366,"num_write_kb":11964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"97'484","reported_seq":3944,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.202749+0000","last_change":"2024-09-14T05:59:08.370421+0000","last_active":"2024-09-14T06:00:41.202749+0000","last_peered":"2024-09-14T06:00:41.202749+0000","last_clean":"2024-09-14T06:00:41.202749+0000","last_became_active":"2024-09-14T05:59:06.308504+0000","last_became_peered":"2024-09-14T05:59:06.308504+0000","last_unstale":"2024-09-14T06:00:41.202749+0000","last_undegraded":"2024-09-14T06:00:41.202749+0000","last_fullsized":"2024-09-14T06:00:41.202749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:25.247897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001798163,"stat_sum":{"num_bytes":25897479,"num_objects":93,"num_object_clones":17,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":42,"num_read":5199,"num_read_kb":24114,"num_write":486,"num_write_kb":11294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"97'515","reported_seq":5827,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:40.789795+0000","last_change":"2024-09-14T05:59:08.370940+0000","last_active":"2024-09-14T06:00:40.789795+0000","last_peered":"2024-09-14T06:00:40.789795+0000","last_clean":"2024-09-14T06:00:40.789795+0000","last_became_active":"2024-09-14T05:59:06.302019+0000","last_became_peered":"2024-09-14T05:59:06.302019+0000","last_unstale":"2024-09-14T06:00:40.789795+0000","last_undegraded":"2024-09-14T06:00:40.789795+0000","last_fullsized":"2024-09-14T06:00:40.789795+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:06.070256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022861499999999998,"stat_sum":{"num_bytes":29797455,"num_objects":73,"num_object_clones":6,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":36,"num_read":6844,"num_read_kb":14371,"num_write":588,"num_write_kb":6253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"97'814","reported_seq":3773,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.518589+0000","last_change":"2024-09-14T05:59:43.767147+0000","last_active":"2024-09-14T06:00:41.518589+0000","last_peered":"2024-09-14T06:00:41.518589+0000","last_clean":"2024-09-14T06:00:41.518589+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T06:00:41.518589+0000","last_undegraded":"2024-09-14T06:00:41.518589+0000","last_fullsized":"2024-09-14T06:00:41.518589+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:58.724976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047002699999999998,"stat_sum":{"num_bytes":46655135,"num_objects":102,"num_object_clones":16,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":56,"num_read":6050,"num_read_kb":18836,"num_write":1103,"num_write_kb":11758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"97'475","reported_seq":5797,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.056162+0000","last_change":"2024-09-14T05:59:08.369705+0000","last_active":"2024-09-14T06:00:41.056162+0000","last_peered":"2024-09-14T06:00:41.056162+0000","last_clean":"2024-09-14T06:00:41.056162+0000","last_became_active":"2024-09-14T05:59:06.311716+0000","last_became_peered":"2024-09-14T05:59:06.311716+0000","last_unstale":"2024-09-14T06:00:41.056162+0000","last_undegraded":"2024-09-14T06:00:41.056162+0000","last_fullsized":"2024-09-14T06:00:41.056162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:54.305085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001347256,"stat_sum":{"num_bytes":48540760,"num_objects":84,"num_object_clones":10,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":44,"num_read":6068,"num_read_kb":33997,"num_write":567,"num_write_kb":30994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"99'600","reported_seq":5323,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-14T06:00:42.857395+0000","last_change":"2024-09-14T05:59:43.765786+0000","last_active":"2024-09-14T06:00:42.857395+0000","last_peered":"2024-09-14T06:00:42.857395+0000","last_clean":"2024-09-14T06:00:42.857395+0000","last_became_active":"2024-09-14T05:59:43.763983+0000","last_became_peered":"2024-09-14T05:59:43.763983+0000","last_unstale":"2024-09-14T06:00:42.857395+0000","last_undegraded":"2024-09-14T06:00:42.857395+0000","last_fullsized":"2024-09-14T06:00:42.857395+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:52.456491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26832145,"num_objects":78,"num_object_clones":11,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":45,"num_read":6250,"num_read_kb":28668,"num_write":633,"num_write_kb":10819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":767927,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"97'364","reported_seq":5675,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-14T06:00:41.625112+0000","last_change":"2024-09-14T05:59:08.369685+0000","last_active":"2024-09-14T06:00:41.625112+0000","last_peered":"2024-09-14T06:00:41.625112+0000","last_clean":"2024-09-14T06:00:41.625112+0000","last_became_active":"2024-09-14T05:59:06.302125+0000","last_became_peered":"2024-09-14T05:59:06.302125+0000","last_unstale":"2024-09-14T06:00:41.625112+0000","last_undegraded":"2024-09-14T06:00:41.625112+0000","last_fullsized":"2024-09-14T06:00:41.625112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:18.895000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012750369999999999,"stat_sum":{"num_bytes":64010946,"num_objects":91,"num_object_clones":20,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":38,"num_read":5307,"num_read_kb":30452,"num_write":386,"num_write_kb":15118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1135899737,"num_objects":2491,"num_object_clones":369,"num_object_copies":4982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2491,"num_whiteouts":1273,"num_read":155369,"num_read_kb":804732,"num_write":22337,"num_write_kb":434851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":433,"num_bytes_recovered":10220769,"num_keys_recovered":69,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":465973248,"data_stored":602227992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18041,"ondisk_log_size":18041,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509466,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60576,"kb_used_data":25232,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94311264,"statfs":{"total":96636764160,"available":96574734336,"internally_reserved":0,"allocated":25837568,"data_stored":30231785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495630,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94748,"kb_used_data":66744,"kb_used_omap":4,"kb_used_meta":27963,"kb_avail":94277092,"statfs":{"total":96636764160,"available":96539742208,"internally_reserved":0,"allocated":68345856,"data_stored":92145896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":28634800},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":129560,"kb_used_data":80316,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94242280,"statfs":{"total":96636764160,"available":96504094720,"internally_reserved":0,"allocated":82243584,"data_stored":104646869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51340,"kb_used_data":15988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94320500,"statfs":{"total":96636764160,"available":96584192000,"internally_reserved":0,"allocated":16371712,"data_stored":23235571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109456,"kb_used_data":60216,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94262384,"statfs":{"total":96636764160,"available":96524681216,"internally_reserved":0,"allocated":61661184,"data_stored":77918606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151484,"kb_used_data":98088,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94220356,"statfs":{"total":96636764160,"available":96481644544,"internally_reserved":0,"allocated":100442112,"data_stored":130992204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116840,"kb_used_data":67600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94255000,"statfs":{"total":96636764160,"available":96517120000,"internally_reserved":0,"allocated":69222400,"data_stored":84894281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92456,"kb_used_data":47384,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94279384,"statfs":{"total":96636764160,"available":96542089216,"internally_reserved":0,"allocated":48521216,"data_stored":59891689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":66584576,"data_stored":91016817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":47374336,"data_stored":59364643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24686592,"data_stored":29702756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":68112384,"data_stored":84399978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":100356096,"data_stored":131514877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":62050304,"data_stored":78924816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15228928,"data_stored":22708544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81580032,"data_stored":104595561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T06:00:46.501 INFO:tasks.thrashosds.thrasher:Setting 1.0 to [4, 1] 2024-09-14T06:00:46.501 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '1.0', '4', '1'] 2024-09-14T06:00:46.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 1.0 4 1 2024-09-14T06:00:46.516 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:46.516 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:46.516 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:46.516 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:46.530 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:00:46.547 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:46.545+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:46.648 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:46.646+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:46.690 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:46.690 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:46.690 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:46.690 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:46.690 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:46.704 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:00:46.790 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:46.790+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:46.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T06:00:46.871 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:46.868+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:46.874 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:46.874 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:46.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:46.874 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:46.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.874 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114752 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1458176~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.875 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:46.875 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5157363630000003, 2024-09-14T06:00:46.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11122652, 2024-09-14T06:00:46.875 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.875 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.875 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.875 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.876 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.876 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.876 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114752 2024-09-14T06:00:46.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.876 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:46.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:46.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:46.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.51e-07 2024-09-14T06:00:46.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357638+0000", 2024-09-14T06:00:46.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7540000000000001e-06 2024-09-14T06:00:46.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357643+0000", 2024-09-14T06:00:46.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1150000000000002e-06 2024-09-14T06:00:46.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357647+0000", 2024-09-14T06:00:46.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7979999999999999e-06 2024-09-14T06:00:46.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468136+0000", 2024-09-14T06:00:46.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.110488747 2024-09-14T06:00:46.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468353+0000", 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000217166 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468862+0000", 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050938899999999996 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.879 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114753 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1564672~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.880 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:46.880 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5156963000000001, 2024-09-14T06:00:46.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111972162, 2024-09-14T06:00:46.880 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.880 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.880 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.880 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.880 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.880 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.880 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114753 2024-09-14T06:00:46.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.880 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6599999999999996e-07 2024-09-14T06:00:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357678+0000", 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.807e-06 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357683+0000", 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.933e-06 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357687+0000", 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8469999999999998e-06 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468941+0000", 2024-09-14T06:00:46.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111254009 2024-09-14T06:00:46.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469159+0000", 2024-09-14T06:00:46.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021768800000000001 2024-09-14T06:00:46.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469648+0000", 2024-09-14T06:00:46.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048931199999999999 2024-09-14T06:00:46.883 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.884 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.884 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.884 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114754 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1671168~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.884 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:46.884 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5156566270000003, 2024-09-14T06:00:46.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.112607016, 2024-09-14T06:00:46.884 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.884 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.884 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.884 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.885 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.885 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.885 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114754 2024-09-14T06:00:46.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.885 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:46.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:46.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357716+0000", 2024-09-14T06:00:46.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-14T06:00:46.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357718+0000", 2024-09-14T06:00:46.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5910000000000001e-06 2024-09-14T06:00:46.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357725+0000", 2024-09-14T06:00:46.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9399999999999996e-06 2024-09-14T06:00:46.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357729+0000", 2024-09-14T06:00:46.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0439999999999997e-06 2024-09-14T06:00:46.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469752+0000", 2024-09-14T06:00:46.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11202385400000001 2024-09-14T06:00:46.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469889+0000", 2024-09-14T06:00:46.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136704 2024-09-14T06:00:46.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470322+0000", 2024-09-14T06:00:46.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000433337 2024-09-14T06:00:46.888 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.888 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.888 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.889 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114771 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 98304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.889 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:46.889 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5156155200000008, 2024-09-14T06:00:46.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11267808, 2024-09-14T06:00:46.890 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.890 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.890 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.890 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.890 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.890 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.890 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114771 2024-09-14T06:00:46.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.890 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:46.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:46.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:46.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.37e-07 2024-09-14T06:00:46.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357759+0000", 2024-09-14T06:00:46.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5650000000000001e-06 2024-09-14T06:00:46.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357764+0000", 2024-09-14T06:00:46.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T06:00:46.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357768+0000", 2024-09-14T06:00:46.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9580000000000001e-06 2024-09-14T06:00:46.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469739+0000", 2024-09-14T06:00:46.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111971591 2024-09-14T06:00:46.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469951+0000", 2024-09-14T06:00:46.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021185999999999999 2024-09-14T06:00:46.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470435+0000", 2024-09-14T06:00:46.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048335499999999998 2024-09-14T06:00:46.894 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.894 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.894 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.894 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114772 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.894 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:46.894 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5155753040000004, 2024-09-14T06:00:46.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11329244500000001, 2024-09-14T06:00:46.894 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.895 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.895 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.895 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.895 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.895 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.895 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114772 2024-09-14T06:00:46.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.895 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:46.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3099999999999998e-07 2024-09-14T06:00:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357799+0000", 2024-09-14T06:00:46.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0770000000000002e-06 2024-09-14T06:00:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357805+0000", 2024-09-14T06:00:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3329999999999996e-06 2024-09-14T06:00:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357816+0000", 2024-09-14T06:00:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0869999999999999e-05 2024-09-14T06:00:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470507+0000", 2024-09-14T06:00:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.112691635 2024-09-14T06:00:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470648+0000", 2024-09-14T06:00:46.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014075000000000001 2024-09-14T06:00:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471089+0000", 2024-09-14T06:00:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000441249 2024-09-14T06:00:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114773 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 311296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:46.899 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5155297579999996, 2024-09-14T06:00:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114111303, 2024-09-14T06:00:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114773 2024-09-14T06:00:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357843+0000", 2024-09-14T06:00:46.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4499999999999997e-07 2024-09-14T06:00:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357844+0000", 2024-09-14T06:00:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.612e-06 2024-09-14T06:00:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357851+0000", 2024-09-14T06:00:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7900000000000002e-06 2024-09-14T06:00:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357855+0000", 2024-09-14T06:00:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9310000000000001e-06 2024-09-14T06:00:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471187+0000", 2024-09-14T06:00:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.113332222 2024-09-14T06:00:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471425+0000", 2024-09-14T06:00:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000237412 2024-09-14T06:00:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471954+0000", 2024-09-14T06:00:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00052879100000000003 2024-09-14T06:00:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114774 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 417792~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5154887319999997, 2024-09-14T06:00:46.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114690902, 2024-09-14T06:00:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114774 2024-09-14T06:00:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357884+0000", 2024-09-14T06:00:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.37e-07 2024-09-14T06:00:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357886+0000", 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7010000000000001e-06 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357891+0000", 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357896+0000", 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5999999999999997e-06 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472030+0000", 2024-09-14T06:00:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11413328 2024-09-14T06:00:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472157+0000", 2024-09-14T06:00:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012693900000000001 2024-09-14T06:00:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472574+0000", 2024-09-14T06:00:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041773100000000002 2024-09-14T06:00:46.908 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.909 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.909 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.909 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114775 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 524288~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.909 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:46.909 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5154490640000002, 2024-09-14T06:00:46.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.115518357, 2024-09-14T06:00:46.909 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.909 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.909 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.910 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.910 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.910 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.910 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114775 2024-09-14T06:00:46.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.910 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:46.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:46.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357924+0000", 2024-09-14T06:00:46.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3799999999999997e-07 2024-09-14T06:00:46.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357928+0000", 2024-09-14T06:00:46.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7700000000000001e-06 2024-09-14T06:00:46.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357934+0000", 2024-09-14T06:00:46.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6420000000000004e-06 2024-09-14T06:00:46.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357938+0000", 2024-09-14T06:00:46.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1899999999999997e-06 2024-09-14T06:00:46.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472667+0000", 2024-09-14T06:00:46.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114728409 2024-09-14T06:00:46.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472901+0000", 2024-09-14T06:00:46.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023484100000000001 2024-09-14T06:00:46.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473441+0000", 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053996700000000003 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114776 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 630784~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5154091679999997, 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11610183, 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.915 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114776 2024-09-14T06:00:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:46.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357964+0000", 2024-09-14T06:00:46.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7700000000000004e-07 2024-09-14T06:00:46.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357965+0000", 2024-09-14T06:00:46.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.761e-06 2024-09-14T06:00:46.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357970+0000", 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1429999999999997e-06 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357974+0000", 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8879999999999999e-06 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473514+0000", 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11554007500000001 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473641+0000", 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000127088 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474065+0000", 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00042329800000000001 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114777 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 737280~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:46.919 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5153699930000002, 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11697975200000001, 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114777 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:46.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358003+0000", 2024-09-14T06:00:46.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-14T06:00:46.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358004+0000", 2024-09-14T06:00:46.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6950000000000001e-06 2024-09-14T06:00:46.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358010+0000", 2024-09-14T06:00:46.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2410000000000003e-06 2024-09-14T06:00:46.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358014+0000", 2024-09-14T06:00:46.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9380000000000002e-06 2024-09-14T06:00:46.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474156+0000", 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.116142597 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474386+0000", 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023008999999999999 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474982+0000", 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059564500000000001 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.923 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.924 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114778 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 843776~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.924 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:46.924 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.51532965, 2024-09-14T06:00:46.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11749908100000001, 2024-09-14T06:00:46.924 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.924 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.924 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.924 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.924 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.924 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.924 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114778 2024-09-14T06:00:46.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.925 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:46.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:46.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358043+0000", 2024-09-14T06:00:46.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3399999999999999e-07 2024-09-14T06:00:46.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358045+0000", 2024-09-14T06:00:46.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8789999999999999e-06 2024-09-14T06:00:46.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358052+0000", 2024-09-14T06:00:46.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.951e-06 2024-09-14T06:00:46.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358056+0000", 2024-09-14T06:00:46.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.121e-06 2024-09-14T06:00:46.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475018+0000", 2024-09-14T06:00:46.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11696224199999999 2024-09-14T06:00:46.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475141+0000", 2024-09-14T06:00:46.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012285099999999999 2024-09-14T06:00:46.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475542+0000", 2024-09-14T06:00:46.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00040050300000000002 2024-09-14T06:00:46.928 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.928 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.928 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.929 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114779 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 950272~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.929 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:46.929 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5152870509999996, 2024-09-14T06:00:46.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.118289098, 2024-09-14T06:00:46.929 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.929 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.929 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.929 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.929 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.929 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.929 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114779 2024-09-14T06:00:46.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.930 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:46.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:46.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358086+0000", 2024-09-14T06:00:46.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5300000000000004e-07 2024-09-14T06:00:46.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358087+0000", 2024-09-14T06:00:46.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.623e-06 2024-09-14T06:00:46.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358093+0000", 2024-09-14T06:00:46.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9510000000000003e-06 2024-09-14T06:00:46.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358097+0000", 2024-09-14T06:00:46.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1819999999999999e-06 2024-09-14T06:00:46.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475637+0000", 2024-09-14T06:00:46.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11753928600000001 2024-09-14T06:00:46.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475862+0000", 2024-09-14T06:00:46.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225336 2024-09-14T06:00:46.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476374+0000", 2024-09-14T06:00:46.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000512167 2024-09-14T06:00:46.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.933 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.933 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.933 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114780 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1056768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.933 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:46.933 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5152460269999999, 2024-09-14T06:00:46.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.119083513, 2024-09-14T06:00:46.934 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.934 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.934 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.934 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.934 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.934 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.934 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114780 2024-09-14T06:00:46.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.934 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:46.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:46.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358127+0000", 2024-09-14T06:00:46.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.44e-07 2024-09-14T06:00:46.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358128+0000", 2024-09-14T06:00:46.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.714e-06 2024-09-14T06:00:46.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358135+0000", 2024-09-14T06:00:46.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-09-14T06:00:46.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358140+0000", 2024-09-14T06:00:46.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1969999999999998e-06 2024-09-14T06:00:46.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476456+0000", 2024-09-14T06:00:46.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.118316717 2024-09-14T06:00:46.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476674+0000", 2024-09-14T06:00:46.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021775200000000001 2024-09-14T06:00:46.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477210+0000", 2024-09-14T06:00:46.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053548400000000003 2024-09-14T06:00:46.938 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.938 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.938 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.938 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114781 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1163264~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.938 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:46.938 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5152009060000005, 2024-09-14T06:00:46.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11988966700000001, 2024-09-14T06:00:46.938 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.938 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.938 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114781 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:46.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358172+0000", 2024-09-14T06:00:46.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.44e-07 2024-09-14T06:00:46.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358174+0000", 2024-09-14T06:00:46.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9920000000000002e-06 2024-09-14T06:00:46.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358179+0000", 2024-09-14T06:00:46.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.288e-06 2024-09-14T06:00:46.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358183+0000", 2024-09-14T06:00:46.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0489999999999997e-06 2024-09-14T06:00:46.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477294+0000", 2024-09-14T06:00:46.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11911132000000001 2024-09-14T06:00:46.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477516+0000", 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022208500000000001 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478061+0000", 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00054438900000000005 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114782 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1269760~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.942 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5151823390000008, 2024-09-14T06:00:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.120723238, 2024-09-14T06:00:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114782 2024-09-14T06:00:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:46.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:46.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:46.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4099999999999999e-07 2024-09-14T06:00:46.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358192+0000", 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.559e-06 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358197+0000", 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6789999999999996e-06 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358202+0000", 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4779999999999999e-06 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478140+0000", 2024-09-14T06:00:46.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11993833600000001 2024-09-14T06:00:46.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478358+0000", 2024-09-14T06:00:46.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021785700000000001 2024-09-14T06:00:46.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478913+0000", 2024-09-14T06:00:46.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055478799999999996 2024-09-14T06:00:46.946 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114783 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1376256~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5151639939999999, 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121464831, 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.947 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114783 2024-09-14T06:00:46.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.948 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:46.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:46.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:46.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4499999999999998e-07 2024-09-14T06:00:46.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358210+0000", 2024-09-14T06:00:46.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5880000000000001e-06 2024-09-14T06:00:46.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358214+0000", 2024-09-14T06:00:46.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3850000000000004e-06 2024-09-14T06:00:46.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358218+0000", 2024-09-14T06:00:46.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7799999999999998e-06 2024-09-14T06:00:46.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479024+0000", 2024-09-14T06:00:46.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.120805364 2024-09-14T06:00:46.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479177+0000", 2024-09-14T06:00:46.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153642 2024-09-14T06:00:46.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479673+0000", 2024-09-14T06:00:46.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049572699999999995 2024-09-14T06:00:46.951 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.951 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.951 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.951 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114784 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1482752~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.951 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:46.951 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5151493360000003, 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.122316759, 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114784 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:46.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:46.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2399999999999999e-07 2024-09-14T06:00:46.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358225+0000", 2024-09-14T06:00:46.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5570000000000001e-06 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358229+0000", 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5589999999999999e-06 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358233+0000", 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7270000000000001e-06 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479769+0000", 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12153594299999999 2024-09-14T06:00:46.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480000+0000", 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000230967 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480540+0000", 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053968199999999999 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.955 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114785 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1589248~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.956 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:46.956 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5151331450000001, 2024-09-14T06:00:46.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123154237, 2024-09-14T06:00:46.956 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.956 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.956 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.956 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.956 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.956 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.956 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114785 2024-09-14T06:00:46.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.956 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:46.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:46.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:46.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3799999999999998e-07 2024-09-14T06:00:46.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358241+0000", 2024-09-14T06:00:46.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.457e-06 2024-09-14T06:00:46.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358245+0000", 2024-09-14T06:00:46.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.42e-06 2024-09-14T06:00:46.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358249+0000", 2024-09-14T06:00:46.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7740000000000002e-06 2024-09-14T06:00:46.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480626+0000", 2024-09-14T06:00:46.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12237743600000001 2024-09-14T06:00:46.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480844+0000", 2024-09-14T06:00:46.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021792299999999999 2024-09-14T06:00:46.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481393+0000", 2024-09-14T06:00:46.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000548889 2024-09-14T06:00:46.960 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.960 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.960 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.960 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114786 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1695744~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.960 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:46.960 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5151184410000003, 2024-09-14T06:00:46.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123995568, 2024-09-14T06:00:46.960 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.960 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.960 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:46.960 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.960 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114786 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:46.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.27e-07 2024-09-14T06:00:46.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358256+0000", 2024-09-14T06:00:46.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5460000000000001e-06 2024-09-14T06:00:46.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358260+0000", 2024-09-14T06:00:46.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3819999999999997e-06 2024-09-14T06:00:46.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358264+0000", 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7469999999999999e-06 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481473+0000", 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123209244 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481686+0000", 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000212957 2024-09-14T06:00:46.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482249+0000", 2024-09-14T06:00:46.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00056336500000000002 2024-09-14T06:00:46.964 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.964 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.964 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.964 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114867 3.15 3:aea12e8e:::rbd_data.1127cb09e343.000000000000000b:head [stat,truncate 737280] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:46.964 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:46.964 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.5151038559999996, 2024-09-14T06:00:46.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12722582099999999, 2024-09-14T06:00:46.964 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114867 2024-09-14T06:00:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358269+0000", 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4799999999999999e-07 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358274+0000", 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.237e-06 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358279+0000", 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7990000000000001e-06 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358284+0000", 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1900000000000003e-06 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482355+0000", 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.124070718 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:46.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482496+0000", 2024-09-14T06:00:46.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014162699999999999 2024-09-14T06:00:46.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 3", 2024-09-14T06:00:46.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482722+0000", 2024-09-14T06:00:46.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225622 2024-09-14T06:00:46.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:46.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.484427+0000", 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001704929 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485332+0000", 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00090576600000000001 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485429+0000", 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6540999999999996e-05 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:46.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485494+0000", 2024-09-14T06:00:46.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5043999999999996e-05 2024-09-14T06:00:46.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.970 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:46.970 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:46.970 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:46.971 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:00:46.972 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:46.970+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:47.073 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:47.070+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:00:47.102 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:47.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:00:47.174 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:47.168+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:47.235 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:47.235 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:47.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:00:47.275 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:47.274+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:47.376 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:47.372+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:47.392 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:00:47.416 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:47.416 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:00:47.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:00:47.416 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119850 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 3571712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:00:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6636855329999998, 2024-09-14T06:00:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050424731, 2024-09-14T06:00:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119850 2024-09-14T06:00:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:00:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6100000000000001e-07 2024-09-14T06:00:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751247+0000", 2024-09-14T06:00:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5059999999999998e-06 2024-09-14T06:00:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751255+0000", 2024-09-14T06:00:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3080000000000008e-06 2024-09-14T06:00:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751262+0000", 2024-09-14T06:00:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1060000000000002e-06 2024-09-14T06:00:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801559+0000", 2024-09-14T06:00:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050297043 2024-09-14T06:00:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801614+0000", 2024-09-14T06:00:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5028999999999998e-05 2024-09-14T06:00:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801668+0000", 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4178000000000002e-05 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119851 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 3620864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6636568760000001, 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050528479000000001, 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119851 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:00:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752502+0000", 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012294529999999999 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752508+0000", 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8780000000000003e-06 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752522+0000", 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4405e-05 2024-09-14T06:00:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752532+0000", 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6739999999999992e-06 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801702+0000", 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049169996000000001 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801744+0000", 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2789e-05 2024-09-14T06:00:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801801+0000", 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6283999999999998e-05 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119877 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4898816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6589274419999995, 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050416282999999999, 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119877 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:00:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6300000000000005e-07 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756005+0000", 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7350000000000001e-06 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756012+0000", 2024-09-14T06:00:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8990000000000004e-06 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756017+0000", 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.023e-06 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806256+0000", 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050239355999999999 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806331+0000", 2024-09-14T06:00:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4800000000000002e-05 2024-09-14T06:00:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806418+0000", 2024-09-14T06:00:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6907e-05 2024-09-14T06:00:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119878 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4947968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:00:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6589025959999999, 2024-09-14T06:00:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050582539000000003, 2024-09-14T06:00:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119878 2024-09-14T06:00:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:00:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:00:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756027+0000", 2024-09-14T06:00:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1399999999999997e-07 2024-09-14T06:00:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756029+0000", 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3420000000000002e-06 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756036+0000", 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9550000000000003e-06 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756041+0000", 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2669999999999997e-06 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806448+0000", 2024-09-14T06:00:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050407037000000002 2024-09-14T06:00:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806526+0000", 2024-09-14T06:00:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7119000000000005e-05 2024-09-14T06:00:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806609+0000", 2024-09-14T06:00:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3405000000000005e-05 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119879 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4997120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6588801159999997, 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.05075727, 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119879 2024-09-14T06:00:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:00:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:00:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:00:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9400000000000001e-07 2024-09-14T06:00:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756058+0000", 2024-09-14T06:00:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5199999999999997e-06 2024-09-14T06:00:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756065+0000", 2024-09-14T06:00:47.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9800000000000001e-06 2024-09-14T06:00:47.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756070+0000", 2024-09-14T06:00:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2360000000000004e-06 2024-09-14T06:00:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806639+0000", 2024-09-14T06:00:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050568702 2024-09-14T06:00:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806714+0000", 2024-09-14T06:00:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4825000000000003e-05 2024-09-14T06:00:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806806+0000", 2024-09-14T06:00:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2613000000000003e-05 2024-09-14T06:00:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119880 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5046272~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:00:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6588254170000001, 2024-09-14T06:00:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050918568999999997, 2024-09-14T06:00:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119880 2024-09-14T06:00:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:00:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:00:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:00:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:00:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756107+0000", 2024-09-14T06:00:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8159999999999998e-06 2024-09-14T06:00:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756116+0000", 2024-09-14T06:00:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4980000000000006e-06 2024-09-14T06:00:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756122+0000", 2024-09-14T06:00:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8809999999999998e-06 2024-09-14T06:00:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806841+0000", 2024-09-14T06:00:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050718907000000001 2024-09-14T06:00:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806927+0000", 2024-09-14T06:00:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5908999999999994e-05 2024-09-14T06:00:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807022+0000", 2024-09-14T06:00:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4901000000000005e-05 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119881 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5095424~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6587947940000003, 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051097946999999998, 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119881 2024-09-14T06:00:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:00:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:00:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756135+0000", 2024-09-14T06:00:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.51e-07 2024-09-14T06:00:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756137+0000", 2024-09-14T06:00:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2230000000000001e-06 2024-09-14T06:00:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756145+0000", 2024-09-14T06:00:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6629999999999993e-06 2024-09-14T06:00:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756150+0000", 2024-09-14T06:00:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9150000000000004e-06 2024-09-14T06:00:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807054+0000", 2024-09-14T06:00:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050904855999999998 2024-09-14T06:00:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807137+0000", 2024-09-14T06:00:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2248000000000003e-05 2024-09-14T06:00:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807232+0000", 2024-09-14T06:00:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5490999999999998e-05 2024-09-14T06:00:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119882 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5144576~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:00:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6587709180000001, 2024-09-14T06:00:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051297745999999998, 2024-09-14T06:00:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119882 2024-09-14T06:00:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:00:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756159+0000", 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4299999999999998e-07 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756161+0000", 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4959999999999999e-06 2024-09-14T06:00:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756170+0000", 2024-09-14T06:00:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1779999999999992e-06 2024-09-14T06:00:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756176+0000", 2024-09-14T06:00:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0090000000000004e-06 2024-09-14T06:00:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807264+0000", 2024-09-14T06:00:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051087948000000001 2024-09-14T06:00:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807353+0000", 2024-09-14T06:00:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8919999999999996e-05 2024-09-14T06:00:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807456+0000", 2024-09-14T06:00:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010275199999999999 2024-09-14T06:00:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119883 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5193728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:00:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6587440650000005, 2024-09-14T06:00:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051484553000000002, 2024-09-14T06:00:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119883 2024-09-14T06:00:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:00:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:00:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8699999999999995e-07 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756188+0000", 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4820000000000001e-06 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756195+0000", 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.545e-06 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756200+0000", 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.045e-06 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807487+0000", 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051287228999999997 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807572+0000", 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5303999999999995e-05 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807670+0000", 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7460999999999994e-05 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119884 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5242880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6587035759999997, 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051672403999999998, 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119884 2024-09-14T06:00:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:00:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:00:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756226+0000", 2024-09-14T06:00:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7899999999999998e-07 2024-09-14T06:00:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756229+0000", 2024-09-14T06:00:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9919999999999999e-06 2024-09-14T06:00:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756237+0000", 2024-09-14T06:00:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1280000000000008e-06 2024-09-14T06:00:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756244+0000", 2024-09-14T06:00:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7519999999999999e-06 2024-09-14T06:00:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807726+0000", 2024-09-14T06:00:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051482344999999999 2024-09-14T06:00:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807808+0000", 2024-09-14T06:00:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1845e-05 2024-09-14T06:00:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807898+0000", 2024-09-14T06:00:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9662999999999999e-05 2024-09-14T06:00:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119885 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5292032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:00:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6586751709999996, 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051858125999999997, 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119885 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759822+0000", 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035676610000000002 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759831+0000", 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2329999999999995e-06 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759842+0000", 2024-09-14T06:00:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0954999999999999e-05 2024-09-14T06:00:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759851+0000", 2024-09-14T06:00:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1770000000000004e-06 2024-09-14T06:00:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807942+0000", 2024-09-14T06:00:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048091438 2024-09-14T06:00:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.808027+0000", 2024-09-14T06:00:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4227999999999994e-05 2024-09-14T06:00:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.808112+0000", 2024-09-14T06:00:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5433999999999996e-05 2024-09-14T06:00:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119897 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5881856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:00:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6548706639999997, 2024-09-14T06:00:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050603113999999998, 2024-09-14T06:00:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119897 2024-09-14T06:00:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:00:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:00:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760059+0000", 2024-09-14T06:00:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0800000000000001e-07 2024-09-14T06:00:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760060+0000", 2024-09-14T06:00:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4050000000000001e-06 2024-09-14T06:00:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760063+0000", 2024-09-14T06:00:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2320000000000001e-06 2024-09-14T06:00:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760066+0000", 2024-09-14T06:00:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.74e-06 2024-09-14T06:00:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810454+0000", 2024-09-14T06:00:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050388355000000003 2024-09-14T06:00:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810550+0000", 2024-09-14T06:00:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5441999999999999e-05 2024-09-14T06:00:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810662+0000", 2024-09-14T06:00:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011173199999999999 2024-09-14T06:00:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119898 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5931008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:00:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6548593250000003, 2024-09-14T06:00:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050800631999999998, 2024-09-14T06:00:47.471 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.471 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.471 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.471 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.471 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.472 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.472 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119898 2024-09-14T06:00:47.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.472 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.472 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.472 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:00:47.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:00:47.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:00:47.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0900000000000001e-07 2024-09-14T06:00:47.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760071+0000", 2024-09-14T06:00:47.476 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0899999999999999e-06 2024-09-14T06:00:47.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.476 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.476 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.476 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760074+0000", 2024-09-14T06:00:47.476 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1470000000000001e-06 2024-09-14T06:00:47.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.477 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.477 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.477 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760077+0000", 2024-09-14T06:00:47.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0170000000000001e-06 2024-09-14T06:00:47.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.478 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810704+0000", 2024-09-14T06:00:47.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050626811000000001 2024-09-14T06:00:47.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.479 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.479 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810779+0000", 2024-09-14T06:00:47.479 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4762e-05 2024-09-14T06:00:47.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.480 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.480 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.480 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810870+0000", 2024-09-14T06:00:47.480 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1595999999999995e-05 2024-09-14T06:00:47.480 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.481 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.481 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.481 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.481 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119899 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5980160~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.482 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:00:47.482 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6548483110000003, 2024-09-14T06:00:47.482 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051034903, 2024-09-14T06:00:47.482 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.482 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.482 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.483 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.483 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.483 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.483 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119899 2024-09-14T06:00:47.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.484 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.484 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.484 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.484 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:00:47.484 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.485 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.485 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.485 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:00:47.485 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.486 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.486 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.486 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:00:47.486 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.34e-07 2024-09-14T06:00:47.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.486 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.487 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.487 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760082+0000", 2024-09-14T06:00:47.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4190000000000001e-06 2024-09-14T06:00:47.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.487 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.487 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760086+0000", 2024-09-14T06:00:47.488 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2629999999999999e-06 2024-09-14T06:00:47.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760088+0000", 2024-09-14T06:00:47.489 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5150000000000001e-06 2024-09-14T06:00:47.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.489 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.489 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810919+0000", 2024-09-14T06:00:47.490 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050831111999999998 2024-09-14T06:00:47.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.490 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.490 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811011+0000", 2024-09-14T06:00:47.490 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1339000000000001e-05 2024-09-14T06:00:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811116+0000", 2024-09-14T06:00:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105021 2024-09-14T06:00:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.492 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.492 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.492 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119900 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6029312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.492 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:00:47.493 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6548374060000004, 2024-09-14T06:00:47.493 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051299599000000001, 2024-09-14T06:00:47.493 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.493 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.493 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.494 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.494 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.494 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.494 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119900 2024-09-14T06:00:47.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.494 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.495 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.495 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:00:47.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.496 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.496 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:00:47.496 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.496 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.496 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.497 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:00:47.497 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5699999999999999e-07 2024-09-14T06:00:47.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.497 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.498 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760093+0000", 2024-09-14T06:00:47.498 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1689999999999999e-06 2024-09-14T06:00:47.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.498 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.498 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760096+0000", 2024-09-14T06:00:47.499 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.315e-06 2024-09-14T06:00:47.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.499 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.499 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760101+0000", 2024-09-14T06:00:47.499 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T06:00:47.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.500 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.500 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811162+0000", 2024-09-14T06:00:47.500 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051061341000000003 2024-09-14T06:00:47.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.501 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.501 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811271+0000", 2024-09-14T06:00:47.501 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010851799999999999 2024-09-14T06:00:47.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.502 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.502 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811391+0000", 2024-09-14T06:00:47.502 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000120307 2024-09-14T06:00:47.502 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.502 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.503 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.503 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119901 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6078464~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.503 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:00:47.504 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6547958860000005, 2024-09-14T06:00:47.504 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051519772999999998, 2024-09-14T06:00:47.504 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.504 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.504 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.504 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.505 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.505 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.505 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119901 2024-09-14T06:00:47.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.505 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.506 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.506 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:00:47.506 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.507 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.507 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:00:47.507 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.508 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760134+0000", 2024-09-14T06:00:47.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.92e-07 2024-09-14T06:00:47.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.509 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760138+0000", 2024-09-14T06:00:47.509 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3869999999999997e-06 2024-09-14T06:00:47.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.509 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760145+0000", 2024-09-14T06:00:47.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.878e-06 2024-09-14T06:00:47.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.510 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760151+0000", 2024-09-14T06:00:47.511 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4399999999999996e-06 2024-09-14T06:00:47.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.511 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.511 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811452+0000", 2024-09-14T06:00:47.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051301872999999998 2024-09-14T06:00:47.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.512 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811545+0000", 2024-09-14T06:00:47.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2472000000000005e-05 2024-09-14T06:00:47.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.513 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811653+0000", 2024-09-14T06:00:47.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108031 2024-09-14T06:00:47.514 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.514 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.514 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.515 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119902 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.515 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:00:47.515 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6547685009999995, 2024-09-14T06:00:47.515 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051737544000000003, 2024-09-14T06:00:47.515 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.515 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.516 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.516 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.516 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.516 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.516 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119902 2024-09-14T06:00:47.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.517 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.517 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:00:47.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:00:47.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.519 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.519 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:00:47.519 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0600000000000001e-07 2024-09-14T06:00:47.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.520 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.520 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760163+0000", 2024-09-14T06:00:47.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2850000000000001e-06 2024-09-14T06:00:47.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760170+0000", 2024-09-14T06:00:47.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6030000000000001e-06 2024-09-14T06:00:47.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760176+0000", 2024-09-14T06:00:47.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6540000000000004e-06 2024-09-14T06:00:47.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.523 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811704+0000", 2024-09-14T06:00:47.523 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051528303999999997 2024-09-14T06:00:47.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.523 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.523 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811794+0000", 2024-09-14T06:00:47.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0142000000000005e-05 2024-09-14T06:00:47.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.524 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811898+0000", 2024-09-14T06:00:47.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010415 2024-09-14T06:00:47.525 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.525 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.525 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.526 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119903 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6176768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.526 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:00:47.526 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6547388380000001, 2024-09-14T06:00:47.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051958747999999999, 2024-09-14T06:00:47.526 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.526 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.527 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.527 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.527 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.527 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.527 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119903 2024-09-14T06:00:47.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.528 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:00:47.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.529 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.529 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:00:47.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.530 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.530 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760191+0000", 2024-09-14T06:00:47.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6400000000000002e-07 2024-09-14T06:00:47.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760194+0000", 2024-09-14T06:00:47.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7920000000000001e-06 2024-09-14T06:00:47.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.532 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760203+0000", 2024-09-14T06:00:47.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0669999999999998e-06 2024-09-14T06:00:47.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760208+0000", 2024-09-14T06:00:47.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5929999999999996e-06 2024-09-14T06:00:47.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811955+0000", 2024-09-14T06:00:47.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051746357 2024-09-14T06:00:47.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812046+0000", 2024-09-14T06:00:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1824999999999996e-05 2024-09-14T06:00:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812149+0000", 2024-09-14T06:00:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010255 2024-09-14T06:00:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119904 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6225920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:00:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6547116509999995, 2024-09-14T06:00:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052164159000000002, 2024-09-14T06:00:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119904 2024-09-14T06:00:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:00:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:00:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760218+0000", 2024-09-14T06:00:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2899999999999999e-07 2024-09-14T06:00:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760220+0000", 2024-09-14T06:00:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2879999999999999e-06 2024-09-14T06:00:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760226+0000", 2024-09-14T06:00:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1870000000000002e-06 2024-09-14T06:00:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760231+0000", 2024-09-14T06:00:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0950000000000003e-06 2024-09-14T06:00:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812192+0000", 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051960587000000003 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812281+0000", 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9225e-05 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812382+0000", 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000100348 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.540 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.540 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119905 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6275072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:47.540 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:00:47.540 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4.6546896120000003, 2024-09-14T06:00:47.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052394334000000001, 2024-09-14T06:00:47.540 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:47.540 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:47.540 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:47.540 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:47.540 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:47.540 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119905 2024-09-14T06:00:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:00:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:00:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760240+0000", 2024-09-14T06:00:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:00:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760242+0000", 2024-09-14T06:00:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0959999999999999e-06 2024-09-14T06:00:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760249+0000", 2024-09-14T06:00:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7399999999999998e-06 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760254+0000", 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9089999999999999e-06 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812419+0000", 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052165481 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812510+0000", 2024-09-14T06:00:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0525000000000005e-05 2024-09-14T06:00:47.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:47.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:47.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:47.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812634+0000", 2024-09-14T06:00:47.544 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012412600000000001 2024-09-14T06:00:47.544 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.544 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.544 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.544 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:47.544 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:47.544 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:47.546 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:47.546 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:00:47.546 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:47.547 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:47.546+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:47.552 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:47.569 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:47.586 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:47.607 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:47.607 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:47.630 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:47.630 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:47.646 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:47.646+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:47.652 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:47.652 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:47.669 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:47.669 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:47.672 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:47.672 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:47.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:00:47.779 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:47.776+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:47.833 INFO:teuthology.orchestra.run.smithi006.stderr:set 1.0 pg_upmap mapping to [4,1] 2024-09-14T06:00:47.834 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2024-09-14T06:00:47.848 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:47.844+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:47.871 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:47.872 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:47.889 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:00:47.975 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:47.972+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:48.050 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:48.050+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:48.065 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:48.065 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:48.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:00:48.167 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:48.164+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:48.247 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:48.247 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:48.252 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:48.248+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:48.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:00:48.353 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:48.348+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:48.430 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:48.430 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:48.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:00:48.487 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:48.484+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:48.555 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:48.554+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:48.606 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:48.606 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:48.621 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:00:48.667 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:48.664+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:48.741 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:48.741 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:48.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:00:48.799 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:48.796+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:48.858 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:48.858+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:48.932 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:48.932 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:48.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:00:48.995 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:48.992+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:49.059 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:49.056+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:49.075 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:49.075 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:49.089 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:00:49.161 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:49.158+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:49.224 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:49.224 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:49.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:00:49.282 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:49.282+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:49.362 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:49.360+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:49.401 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:49.401 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:49.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:00:49.463 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:49.460+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:49.539 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:49.539 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:49.553 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:00:49.563 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:49.560+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:49.664 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:49.660+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:49.678 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:49.678 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:49.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:00:49.693 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:00:49.765 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:49.762+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:49.814 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:49.815 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:49.829 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:00:49.859 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:49.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T06:00:49.866 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:49.860+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:49.883 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:49.902 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:49.902 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:49.921 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:49.921 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:49.940 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:49.962 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:49.967 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:49.964+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:49.983 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:49.983 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:50.009 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:50.009 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:50.011 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:50.011 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:50.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:50.011 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:50.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.011 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:00:50.011 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:50.011 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 78.462565741999995, 2024-09-14T06:00:50.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:00:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:00:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:00:50.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:00:50.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:00:50.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:00:50.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:00:50.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:00:50.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:00:50.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:00:50.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:00:50.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:00:50.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:00:50.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:00:50.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:00:50.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:00:50.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:00:50.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:00:50.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:50.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:00:50.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:00:50.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:50.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:00:50.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:00:50.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:50.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:00:50.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38849 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9748480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 65.487314918999999, 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084581577000000005, 2024-09-14T06:00:50.017 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.018 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.018 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.018 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.018 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.018 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.018 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38849 2024-09-14T06:00:50.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.018 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:50.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521686+0000", 2024-09-14T06:00:50.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521687+0000", 2024-09-14T06:00:50.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9400000000000005e-07 2024-09-14T06:00:50.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521729+0000", 2024-09-14T06:00:50.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2657000000000002e-05 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521749+0000", 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9264000000000001e-05 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521761+0000", 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2289999999999999e-05 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606078+0000", 2024-09-14T06:00:50.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084316772999999998 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606176+0000", 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7992999999999995e-05 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606268+0000", 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2006e-05 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38851 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 9928704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 65.487219607, 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084695081000000005, 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38851 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:50.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521781+0000", 2024-09-14T06:00:50.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521783+0000", 2024-09-14T06:00:50.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1000000000000001e-06 2024-09-14T06:00:50.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521788+0000", 2024-09-14T06:00:50.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2619999999999998e-06 2024-09-14T06:00:50.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521803+0000", 2024-09-14T06:00:50.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5421999999999999e-05 2024-09-14T06:00:50.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521815+0000", 2024-09-14T06:00:50.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.171e-05 2024-09-14T06:00:50.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606320+0000", 2024-09-14T06:00:50.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084504698000000003 2024-09-14T06:00:50.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606404+0000", 2024-09-14T06:00:50.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4379e-05 2024-09-14T06:00:50.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606476+0000", 2024-09-14T06:00:50.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2509999999999995e-05 2024-09-14T06:00:50.026 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.026 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.026 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.026 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:50.026 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:50.026 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 65.487168857, 2024-09-14T06:00:50.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:00:50.026 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.026 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.026 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.027 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.027 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.027 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.027 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:00:50.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.027 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:50.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:00:50.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:00:50.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:00:50.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:00:50.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:00:50.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:00:50.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:00:50.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:00:50.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:00:50.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:00:50.030 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.030 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.030 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.030 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:50.030 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:50.031 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 65.487130534000002, 2024-09-14T06:00:50.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:00:50.031 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.031 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.031 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.031 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.031 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.031 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.031 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:00:50.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.031 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:00:50.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:00:50.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:00:50.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:00:50.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:00:50.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:00:50.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 65.487103841999996, 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:00:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:00:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:00:50.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:00:50.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:00:50.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:00:50.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:00:50.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:00:50.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:00:50.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:00:50.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:00:50.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:00:50.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:00:50.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 65.487077975999995, 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.040 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.040 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.040 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:00:50.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.040 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:50.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:00:50.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:00:50.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:00:50.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:00:50.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:00:50.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:00:50.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:00:50.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:50.043 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 65.485977606999995, 2024-09-14T06:00:50.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:00:50.044 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.044 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.044 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.044 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.044 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.044 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.044 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:00:50.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.044 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:50.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:00:50.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:00:50.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:00:50.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:00:50.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:00:50.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:00:50.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:00:50.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:00:50.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:00:50.047 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.047 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.048 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.048 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:50.048 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:50.048 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 65.485933627999998, 2024-09-14T06:00:50.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:00:50.048 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.048 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.048 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.048 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.048 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.049 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.049 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:00:50.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.049 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:50.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:00:50.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:00:50.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:00:50.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:00:50.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:00:50.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:00:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:00:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:00:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:00:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:00:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:00:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:00:50.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:00:50.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:00:50.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:00:50.052 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.052 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.052 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.052 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:50.052 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:50.053 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 65.484871867999999, 2024-09-14T06:00:50.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:00:50.053 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.053 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.053 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.053 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.053 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.053 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.053 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:00:50.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.053 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:00:50.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:00:50.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:00:50.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:00:50.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:00:50.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:00:50.056 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.056 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.057 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.057 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38869 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 458752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:00:50.057 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:50.057 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 65.484466397999995, 2024-09-14T06:00:50.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084608905999999998, 2024-09-14T06:00:50.057 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.057 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.057 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.057 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.057 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.057 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.057 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38869 2024-09-14T06:00:50.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.058 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:50.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524535+0000", 2024-09-14T06:00:50.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525138+0000", 2024-09-14T06:00:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00060367999999999999 2024-09-14T06:00:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525160+0000", 2024-09-14T06:00:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1875999999999999e-05 2024-09-14T06:00:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525182+0000", 2024-09-14T06:00:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1427e-05 2024-09-14T06:00:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.525198+0000", 2024-09-14T06:00:50.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507e-05 2024-09-14T06:00:50.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608907+0000", 2024-09-14T06:00:50.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083708535000000001 2024-09-14T06:00:50.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609011+0000", 2024-09-14T06:00:50.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010461199999999999 2024-09-14T06:00:50.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.609144+0000", 2024-09-14T06:00:50.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013226899999999999 2024-09-14T06:00:50.061 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.061 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.061 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.061 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119203 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5881856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:50.061 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:00:50.061 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.943498838, 2024-09-14T06:00:50.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084813824999999995, 2024-09-14T06:00:50.062 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.062 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.062 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.062 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.062 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.062 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.062 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119203 2024-09-14T06:00:50.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.062 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:00:50.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:00:50.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065503+0000", 2024-09-14T06:00:50.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.054e-06 2024-09-14T06:00:50.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065509+0000", 2024-09-14T06:00:50.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9939999999999997e-06 2024-09-14T06:00:50.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065528+0000", 2024-09-14T06:00:50.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8736000000000002e-05 2024-09-14T06:00:50.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065540+0000", 2024-09-14T06:00:50.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2427e-05 2024-09-14T06:00:50.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.149851+0000", 2024-09-14T06:00:50.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084310806000000002 2024-09-14T06:00:50.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150073+0000", 2024-09-14T06:00:50.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022202999999999999 2024-09-14T06:00:50.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150316+0000", 2024-09-14T06:00:50.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000242778 2024-09-14T06:00:50.065 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119204 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5931008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.9434433310000001, 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085122164, 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119204 2024-09-14T06:00:50.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065559+0000", 2024-09-14T06:00:50.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.068e-06 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065564+0000", 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1089999999999997e-06 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065580+0000", 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6438000000000001e-05 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065592+0000", 2024-09-14T06:00:50.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1739000000000001e-05 2024-09-14T06:00:50.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150396+0000", 2024-09-14T06:00:50.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084803859999999995 2024-09-14T06:00:50.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150524+0000", 2024-09-14T06:00:50.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012805600000000001 2024-09-14T06:00:50.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150680+0000", 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015589400000000001 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119205 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5980160~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.9433474559999997, 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085597655999999994, 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.070 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119205 2024-09-14T06:00:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:00:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:00:50.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065656+0000", 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9829999999999999e-06 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065661+0000", 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9510000000000003e-06 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065680+0000", 2024-09-14T06:00:50.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8947e-05 2024-09-14T06:00:50.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065694+0000", 2024-09-14T06:00:50.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3433e-05 2024-09-14T06:00:50.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150778+0000", 2024-09-14T06:00:50.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085083856999999999 2024-09-14T06:00:50.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151007+0000", 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022914499999999999 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151251+0000", 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024434000000000001 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119206 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6029312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.9432860270000001, 2024-09-14T06:00:50.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086002258999999998, 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119206 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065716+0000", 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230000000000001e-06 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065722+0000", 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5219999999999998e-06 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065739+0000", 2024-09-14T06:00:50.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7122e-05 2024-09-14T06:00:50.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065752+0000", 2024-09-14T06:00:50.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2639e-05 2024-09-14T06:00:50.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151384+0000", 2024-09-14T06:00:50.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085632514000000007 2024-09-14T06:00:50.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151532+0000", 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000147761 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151717+0000", 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018537800000000001 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119207 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6078464~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:00:50.078 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.9432326819999997, 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086515080999999994, 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119207 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065770+0000", 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5770000000000001e-06 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065775+0000", 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1930000000000001e-06 2024-09-14T06:00:50.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065791+0000", 2024-09-14T06:00:50.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6351e-05 2024-09-14T06:00:50.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065804+0000", 2024-09-14T06:00:50.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.259e-05 2024-09-14T06:00:50.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151820+0000", 2024-09-14T06:00:50.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086016398999999993 2024-09-14T06:00:50.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152043+0000", 2024-09-14T06:00:50.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022236200000000001 2024-09-14T06:00:50.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152283+0000", 2024-09-14T06:00:50.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000240609 2024-09-14T06:00:50.082 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.082 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.082 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119208 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.943180184, 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086932403000000005, 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119208 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:00:50.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:00:50.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065822+0000", 2024-09-14T06:00:50.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.032e-06 2024-09-14T06:00:50.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065827+0000", 2024-09-14T06:00:50.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5790000000000003e-06 2024-09-14T06:00:50.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065843+0000", 2024-09-14T06:00:50.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5801999999999999e-05 2024-09-14T06:00:50.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065856+0000", 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2267e-05 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152416+0000", 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086560893999999999 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152568+0000", 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151664 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152753+0000", 2024-09-14T06:00:50.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018516499999999999 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119209 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6176768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.943128314, 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087450828999999994, 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.087 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119209 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065874+0000", 2024-09-14T06:00:50.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.097e-06 2024-09-14T06:00:50.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065879+0000", 2024-09-14T06:00:50.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.254e-06 2024-09-14T06:00:50.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065895+0000", 2024-09-14T06:00:50.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6373000000000001e-05 2024-09-14T06:00:50.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065908+0000", 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2656e-05 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152854+0000", 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086946078999999996 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153080+0000", 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022582200000000001 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153324+0000", 2024-09-14T06:00:50.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024354800000000001 2024-09-14T06:00:50.091 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.091 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.091 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.091 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119210 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6225920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:50.091 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:00:50.091 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.9430763869999996, 2024-09-14T06:00:50.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087773166, 2024-09-14T06:00:50.091 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119210 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065926+0000", 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3799999999999999e-06 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065931+0000", 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9629999999999997e-06 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065950+0000", 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9369999999999999e-05 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065963+0000", 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2164000000000001e-05 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153404+0000", 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087441840000000007 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153537+0000", 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013305500000000001 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153698+0000", 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016039400000000001 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119211 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6275072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.9430206200000004, 2024-09-14T06:00:50.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088244734000000005, 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119211 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:00:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065981+0000", 2024-09-14T06:00:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.012e-06 2024-09-14T06:00:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065987+0000", 2024-09-14T06:00:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5450000000000003e-06 2024-09-14T06:00:50.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.066003+0000", 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6198999999999999e-05 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.066016+0000", 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2595999999999999e-05 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153758+0000", 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087742610999999998 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153983+0000", 2024-09-14T06:00:50.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000224336 2024-09-14T06:00:50.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.154225+0000", 2024-09-14T06:00:50.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024243499999999999 2024-09-14T06:00:50.099 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.099 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.099 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.099 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.099 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.099 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:50.101 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:50.096+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:50.101 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:00:50.202 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:50.202+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:50.224 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:50.224 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:50.224 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:50.224 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:50.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:00:50.302 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:50.300+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:50.399 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:50.399 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:50.399 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:50.404 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:50.400+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:50.413 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:00:50.505 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:50.500+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:50.544 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:50.544 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59148 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 419840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.274236618000003, 2024-09-14T06:00:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072974285999999999, 2024-09-14T06:00:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59148 2024-09-14T06:00:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268521+0000", 2024-09-14T06:00:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4199999999999995e-07 2024-09-14T06:00:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268524+0000", 2024-09-14T06:00:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.05e-06 2024-09-14T06:00:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268534+0000", 2024-09-14T06:00:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8719999999999997e-06 2024-09-14T06:00:50.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268541+0000", 2024-09-14T06:00:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5349999999999999e-06 2024-09-14T06:00:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341108+0000", 2024-09-14T06:00:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072566624999999996 2024-09-14T06:00:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341169+0000", 2024-09-14T06:00:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1251e-05 2024-09-14T06:00:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341494+0000", 2024-09-14T06:00:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325311 2024-09-14T06:00:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59149 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 436224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:50.549 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.274197393999998, 2024-09-14T06:00:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073405053999999997, 2024-09-14T06:00:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59149 2024-09-14T06:00:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268560+0000", 2024-09-14T06:00:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9999999999999997e-07 2024-09-14T06:00:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268563+0000", 2024-09-14T06:00:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.292e-06 2024-09-14T06:00:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268573+0000", 2024-09-14T06:00:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3260000000000002e-06 2024-09-14T06:00:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268581+0000", 2024-09-14T06:00:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1960000000000008e-06 2024-09-14T06:00:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341537+0000", 2024-09-14T06:00:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072955916999999995 2024-09-14T06:00:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341641+0000", 2024-09-14T06:00:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104341 2024-09-14T06:00:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341964+0000", 2024-09-14T06:00:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032328199999999999 2024-09-14T06:00:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59150 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 452608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.274164153999997, 2024-09-14T06:00:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073829748000000001, 2024-09-14T06:00:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59150 2024-09-14T06:00:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0399999999999995e-07 2024-09-14T06:00:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268596+0000", 2024-09-14T06:00:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9859999999999999e-06 2024-09-14T06:00:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268606+0000", 2024-09-14T06:00:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0088000000000001e-05 2024-09-14T06:00:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268614+0000", 2024-09-14T06:00:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T06:00:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341999+0000", 2024-09-14T06:00:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073385011999999999 2024-09-14T06:00:50.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342093+0000", 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3793000000000001e-05 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342422+0000", 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000329129 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.558 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59151 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.274131785999998, 2024-09-14T06:00:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074207289999999995, 2024-09-14T06:00:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59151 2024-09-14T06:00:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268626+0000", 2024-09-14T06:00:50.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T06:00:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268629+0000", 2024-09-14T06:00:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.038e-06 2024-09-14T06:00:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268638+0000", 2024-09-14T06:00:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8139999999999995e-06 2024-09-14T06:00:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268647+0000", 2024-09-14T06:00:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4889999999999995e-06 2024-09-14T06:00:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342457+0000", 2024-09-14T06:00:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073809890000000003 2024-09-14T06:00:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342545+0000", 2024-09-14T06:00:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8697999999999997e-05 2024-09-14T06:00:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342832+0000", 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028681799999999999 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59152 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.274099145000001, 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074695176000000002, 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.563 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59152 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:50.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2900000000000003e-07 2024-09-14T06:00:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268661+0000", 2024-09-14T06:00:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0230000000000001e-06 2024-09-14T06:00:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268670+0000", 2024-09-14T06:00:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2129999999999997e-06 2024-09-14T06:00:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268679+0000", 2024-09-14T06:00:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-09-14T06:00:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342937+0000", 2024-09-14T06:00:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074258781999999995 2024-09-14T06:00:50.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343044+0000", 2024-09-14T06:00:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-09-14T06:00:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343353+0000", 2024-09-14T06:00:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030911099999999999 2024-09-14T06:00:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59153 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 501760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.274066374999997, 2024-09-14T06:00:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074997241000000006, 2024-09-14T06:00:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59153 2024-09-14T06:00:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.568 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268691+0000", 2024-09-14T06:00:50.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:00:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268693+0000", 2024-09-14T06:00:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3599999999999999e-06 2024-09-14T06:00:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268699+0000", 2024-09-14T06:00:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-09-14T06:00:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268704+0000", 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5759999999999999e-06 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343398+0000", 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074694522999999999 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343450+0000", 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1350999999999997e-05 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343688+0000", 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023806500000000001 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59154 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 518144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.274047308999997, 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075389938000000004, 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.572 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.573 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.573 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59154 2024-09-14T06:00:50.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.573 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:50.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:50.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268710+0000", 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8000000000000001e-07 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268712+0000", 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268717+0000", 2024-09-14T06:00:50.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8570000000000003e-06 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268721+0000", 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2039999999999999e-06 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343721+0000", 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074999748000000005 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343784+0000", 2024-09-14T06:00:50.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3174000000000002e-05 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.344099+0000", 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000315299 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59398 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 323584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.263083061000003, 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073326565999999996, 2024-09-14T06:00:50.576 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.577 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.577 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.577 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.577 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.577 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.577 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59398 2024-09-14T06:00:50.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.577 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:50.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279675+0000", 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279681+0000", 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279702+0000", 2024-09-14T06:00:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1259000000000001e-05 2024-09-14T06:00:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279718+0000", 2024-09-14T06:00:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5475999999999999e-05 2024-09-14T06:00:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352360+0000", 2024-09-14T06:00:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.07264226 2024-09-14T06:00:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352447+0000", 2024-09-14T06:00:50.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7381999999999998e-05 2024-09-14T06:00:50.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353000+0000", 2024-09-14T06:00:50.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055309200000000004 2024-09-14T06:00:50.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.580 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.581 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59399 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.581 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:50.581 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.263018698000003, 2024-09-14T06:00:50.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073824446000000002, 2024-09-14T06:00:50.581 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.581 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.581 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.581 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59399 2024-09-14T06:00:50.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.581 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279739+0000", 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279745+0000", 2024-09-14T06:00:50.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T06:00:50.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279767+0000", 2024-09-14T06:00:50.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639000000000001e-05 2024-09-14T06:00:50.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279781+0000", 2024-09-14T06:00:50.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4511999999999999e-05 2024-09-14T06:00:50.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353045+0000", 2024-09-14T06:00:50.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073263718000000005 2024-09-14T06:00:50.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353168+0000", 2024-09-14T06:00:50.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012314499999999999 2024-09-14T06:00:50.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353562+0000", 2024-09-14T06:00:50.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039435199999999999 2024-09-14T06:00:50.585 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.585 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.585 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.585 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59400 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.585 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:50.585 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.262954938, 2024-09-14T06:00:50.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074271465999999994, 2024-09-14T06:00:50.585 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.585 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.585 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.586 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59400 2024-09-14T06:00:50.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.586 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:50.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:50.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279803+0000", 2024-09-14T06:00:50.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2100000000000001e-06 2024-09-14T06:00:50.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279819+0000", 2024-09-14T06:00:50.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6409000000000002e-05 2024-09-14T06:00:50.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279841+0000", 2024-09-14T06:00:50.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1878e-05 2024-09-14T06:00:50.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279856+0000", 2024-09-14T06:00:50.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4392999999999999e-05 2024-09-14T06:00:50.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353650+0000", 2024-09-14T06:00:50.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073794144000000006 2024-09-14T06:00:50.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353757+0000", 2024-09-14T06:00:50.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010687 2024-09-14T06:00:50.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354073+0000", 2024-09-14T06:00:50.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000316562 2024-09-14T06:00:50.590 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.590 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.590 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.590 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59401 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 372736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.590 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:50.590 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.262880113000001, 2024-09-14T06:00:50.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074643900999999999, 2024-09-14T06:00:50.590 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.590 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.590 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.590 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.590 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.591 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.591 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59401 2024-09-14T06:00:50.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.591 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:50.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:50.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279878+0000", 2024-09-14T06:00:50.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.31e-06 2024-09-14T06:00:50.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279883+0000", 2024-09-14T06:00:50.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3770000000000004e-06 2024-09-14T06:00:50.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279906+0000", 2024-09-14T06:00:50.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2398000000000001e-05 2024-09-14T06:00:50.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279920+0000", 2024-09-14T06:00:50.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.402e-05 2024-09-14T06:00:50.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354125+0000", 2024-09-14T06:00:50.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074205750000000001 2024-09-14T06:00:50.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354227+0000", 2024-09-14T06:00:50.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101612 2024-09-14T06:00:50.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354521+0000", 2024-09-14T06:00:50.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029343400000000002 2024-09-14T06:00:50.594 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.594 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.594 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59402 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 389120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.262818529999997, 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075017027999999999, 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59402 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279939+0000", 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2470000000000001e-06 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279945+0000", 2024-09-14T06:00:50.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-09-14T06:00:50.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279966+0000", 2024-09-14T06:00:50.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1801999999999999e-05 2024-09-14T06:00:50.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279980+0000", 2024-09-14T06:00:50.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3589e-05 2024-09-14T06:00:50.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354569+0000", 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074588707000000004 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354671+0000", 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102398 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354955+0000", 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028406500000000001 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.598 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59403 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 405504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.262756742999997, 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075434395000000001, 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59403 2024-09-14T06:00:50.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280001+0000", 2024-09-14T06:00:50.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2669999999999999e-06 2024-09-14T06:00:50.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280008+0000", 2024-09-14T06:00:50.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5849999999999996e-06 2024-09-14T06:00:50.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280030+0000", 2024-09-14T06:00:50.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2293000000000002e-05 2024-09-14T06:00:50.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280044+0000", 2024-09-14T06:00:50.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3974999999999999e-05 2024-09-14T06:00:50.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355013+0000", 2024-09-14T06:00:50.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074969039000000001 2024-09-14T06:00:50.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355144+0000", 2024-09-14T06:00:50.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000131333 2024-09-14T06:00:50.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355434+0000", 2024-09-14T06:00:50.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028990299999999999 2024-09-14T06:00:50.603 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.603 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.603 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.603 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59404 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.603 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:50.603 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.262691623999999, 2024-09-14T06:00:50.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075696103000000001, 2024-09-14T06:00:50.604 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.604 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.604 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.604 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.604 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.604 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.604 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59404 2024-09-14T06:00:50.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.604 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:50.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:50.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280066+0000", 2024-09-14T06:00:50.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2640000000000001e-06 2024-09-14T06:00:50.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280072+0000", 2024-09-14T06:00:50.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129999999999997e-06 2024-09-14T06:00:50.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280094+0000", 2024-09-14T06:00:50.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2608000000000001e-05 2024-09-14T06:00:50.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280109+0000", 2024-09-14T06:00:50.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:50.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355479+0000", 2024-09-14T06:00:50.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075370699999999999 2024-09-14T06:00:50.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355554+0000", 2024-09-14T06:00:50.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4674999999999999e-05 2024-09-14T06:00:50.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355761+0000", 2024-09-14T06:00:50.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-14T06:00:50.608 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.608 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.608 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.608 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59405 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.608 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:50.608 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.262627713999997, 2024-09-14T06:00:50.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076008867999999993, 2024-09-14T06:00:50.608 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.608 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.608 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.608 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59405 2024-09-14T06:00:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280130+0000", 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2500000000000001e-06 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280136+0000", 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280158+0000", 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1795000000000001e-05 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280172+0000", 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4303e-05 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355797+0000", 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075624835000000001 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355866+0000", 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9043999999999998e-05 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356138+0000", 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027207799999999998 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59406 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.262563772, 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076435642999999998, 2024-09-14T06:00:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59406 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280194+0000", 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280200+0000", 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6359999999999999e-06 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280222+0000", 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1628999999999999e-05 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280236+0000", 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4413000000000001e-05 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356172+0000", 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075936466999999994 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356260+0000", 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7437999999999999e-05 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356629+0000", 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036877600000000002 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59407 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 471040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.262499538999997, 2024-09-14T06:00:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076820083999999997, 2024-09-14T06:00:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59407 2024-09-14T06:00:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280258+0000", 2024-09-14T06:00:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1370000000000001e-06 2024-09-14T06:00:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280264+0000", 2024-09-14T06:00:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6930000000000004e-06 2024-09-14T06:00:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280285+0000", 2024-09-14T06:00:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1455999999999999e-05 2024-09-14T06:00:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280300+0000", 2024-09-14T06:00:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4319e-05 2024-09-14T06:00:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356676+0000", 2024-09-14T06:00:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076376615999999994 2024-09-14T06:00:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356768+0000", 2024-09-14T06:00:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1234000000000001e-05 2024-09-14T06:00:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357077+0000", 2024-09-14T06:00:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030962900000000001 2024-09-14T06:00:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59408 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 487424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.262434538999997, 2024-09-14T06:00:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077185511999999998, 2024-09-14T06:00:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59408 2024-09-14T06:00:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280323+0000", 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2860000000000001e-06 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280329+0000", 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.553e-06 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280352+0000", 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280366+0000", 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357126+0000", 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076760326000000004 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357223+0000", 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6490000000000006e-05 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357508+0000", 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028479900000000002 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59409 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.262370308999998, 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077536090000000002, 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59409 2024-09-14T06:00:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280388+0000", 2024-09-14T06:00:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.096e-06 2024-09-14T06:00:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280393+0000", 2024-09-14T06:00:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T06:00:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280414+0000", 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1175999999999999e-05 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280427+0000", 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3032e-05 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357553+0000", 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077125845999999998 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357624+0000", 2024-09-14T06:00:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1062000000000005e-05 2024-09-14T06:00:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357923+0000", 2024-09-14T06:00:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029891199999999997 2024-09-14T06:00:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59410 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.262310997, 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077854494999999996, 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59410 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280447+0000", 2024-09-14T06:00:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069999999999999e-06 2024-09-14T06:00:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280453+0000", 2024-09-14T06:00:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-06 2024-09-14T06:00:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280471+0000", 2024-09-14T06:00:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8295999999999999e-05 2024-09-14T06:00:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280484+0000", 2024-09-14T06:00:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2609000000000001e-05 2024-09-14T06:00:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357954+0000", 2024-09-14T06:00:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077470405000000006 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358040+0000", 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.551e-05 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358300+0000", 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026036800000000003 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:50.634 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:50.635 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:00:50.635 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:50.632+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:50.736 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:50.734+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:50.759 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:50.759 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:50.760 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:50.775 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:00:50.848 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2024-09-14T06:00:50.862 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:50.861+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:50.937 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:50.932+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:50.953 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:50.953 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:50.953 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:50.953 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:50.953 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:50.968 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:00:51.038 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:51.032+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:51.135 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:51.135 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:51.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:51.135 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:51.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.135 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114752 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1458176~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.135 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:51.135 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.77553561, 2024-09-14T06:00:51.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11122652, 2024-09-14T06:00:51.136 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.136 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.136 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.136 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.136 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.136 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.136 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114752 2024-09-14T06:00:51.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.136 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:51.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:51.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:51.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.51e-07 2024-09-14T06:00:51.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357638+0000", 2024-09-14T06:00:51.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7540000000000001e-06 2024-09-14T06:00:51.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357643+0000", 2024-09-14T06:00:51.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1150000000000002e-06 2024-09-14T06:00:51.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357647+0000", 2024-09-14T06:00:51.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7979999999999999e-06 2024-09-14T06:00:51.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468136+0000", 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.110488747 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468353+0000", 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000217166 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468862+0000", 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050938899999999996 2024-09-14T06:00:51.139 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.140 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.140 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.140 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114753 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1564672~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.140 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:51.140 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.775495547, 2024-09-14T06:00:51.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111972162, 2024-09-14T06:00:51.140 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.140 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.140 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.140 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.141 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114753 2024-09-14T06:00:51.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.141 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:51.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:51.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:51.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6599999999999996e-07 2024-09-14T06:00:51.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357678+0000", 2024-09-14T06:00:51.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.807e-06 2024-09-14T06:00:51.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357683+0000", 2024-09-14T06:00:51.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.933e-06 2024-09-14T06:00:51.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357687+0000", 2024-09-14T06:00:51.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8469999999999998e-06 2024-09-14T06:00:51.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468941+0000", 2024-09-14T06:00:51.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111254009 2024-09-14T06:00:51.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469159+0000", 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021768800000000001 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469648+0000", 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048931199999999999 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114754 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1671168~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.144 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.775455874, 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.112607016, 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114754 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:51.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357716+0000", 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357718+0000", 2024-09-14T06:00:51.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5910000000000001e-06 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357725+0000", 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9399999999999996e-06 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357729+0000", 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0439999999999997e-06 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469752+0000", 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11202385400000001 2024-09-14T06:00:51.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469889+0000", 2024-09-14T06:00:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136704 2024-09-14T06:00:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470322+0000", 2024-09-14T06:00:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000433337 2024-09-14T06:00:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.149 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114771 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 98304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.149 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:51.149 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.775414767000001, 2024-09-14T06:00:51.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11267808, 2024-09-14T06:00:51.149 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.149 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.149 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.149 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114771 2024-09-14T06:00:51.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.149 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.37e-07 2024-09-14T06:00:51.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357759+0000", 2024-09-14T06:00:51.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5650000000000001e-06 2024-09-14T06:00:51.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357764+0000", 2024-09-14T06:00:51.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T06:00:51.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357768+0000", 2024-09-14T06:00:51.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9580000000000001e-06 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469739+0000", 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111971591 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469951+0000", 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021185999999999999 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470435+0000", 2024-09-14T06:00:51.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048335499999999998 2024-09-14T06:00:51.153 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.153 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.153 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.153 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114772 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.153 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:51.153 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.775374551000001, 2024-09-14T06:00:51.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11329244500000001, 2024-09-14T06:00:51.153 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.153 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.153 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.153 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.154 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.154 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.154 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114772 2024-09-14T06:00:51.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.154 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:51.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:51.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:51.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3099999999999998e-07 2024-09-14T06:00:51.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357799+0000", 2024-09-14T06:00:51.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0770000000000002e-06 2024-09-14T06:00:51.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357805+0000", 2024-09-14T06:00:51.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3329999999999996e-06 2024-09-14T06:00:51.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357816+0000", 2024-09-14T06:00:51.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0869999999999999e-05 2024-09-14T06:00:51.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470507+0000", 2024-09-14T06:00:51.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.112691635 2024-09-14T06:00:51.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470648+0000", 2024-09-14T06:00:51.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014075000000000001 2024-09-14T06:00:51.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471089+0000", 2024-09-14T06:00:51.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000441249 2024-09-14T06:00:51.157 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.157 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.157 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.158 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114773 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 311296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.158 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:51.158 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.775329005, 2024-09-14T06:00:51.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114111303, 2024-09-14T06:00:51.158 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.158 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.158 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.158 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.158 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.158 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.159 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114773 2024-09-14T06:00:51.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.159 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:51.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:51.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357843+0000", 2024-09-14T06:00:51.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4499999999999997e-07 2024-09-14T06:00:51.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357844+0000", 2024-09-14T06:00:51.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.612e-06 2024-09-14T06:00:51.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357851+0000", 2024-09-14T06:00:51.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7900000000000002e-06 2024-09-14T06:00:51.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357855+0000", 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9310000000000001e-06 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471187+0000", 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.113332222 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471425+0000", 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000237412 2024-09-14T06:00:51.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471954+0000", 2024-09-14T06:00:51.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00052879100000000003 2024-09-14T06:00:51.162 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.162 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.162 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.162 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114774 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 417792~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.162 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:51.162 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.775287979, 2024-09-14T06:00:51.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114690902, 2024-09-14T06:00:51.162 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114774 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:51.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357884+0000", 2024-09-14T06:00:51.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.37e-07 2024-09-14T06:00:51.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357886+0000", 2024-09-14T06:00:51.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7010000000000001e-06 2024-09-14T06:00:51.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357891+0000", 2024-09-14T06:00:51.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T06:00:51.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357896+0000", 2024-09-14T06:00:51.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5999999999999997e-06 2024-09-14T06:00:51.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472030+0000", 2024-09-14T06:00:51.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11413328 2024-09-14T06:00:51.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472157+0000", 2024-09-14T06:00:51.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012693900000000001 2024-09-14T06:00:51.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472574+0000", 2024-09-14T06:00:51.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041773100000000002 2024-09-14T06:00:51.166 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.166 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.166 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114775 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 524288~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.775248311, 2024-09-14T06:00:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.115518357, 2024-09-14T06:00:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114775 2024-09-14T06:00:51.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.168 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:51.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:51.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357924+0000", 2024-09-14T06:00:51.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3799999999999997e-07 2024-09-14T06:00:51.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357928+0000", 2024-09-14T06:00:51.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7700000000000001e-06 2024-09-14T06:00:51.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357934+0000", 2024-09-14T06:00:51.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6420000000000004e-06 2024-09-14T06:00:51.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357938+0000", 2024-09-14T06:00:51.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1899999999999997e-06 2024-09-14T06:00:51.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472667+0000", 2024-09-14T06:00:51.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114728409 2024-09-14T06:00:51.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472901+0000", 2024-09-14T06:00:51.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023484100000000001 2024-09-14T06:00:51.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473441+0000", 2024-09-14T06:00:51.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053996700000000003 2024-09-14T06:00:51.171 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.171 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.171 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.171 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114776 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 630784~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.171 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:51.171 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.775208415, 2024-09-14T06:00:51.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11610183, 2024-09-14T06:00:51.172 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.172 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.172 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.172 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.172 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.172 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.172 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114776 2024-09-14T06:00:51.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.172 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:51.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:51.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357964+0000", 2024-09-14T06:00:51.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7700000000000004e-07 2024-09-14T06:00:51.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357965+0000", 2024-09-14T06:00:51.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.761e-06 2024-09-14T06:00:51.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357970+0000", 2024-09-14T06:00:51.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1429999999999997e-06 2024-09-14T06:00:51.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357974+0000", 2024-09-14T06:00:51.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8879999999999999e-06 2024-09-14T06:00:51.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473514+0000", 2024-09-14T06:00:51.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11554007500000001 2024-09-14T06:00:51.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473641+0000", 2024-09-14T06:00:51.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000127088 2024-09-14T06:00:51.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474065+0000", 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00042329800000000001 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114777 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 737280~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.77516924, 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11697975200000001, 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.176 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.177 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.177 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.177 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114777 2024-09-14T06:00:51.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.177 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:51.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:51.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358003+0000", 2024-09-14T06:00:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-14T06:00:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358004+0000", 2024-09-14T06:00:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6950000000000001e-06 2024-09-14T06:00:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358010+0000", 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2410000000000003e-06 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358014+0000", 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9380000000000002e-06 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474156+0000", 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.116142597 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474386+0000", 2024-09-14T06:00:51.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023008999999999999 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474982+0000", 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059564500000000001 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114778 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 843776~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.775128897, 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11749908100000001, 2024-09-14T06:00:51.180 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.181 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.181 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.181 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.181 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.181 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.181 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114778 2024-09-14T06:00:51.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.181 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:51.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358043+0000", 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3399999999999999e-07 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358045+0000", 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8789999999999999e-06 2024-09-14T06:00:51.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358052+0000", 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.951e-06 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358056+0000", 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.121e-06 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475018+0000", 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11696224199999999 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475141+0000", 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012285099999999999 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475542+0000", 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00040050300000000002 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114779 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 950272~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.184 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:51.185 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.775086298, 2024-09-14T06:00:51.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.118289098, 2024-09-14T06:00:51.185 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.185 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.185 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.185 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.185 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.185 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.185 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114779 2024-09-14T06:00:51.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.185 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:51.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:51.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358086+0000", 2024-09-14T06:00:51.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5300000000000004e-07 2024-09-14T06:00:51.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358087+0000", 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.623e-06 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358093+0000", 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9510000000000003e-06 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358097+0000", 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1819999999999999e-06 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475637+0000", 2024-09-14T06:00:51.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11753928600000001 2024-09-14T06:00:51.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475862+0000", 2024-09-14T06:00:51.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225336 2024-09-14T06:00:51.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476374+0000", 2024-09-14T06:00:51.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000512167 2024-09-14T06:00:51.188 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.188 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.189 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.189 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114780 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1056768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.189 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:51.189 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.775045274, 2024-09-14T06:00:51.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.119083513, 2024-09-14T06:00:51.189 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.189 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.189 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.189 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.189 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.189 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.190 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114780 2024-09-14T06:00:51.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.190 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:51.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:51.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358127+0000", 2024-09-14T06:00:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.44e-07 2024-09-14T06:00:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358128+0000", 2024-09-14T06:00:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.714e-06 2024-09-14T06:00:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358135+0000", 2024-09-14T06:00:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358140+0000", 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1969999999999998e-06 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476456+0000", 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.118316717 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476674+0000", 2024-09-14T06:00:51.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021775200000000001 2024-09-14T06:00:51.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477210+0000", 2024-09-14T06:00:51.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053548400000000003 2024-09-14T06:00:51.193 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.193 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.193 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.193 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114781 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1163264~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.193 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:51.193 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.775000153000001, 2024-09-14T06:00:51.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11988966700000001, 2024-09-14T06:00:51.194 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.194 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.194 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.194 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.194 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.194 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.194 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114781 2024-09-14T06:00:51.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.194 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:51.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358172+0000", 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.44e-07 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358174+0000", 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9920000000000002e-06 2024-09-14T06:00:51.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358179+0000", 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.288e-06 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358183+0000", 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0489999999999997e-06 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477294+0000", 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11911132000000001 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477516+0000", 2024-09-14T06:00:51.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022208500000000001 2024-09-14T06:00:51.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478061+0000", 2024-09-14T06:00:51.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00054438900000000005 2024-09-14T06:00:51.197 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.197 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.197 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.197 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114782 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1269760~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.198 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:51.198 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.774981585999999, 2024-09-14T06:00:51.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.120723238, 2024-09-14T06:00:51.198 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.198 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.198 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.198 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.198 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.198 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.198 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114782 2024-09-14T06:00:51.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.198 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4099999999999999e-07 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358192+0000", 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.559e-06 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358197+0000", 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6789999999999996e-06 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358202+0000", 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4779999999999999e-06 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478140+0000", 2024-09-14T06:00:51.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11993833600000001 2024-09-14T06:00:51.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478358+0000", 2024-09-14T06:00:51.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021785700000000001 2024-09-14T06:00:51.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478913+0000", 2024-09-14T06:00:51.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055478799999999996 2024-09-14T06:00:51.201 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.201 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.202 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.202 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114783 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1376256~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.202 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:51.202 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.774963241, 2024-09-14T06:00:51.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121464831, 2024-09-14T06:00:51.202 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.202 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.202 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.202 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.202 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.202 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.202 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114783 2024-09-14T06:00:51.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.203 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:51.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:51.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4499999999999998e-07 2024-09-14T06:00:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358210+0000", 2024-09-14T06:00:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5880000000000001e-06 2024-09-14T06:00:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358214+0000", 2024-09-14T06:00:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3850000000000004e-06 2024-09-14T06:00:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358218+0000", 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7799999999999998e-06 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479024+0000", 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.120805364 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479177+0000", 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153642 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479673+0000", 2024-09-14T06:00:51.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049572699999999995 2024-09-14T06:00:51.206 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.206 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.206 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.206 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114784 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1482752~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.206 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:51.206 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.774948583, 2024-09-14T06:00:51.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.122316759, 2024-09-14T06:00:51.206 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.206 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114784 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:51.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:51.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2399999999999999e-07 2024-09-14T06:00:51.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358225+0000", 2024-09-14T06:00:51.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5570000000000001e-06 2024-09-14T06:00:51.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358229+0000", 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5589999999999999e-06 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358233+0000", 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7270000000000001e-06 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479769+0000", 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12153594299999999 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480000+0000", 2024-09-14T06:00:51.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000230967 2024-09-14T06:00:51.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480540+0000", 2024-09-14T06:00:51.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053968199999999999 2024-09-14T06:00:51.210 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.210 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.210 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.210 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114785 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1589248~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.210 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:51.211 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.774932392, 2024-09-14T06:00:51.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123154237, 2024-09-14T06:00:51.211 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.211 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.211 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.211 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.211 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.211 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.211 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114785 2024-09-14T06:00:51.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.211 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:51.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:51.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:51.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3799999999999998e-07 2024-09-14T06:00:51.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358241+0000", 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.457e-06 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358245+0000", 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.42e-06 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358249+0000", 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7740000000000002e-06 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480626+0000", 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12237743600000001 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480844+0000", 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021792299999999999 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481393+0000", 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000548889 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.214 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114786 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1695744~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.774917688, 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123995568, 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114786 2024-09-14T06:00:51.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:51.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.27e-07 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358256+0000", 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5460000000000001e-06 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358260+0000", 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3819999999999997e-06 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358264+0000", 2024-09-14T06:00:51.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7469999999999999e-06 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481473+0000", 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123209244 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481686+0000", 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000212957 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482249+0000", 2024-09-14T06:00:51.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00056336500000000002 2024-09-14T06:00:51.219 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.219 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.219 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.219 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114867 3.15 3:aea12e8e:::rbd_data.1127cb09e343.000000000000000b:head [stat,truncate 737280] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:51.219 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:51.219 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.774903103, 2024-09-14T06:00:51.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12722582099999999, 2024-09-14T06:00:51.219 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:51.219 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:51.219 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:51.219 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114867 2024-09-14T06:00:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:51.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358269+0000", 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4799999999999999e-07 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358274+0000", 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.237e-06 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358279+0000", 2024-09-14T06:00:51.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7990000000000001e-06 2024-09-14T06:00:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358284+0000", 2024-09-14T06:00:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1900000000000003e-06 2024-09-14T06:00:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482355+0000", 2024-09-14T06:00:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.124070718 2024-09-14T06:00:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482496+0000", 2024-09-14T06:00:51.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014162699999999999 2024-09-14T06:00:51.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 3", 2024-09-14T06:00:51.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482722+0000", 2024-09-14T06:00:51.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225622 2024-09-14T06:00:51.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:51.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.484427+0000", 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001704929 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485332+0000", 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00090576600000000001 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485429+0000", 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6540999999999996e-05 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:51.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485494+0000", 2024-09-14T06:00:51.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5043999999999996e-05 2024-09-14T06:00:51.225 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.225 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.225 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.225 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:51.225 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:51.225 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:51.226 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:00:51.227 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:51.225+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:51.327 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:51.324+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:51.360 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:51.360 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:51.360 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:00:51.361 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:51.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:00:51.467 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:51.464+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:51.529 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:51.524+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:51.552 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:51.552 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:51.552 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:51.552 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:51.552 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:51.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:00:51.655 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:51.652+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:51.732 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:51.728+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:51.740 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:51.740 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:00:51.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:00:51.741 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:51.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.741 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119850 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 3571712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.741 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:00:51.741 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9882318970000004, 2024-09-14T06:00:51.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050424731, 2024-09-14T06:00:51.741 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.741 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.741 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.741 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.741 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.741 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.742 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119850 2024-09-14T06:00:51.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.742 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:00:51.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.742 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:00:51.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:00:51.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6100000000000001e-07 2024-09-14T06:00:51.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751247+0000", 2024-09-14T06:00:51.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5059999999999998e-06 2024-09-14T06:00:51.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751255+0000", 2024-09-14T06:00:51.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3080000000000008e-06 2024-09-14T06:00:51.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751262+0000", 2024-09-14T06:00:51.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1060000000000002e-06 2024-09-14T06:00:51.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801559+0000", 2024-09-14T06:00:51.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050297043 2024-09-14T06:00:51.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801614+0000", 2024-09-14T06:00:51.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5028999999999998e-05 2024-09-14T06:00:51.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801668+0000", 2024-09-14T06:00:51.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4178000000000002e-05 2024-09-14T06:00:51.745 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.745 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.745 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.746 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119851 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 3620864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.746 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:00:51.746 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9882032400000007, 2024-09-14T06:00:51.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050528479000000001, 2024-09-14T06:00:51.746 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.746 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.746 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.746 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.746 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.746 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.746 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119851 2024-09-14T06:00:51.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.746 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.747 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:00:51.747 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.747 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:00:51.747 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752502+0000", 2024-09-14T06:00:51.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012294529999999999 2024-09-14T06:00:51.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752508+0000", 2024-09-14T06:00:51.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8780000000000003e-06 2024-09-14T06:00:51.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752522+0000", 2024-09-14T06:00:51.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4405e-05 2024-09-14T06:00:51.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.749 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.749 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752532+0000", 2024-09-14T06:00:51.749 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6739999999999992e-06 2024-09-14T06:00:51.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.749 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.749 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801702+0000", 2024-09-14T06:00:51.749 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049169996000000001 2024-09-14T06:00:51.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.749 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.749 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801744+0000", 2024-09-14T06:00:51.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2789e-05 2024-09-14T06:00:51.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.750 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.750 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801801+0000", 2024-09-14T06:00:51.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6283999999999998e-05 2024-09-14T06:00:51.750 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.750 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.750 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.750 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119877 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4898816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.751 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:00:51.751 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9834738059999992, 2024-09-14T06:00:51.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050416282999999999, 2024-09-14T06:00:51.751 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.751 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.751 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.751 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.751 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.751 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.751 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119877 2024-09-14T06:00:51.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.751 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.752 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:00:51.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.752 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:00:51.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.752 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:00:51.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6300000000000005e-07 2024-09-14T06:00:51.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.753 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.753 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756005+0000", 2024-09-14T06:00:51.753 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7350000000000001e-06 2024-09-14T06:00:51.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.753 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.753 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756012+0000", 2024-09-14T06:00:51.753 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8990000000000004e-06 2024-09-14T06:00:51.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.753 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756017+0000", 2024-09-14T06:00:51.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.023e-06 2024-09-14T06:00:51.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.754 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806256+0000", 2024-09-14T06:00:51.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050239355999999999 2024-09-14T06:00:51.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806331+0000", 2024-09-14T06:00:51.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4800000000000002e-05 2024-09-14T06:00:51.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806418+0000", 2024-09-14T06:00:51.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6907e-05 2024-09-14T06:00:51.756 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.756 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.756 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.756 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119878 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4947968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.757 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:00:51.757 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9834489600000005, 2024-09-14T06:00:51.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050582539000000003, 2024-09-14T06:00:51.757 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.757 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.757 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.757 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.757 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.757 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.758 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119878 2024-09-14T06:00:51.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.758 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.758 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.758 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:00:51.758 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.758 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.758 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:00:51.758 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756027+0000", 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1399999999999997e-07 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756029+0000", 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3420000000000002e-06 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756036+0000", 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9550000000000003e-06 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756041+0000", 2024-09-14T06:00:51.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2669999999999997e-06 2024-09-14T06:00:51.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806448+0000", 2024-09-14T06:00:51.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050407037000000002 2024-09-14T06:00:51.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806526+0000", 2024-09-14T06:00:51.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7119000000000005e-05 2024-09-14T06:00:51.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806609+0000", 2024-09-14T06:00:51.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3405000000000005e-05 2024-09-14T06:00:51.761 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.761 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.761 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119879 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4997120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9834264800000003, 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.05075727, 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119879 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.762 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.763 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.763 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:00:51.763 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.763 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.763 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:00:51.763 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.763 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.763 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:00:51.763 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9400000000000001e-07 2024-09-14T06:00:51.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756058+0000", 2024-09-14T06:00:51.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5199999999999997e-06 2024-09-14T06:00:51.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756065+0000", 2024-09-14T06:00:51.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9800000000000001e-06 2024-09-14T06:00:51.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756070+0000", 2024-09-14T06:00:51.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2360000000000004e-06 2024-09-14T06:00:51.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806639+0000", 2024-09-14T06:00:51.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050568702 2024-09-14T06:00:51.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806714+0000", 2024-09-14T06:00:51.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4825000000000003e-05 2024-09-14T06:00:51.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806806+0000", 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2613000000000003e-05 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119880 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5046272~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9833717810000007, 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050918568999999997, 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.766 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.767 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.767 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.767 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119880 2024-09-14T06:00:51.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.767 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:00:51.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:00:51.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.768 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.768 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:00:51.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:00:51.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.768 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.768 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756107+0000", 2024-09-14T06:00:51.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8159999999999998e-06 2024-09-14T06:00:51.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.768 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756116+0000", 2024-09-14T06:00:51.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4980000000000006e-06 2024-09-14T06:00:51.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756122+0000", 2024-09-14T06:00:51.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8809999999999998e-06 2024-09-14T06:00:51.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806841+0000", 2024-09-14T06:00:51.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050718907000000001 2024-09-14T06:00:51.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806927+0000", 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5908999999999994e-05 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807022+0000", 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4901000000000005e-05 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119881 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5095424~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.770 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:00:51.771 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.983341158, 2024-09-14T06:00:51.771 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051097946999999998, 2024-09-14T06:00:51.771 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.771 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.771 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.771 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.771 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.771 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.771 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119881 2024-09-14T06:00:51.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.771 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.771 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:00:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:00:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756135+0000", 2024-09-14T06:00:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.51e-07 2024-09-14T06:00:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.772 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756137+0000", 2024-09-14T06:00:51.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2230000000000001e-06 2024-09-14T06:00:51.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756145+0000", 2024-09-14T06:00:51.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6629999999999993e-06 2024-09-14T06:00:51.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756150+0000", 2024-09-14T06:00:51.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9150000000000004e-06 2024-09-14T06:00:51.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807054+0000", 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050904855999999998 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807137+0000", 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2248000000000003e-05 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807232+0000", 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5490999999999998e-05 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.774 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119882 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5144576~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9833172819999998, 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051297745999999998, 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119882 2024-09-14T06:00:51.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.776 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.776 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.776 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:00:51.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.776 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.776 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:00:51.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.776 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.776 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756159+0000", 2024-09-14T06:00:51.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4299999999999998e-07 2024-09-14T06:00:51.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.777 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.777 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756161+0000", 2024-09-14T06:00:51.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4959999999999999e-06 2024-09-14T06:00:51.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.777 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.777 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756170+0000", 2024-09-14T06:00:51.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1779999999999992e-06 2024-09-14T06:00:51.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.777 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756176+0000", 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0090000000000004e-06 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807264+0000", 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051087948000000001 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807353+0000", 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8919999999999996e-05 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.779 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807456+0000", 2024-09-14T06:00:51.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010275199999999999 2024-09-14T06:00:51.779 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.779 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.779 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.779 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119883 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5193728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.779 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:00:51.779 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9832904290000002, 2024-09-14T06:00:51.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051484553000000002, 2024-09-14T06:00:51.779 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.780 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.780 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.780 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.780 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.780 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.780 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119883 2024-09-14T06:00:51.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.780 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.780 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.780 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:00:51.780 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.781 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.781 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:00:51.781 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.781 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.781 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:00:51.781 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8699999999999995e-07 2024-09-14T06:00:51.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.781 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.781 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756188+0000", 2024-09-14T06:00:51.781 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4820000000000001e-06 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756195+0000", 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.545e-06 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756200+0000", 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.045e-06 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807487+0000", 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051287228999999997 2024-09-14T06:00:51.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807572+0000", 2024-09-14T06:00:51.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5303999999999995e-05 2024-09-14T06:00:51.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807670+0000", 2024-09-14T06:00:51.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7460999999999994e-05 2024-09-14T06:00:51.783 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.783 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.783 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.784 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119884 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5242880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.784 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:00:51.784 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9832499400000003, 2024-09-14T06:00:51.784 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051672403999999998, 2024-09-14T06:00:51.784 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.784 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.784 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.784 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.784 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.784 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.784 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119884 2024-09-14T06:00:51.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.784 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.785 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.785 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:00:51.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.785 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.785 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:00:51.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.785 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.785 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756226+0000", 2024-09-14T06:00:51.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7899999999999998e-07 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756229+0000", 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9919999999999999e-06 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756237+0000", 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1280000000000008e-06 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756244+0000", 2024-09-14T06:00:51.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7519999999999999e-06 2024-09-14T06:00:51.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807726+0000", 2024-09-14T06:00:51.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051482344999999999 2024-09-14T06:00:51.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807808+0000", 2024-09-14T06:00:51.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1845e-05 2024-09-14T06:00:51.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807898+0000", 2024-09-14T06:00:51.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9662999999999999e-05 2024-09-14T06:00:51.788 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.788 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.788 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.788 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119885 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5292032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.788 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:00:51.788 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9832215350000002, 2024-09-14T06:00:51.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051858125999999997, 2024-09-14T06:00:51.788 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.789 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.789 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.789 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.789 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.789 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119885 2024-09-14T06:00:51.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.789 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.789 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:00:51.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.790 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.790 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:00:51.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.790 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.790 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759822+0000", 2024-09-14T06:00:51.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035676610000000002 2024-09-14T06:00:51.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.790 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.790 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759831+0000", 2024-09-14T06:00:51.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2329999999999995e-06 2024-09-14T06:00:51.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759842+0000", 2024-09-14T06:00:51.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0954999999999999e-05 2024-09-14T06:00:51.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759851+0000", 2024-09-14T06:00:51.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1770000000000004e-06 2024-09-14T06:00:51.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807942+0000", 2024-09-14T06:00:51.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048091438 2024-09-14T06:00:51.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.808027+0000", 2024-09-14T06:00:51.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4227999999999994e-05 2024-09-14T06:00:51.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.808112+0000", 2024-09-14T06:00:51.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5433999999999996e-05 2024-09-14T06:00:51.792 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.792 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.792 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.793 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119897 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5881856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.793 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:00:51.793 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9794170280000003, 2024-09-14T06:00:51.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050603113999999998, 2024-09-14T06:00:51.793 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.793 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.793 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.793 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.793 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.793 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.793 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119897 2024-09-14T06:00:51.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760059+0000", 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0800000000000001e-07 2024-09-14T06:00:51.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760060+0000", 2024-09-14T06:00:51.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4050000000000001e-06 2024-09-14T06:00:51.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760063+0000", 2024-09-14T06:00:51.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2320000000000001e-06 2024-09-14T06:00:51.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760066+0000", 2024-09-14T06:00:51.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.74e-06 2024-09-14T06:00:51.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810454+0000", 2024-09-14T06:00:51.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050388355000000003 2024-09-14T06:00:51.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810550+0000", 2024-09-14T06:00:51.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5441999999999999e-05 2024-09-14T06:00:51.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810662+0000", 2024-09-14T06:00:51.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011173199999999999 2024-09-14T06:00:51.797 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.797 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.797 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.797 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119898 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5931008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.797 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:00:51.797 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.979405689, 2024-09-14T06:00:51.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050800631999999998, 2024-09-14T06:00:51.797 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.797 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119898 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:00:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:00:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0900000000000001e-07 2024-09-14T06:00:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760071+0000", 2024-09-14T06:00:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0899999999999999e-06 2024-09-14T06:00:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760074+0000", 2024-09-14T06:00:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1470000000000001e-06 2024-09-14T06:00:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760077+0000", 2024-09-14T06:00:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0170000000000001e-06 2024-09-14T06:00:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810704+0000", 2024-09-14T06:00:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050626811000000001 2024-09-14T06:00:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810779+0000", 2024-09-14T06:00:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4762e-05 2024-09-14T06:00:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810870+0000", 2024-09-14T06:00:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1595999999999995e-05 2024-09-14T06:00:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.801 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119899 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5980160~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.979394675, 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051034903, 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119899 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:00:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:00:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:00:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.34e-07 2024-09-14T06:00:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.804 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760082+0000", 2024-09-14T06:00:51.804 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4190000000000001e-06 2024-09-14T06:00:51.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.804 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.804 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760086+0000", 2024-09-14T06:00:51.804 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2629999999999999e-06 2024-09-14T06:00:51.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.804 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.804 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760088+0000", 2024-09-14T06:00:51.804 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5150000000000001e-06 2024-09-14T06:00:51.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810919+0000", 2024-09-14T06:00:51.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050831111999999998 2024-09-14T06:00:51.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811011+0000", 2024-09-14T06:00:51.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1339000000000001e-05 2024-09-14T06:00:51.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811116+0000", 2024-09-14T06:00:51.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105021 2024-09-14T06:00:51.805 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.806 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.806 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.806 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119900 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6029312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.806 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:00:51.806 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9793837700000001, 2024-09-14T06:00:51.806 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051299599000000001, 2024-09-14T06:00:51.806 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.806 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.806 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.806 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.806 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.806 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.807 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119900 2024-09-14T06:00:51.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.807 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.807 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.807 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:00:51.807 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.807 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.807 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:00:51.807 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.808 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.808 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:00:51.808 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5699999999999999e-07 2024-09-14T06:00:51.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.808 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.808 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760093+0000", 2024-09-14T06:00:51.808 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1689999999999999e-06 2024-09-14T06:00:51.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.808 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.808 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760096+0000", 2024-09-14T06:00:51.808 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.315e-06 2024-09-14T06:00:51.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.809 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760101+0000", 2024-09-14T06:00:51.809 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T06:00:51.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.809 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811162+0000", 2024-09-14T06:00:51.809 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051061341000000003 2024-09-14T06:00:51.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.809 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811271+0000", 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010851799999999999 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811391+0000", 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000120307 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119901 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6078464~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9793422500000002, 2024-09-14T06:00:51.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051519772999999998, 2024-09-14T06:00:51.811 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.811 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.811 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.811 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.811 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.811 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.811 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119901 2024-09-14T06:00:51.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.811 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.811 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:00:51.811 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.812 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.812 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:00:51.812 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.812 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.812 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760134+0000", 2024-09-14T06:00:51.812 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.92e-07 2024-09-14T06:00:51.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.812 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.813 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760138+0000", 2024-09-14T06:00:51.813 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3869999999999997e-06 2024-09-14T06:00:51.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.813 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.813 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760145+0000", 2024-09-14T06:00:51.813 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.878e-06 2024-09-14T06:00:51.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.813 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.813 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760151+0000", 2024-09-14T06:00:51.813 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4399999999999996e-06 2024-09-14T06:00:51.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811452+0000", 2024-09-14T06:00:51.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051301872999999998 2024-09-14T06:00:51.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811545+0000", 2024-09-14T06:00:51.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2472000000000005e-05 2024-09-14T06:00:51.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811653+0000", 2024-09-14T06:00:51.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108031 2024-09-14T06:00:51.815 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.815 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.815 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.815 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119902 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.815 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:00:51.815 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9793148649999992, 2024-09-14T06:00:51.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051737544000000003, 2024-09-14T06:00:51.815 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.815 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.815 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.815 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.816 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.816 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.816 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119902 2024-09-14T06:00:51.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.816 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.816 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.816 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:00:51.816 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.816 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.816 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:00:51.816 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.817 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.817 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:00:51.817 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0600000000000001e-07 2024-09-14T06:00:51.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.817 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.817 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760163+0000", 2024-09-14T06:00:51.817 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2850000000000001e-06 2024-09-14T06:00:51.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.817 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.818 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760170+0000", 2024-09-14T06:00:51.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6030000000000001e-06 2024-09-14T06:00:51.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.818 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.818 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760176+0000", 2024-09-14T06:00:51.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6540000000000004e-06 2024-09-14T06:00:51.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.818 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.818 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811704+0000", 2024-09-14T06:00:51.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051528303999999997 2024-09-14T06:00:51.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.819 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.819 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811794+0000", 2024-09-14T06:00:51.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0142000000000005e-05 2024-09-14T06:00:51.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.819 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.819 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811898+0000", 2024-09-14T06:00:51.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010415 2024-09-14T06:00:51.819 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.819 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.819 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.820 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119903 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6176768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.820 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:00:51.820 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9792852019999998, 2024-09-14T06:00:51.820 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051958747999999999, 2024-09-14T06:00:51.820 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.820 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.820 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.820 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.820 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.820 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.820 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119903 2024-09-14T06:00:51.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.820 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:00:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:00:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760191+0000", 2024-09-14T06:00:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6400000000000002e-07 2024-09-14T06:00:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760194+0000", 2024-09-14T06:00:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7920000000000001e-06 2024-09-14T06:00:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760203+0000", 2024-09-14T06:00:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0669999999999998e-06 2024-09-14T06:00:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760208+0000", 2024-09-14T06:00:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5929999999999996e-06 2024-09-14T06:00:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811955+0000", 2024-09-14T06:00:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051746357 2024-09-14T06:00:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812046+0000", 2024-09-14T06:00:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1824999999999996e-05 2024-09-14T06:00:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812149+0000", 2024-09-14T06:00:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010255 2024-09-14T06:00:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119904 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6225920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:00:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.9792580149999992, 2024-09-14T06:00:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052164159000000002, 2024-09-14T06:00:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.825 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.825 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.825 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.825 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119904 2024-09-14T06:00:51.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.825 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.825 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.825 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:00:51.825 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.825 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.826 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:00:51.826 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.826 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.826 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760218+0000", 2024-09-14T06:00:51.826 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2899999999999999e-07 2024-09-14T06:00:51.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.826 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.826 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760220+0000", 2024-09-14T06:00:51.826 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2879999999999999e-06 2024-09-14T06:00:51.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.827 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.827 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760226+0000", 2024-09-14T06:00:51.827 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1870000000000002e-06 2024-09-14T06:00:51.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.827 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.827 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760231+0000", 2024-09-14T06:00:51.827 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0950000000000003e-06 2024-09-14T06:00:51.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.827 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.827 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812192+0000", 2024-09-14T06:00:51.827 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051960587000000003 2024-09-14T06:00:51.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.828 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.828 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812281+0000", 2024-09-14T06:00:51.828 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9225e-05 2024-09-14T06:00:51.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.828 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.828 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812382+0000", 2024-09-14T06:00:51.828 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000100348 2024-09-14T06:00:51.828 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.828 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.828 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.829 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119905 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6275072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:51.829 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:00:51.829 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 8.979235976, 2024-09-14T06:00:51.829 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052394334000000001, 2024-09-14T06:00:51.829 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:51.829 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:51.829 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:51.829 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:51.829 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:51.829 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:51.829 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119905 2024-09-14T06:00:51.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.829 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:51.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.830 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:51.830 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:00:51.830 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.830 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:51.830 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:00:51.830 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:51.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.830 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:51.830 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760240+0000", 2024-09-14T06:00:51.831 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:00:51.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.831 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:51.831 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760242+0000", 2024-09-14T06:00:51.831 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0959999999999999e-06 2024-09-14T06:00:51.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.831 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:51.831 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760249+0000", 2024-09-14T06:00:51.831 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7399999999999998e-06 2024-09-14T06:00:51.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.831 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:51.832 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760254+0000", 2024-09-14T06:00:51.832 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9089999999999999e-06 2024-09-14T06:00:51.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.832 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.832 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:51.832 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812419+0000", 2024-09-14T06:00:51.832 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052165481 2024-09-14T06:00:51.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.832 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.832 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:51.832 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812510+0000", 2024-09-14T06:00:51.832 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0525000000000005e-05 2024-09-14T06:00:51.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:51.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:51.833 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:51.833 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812634+0000", 2024-09-14T06:00:51.833 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012412600000000001 2024-09-14T06:00:51.833 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.833 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.833 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.833 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:51.833 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:51.833 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:51.835 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:00:51.835 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:51.833+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:51.935 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:51.933+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:52.017 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:52.017 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:52.018 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:00:52.018 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:52.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:00:52.036 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:52.033+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:52.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:00:52.137 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:52.133+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:52.162 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:52.162 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:52.162 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:52.162 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:52.162 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:52.178 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:00:52.238 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:52.232+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:52.250 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:52.250 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:52.267 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:52.267 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:52.283 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:52.283 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:52.296 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:52.296 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:52.300 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:52.311 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:00:52.321 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:52.321 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:52.339 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:52.337+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:52.342 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:52.342 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:52.362 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:52.384 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:52.384 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:52.440 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:52.440 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:52.436+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:52.454 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:00:52.543 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:52.540+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:52.621 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:52.621 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:52.635 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:00:52.641 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:52.641+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:52.742 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:52.741+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:52.808 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:52.808 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:52.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:00:52.843 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:52.841+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:52.865 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-14T06:00:52.865 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T06:00:52.865 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-14T06:00:52.865 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T06:00:52.865 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T06:00:52.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-14T06:00:52.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T06:00:52.944 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:52.941+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:52.959 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:52.959 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:52.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:00:53.007 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:53.008 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T06:00:53.008 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:53.044 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:53.040+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:53.105 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:53.105 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:53.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:00:53.163 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:53.160+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:53.246 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:53.245+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:53.283 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:53.283 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:53.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:00:53.347 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:53.345+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:53.432 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:53.432 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:53.446 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:00:53.490 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:53.489+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:53.548 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:53.545+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:53.610 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:53.610 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:53.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:00:53.666 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:53.665+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:53.750 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:53.744+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:53.785 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:53.785 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:53.801 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:00:53.850 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:53.849+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2024-09-14T06:00:53.923 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:53.923 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:53.938 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:00:53.982 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:53.981+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:54.052 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:54.049+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:54.115 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:54.115 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:54.130 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:00:54.178 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:54.173+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:54.254 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:54.253+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:54.311 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:54.311 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:54.329 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:00:54.374 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:54.373+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:54.403 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:00:54.457 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:54.452+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:54.502 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:54.502 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:54.518 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:00:54.557 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:54.552+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:54.567 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:54.567 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:54.583 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:54.584 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:54.602 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:54.602 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:54.621 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:54.621 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:54.634 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:54.635 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:54.642 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:54.642 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:54.649 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:00:54.658 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:54.652+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:54.661 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:54.661 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:54.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:54.680 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:54.699 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:54.700 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:54.759 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:54.756+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:54.775 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:54.775 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:54.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:54.775 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:54.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.775 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59148 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 419840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.775 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:54.775 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.504374646000002, 2024-09-14T06:00:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072974285999999999, 2024-09-14T06:00:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59148 2024-09-14T06:00:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:00:54.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268521+0000", 2024-09-14T06:00:54.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4199999999999995e-07 2024-09-14T06:00:54.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268524+0000", 2024-09-14T06:00:54.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.05e-06 2024-09-14T06:00:54.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268534+0000", 2024-09-14T06:00:54.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8719999999999997e-06 2024-09-14T06:00:54.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268541+0000", 2024-09-14T06:00:54.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5349999999999999e-06 2024-09-14T06:00:54.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341108+0000", 2024-09-14T06:00:54.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072566624999999996 2024-09-14T06:00:54.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341169+0000", 2024-09-14T06:00:54.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1251e-05 2024-09-14T06:00:54.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341494+0000", 2024-09-14T06:00:54.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325311 2024-09-14T06:00:54.780 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.780 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.780 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.780 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59149 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 436224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.780 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:54.780 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.504335421999997, 2024-09-14T06:00:54.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073405053999999997, 2024-09-14T06:00:54.780 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.780 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.780 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.781 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.781 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59149 2024-09-14T06:00:54.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.781 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:54.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:00:54.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268560+0000", 2024-09-14T06:00:54.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9999999999999997e-07 2024-09-14T06:00:54.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268563+0000", 2024-09-14T06:00:54.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.292e-06 2024-09-14T06:00:54.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268573+0000", 2024-09-14T06:00:54.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3260000000000002e-06 2024-09-14T06:00:54.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268581+0000", 2024-09-14T06:00:54.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1960000000000008e-06 2024-09-14T06:00:54.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341537+0000", 2024-09-14T06:00:54.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072955916999999995 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341641+0000", 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104341 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341964+0000", 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032328199999999999 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.785 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59150 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 452608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.785 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:54.785 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.504302182000004, 2024-09-14T06:00:54.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073829748000000001, 2024-09-14T06:00:54.785 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.785 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.785 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.785 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.785 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.785 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.785 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59150 2024-09-14T06:00:54.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.785 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0399999999999995e-07 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268596+0000", 2024-09-14T06:00:54.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9859999999999999e-06 2024-09-14T06:00:54.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268606+0000", 2024-09-14T06:00:54.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0088000000000001e-05 2024-09-14T06:00:54.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268614+0000", 2024-09-14T06:00:54.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T06:00:54.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341999+0000", 2024-09-14T06:00:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073385011999999999 2024-09-14T06:00:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342093+0000", 2024-09-14T06:00:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3793000000000001e-05 2024-09-14T06:00:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342422+0000", 2024-09-14T06:00:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000329129 2024-09-14T06:00:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.789 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.789 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59151 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.789 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:54.789 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.504269813999997, 2024-09-14T06:00:54.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074207289999999995, 2024-09-14T06:00:54.789 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.789 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.789 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.789 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.789 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.790 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59151 2024-09-14T06:00:54.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.790 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:54.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:00:54.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268626+0000", 2024-09-14T06:00:54.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T06:00:54.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268629+0000", 2024-09-14T06:00:54.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.038e-06 2024-09-14T06:00:54.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268638+0000", 2024-09-14T06:00:54.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8139999999999995e-06 2024-09-14T06:00:54.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268647+0000", 2024-09-14T06:00:54.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4889999999999995e-06 2024-09-14T06:00:54.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342457+0000", 2024-09-14T06:00:54.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073809890000000003 2024-09-14T06:00:54.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342545+0000", 2024-09-14T06:00:54.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8697999999999997e-05 2024-09-14T06:00:54.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342832+0000", 2024-09-14T06:00:54.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028681799999999999 2024-09-14T06:00:54.793 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.793 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.793 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.793 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59152 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.793 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:54.793 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.504237173, 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074695176000000002, 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59152 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:54.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:00:54.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2900000000000003e-07 2024-09-14T06:00:54.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268661+0000", 2024-09-14T06:00:54.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0230000000000001e-06 2024-09-14T06:00:54.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268670+0000", 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2129999999999997e-06 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268679+0000", 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342937+0000", 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074258781999999995 2024-09-14T06:00:54.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343044+0000", 2024-09-14T06:00:54.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-09-14T06:00:54.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343353+0000", 2024-09-14T06:00:54.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030911099999999999 2024-09-14T06:00:54.797 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.797 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.797 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.798 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59153 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 501760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.798 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:54.798 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.504204403000003, 2024-09-14T06:00:54.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074997241000000006, 2024-09-14T06:00:54.798 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.798 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.798 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.798 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.798 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.798 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.798 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59153 2024-09-14T06:00:54.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.798 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:54.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:00:54.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268691+0000", 2024-09-14T06:00:54.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:00:54.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268693+0000", 2024-09-14T06:00:54.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3599999999999999e-06 2024-09-14T06:00:54.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268699+0000", 2024-09-14T06:00:54.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-09-14T06:00:54.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268704+0000", 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5759999999999999e-06 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343398+0000", 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074694522999999999 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343450+0000", 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1350999999999997e-05 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343688+0000", 2024-09-14T06:00:54.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023806500000000001 2024-09-14T06:00:54.802 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.802 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.802 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.802 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59154 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 518144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.802 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:54.802 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.504185337000003, 2024-09-14T06:00:54.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075389938000000004, 2024-09-14T06:00:54.802 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.802 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.802 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.802 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59154 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268710+0000", 2024-09-14T06:00:54.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8000000000000001e-07 2024-09-14T06:00:54.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268712+0000", 2024-09-14T06:00:54.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T06:00:54.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268717+0000", 2024-09-14T06:00:54.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8570000000000003e-06 2024-09-14T06:00:54.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268721+0000", 2024-09-14T06:00:54.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2039999999999999e-06 2024-09-14T06:00:54.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343721+0000", 2024-09-14T06:00:54.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074999748000000005 2024-09-14T06:00:54.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343784+0000", 2024-09-14T06:00:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3174000000000002e-05 2024-09-14T06:00:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.344099+0000", 2024-09-14T06:00:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000315299 2024-09-14T06:00:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59398 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 323584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:54.806 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.493221089000002, 2024-09-14T06:00:54.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073326565999999996, 2024-09-14T06:00:54.807 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.807 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.807 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.807 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59398 2024-09-14T06:00:54.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.807 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:54.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:00:54.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279675+0000", 2024-09-14T06:00:54.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-14T06:00:54.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279681+0000", 2024-09-14T06:00:54.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-09-14T06:00:54.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279702+0000", 2024-09-14T06:00:54.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1259000000000001e-05 2024-09-14T06:00:54.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279718+0000", 2024-09-14T06:00:54.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5475999999999999e-05 2024-09-14T06:00:54.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352360+0000", 2024-09-14T06:00:54.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.07264226 2024-09-14T06:00:54.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352447+0000", 2024-09-14T06:00:54.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7381999999999998e-05 2024-09-14T06:00:54.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353000+0000", 2024-09-14T06:00:54.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055309200000000004 2024-09-14T06:00:54.810 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.810 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.811 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.811 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59399 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.811 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:54.811 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.493156726000002, 2024-09-14T06:00:54.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073824446000000002, 2024-09-14T06:00:54.811 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.811 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.811 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.811 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.811 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.811 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.811 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59399 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279739+0000", 2024-09-14T06:00:54.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T06:00:54.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279745+0000", 2024-09-14T06:00:54.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T06:00:54.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279767+0000", 2024-09-14T06:00:54.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639000000000001e-05 2024-09-14T06:00:54.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279781+0000", 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4511999999999999e-05 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353045+0000", 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073263718000000005 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353168+0000", 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012314499999999999 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353562+0000", 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039435199999999999 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59400 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.493092965999999, 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074271465999999994, 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.815 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.816 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.816 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.816 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59400 2024-09-14T06:00:54.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.816 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:54.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:00:54.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279803+0000", 2024-09-14T06:00:54.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2100000000000001e-06 2024-09-14T06:00:54.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279819+0000", 2024-09-14T06:00:54.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6409000000000002e-05 2024-09-14T06:00:54.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279841+0000", 2024-09-14T06:00:54.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1878e-05 2024-09-14T06:00:54.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279856+0000", 2024-09-14T06:00:54.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4392999999999999e-05 2024-09-14T06:00:54.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353650+0000", 2024-09-14T06:00:54.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073794144000000006 2024-09-14T06:00:54.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353757+0000", 2024-09-14T06:00:54.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010687 2024-09-14T06:00:54.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354073+0000", 2024-09-14T06:00:54.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000316562 2024-09-14T06:00:54.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.821 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.821 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59401 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 372736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.821 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:54.821 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.493018141, 2024-09-14T06:00:54.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074643900999999999, 2024-09-14T06:00:54.821 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.821 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.822 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.822 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.822 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.822 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.822 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59401 2024-09-14T06:00:54.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.822 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:54.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:00:54.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279878+0000", 2024-09-14T06:00:54.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.31e-06 2024-09-14T06:00:54.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279883+0000", 2024-09-14T06:00:54.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3770000000000004e-06 2024-09-14T06:00:54.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279906+0000", 2024-09-14T06:00:54.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2398000000000001e-05 2024-09-14T06:00:54.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279920+0000", 2024-09-14T06:00:54.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.402e-05 2024-09-14T06:00:54.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354125+0000", 2024-09-14T06:00:54.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074205750000000001 2024-09-14T06:00:54.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354227+0000", 2024-09-14T06:00:54.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101612 2024-09-14T06:00:54.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354521+0000", 2024-09-14T06:00:54.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029343400000000002 2024-09-14T06:00:54.825 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.826 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.826 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.826 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59402 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 389120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.826 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:54.826 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.492956558000003, 2024-09-14T06:00:54.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075017027999999999, 2024-09-14T06:00:54.826 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.826 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.826 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.826 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.826 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.826 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59402 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279939+0000", 2024-09-14T06:00:54.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2470000000000001e-06 2024-09-14T06:00:54.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279945+0000", 2024-09-14T06:00:54.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-09-14T06:00:54.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279966+0000", 2024-09-14T06:00:54.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1801999999999999e-05 2024-09-14T06:00:54.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279980+0000", 2024-09-14T06:00:54.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3589e-05 2024-09-14T06:00:54.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354569+0000", 2024-09-14T06:00:54.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074588707000000004 2024-09-14T06:00:54.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354671+0000", 2024-09-14T06:00:54.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102398 2024-09-14T06:00:54.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354955+0000", 2024-09-14T06:00:54.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028406500000000001 2024-09-14T06:00:54.830 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.830 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.830 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.830 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59403 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 405504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.830 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:54.831 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.492894771000003, 2024-09-14T06:00:54.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075434395000000001, 2024-09-14T06:00:54.831 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.831 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.831 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.831 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.831 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.831 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.831 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59403 2024-09-14T06:00:54.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.831 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:00:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280001+0000", 2024-09-14T06:00:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2669999999999999e-06 2024-09-14T06:00:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280008+0000", 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5849999999999996e-06 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280030+0000", 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2293000000000002e-05 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280044+0000", 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3974999999999999e-05 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355013+0000", 2024-09-14T06:00:54.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074969039000000001 2024-09-14T06:00:54.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355144+0000", 2024-09-14T06:00:54.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000131333 2024-09-14T06:00:54.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355434+0000", 2024-09-14T06:00:54.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028990299999999999 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59404 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.492829651999998, 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075696103000000001, 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.835 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59404 2024-09-14T06:00:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:00:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280066+0000", 2024-09-14T06:00:54.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2640000000000001e-06 2024-09-14T06:00:54.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280072+0000", 2024-09-14T06:00:54.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129999999999997e-06 2024-09-14T06:00:54.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280094+0000", 2024-09-14T06:00:54.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2608000000000001e-05 2024-09-14T06:00:54.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280109+0000", 2024-09-14T06:00:54.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:00:54.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355479+0000", 2024-09-14T06:00:54.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075370699999999999 2024-09-14T06:00:54.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355554+0000", 2024-09-14T06:00:54.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4674999999999999e-05 2024-09-14T06:00:54.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355761+0000", 2024-09-14T06:00:54.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-14T06:00:54.839 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.839 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.839 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.839 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59405 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.839 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:54.840 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.492765742000003, 2024-09-14T06:00:54.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076008867999999993, 2024-09-14T06:00:54.840 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.840 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.840 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.840 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.840 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.840 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.840 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59405 2024-09-14T06:00:54.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.840 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:54.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:00:54.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280130+0000", 2024-09-14T06:00:54.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2500000000000001e-06 2024-09-14T06:00:54.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280136+0000", 2024-09-14T06:00:54.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-09-14T06:00:54.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280158+0000", 2024-09-14T06:00:54.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1795000000000001e-05 2024-09-14T06:00:54.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280172+0000", 2024-09-14T06:00:54.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4303e-05 2024-09-14T06:00:54.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355797+0000", 2024-09-14T06:00:54.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075624835000000001 2024-09-14T06:00:54.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355866+0000", 2024-09-14T06:00:54.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9043999999999998e-05 2024-09-14T06:00:54.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356138+0000", 2024-09-14T06:00:54.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027207799999999998 2024-09-14T06:00:54.844 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.844 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.844 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.844 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59406 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.844 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:54.844 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.492701799999999, 2024-09-14T06:00:54.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076435642999999998, 2024-09-14T06:00:54.844 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.844 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.845 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.845 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.845 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.845 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.845 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59406 2024-09-14T06:00:54.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.845 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:54.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:00:54.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280194+0000", 2024-09-14T06:00:54.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-14T06:00:54.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280200+0000", 2024-09-14T06:00:54.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6359999999999999e-06 2024-09-14T06:00:54.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280222+0000", 2024-09-14T06:00:54.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1628999999999999e-05 2024-09-14T06:00:54.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280236+0000", 2024-09-14T06:00:54.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4413000000000001e-05 2024-09-14T06:00:54.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356172+0000", 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075936466999999994 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356260+0000", 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7437999999999999e-05 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356629+0000", 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036877600000000002 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.849 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59407 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 471040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.849 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:54.849 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.492637567000003, 2024-09-14T06:00:54.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076820083999999997, 2024-09-14T06:00:54.849 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.849 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.849 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.849 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.849 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.849 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.849 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59407 2024-09-14T06:00:54.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.849 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:54.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:00:54.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280258+0000", 2024-09-14T06:00:54.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1370000000000001e-06 2024-09-14T06:00:54.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280264+0000", 2024-09-14T06:00:54.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6930000000000004e-06 2024-09-14T06:00:54.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280285+0000", 2024-09-14T06:00:54.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1455999999999999e-05 2024-09-14T06:00:54.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280300+0000", 2024-09-14T06:00:54.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4319e-05 2024-09-14T06:00:54.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356676+0000", 2024-09-14T06:00:54.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076376615999999994 2024-09-14T06:00:54.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356768+0000", 2024-09-14T06:00:54.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1234000000000001e-05 2024-09-14T06:00:54.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357077+0000", 2024-09-14T06:00:54.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030962900000000001 2024-09-14T06:00:54.853 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.853 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.853 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.853 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59408 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 487424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.853 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:54.853 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.492572567000003, 2024-09-14T06:00:54.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077185511999999998, 2024-09-14T06:00:54.854 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.854 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.854 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.854 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.854 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.854 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.854 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59408 2024-09-14T06:00:54.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.854 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:54.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:00:54.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280323+0000", 2024-09-14T06:00:54.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2860000000000001e-06 2024-09-14T06:00:54.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280329+0000", 2024-09-14T06:00:54.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.553e-06 2024-09-14T06:00:54.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280352+0000", 2024-09-14T06:00:54.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-14T06:00:54.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280366+0000", 2024-09-14T06:00:54.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-14T06:00:54.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357126+0000", 2024-09-14T06:00:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076760326000000004 2024-09-14T06:00:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357223+0000", 2024-09-14T06:00:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6490000000000006e-05 2024-09-14T06:00:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357508+0000", 2024-09-14T06:00:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028479900000000002 2024-09-14T06:00:54.858 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.858 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.858 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.858 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59409 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.858 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:54.858 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.492508336999997, 2024-09-14T06:00:54.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077536090000000002, 2024-09-14T06:00:54.858 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.858 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.858 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.858 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.858 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.859 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.859 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59409 2024-09-14T06:00:54.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.859 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:54.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:00:54.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280388+0000", 2024-09-14T06:00:54.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.096e-06 2024-09-14T06:00:54.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280393+0000", 2024-09-14T06:00:54.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T06:00:54.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280414+0000", 2024-09-14T06:00:54.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1175999999999999e-05 2024-09-14T06:00:54.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280427+0000", 2024-09-14T06:00:54.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3032e-05 2024-09-14T06:00:54.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357553+0000", 2024-09-14T06:00:54.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077125845999999998 2024-09-14T06:00:54.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357624+0000", 2024-09-14T06:00:54.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1062000000000005e-05 2024-09-14T06:00:54.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357923+0000", 2024-09-14T06:00:54.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029891199999999997 2024-09-14T06:00:54.862 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.862 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.862 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59410 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:00:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 59.492449024999999, 2024-09-14T06:00:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077854494999999996, 2024-09-14T06:00:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59410 2024-09-14T06:00:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.863 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:54.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:54.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:54.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:54.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:00:54.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:54.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:54.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280447+0000", 2024-09-14T06:00:54.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069999999999999e-06 2024-09-14T06:00:54.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:54.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280453+0000", 2024-09-14T06:00:54.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-06 2024-09-14T06:00:54.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:54.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280471+0000", 2024-09-14T06:00:54.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8295999999999999e-05 2024-09-14T06:00:54.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:54.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280484+0000", 2024-09-14T06:00:54.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2609000000000001e-05 2024-09-14T06:00:54.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:54.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357954+0000", 2024-09-14T06:00:54.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077470405000000006 2024-09-14T06:00:54.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:54.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358040+0000", 2024-09-14T06:00:54.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.551e-05 2024-09-14T06:00:54.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:54.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:54.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:54.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358300+0000", 2024-09-14T06:00:54.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026036800000000003 2024-09-14T06:00:54.867 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.867 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.867 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.867 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:54.867 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:54.867 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:54.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:00:54.869 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:54.868+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:54.970 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:54.968+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:54.995 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:54.995 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:00:54.996 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:55.010 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:00:55.071 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:55.069+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:55.129 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:55.129 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:55.129 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:55.129 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:55.129 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:55.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:00:55.172 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:55.168+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:55.273 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:55.269+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:55.318 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:55.319 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:55.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:55.319 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:55.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.319 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114752 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1458176~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.319 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:55.319 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.960382613, 2024-09-14T06:00:55.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11122652, 2024-09-14T06:00:55.319 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.319 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.319 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.320 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.320 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114752 2024-09-14T06:00:55.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.320 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:55.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:55.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:55.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.51e-07 2024-09-14T06:00:55.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357638+0000", 2024-09-14T06:00:55.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7540000000000001e-06 2024-09-14T06:00:55.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357643+0000", 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1150000000000002e-06 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357647+0000", 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7979999999999999e-06 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468136+0000", 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.110488747 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468353+0000", 2024-09-14T06:00:55.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000217166 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468862+0000", 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050938899999999996 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114753 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1564672~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.96034255, 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111972162, 2024-09-14T06:00:55.323 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.324 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.324 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.324 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.324 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.324 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.324 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114753 2024-09-14T06:00:55.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.324 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:55.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:55.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:55.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6599999999999996e-07 2024-09-14T06:00:55.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357678+0000", 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.807e-06 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357683+0000", 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.933e-06 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357687+0000", 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8469999999999998e-06 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468941+0000", 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111254009 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469159+0000", 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021768800000000001 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469648+0000", 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048931199999999999 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.327 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114754 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1671168~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.960302877, 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.112607016, 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114754 2024-09-14T06:00:55.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357716+0000", 2024-09-14T06:00:55.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-14T06:00:55.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357718+0000", 2024-09-14T06:00:55.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5910000000000001e-06 2024-09-14T06:00:55.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357725+0000", 2024-09-14T06:00:55.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9399999999999996e-06 2024-09-14T06:00:55.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357729+0000", 2024-09-14T06:00:55.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0439999999999997e-06 2024-09-14T06:00:55.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469752+0000", 2024-09-14T06:00:55.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11202385400000001 2024-09-14T06:00:55.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469889+0000", 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136704 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470322+0000", 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000433337 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114771 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 98304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.960261769999999, 2024-09-14T06:00:55.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11267808, 2024-09-14T06:00:55.333 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.333 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.333 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.333 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.333 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.333 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.333 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114771 2024-09-14T06:00:55.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.333 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:55.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:55.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:55.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.37e-07 2024-09-14T06:00:55.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357759+0000", 2024-09-14T06:00:55.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5650000000000001e-06 2024-09-14T06:00:55.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357764+0000", 2024-09-14T06:00:55.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T06:00:55.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357768+0000", 2024-09-14T06:00:55.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9580000000000001e-06 2024-09-14T06:00:55.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469739+0000", 2024-09-14T06:00:55.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111971591 2024-09-14T06:00:55.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469951+0000", 2024-09-14T06:00:55.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021185999999999999 2024-09-14T06:00:55.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470435+0000", 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048335499999999998 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114772 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.960221554, 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11329244500000001, 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.337 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.338 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.338 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.338 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114772 2024-09-14T06:00:55.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.338 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:55.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:55.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:55.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3099999999999998e-07 2024-09-14T06:00:55.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357799+0000", 2024-09-14T06:00:55.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0770000000000002e-06 2024-09-14T06:00:55.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357805+0000", 2024-09-14T06:00:55.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3329999999999996e-06 2024-09-14T06:00:55.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357816+0000", 2024-09-14T06:00:55.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0869999999999999e-05 2024-09-14T06:00:55.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470507+0000", 2024-09-14T06:00:55.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.112691635 2024-09-14T06:00:55.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470648+0000", 2024-09-14T06:00:55.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014075000000000001 2024-09-14T06:00:55.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471089+0000", 2024-09-14T06:00:55.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000441249 2024-09-14T06:00:55.341 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.341 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.341 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114773 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 311296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.960176008000001, 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114111303, 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114773 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357843+0000", 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4499999999999997e-07 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357844+0000", 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.612e-06 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357851+0000", 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7900000000000002e-06 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357855+0000", 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9310000000000001e-06 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471187+0000", 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.113332222 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471425+0000", 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000237412 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471954+0000", 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00052879100000000003 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.345 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114774 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 417792~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.960134982, 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114690902, 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114774 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.346 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357884+0000", 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.37e-07 2024-09-14T06:00:55.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357886+0000", 2024-09-14T06:00:55.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7010000000000001e-06 2024-09-14T06:00:55.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357891+0000", 2024-09-14T06:00:55.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T06:00:55.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357896+0000", 2024-09-14T06:00:55.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5999999999999997e-06 2024-09-14T06:00:55.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472030+0000", 2024-09-14T06:00:55.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11413328 2024-09-14T06:00:55.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472157+0000", 2024-09-14T06:00:55.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012693900000000001 2024-09-14T06:00:55.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472574+0000", 2024-09-14T06:00:55.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041773100000000002 2024-09-14T06:00:55.350 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.350 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.350 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.350 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114775 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 524288~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.350 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:55.350 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.960095314, 2024-09-14T06:00:55.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.115518357, 2024-09-14T06:00:55.350 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.350 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.350 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114775 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357924+0000", 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3799999999999997e-07 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357928+0000", 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7700000000000001e-06 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357934+0000", 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6420000000000004e-06 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357938+0000", 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1899999999999997e-06 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472667+0000", 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114728409 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472901+0000", 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023484100000000001 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473441+0000", 2024-09-14T06:00:55.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053996700000000003 2024-09-14T06:00:55.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.354 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.354 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114776 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 630784~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.354 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:55.354 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.960055418, 2024-09-14T06:00:55.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11610183, 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114776 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357964+0000", 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7700000000000004e-07 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357965+0000", 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.761e-06 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357970+0000", 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1429999999999997e-06 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357974+0000", 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8879999999999999e-06 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473514+0000", 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11554007500000001 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473641+0000", 2024-09-14T06:00:55.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000127088 2024-09-14T06:00:55.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474065+0000", 2024-09-14T06:00:55.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00042329800000000001 2024-09-14T06:00:55.358 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.358 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.358 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.358 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114777 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 737280~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.960016242999998, 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11697975200000001, 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114777 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:55.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:55.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358003+0000", 2024-09-14T06:00:55.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-14T06:00:55.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358004+0000", 2024-09-14T06:00:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6950000000000001e-06 2024-09-14T06:00:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358010+0000", 2024-09-14T06:00:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2410000000000003e-06 2024-09-14T06:00:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358014+0000", 2024-09-14T06:00:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9380000000000002e-06 2024-09-14T06:00:55.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474156+0000", 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.116142597 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474386+0000", 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023008999999999999 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474982+0000", 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059564500000000001 2024-09-14T06:00:55.362 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114778 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 843776~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.9599759, 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11749908100000001, 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.363 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114778 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358043+0000", 2024-09-14T06:00:55.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3399999999999999e-07 2024-09-14T06:00:55.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358045+0000", 2024-09-14T06:00:55.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8789999999999999e-06 2024-09-14T06:00:55.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358052+0000", 2024-09-14T06:00:55.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.951e-06 2024-09-14T06:00:55.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358056+0000", 2024-09-14T06:00:55.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.121e-06 2024-09-14T06:00:55.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475018+0000", 2024-09-14T06:00:55.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11696224199999999 2024-09-14T06:00:55.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475141+0000", 2024-09-14T06:00:55.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012285099999999999 2024-09-14T06:00:55.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475542+0000", 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00040050300000000002 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114779 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 950272~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.959933301, 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.118289098, 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.367 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.368 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.368 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.368 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.368 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114779 2024-09-14T06:00:55.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.368 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:55.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358086+0000", 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5300000000000004e-07 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358087+0000", 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.623e-06 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358093+0000", 2024-09-14T06:00:55.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9510000000000003e-06 2024-09-14T06:00:55.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358097+0000", 2024-09-14T06:00:55.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1819999999999999e-06 2024-09-14T06:00:55.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475637+0000", 2024-09-14T06:00:55.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11753928600000001 2024-09-14T06:00:55.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475862+0000", 2024-09-14T06:00:55.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225336 2024-09-14T06:00:55.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476374+0000", 2024-09-14T06:00:55.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000512167 2024-09-14T06:00:55.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.371 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.372 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114780 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1056768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.372 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:55.372 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.959892277000002, 2024-09-14T06:00:55.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.119083513, 2024-09-14T06:00:55.372 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.372 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.372 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.372 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.372 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.372 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.372 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114780 2024-09-14T06:00:55.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.372 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358127+0000", 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.44e-07 2024-09-14T06:00:55.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358128+0000", 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.714e-06 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358135+0000", 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358140+0000", 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1969999999999998e-06 2024-09-14T06:00:55.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476456+0000", 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.118316717 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476674+0000", 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021775200000000001 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477210+0000", 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053548400000000003 2024-09-14T06:00:55.375 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114781 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1163264~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.959847155999999, 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11988966700000001, 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.376 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114781 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358172+0000", 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.44e-07 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358174+0000", 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9920000000000002e-06 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358179+0000", 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.288e-06 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358183+0000", 2024-09-14T06:00:55.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0489999999999997e-06 2024-09-14T06:00:55.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477294+0000", 2024-09-14T06:00:55.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11911132000000001 2024-09-14T06:00:55.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477516+0000", 2024-09-14T06:00:55.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022208500000000001 2024-09-14T06:00:55.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478061+0000", 2024-09-14T06:00:55.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00054438900000000005 2024-09-14T06:00:55.380 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.380 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.380 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.380 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114782 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1269760~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.380 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:55.380 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.959828589000001, 2024-09-14T06:00:55.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.120723238, 2024-09-14T06:00:55.380 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.380 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.380 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.381 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.381 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.381 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.381 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114782 2024-09-14T06:00:55.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.381 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:55.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4099999999999999e-07 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358192+0000", 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.559e-06 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358197+0000", 2024-09-14T06:00:55.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6789999999999996e-06 2024-09-14T06:00:55.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358202+0000", 2024-09-14T06:00:55.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4779999999999999e-06 2024-09-14T06:00:55.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478140+0000", 2024-09-14T06:00:55.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11993833600000001 2024-09-14T06:00:55.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478358+0000", 2024-09-14T06:00:55.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021785700000000001 2024-09-14T06:00:55.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478913+0000", 2024-09-14T06:00:55.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055478799999999996 2024-09-14T06:00:55.384 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.384 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.384 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.384 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114783 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1376256~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.384 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:55.385 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.959810244, 2024-09-14T06:00:55.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121464831, 2024-09-14T06:00:55.385 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.385 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.385 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.385 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114783 2024-09-14T06:00:55.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.385 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:55.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:55.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:55.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4499999999999998e-07 2024-09-14T06:00:55.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358210+0000", 2024-09-14T06:00:55.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5880000000000001e-06 2024-09-14T06:00:55.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358214+0000", 2024-09-14T06:00:55.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3850000000000004e-06 2024-09-14T06:00:55.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358218+0000", 2024-09-14T06:00:55.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7799999999999998e-06 2024-09-14T06:00:55.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479024+0000", 2024-09-14T06:00:55.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.120805364 2024-09-14T06:00:55.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479177+0000", 2024-09-14T06:00:55.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153642 2024-09-14T06:00:55.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479673+0000", 2024-09-14T06:00:55.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049572699999999995 2024-09-14T06:00:55.389 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.389 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.389 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.389 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114784 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1482752~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.389 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:55.389 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.959795585999998, 2024-09-14T06:00:55.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.122316759, 2024-09-14T06:00:55.389 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.389 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.389 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114784 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:55.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2399999999999999e-07 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358225+0000", 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5570000000000001e-06 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358229+0000", 2024-09-14T06:00:55.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5589999999999999e-06 2024-09-14T06:00:55.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358233+0000", 2024-09-14T06:00:55.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7270000000000001e-06 2024-09-14T06:00:55.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479769+0000", 2024-09-14T06:00:55.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12153594299999999 2024-09-14T06:00:55.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480000+0000", 2024-09-14T06:00:55.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000230967 2024-09-14T06:00:55.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480540+0000", 2024-09-14T06:00:55.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053968199999999999 2024-09-14T06:00:55.393 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.393 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.393 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.393 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114785 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1589248~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.393 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:55.393 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.959779394999998, 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123154237, 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114785 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3799999999999998e-07 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358241+0000", 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.457e-06 2024-09-14T06:00:55.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358245+0000", 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.42e-06 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358249+0000", 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7740000000000002e-06 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480626+0000", 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12237743600000001 2024-09-14T06:00:55.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480844+0000", 2024-09-14T06:00:55.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021792299999999999 2024-09-14T06:00:55.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481393+0000", 2024-09-14T06:00:55.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000548889 2024-09-14T06:00:55.397 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.397 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.397 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114786 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1695744~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.959764691, 2024-09-14T06:00:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123995568, 2024-09-14T06:00:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114786 2024-09-14T06:00:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.27e-07 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358256+0000", 2024-09-14T06:00:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5460000000000001e-06 2024-09-14T06:00:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358260+0000", 2024-09-14T06:00:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3819999999999997e-06 2024-09-14T06:00:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358264+0000", 2024-09-14T06:00:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7469999999999999e-06 2024-09-14T06:00:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481473+0000", 2024-09-14T06:00:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123209244 2024-09-14T06:00:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481686+0000", 2024-09-14T06:00:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000212957 2024-09-14T06:00:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482249+0000", 2024-09-14T06:00:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00056336500000000002 2024-09-14T06:00:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114867 3.15 3:aea12e8e:::rbd_data.1127cb09e343.000000000000000b:head [stat,truncate 737280] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.959750106000001, 2024-09-14T06:00:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12722582099999999, 2024-09-14T06:00:55.402 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114867 2024-09-14T06:00:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358269+0000", 2024-09-14T06:00:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4799999999999999e-07 2024-09-14T06:00:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358274+0000", 2024-09-14T06:00:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.237e-06 2024-09-14T06:00:55.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358279+0000", 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7990000000000001e-06 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358284+0000", 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1900000000000003e-06 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482355+0000", 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.124070718 2024-09-14T06:00:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482496+0000", 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014162699999999999 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 3", 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482722+0000", 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225622 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.484427+0000", 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001704929 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485332+0000", 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00090576600000000001 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485429+0000", 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6540999999999996e-05 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485494+0000", 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5043999999999996e-05 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.407 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:55.408 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:55.408 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:55.409 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:00:55.409 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:55.404+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:55.510 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:55.509+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:55.550 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:55.550 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:55.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.550 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:122596 3.1b 3:df36c6d0:::rbd_object_map.112763f1be8c:head [call lock.lock in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-09-14T06:00:55.550 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:55.547342+0000", 2024-09-14T06:00:55.550 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.002615231, 2024-09-14T06:00:55.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0026592740000000001, 2024-09-14T06:00:55.550 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.550 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.550 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:55.550 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.550 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 122596 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.547342+0000", 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.547342+0000", 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.547345+0000", 2024-09-14T06:00:55.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6199999999999999e-06 2024-09-14T06:00:55.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.547359+0000", 2024-09-14T06:00:55.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3587000000000001e-05 2024-09-14T06:00:55.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.547392+0000", 2024-09-14T06:00:55.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3445999999999998e-05 2024-09-14T06:00:55.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.547431+0000", 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9270000000000002e-05 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.547523+0000", 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1945000000000001e-05 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.547597+0000", 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4085000000000006e-05 2024-09-14T06:00:55.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:00:55.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.547717+0000", 2024-09-14T06:00:55.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011976000000000001 2024-09-14T06:00:55.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:00:55.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.548412+0000", 2024-09-14T06:00:55.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00069524500000000004 2024-09-14T06:00:55.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:55.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.549727+0000", 2024-09-14T06:00:55.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0013143650000000001 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.549898+0000", 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017159799999999999 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop_reply(client.4391.0:122596 3.1b e112/46 ondisk, result = 0)", 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:55.549503+0000", 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 0.00045494200000000001, 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00063684699999999996, 2024-09-14T06:00:55.555 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.556 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.556 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.556 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.549503+0000", 2024-09-14T06:00:55.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.549503+0000", 2024-09-14T06:00:55.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.549504+0000", 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3430000000000001e-06 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.549511+0000", 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5229999999999998e-06 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.549534+0000", 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2710000000000001e-05 2024-09-14T06:00:55.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.549547+0000", 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2859e-05 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.549677+0000", 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000129899 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.549705+0000", 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8076999999999999e-05 2024-09-14T06:00:55.558 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.559 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.559 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.559 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:122597 3.1b 3:df36c6d0:::rbd_object_map.112763f1be8c:head [call rbd.object_map_load in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112)", 2024-09-14T06:00:55.559 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:55.550035+0000", 2024-09-14T06:00:55.559 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 4294967295.9999223, 2024-09-14T06:00:55.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000201514, 2024-09-14T06:00:55.559 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.559 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.559 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.559 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.559 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.559 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.560 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 122597 2024-09-14T06:00:55.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.560 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.550035+0000", 2024-09-14T06:00:55.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.550035+0000", 2024-09-14T06:00:55.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.550036+0000", 2024-09-14T06:00:55.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8599999999999997e-07 2024-09-14T06:00:55.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.550041+0000", 2024-09-14T06:00:55.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7339999999999999e-06 2024-09-14T06:00:55.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.550053+0000", 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2252999999999999e-05 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.550059+0000", 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9159999999999998e-06 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.550175+0000", 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000115696 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:55.550224+0000", 2024-09-14T06:00:55.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9672000000000001e-05 2024-09-14T06:00:55.563 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.563 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.563 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.563 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.563 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:00:55.563 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 3 2024-09-14T06:00:55.563 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:55.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:00:55.611 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:55.608+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:55.691 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:55.692 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:55.692 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:55.692 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:55.692 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:55.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:00:55.751 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:55.748+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:55.813 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:55.808+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:55.873 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:55.873 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:00:55.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:00:55.873 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119850 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 3571712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.119576149, 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050424731, 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119850 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6100000000000001e-07 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751247+0000", 2024-09-14T06:00:55.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5059999999999998e-06 2024-09-14T06:00:55.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751255+0000", 2024-09-14T06:00:55.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3080000000000008e-06 2024-09-14T06:00:55.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751262+0000", 2024-09-14T06:00:55.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1060000000000002e-06 2024-09-14T06:00:55.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801559+0000", 2024-09-14T06:00:55.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050297043 2024-09-14T06:00:55.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801614+0000", 2024-09-14T06:00:55.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5028999999999998e-05 2024-09-14T06:00:55.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801668+0000", 2024-09-14T06:00:55.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4178000000000002e-05 2024-09-14T06:00:55.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.878 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.878 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119851 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 3620864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.878 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:00:55.878 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.119547492000001, 2024-09-14T06:00:55.878 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050528479000000001, 2024-09-14T06:00:55.878 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.878 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.878 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.878 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.878 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119851 2024-09-14T06:00:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:00:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:00:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.880 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.880 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752502+0000", 2024-09-14T06:00:55.880 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012294529999999999 2024-09-14T06:00:55.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.880 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.880 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752508+0000", 2024-09-14T06:00:55.880 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8780000000000003e-06 2024-09-14T06:00:55.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.880 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.880 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752522+0000", 2024-09-14T06:00:55.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4405e-05 2024-09-14T06:00:55.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752532+0000", 2024-09-14T06:00:55.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6739999999999992e-06 2024-09-14T06:00:55.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801702+0000", 2024-09-14T06:00:55.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049169996000000001 2024-09-14T06:00:55.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801744+0000", 2024-09-14T06:00:55.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2789e-05 2024-09-14T06:00:55.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801801+0000", 2024-09-14T06:00:55.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6283999999999998e-05 2024-09-14T06:00:55.882 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.882 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.882 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119877 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4898816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.114818058000001, 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050416282999999999, 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119877 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:00:55.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:00:55.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:00:55.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6300000000000005e-07 2024-09-14T06:00:55.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.885 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.885 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756005+0000", 2024-09-14T06:00:55.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7350000000000001e-06 2024-09-14T06:00:55.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.885 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.885 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756012+0000", 2024-09-14T06:00:55.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8990000000000004e-06 2024-09-14T06:00:55.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.885 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.885 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756017+0000", 2024-09-14T06:00:55.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.023e-06 2024-09-14T06:00:55.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806256+0000", 2024-09-14T06:00:55.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050239355999999999 2024-09-14T06:00:55.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806331+0000", 2024-09-14T06:00:55.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4800000000000002e-05 2024-09-14T06:00:55.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806418+0000", 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6907e-05 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119878 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4947968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.114793212, 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050582539000000003, 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.887 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.888 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.888 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.888 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119878 2024-09-14T06:00:55.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.888 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:00:55.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.888 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.888 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:00:55.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.889 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.889 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756027+0000", 2024-09-14T06:00:55.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1399999999999997e-07 2024-09-14T06:00:55.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.889 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.889 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756029+0000", 2024-09-14T06:00:55.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3420000000000002e-06 2024-09-14T06:00:55.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756036+0000", 2024-09-14T06:00:55.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9550000000000003e-06 2024-09-14T06:00:55.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756041+0000", 2024-09-14T06:00:55.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2669999999999997e-06 2024-09-14T06:00:55.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806448+0000", 2024-09-14T06:00:55.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050407037000000002 2024-09-14T06:00:55.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806526+0000", 2024-09-14T06:00:55.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7119000000000005e-05 2024-09-14T06:00:55.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806609+0000", 2024-09-14T06:00:55.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3405000000000005e-05 2024-09-14T06:00:55.891 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.891 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.891 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.892 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119879 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4997120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.892 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:00:55.892 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.114770732, 2024-09-14T06:00:55.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.05075727, 2024-09-14T06:00:55.892 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.892 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.892 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.892 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.892 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.892 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.892 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119879 2024-09-14T06:00:55.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.893 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.893 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.893 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:00:55.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.893 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.893 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:00:55.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:00:55.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9400000000000001e-07 2024-09-14T06:00:55.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756058+0000", 2024-09-14T06:00:55.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5199999999999997e-06 2024-09-14T06:00:55.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756065+0000", 2024-09-14T06:00:55.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9800000000000001e-06 2024-09-14T06:00:55.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756070+0000", 2024-09-14T06:00:55.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2360000000000004e-06 2024-09-14T06:00:55.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806639+0000", 2024-09-14T06:00:55.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050568702 2024-09-14T06:00:55.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806714+0000", 2024-09-14T06:00:55.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4825000000000003e-05 2024-09-14T06:00:55.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806806+0000", 2024-09-14T06:00:55.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2613000000000003e-05 2024-09-14T06:00:55.896 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.896 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.896 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.896 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119880 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5046272~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.896 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:00:55.896 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.114716033000001, 2024-09-14T06:00:55.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050918568999999997, 2024-09-14T06:00:55.897 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.897 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.897 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.897 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.897 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.897 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.897 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119880 2024-09-14T06:00:55.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.897 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:00:55.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.898 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.898 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:00:55.898 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.898 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.898 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:00:55.898 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:00:55.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.898 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.898 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756107+0000", 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8159999999999998e-06 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756116+0000", 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4980000000000006e-06 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756122+0000", 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8809999999999998e-06 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806841+0000", 2024-09-14T06:00:55.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050718907000000001 2024-09-14T06:00:55.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806927+0000", 2024-09-14T06:00:55.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5908999999999994e-05 2024-09-14T06:00:55.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807022+0000", 2024-09-14T06:00:55.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4901000000000005e-05 2024-09-14T06:00:55.900 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.900 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119881 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5095424~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:00:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.11468541, 2024-09-14T06:00:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051097946999999998, 2024-09-14T06:00:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.901 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119881 2024-09-14T06:00:55.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.902 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.902 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.902 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:00:55.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.902 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.902 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:00:55.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756135+0000", 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.51e-07 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756137+0000", 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2230000000000001e-06 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756145+0000", 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6629999999999993e-06 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756150+0000", 2024-09-14T06:00:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9150000000000004e-06 2024-09-14T06:00:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807054+0000", 2024-09-14T06:00:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050904855999999998 2024-09-14T06:00:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807137+0000", 2024-09-14T06:00:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2248000000000003e-05 2024-09-14T06:00:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807232+0000", 2024-09-14T06:00:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5490999999999998e-05 2024-09-14T06:00:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119882 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5144576~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:00:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.114661534, 2024-09-14T06:00:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051297745999999998, 2024-09-14T06:00:55.905 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119882 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.906 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:00:55.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756159+0000", 2024-09-14T06:00:55.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4299999999999998e-07 2024-09-14T06:00:55.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756161+0000", 2024-09-14T06:00:55.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4959999999999999e-06 2024-09-14T06:00:55.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756170+0000", 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1779999999999992e-06 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756176+0000", 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0090000000000004e-06 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807264+0000", 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051087948000000001 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807353+0000", 2024-09-14T06:00:55.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8919999999999996e-05 2024-09-14T06:00:55.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807456+0000", 2024-09-14T06:00:55.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010275199999999999 2024-09-14T06:00:55.909 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.909 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.909 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.909 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119883 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5193728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.909 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.114634681, 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051484553000000002, 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119883 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:00:55.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:00:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:00:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8699999999999995e-07 2024-09-14T06:00:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756188+0000", 2024-09-14T06:00:55.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4820000000000001e-06 2024-09-14T06:00:55.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756195+0000", 2024-09-14T06:00:55.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.545e-06 2024-09-14T06:00:55.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756200+0000", 2024-09-14T06:00:55.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.045e-06 2024-09-14T06:00:55.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807487+0000", 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051287228999999997 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807572+0000", 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5303999999999995e-05 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807670+0000", 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7460999999999994e-05 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.913 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.914 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119884 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5242880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.914 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:00:55.914 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.114594192, 2024-09-14T06:00:55.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051672403999999998, 2024-09-14T06:00:55.914 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.914 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.914 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.914 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.914 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.914 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.914 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119884 2024-09-14T06:00:55.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756226+0000", 2024-09-14T06:00:55.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7899999999999998e-07 2024-09-14T06:00:55.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756229+0000", 2024-09-14T06:00:55.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9919999999999999e-06 2024-09-14T06:00:55.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756237+0000", 2024-09-14T06:00:55.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1280000000000008e-06 2024-09-14T06:00:55.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756244+0000", 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7519999999999999e-06 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807726+0000", 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051482344999999999 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807808+0000", 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1845e-05 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807898+0000", 2024-09-14T06:00:55.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9662999999999999e-05 2024-09-14T06:00:55.918 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.918 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.918 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.918 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119885 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5292032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.918 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:00:55.918 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.114565787, 2024-09-14T06:00:55.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051858125999999997, 2024-09-14T06:00:55.918 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.918 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.919 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.919 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.919 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.919 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.919 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119885 2024-09-14T06:00:55.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.919 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:00:55.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:00:55.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759822+0000", 2024-09-14T06:00:55.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035676610000000002 2024-09-14T06:00:55.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759831+0000", 2024-09-14T06:00:55.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2329999999999995e-06 2024-09-14T06:00:55.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759842+0000", 2024-09-14T06:00:55.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0954999999999999e-05 2024-09-14T06:00:55.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759851+0000", 2024-09-14T06:00:55.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1770000000000004e-06 2024-09-14T06:00:55.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807942+0000", 2024-09-14T06:00:55.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048091438 2024-09-14T06:00:55.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.808027+0000", 2024-09-14T06:00:55.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4227999999999994e-05 2024-09-14T06:00:55.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.808112+0000", 2024-09-14T06:00:55.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5433999999999996e-05 2024-09-14T06:00:55.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.922 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.923 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119897 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5881856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.923 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:00:55.923 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.11076128, 2024-09-14T06:00:55.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050603113999999998, 2024-09-14T06:00:55.923 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.923 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.923 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.923 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.923 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.923 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.923 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119897 2024-09-14T06:00:55.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.924 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:00:55.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:00:55.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760059+0000", 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0800000000000001e-07 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760060+0000", 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4050000000000001e-06 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760063+0000", 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2320000000000001e-06 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760066+0000", 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.74e-06 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810454+0000", 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050388355000000003 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810550+0000", 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5441999999999999e-05 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810662+0000", 2024-09-14T06:00:55.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011173199999999999 2024-09-14T06:00:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119898 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5931008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:00:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.110749941, 2024-09-14T06:00:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050800631999999998, 2024-09-14T06:00:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.927 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.928 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.928 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119898 2024-09-14T06:00:55.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.928 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:00:55.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:00:55.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:00:55.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0900000000000001e-07 2024-09-14T06:00:55.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760071+0000", 2024-09-14T06:00:55.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0899999999999999e-06 2024-09-14T06:00:55.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760074+0000", 2024-09-14T06:00:55.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1470000000000001e-06 2024-09-14T06:00:55.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760077+0000", 2024-09-14T06:00:55.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0170000000000001e-06 2024-09-14T06:00:55.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810704+0000", 2024-09-14T06:00:55.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050626811000000001 2024-09-14T06:00:55.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810779+0000", 2024-09-14T06:00:55.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4762e-05 2024-09-14T06:00:55.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810870+0000", 2024-09-14T06:00:55.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1595999999999995e-05 2024-09-14T06:00:55.931 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.931 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.931 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.931 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119899 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5980160~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.932 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:00:55.932 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.110738927, 2024-09-14T06:00:55.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051034903, 2024-09-14T06:00:55.932 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.932 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.932 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.932 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.932 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.932 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.932 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119899 2024-09-14T06:00:55.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.932 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:00:55.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:00:55.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:00:55.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.34e-07 2024-09-14T06:00:55.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760082+0000", 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4190000000000001e-06 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760086+0000", 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2629999999999999e-06 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760088+0000", 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5150000000000001e-06 2024-09-14T06:00:55.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810919+0000", 2024-09-14T06:00:55.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050831111999999998 2024-09-14T06:00:55.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811011+0000", 2024-09-14T06:00:55.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1339000000000001e-05 2024-09-14T06:00:55.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811116+0000", 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105021 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119900 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6029312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.110728022, 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051299599000000001, 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.936 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.937 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.937 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119900 2024-09-14T06:00:55.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.937 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:00:55.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5699999999999999e-07 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760093+0000", 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1689999999999999e-06 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760096+0000", 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.315e-06 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760101+0000", 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811162+0000", 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051061341000000003 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811271+0000", 2024-09-14T06:00:55.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010851799999999999 2024-09-14T06:00:55.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811391+0000", 2024-09-14T06:00:55.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000120307 2024-09-14T06:00:55.940 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.940 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.940 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.940 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119901 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6078464~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.940 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:00:55.940 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.110686502, 2024-09-14T06:00:55.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051519772999999998, 2024-09-14T06:00:55.941 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.941 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.941 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.941 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.941 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.941 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.941 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119901 2024-09-14T06:00:55.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.941 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.941 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.941 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:00:55.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760134+0000", 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.92e-07 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760138+0000", 2024-09-14T06:00:55.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3869999999999997e-06 2024-09-14T06:00:55.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760145+0000", 2024-09-14T06:00:55.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.878e-06 2024-09-14T06:00:55.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760151+0000", 2024-09-14T06:00:55.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4399999999999996e-06 2024-09-14T06:00:55.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811452+0000", 2024-09-14T06:00:55.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051301872999999998 2024-09-14T06:00:55.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811545+0000", 2024-09-14T06:00:55.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2472000000000005e-05 2024-09-14T06:00:55.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811653+0000", 2024-09-14T06:00:55.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108031 2024-09-14T06:00:55.944 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.944 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.944 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.945 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119902 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.945 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:00:55.945 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.110659117000001, 2024-09-14T06:00:55.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051737544000000003, 2024-09-14T06:00:55.945 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.945 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.945 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.945 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.945 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.945 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.945 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119902 2024-09-14T06:00:55.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.946 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:00:55.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:00:55.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0600000000000001e-07 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760163+0000", 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2850000000000001e-06 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760170+0000", 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6030000000000001e-06 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760176+0000", 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6540000000000004e-06 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811704+0000", 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051528303999999997 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811794+0000", 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0142000000000005e-05 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811898+0000", 2024-09-14T06:00:55.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010415 2024-09-14T06:00:55.949 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.949 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.949 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.949 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119903 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6176768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.949 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:00:55.949 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.110629454, 2024-09-14T06:00:55.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051958747999999999, 2024-09-14T06:00:55.949 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.949 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.949 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.949 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.950 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.950 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.950 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119903 2024-09-14T06:00:55.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.950 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:00:55.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760191+0000", 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6400000000000002e-07 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760194+0000", 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7920000000000001e-06 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760203+0000", 2024-09-14T06:00:55.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0669999999999998e-06 2024-09-14T06:00:55.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760208+0000", 2024-09-14T06:00:55.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5929999999999996e-06 2024-09-14T06:00:55.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811955+0000", 2024-09-14T06:00:55.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051746357 2024-09-14T06:00:55.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812046+0000", 2024-09-14T06:00:55.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1824999999999996e-05 2024-09-14T06:00:55.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812149+0000", 2024-09-14T06:00:55.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010255 2024-09-14T06:00:55.953 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.953 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.953 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.953 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119904 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6225920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.953 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:00:55.954 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.110602267000001, 2024-09-14T06:00:55.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052164159000000002, 2024-09-14T06:00:55.954 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.954 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.954 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.954 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.954 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.954 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.954 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119904 2024-09-14T06:00:55.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.954 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:00:55.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:00:55.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760218+0000", 2024-09-14T06:00:55.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2899999999999999e-07 2024-09-14T06:00:55.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760220+0000", 2024-09-14T06:00:55.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2879999999999999e-06 2024-09-14T06:00:55.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760226+0000", 2024-09-14T06:00:55.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1870000000000002e-06 2024-09-14T06:00:55.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760231+0000", 2024-09-14T06:00:55.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0950000000000003e-06 2024-09-14T06:00:55.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812192+0000", 2024-09-14T06:00:55.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051960587000000003 2024-09-14T06:00:55.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812281+0000", 2024-09-14T06:00:55.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9225e-05 2024-09-14T06:00:55.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812382+0000", 2024-09-14T06:00:55.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000100348 2024-09-14T06:00:55.958 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.958 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.958 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.958 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119905 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6275072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:00:55.958 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:00:55.958 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 13.110580228, 2024-09-14T06:00:55.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052394334000000001, 2024-09-14T06:00:55.958 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:55.958 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:55.958 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:55.958 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119905 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:55.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760240+0000", 2024-09-14T06:00:55.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:00:55.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:55.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760242+0000", 2024-09-14T06:00:55.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0959999999999999e-06 2024-09-14T06:00:55.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:55.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760249+0000", 2024-09-14T06:00:55.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7399999999999998e-06 2024-09-14T06:00:55.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:55.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760254+0000", 2024-09-14T06:00:55.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9089999999999999e-06 2024-09-14T06:00:55.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:55.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812419+0000", 2024-09-14T06:00:55.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052165481 2024-09-14T06:00:55.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:55.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812510+0000", 2024-09-14T06:00:55.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0525000000000005e-05 2024-09-14T06:00:55.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:55.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:55.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:55.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812634+0000", 2024-09-14T06:00:55.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012412600000000001 2024-09-14T06:00:55.962 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.962 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.962 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.962 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:55.962 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:55.962 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:55.963 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T06:00:55.964 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:55.961+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:55.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:00:56.064 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:56.060+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:56.145 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:56.145 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:56.145 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:00:56.145 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:56.161 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:00:56.207 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:56.204+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:56.266 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:56.265+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:56.337 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:56.337 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:56.337 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:56.337 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:56.337 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:56.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:00:56.366 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:56.365+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:56.467 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:56.464+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:56.486 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:56.486 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:00:56.486 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:00:56.486 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:00:56.487 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.487 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114684 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 999424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.487 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:00:56.487 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.386505496000002, 2024-09-14T06:00:56.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051769745999999998, 2024-09-14T06:00:56.487 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.487 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.487 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.487 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.487 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.487 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.487 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114684 2024-09-14T06:00:56.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:00:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:00:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:00:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3099999999999998e-07 2024-09-14T06:00:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097324+0000", 2024-09-14T06:00:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5019999999999999e-06 2024-09-14T06:00:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097333+0000", 2024-09-14T06:00:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6659999999999997e-06 2024-09-14T06:00:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.489 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097338+0000", 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6049999999999997e-06 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.148711+0000", 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051372831000000001 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.148787+0000", 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6205999999999995e-05 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.490 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149091+0000", 2024-09-14T06:00:56.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030350499999999997 2024-09-14T06:00:56.491 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.491 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.491 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.491 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114685 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1105920~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.491 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:00:56.491 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.386480747, 2024-09-14T06:00:56.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052125193, 2024-09-14T06:00:56.491 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.491 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.491 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.491 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.492 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.492 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.492 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114685 2024-09-14T06:00:56.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.492 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.492 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.492 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:00:56.492 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.492 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.492 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:00:56.492 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.493 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.493 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:00:56.493 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2800000000000002e-07 2024-09-14T06:00:56.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.493 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.493 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097349+0000", 2024-09-14T06:00:56.493 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4310000000000001e-06 2024-09-14T06:00:56.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.493 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.493 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097357+0000", 2024-09-14T06:00:56.494 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3799999999999994e-06 2024-09-14T06:00:56.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.494 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.494 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097362+0000", 2024-09-14T06:00:56.494 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.933e-06 2024-09-14T06:00:56.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.494 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.494 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149147+0000", 2024-09-14T06:00:56.494 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051784754000000002 2024-09-14T06:00:56.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.494 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149204+0000", 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7794000000000003e-05 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149471+0000", 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026647299999999998 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114686 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1212416~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.386456481, 2024-09-14T06:00:56.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052428210000000003, 2024-09-14T06:00:56.496 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.496 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.496 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.496 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.496 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.496 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.496 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114686 2024-09-14T06:00:56.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.496 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.496 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.496 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.496 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:00:56.496 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4000000000000002e-07 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097373+0000", 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1160000000000002e-06 2024-09-14T06:00:56.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.498 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.498 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097380+0000", 2024-09-14T06:00:56.498 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8199999999999997e-06 2024-09-14T06:00:56.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.498 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.498 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097385+0000", 2024-09-14T06:00:56.498 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7609999999999998e-06 2024-09-14T06:00:56.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.498 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.498 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149501+0000", 2024-09-14T06:00:56.499 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052115941999999998 2024-09-14T06:00:56.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.499 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.499 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149559+0000", 2024-09-14T06:00:56.499 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8313999999999998e-05 2024-09-14T06:00:56.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.499 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.499 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149798+0000", 2024-09-14T06:00:56.499 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000238817 2024-09-14T06:00:56.499 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.499 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.500 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.500 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114687 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1318912~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.500 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:00:56.500 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.386434310999999, 2024-09-14T06:00:56.500 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052786364000000002, 2024-09-14T06:00:56.500 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.500 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.500 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.500 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.500 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.500 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.500 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114687 2024-09-14T06:00:56.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.501 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.501 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.501 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:00:56.501 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.501 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.501 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:00:56.501 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097393+0000", 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6499999999999999e-07 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097395+0000", 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2129999999999998e-06 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097403+0000", 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2360000000000004e-06 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.503 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.503 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097408+0000", 2024-09-14T06:00:56.503 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2460000000000003e-06 2024-09-14T06:00:56.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.503 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.503 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149848+0000", 2024-09-14T06:00:56.503 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052439965999999998 2024-09-14T06:00:56.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.503 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.503 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149919+0000", 2024-09-14T06:00:56.503 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1148000000000004e-05 2024-09-14T06:00:56.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150179+0000", 2024-09-14T06:00:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025909000000000001 2024-09-14T06:00:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114688 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1425408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:00:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.386409773, 2024-09-14T06:00:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053185383000000003, 2024-09-14T06:00:56.504 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114688 2024-09-14T06:00:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:00:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2199999999999999e-07 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097419+0000", 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1670000000000002e-06 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.507 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.507 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097427+0000", 2024-09-14T06:00:56.507 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7819999999999994e-06 2024-09-14T06:00:56.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.507 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.507 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097432+0000", 2024-09-14T06:00:56.507 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:00:56.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.507 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.507 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150228+0000", 2024-09-14T06:00:56.507 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052796434000000003 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150308+0000", 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9221999999999995e-05 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150602+0000", 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000294493 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.509 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114689 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1531904~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.509 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:00:56.509 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.386387436, 2024-09-14T06:00:56.509 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053528527999999999, 2024-09-14T06:00:56.509 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.509 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.509 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.509 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.509 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.509 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.509 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114689 2024-09-14T06:00:56.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.509 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1699999999999999e-07 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097446+0000", 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1090000000000003e-06 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097454+0000", 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3860000000000007e-06 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097458+0000", 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1919999999999998e-06 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150648+0000", 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053190075000000003 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150705+0000", 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6484000000000003e-05 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150968+0000", 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026286499999999998 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.512 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.513 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.513 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114690 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1638400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.513 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:00:56.513 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.386361946000001, 2024-09-14T06:00:56.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053963677000000002, 2024-09-14T06:00:56.513 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.513 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.513 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.513 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.513 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.513 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114690 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:00:56.515 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0400000000000002e-07 2024-09-14T06:00:56.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.515 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.515 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097466+0000", 2024-09-14T06:00:56.515 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4389999999999999e-06 2024-09-14T06:00:56.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.515 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.515 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097470+0000", 2024-09-14T06:00:56.515 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6540000000000001e-06 2024-09-14T06:00:56.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.516 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.516 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097474+0000", 2024-09-14T06:00:56.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.301e-06 2024-09-14T06:00:56.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.516 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.516 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151069+0000", 2024-09-14T06:00:56.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053594827999999997 2024-09-14T06:00:56.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.516 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.516 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151156+0000", 2024-09-14T06:00:56.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6445000000000003e-05 2024-09-14T06:00:56.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.517 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151428+0000", 2024-09-14T06:00:56.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000272706 2024-09-14T06:00:56.517 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.517 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.517 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.517 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114806 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.517 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:00:56.517 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.382400668999999, 2024-09-14T06:00:56.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051625628, 2024-09-14T06:00:56.517 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114806 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101427+0000", 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5600000000000004e-07 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101431+0000", 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5920000000000002e-06 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.519 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101462+0000", 2024-09-14T06:00:56.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0607e-05 2024-09-14T06:00:56.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.520 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.520 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101470+0000", 2024-09-14T06:00:56.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6249999999999998e-06 2024-09-14T06:00:56.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.520 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.520 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.152670+0000", 2024-09-14T06:00:56.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051199972000000003 2024-09-14T06:00:56.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.520 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.152763+0000", 2024-09-14T06:00:56.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3274000000000002e-05 2024-09-14T06:00:56.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153051+0000", 2024-09-14T06:00:56.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000288602 2024-09-14T06:00:56.521 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.521 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.521 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.521 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114807 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 442368~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.521 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:00:56.522 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.382328344000001, 2024-09-14T06:00:56.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051947018999999997, 2024-09-14T06:00:56.522 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.522 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.522 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.522 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.522 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.522 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.522 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114807 2024-09-14T06:00:56.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.522 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:00:56.523 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.523 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.523 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:00:56.523 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.523 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.523 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101499+0000", 2024-09-14T06:00:56.523 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.23e-07 2024-09-14T06:00:56.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.523 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101505+0000", 2024-09-14T06:00:56.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2570000000000004e-06 2024-09-14T06:00:56.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.524 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101518+0000", 2024-09-14T06:00:56.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3327e-05 2024-09-14T06:00:56.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.524 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101525+0000", 2024-09-14T06:00:56.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7410000000000003e-06 2024-09-14T06:00:56.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153108+0000", 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051582688000000002 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153209+0000", 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000101092 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153445+0000", 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023619099999999999 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.525 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114808 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 548864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.382289920000002, 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052334951999999997, 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114808 2024-09-14T06:00:56.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.527 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:00:56.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:00:56.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.527 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.527 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:00:56.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1600000000000001e-07 2024-09-14T06:00:56.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101540+0000", 2024-09-14T06:00:56.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.942e-06 2024-09-14T06:00:56.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101547+0000", 2024-09-14T06:00:56.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9460000000000001e-06 2024-09-14T06:00:56.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.529 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101552+0000", 2024-09-14T06:00:56.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2320000000000001e-06 2024-09-14T06:00:56.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.529 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.529 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153494+0000", 2024-09-14T06:00:56.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051942200000000001 2024-09-14T06:00:56.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.529 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.529 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153600+0000", 2024-09-14T06:00:56.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105886 2024-09-14T06:00:56.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153872+0000", 2024-09-14T06:00:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027123000000000002 2024-09-14T06:00:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114809 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 655360~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:00:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.382022497000001, 2024-09-14T06:00:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052491571000000001, 2024-09-14T06:00:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.530 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.531 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.531 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.531 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.531 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.531 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114809 2024-09-14T06:00:56.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.531 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:00:56.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101805+0000", 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.094e-06 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101810+0000", 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3430000000000003e-06 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.532 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101824+0000", 2024-09-14T06:00:56.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3081999999999999e-05 2024-09-14T06:00:56.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101832+0000", 2024-09-14T06:00:56.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6950000000000006e-06 2024-09-14T06:00:56.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153908+0000", 2024-09-14T06:00:56.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052075444999999998 2024-09-14T06:00:56.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153992+0000", 2024-09-14T06:00:56.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4829999999999999e-05 2024-09-14T06:00:56.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154296+0000", 2024-09-14T06:00:56.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030308199999999998 2024-09-14T06:00:56.534 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.534 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.534 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.534 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114810 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 761856~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.381976508000001, 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052650012000000003, 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114810 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101851+0000", 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.75e-07 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101854+0000", 2024-09-14T06:00:56.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0620000000000001e-06 2024-09-14T06:00:56.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101863+0000", 2024-09-14T06:00:56.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5719999999999992e-06 2024-09-14T06:00:56.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101869+0000", 2024-09-14T06:00:56.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4229999999999996e-06 2024-09-14T06:00:56.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154350+0000", 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052480991999999997 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154429+0000", 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9482999999999998e-05 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154500+0000", 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0905e-05 2024-09-14T06:00:56.538 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.539 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.539 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.539 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114811 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 868352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.539 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:00:56.539 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.381948014999999, 2024-09-14T06:00:56.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053080507999999998, 2024-09-14T06:00:56.539 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.539 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.539 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.539 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.539 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.539 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.540 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114811 2024-09-14T06:00:56.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.540 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:00:56.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.540 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.540 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:00:56.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.540 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101879+0000", 2024-09-14T06:00:56.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0399999999999996e-07 2024-09-14T06:00:56.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101882+0000", 2024-09-14T06:00:56.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6919999999999998e-06 2024-09-14T06:00:56.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101889+0000", 2024-09-14T06:00:56.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.058e-06 2024-09-14T06:00:56.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101894+0000", 2024-09-14T06:00:56.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1669999999999998e-06 2024-09-14T06:00:56.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154552+0000", 2024-09-14T06:00:56.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052658358000000002 2024-09-14T06:00:56.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154649+0000", 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6708999999999999e-05 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154959+0000", 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00031001999999999999 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114812 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 974848~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.381925556999999, 2024-09-14T06:00:56.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053474381000000001, 2024-09-14T06:00:56.544 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.544 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.544 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.544 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.544 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.544 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.544 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114812 2024-09-14T06:00:56.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.544 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.544 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.544 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:00:56.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:00:56.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:00:56.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.53e-07 2024-09-14T06:00:56.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101903+0000", 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1519999999999999e-06 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101909+0000", 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9100000000000002e-06 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101914+0000", 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4240000000000003e-06 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154995+0000", 2024-09-14T06:00:56.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053081101999999998 2024-09-14T06:00:56.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155085+0000", 2024-09-14T06:00:56.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0195e-05 2024-09-14T06:00:56.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155375+0000", 2024-09-14T06:00:56.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029024500000000001 2024-09-14T06:00:56.547 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.548 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.548 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.548 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114813 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1081344~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.548 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:00:56.548 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.381904775999999, 2024-09-14T06:00:56.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053887802999999998, 2024-09-14T06:00:56.548 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.548 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.548 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.548 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.548 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.549 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.549 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114813 2024-09-14T06:00:56.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.549 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:00:56.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:00:56.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.75e-07 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101924+0000", 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.244e-06 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101931+0000", 2024-09-14T06:00:56.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6789999999999999e-06 2024-09-14T06:00:56.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101936+0000", 2024-09-14T06:00:56.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2320000000000001e-06 2024-09-14T06:00:56.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155435+0000", 2024-09-14T06:00:56.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053498187000000003 2024-09-14T06:00:56.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155531+0000", 2024-09-14T06:00:56.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6386999999999997e-05 2024-09-14T06:00:56.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155810+0000", 2024-09-14T06:00:56.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027859899999999998 2024-09-14T06:00:56.552 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.552 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.552 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.552 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114814 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1187840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.552 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.381880171999999, 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054301716, 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114814 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:00:56.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101947+0000", 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6400000000000003e-07 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101949+0000", 2024-09-14T06:00:56.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.396e-06 2024-09-14T06:00:56.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101957+0000", 2024-09-14T06:00:56.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5839999999999997e-06 2024-09-14T06:00:56.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.555 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101962+0000", 2024-09-14T06:00:56.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0100000000000003e-06 2024-09-14T06:00:56.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.555 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155858+0000", 2024-09-14T06:00:56.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053895862000000003 2024-09-14T06:00:56.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155955+0000", 2024-09-14T06:00:56.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7812000000000005e-05 2024-09-14T06:00:56.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156248+0000", 2024-09-14T06:00:56.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029258799999999998 2024-09-14T06:00:56.556 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.556 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.557 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.557 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114815 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1294336~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.557 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:00:56.557 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.381858053999999, 2024-09-14T06:00:56.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054641393000000003, 2024-09-14T06:00:56.557 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.557 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.557 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.557 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.557 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.557 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.557 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114815 2024-09-14T06:00:56.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.558 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:00:56.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:00:56.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101969+0000", 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3099999999999999e-07 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101971+0000", 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0150000000000002e-06 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101982+0000", 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0725e-05 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101987+0000", 2024-09-14T06:00:56.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.716e-06 2024-09-14T06:00:56.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156288+0000", 2024-09-14T06:00:56.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054301035999999997 2024-09-14T06:00:56.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.560 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.560 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.560 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156358+0000", 2024-09-14T06:00:56.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9238000000000004e-05 2024-09-14T06:00:56.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156610+0000", 2024-09-14T06:00:56.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025233200000000002 2024-09-14T06:00:56.561 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.561 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.561 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.561 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114816 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1400832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.561 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:00:56.561 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.381830601000001, 2024-09-14T06:00:56.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054933327999999997, 2024-09-14T06:00:56.561 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114816 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8100000000000003e-07 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101999+0000", 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.633e-06 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102008+0000", 2024-09-14T06:00:56.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4050000000000006e-06 2024-09-14T06:00:56.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102015+0000", 2024-09-14T06:00:56.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6660000000000002e-06 2024-09-14T06:00:56.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.564 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156644+0000", 2024-09-14T06:00:56.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054628942 2024-09-14T06:00:56.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156692+0000", 2024-09-14T06:00:56.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8250000000000001e-05 2024-09-14T06:00:56.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156929+0000", 2024-09-14T06:00:56.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000236951 2024-09-14T06:00:56.565 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.565 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.565 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.566 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114817 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1507328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.566 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:00:56.566 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.381786011999999, 2024-09-14T06:00:56.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.055317495000000001, 2024-09-14T06:00:56.566 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.566 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.566 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.566 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.566 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.566 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.566 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114817 2024-09-14T06:00:56.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.566 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102041+0000", 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5099999999999999e-07 2024-09-14T06:00:56.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102045+0000", 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3790000000000002e-06 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102067+0000", 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2844999999999999e-05 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102074+0000", 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6340000000000003e-06 2024-09-14T06:00:56.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156975+0000", 2024-09-14T06:00:56.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054900596000000003 2024-09-14T06:00:56.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157070+0000", 2024-09-14T06:00:56.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5569000000000006e-05 2024-09-14T06:00:56.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157358+0000", 2024-09-14T06:00:56.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028782100000000001 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114818 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1613824~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.381419977, 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.055293008999999997, 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:00:56.570 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114818 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:00:56.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:00:56.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1500000000000003e-07 2024-09-14T06:00:56.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:00:56.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102412+0000", 2024-09-14T06:00:56.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8860000000000003e-06 2024-09-14T06:00:56.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:00:56.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102429+0000", 2024-09-14T06:00:56.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7147e-05 2024-09-14T06:00:56.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:00:56.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102438+0000", 2024-09-14T06:00:56.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.799e-06 2024-09-14T06:00:56.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:00:56.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157387+0000", 2024-09-14T06:00:56.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054948921999999997 2024-09-14T06:00:56.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:00:56.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157452+0000", 2024-09-14T06:00:56.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4471e-05 2024-09-14T06:00:56.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:00:56.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:00:56.574 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:00:56.574 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157700+0000", 2024-09-14T06:00:56.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024796900000000001 2024-09-14T06:00:56.574 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.574 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.574 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.574 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:00:56.574 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:00:56.574 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:56.576 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:00:56.576 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:56.572+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:56.676 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:56.672+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:56.718 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:00:56.749 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:56.749 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:56.749 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:00:56.749 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:56.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:00:56.777 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:56.773+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:56.862 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:56.878 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:56.872+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:56.878 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:56.878 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:56.895 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:56.895 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:56.912 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:56.912 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:56.933 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:56.933 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:56.937 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:56.937 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:56.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:00:56.953 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:56.954 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:56.975 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:56.975 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:56.978 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:56.976+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:56.997 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:56.997 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:57.063 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:57.063 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:57.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:00:57.080 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:57.077+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:57.181 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:57.177+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:57.188 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:57.188 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:57.203 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:00:57.282 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:57.281+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:57.305 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2024-09-14T06:00:57.344 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:57.344 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:57.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:00:57.382 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:57.381+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:57.483 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:57.481+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:57.541 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:57.541 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:57.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:00:57.584 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:57.580+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:57.685 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:57.680+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:57.687 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:57.687 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:57.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:00:57.786 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:57.785+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:57.819 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:57.819 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:57.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:00:57.922 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:57.921+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:57.988 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:57.984+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:57.998 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:57.998 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:58.013 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:00:58.023 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-14T06:00:58.023 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T06:00:58.023 INFO:tasks.thrashosds.thrasher:Removing osd 7, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-14T06:00:58.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 7 2024-09-14T06:00:58.098 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:58.097+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:58.176 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:58.177 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:58.190 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:58.189+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:58.191 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:00:58.291 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:58.289+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:58.359 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:58.360 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:58.373 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-09-14T06:00:58.368+0000 7fea0eeb4640 -1 mon.a@0(leader).osd e115 definitely_dead 0 2024-09-14T06:00:58.374 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:00:58.418 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:58.417+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:58.492 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:58.489+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:58.545 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:58.545 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:58.560 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:00:58.602 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:58.601+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:00:58.694 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:58.688+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:58.727 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:58.727 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:58.741 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:00:58.795 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:00:58.792+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:00:58.866 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:58.866 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:58.881 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:00:58.897 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:58.892+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:58.998 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:00:58.992+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:00:59.003 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:59.003 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:59.015 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:00:59.017 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:00:59.099 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:59.097+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:59.137 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:00:59.137 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:00:59.152 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:00:59.175 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:00:59.175 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:00:59.192 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:00:59.192 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:00:59.199 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:59.196+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:59.210 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:00:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:00:59.228 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:00:59.228 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:00:59.247 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:00:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:00:59.266 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:00:59.266 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:00:59.284 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:00:59.285 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:00:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:marked out osd.7. 2024-09-14T06:00:59.303 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:59.301+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:59.316 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:00:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:00:59.333 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:59.333 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:00:59.333 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:00:59.333 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:00:59.334 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:59.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T06:00:59.349 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:00:59.434 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:00:59.433+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:00:59.501 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:00:59.496+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:00:59.513 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:00:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:00:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:00:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:00:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114752 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1458176~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152719079000001, 2024-09-14T06:00:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11122652, 2024-09-14T06:00:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.513 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114752 2024-09-14T06:00:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357636+0000", 2024-09-14T06:00:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.51e-07 2024-09-14T06:00:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357638+0000", 2024-09-14T06:00:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7540000000000001e-06 2024-09-14T06:00:59.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357643+0000", 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1150000000000002e-06 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357647+0000", 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7979999999999999e-06 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468136+0000", 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.110488747 2024-09-14T06:00:59.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468353+0000", 2024-09-14T06:00:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000217166 2024-09-14T06:00:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468862+0000", 2024-09-14T06:00:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050938899999999996 2024-09-14T06:00:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114753 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1564672~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152679016, 2024-09-14T06:00:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111972162, 2024-09-14T06:00:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114753 2024-09-14T06:00:59.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:00:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6599999999999996e-07 2024-09-14T06:00:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357678+0000", 2024-09-14T06:00:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.807e-06 2024-09-14T06:00:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357683+0000", 2024-09-14T06:00:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.933e-06 2024-09-14T06:00:59.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357687+0000", 2024-09-14T06:00:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8469999999999998e-06 2024-09-14T06:00:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468941+0000", 2024-09-14T06:00:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111254009 2024-09-14T06:00:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469159+0000", 2024-09-14T06:00:59.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021768800000000001 2024-09-14T06:00:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469648+0000", 2024-09-14T06:00:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048931199999999999 2024-09-14T06:00:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114754 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1671168~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:59.522 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152639343000001, 2024-09-14T06:00:59.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.112607016, 2024-09-14T06:00:59.523 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.523 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.523 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.523 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114754 2024-09-14T06:00:59.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.523 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357716+0000", 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357718+0000", 2024-09-14T06:00:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5910000000000001e-06 2024-09-14T06:00:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357725+0000", 2024-09-14T06:00:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9399999999999996e-06 2024-09-14T06:00:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357729+0000", 2024-09-14T06:00:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0439999999999997e-06 2024-09-14T06:00:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469752+0000", 2024-09-14T06:00:59.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11202385400000001 2024-09-14T06:00:59.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469889+0000", 2024-09-14T06:00:59.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136704 2024-09-14T06:00:59.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470322+0000", 2024-09-14T06:00:59.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000433337 2024-09-14T06:00:59.526 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.526 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.527 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114771 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 98304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.527 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:59.527 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152598235999999, 2024-09-14T06:00:59.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11267808, 2024-09-14T06:00:59.527 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.527 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.527 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.527 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.527 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.527 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.528 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114771 2024-09-14T06:00:59.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.528 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:59.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:59.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.37e-07 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357759+0000", 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5650000000000001e-06 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357764+0000", 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357768+0000", 2024-09-14T06:00:59.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9580000000000001e-06 2024-09-14T06:00:59.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469739+0000", 2024-09-14T06:00:59.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111971591 2024-09-14T06:00:59.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469951+0000", 2024-09-14T06:00:59.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021185999999999999 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470435+0000", 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048335499999999998 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114772 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152558020000001, 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11329244500000001, 2024-09-14T06:00:59.531 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114772 2024-09-14T06:00:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3099999999999998e-07 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357799+0000", 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0770000000000002e-06 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357805+0000", 2024-09-14T06:00:59.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3329999999999996e-06 2024-09-14T06:00:59.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357816+0000", 2024-09-14T06:00:59.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0869999999999999e-05 2024-09-14T06:00:59.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470507+0000", 2024-09-14T06:00:59.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.112691635 2024-09-14T06:00:59.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470648+0000", 2024-09-14T06:00:59.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014075000000000001 2024-09-14T06:00:59.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471089+0000", 2024-09-14T06:00:59.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000441249 2024-09-14T06:00:59.535 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.535 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.535 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.536 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114773 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 311296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.536 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:59.536 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152512474000002, 2024-09-14T06:00:59.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114111303, 2024-09-14T06:00:59.536 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.536 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.536 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.536 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.536 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.536 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.536 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114773 2024-09-14T06:00:59.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.536 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:59.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:00:59.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357843+0000", 2024-09-14T06:00:59.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4499999999999997e-07 2024-09-14T06:00:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357844+0000", 2024-09-14T06:00:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.612e-06 2024-09-14T06:00:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357851+0000", 2024-09-14T06:00:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7900000000000002e-06 2024-09-14T06:00:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357855+0000", 2024-09-14T06:00:59.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9310000000000001e-06 2024-09-14T06:00:59.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471187+0000", 2024-09-14T06:00:59.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.113332222 2024-09-14T06:00:59.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471425+0000", 2024-09-14T06:00:59.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000237412 2024-09-14T06:00:59.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471954+0000", 2024-09-14T06:00:59.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00052879100000000003 2024-09-14T06:00:59.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.540 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.540 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114774 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 417792~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.540 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:59.540 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152471448, 2024-09-14T06:00:59.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114690902, 2024-09-14T06:00:59.540 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.540 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.540 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.541 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.541 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.541 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.541 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114774 2024-09-14T06:00:59.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.541 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:59.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:00:59.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357884+0000", 2024-09-14T06:00:59.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.37e-07 2024-09-14T06:00:59.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357886+0000", 2024-09-14T06:00:59.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7010000000000001e-06 2024-09-14T06:00:59.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357891+0000", 2024-09-14T06:00:59.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T06:00:59.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357896+0000", 2024-09-14T06:00:59.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5999999999999997e-06 2024-09-14T06:00:59.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472030+0000", 2024-09-14T06:00:59.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11413328 2024-09-14T06:00:59.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472157+0000", 2024-09-14T06:00:59.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012693900000000001 2024-09-14T06:00:59.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472574+0000", 2024-09-14T06:00:59.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041773100000000002 2024-09-14T06:00:59.544 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.544 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.544 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.545 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114775 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 524288~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.545 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:59.545 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152431780000001, 2024-09-14T06:00:59.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.115518357, 2024-09-14T06:00:59.545 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.545 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.545 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.545 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114775 2024-09-14T06:00:59.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.545 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357924+0000", 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3799999999999997e-07 2024-09-14T06:00:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357928+0000", 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7700000000000001e-06 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357934+0000", 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6420000000000004e-06 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357938+0000", 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1899999999999997e-06 2024-09-14T06:00:59.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472667+0000", 2024-09-14T06:00:59.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114728409 2024-09-14T06:00:59.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472901+0000", 2024-09-14T06:00:59.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023484100000000001 2024-09-14T06:00:59.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473441+0000", 2024-09-14T06:00:59.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053996700000000003 2024-09-14T06:00:59.549 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.549 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.549 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.549 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114776 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 630784~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.549 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:59.549 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152391884, 2024-09-14T06:00:59.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11610183, 2024-09-14T06:00:59.549 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.549 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.549 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.549 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.550 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.550 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.550 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114776 2024-09-14T06:00:59.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.550 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:59.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:00:59.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357964+0000", 2024-09-14T06:00:59.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7700000000000004e-07 2024-09-14T06:00:59.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357965+0000", 2024-09-14T06:00:59.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.761e-06 2024-09-14T06:00:59.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357970+0000", 2024-09-14T06:00:59.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1429999999999997e-06 2024-09-14T06:00:59.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357974+0000", 2024-09-14T06:00:59.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8879999999999999e-06 2024-09-14T06:00:59.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473514+0000", 2024-09-14T06:00:59.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11554007500000001 2024-09-14T06:00:59.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473641+0000", 2024-09-14T06:00:59.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000127088 2024-09-14T06:00:59.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474065+0000", 2024-09-14T06:00:59.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00042329800000000001 2024-09-14T06:00:59.554 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.554 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.554 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.554 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114777 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 737280~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.554 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:59.554 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152352708999999, 2024-09-14T06:00:59.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11697975200000001, 2024-09-14T06:00:59.554 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.554 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.554 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.555 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.555 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114777 2024-09-14T06:00:59.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.555 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:59.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:00:59.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358003+0000", 2024-09-14T06:00:59.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-14T06:00:59.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358004+0000", 2024-09-14T06:00:59.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6950000000000001e-06 2024-09-14T06:00:59.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358010+0000", 2024-09-14T06:00:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2410000000000003e-06 2024-09-14T06:00:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358014+0000", 2024-09-14T06:00:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9380000000000002e-06 2024-09-14T06:00:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474156+0000", 2024-09-14T06:00:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.116142597 2024-09-14T06:00:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474386+0000", 2024-09-14T06:00:59.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023008999999999999 2024-09-14T06:00:59.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474982+0000", 2024-09-14T06:00:59.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059564500000000001 2024-09-14T06:00:59.558 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.558 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.558 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.558 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114778 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 843776~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.559 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:59.559 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152312366, 2024-09-14T06:00:59.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11749908100000001, 2024-09-14T06:00:59.559 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.559 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.559 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.559 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114778 2024-09-14T06:00:59.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.559 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:59.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:00:59.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358043+0000", 2024-09-14T06:00:59.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3399999999999999e-07 2024-09-14T06:00:59.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358045+0000", 2024-09-14T06:00:59.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8789999999999999e-06 2024-09-14T06:00:59.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358052+0000", 2024-09-14T06:00:59.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.951e-06 2024-09-14T06:00:59.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358056+0000", 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.121e-06 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475018+0000", 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11696224199999999 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475141+0000", 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012285099999999999 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475542+0000", 2024-09-14T06:00:59.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00040050300000000002 2024-09-14T06:00:59.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.563 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.563 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114779 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 950272~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.563 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:59.563 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152269767, 2024-09-14T06:00:59.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.118289098, 2024-09-14T06:00:59.563 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.563 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.563 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114779 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:00:59.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358086+0000", 2024-09-14T06:00:59.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5300000000000004e-07 2024-09-14T06:00:59.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358087+0000", 2024-09-14T06:00:59.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.623e-06 2024-09-14T06:00:59.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358093+0000", 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9510000000000003e-06 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358097+0000", 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1819999999999999e-06 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475637+0000", 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11753928600000001 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475862+0000", 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225336 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476374+0000", 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000512167 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114780 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1056768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152228742999998, 2024-09-14T06:00:59.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.119083513, 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114780 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:00:59.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358127+0000", 2024-09-14T06:00:59.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.44e-07 2024-09-14T06:00:59.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358128+0000", 2024-09-14T06:00:59.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.714e-06 2024-09-14T06:00:59.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358135+0000", 2024-09-14T06:00:59.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-09-14T06:00:59.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358140+0000", 2024-09-14T06:00:59.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1969999999999998e-06 2024-09-14T06:00:59.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476456+0000", 2024-09-14T06:00:59.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.118316717 2024-09-14T06:00:59.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476674+0000", 2024-09-14T06:00:59.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021775200000000001 2024-09-14T06:00:59.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477210+0000", 2024-09-14T06:00:59.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053548400000000003 2024-09-14T06:00:59.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.571 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.572 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114781 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1163264~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.572 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:59.572 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152183621999999, 2024-09-14T06:00:59.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11988966700000001, 2024-09-14T06:00:59.572 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.572 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.572 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.572 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.572 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.572 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.572 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114781 2024-09-14T06:00:59.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.572 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358172+0000", 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.44e-07 2024-09-14T06:00:59.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358174+0000", 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9920000000000002e-06 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358179+0000", 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.288e-06 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358183+0000", 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0489999999999997e-06 2024-09-14T06:00:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477294+0000", 2024-09-14T06:00:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11911132000000001 2024-09-14T06:00:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477516+0000", 2024-09-14T06:00:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022208500000000001 2024-09-14T06:00:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478061+0000", 2024-09-14T06:00:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00054438900000000005 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114782 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1269760~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152165055000001, 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.120723238, 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114782 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:00:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4099999999999999e-07 2024-09-14T06:00:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358192+0000", 2024-09-14T06:00:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.559e-06 2024-09-14T06:00:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358197+0000", 2024-09-14T06:00:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6789999999999996e-06 2024-09-14T06:00:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358202+0000", 2024-09-14T06:00:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4779999999999999e-06 2024-09-14T06:00:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478140+0000", 2024-09-14T06:00:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11993833600000001 2024-09-14T06:00:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478358+0000", 2024-09-14T06:00:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021785700000000001 2024-09-14T06:00:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478913+0000", 2024-09-14T06:00:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055478799999999996 2024-09-14T06:00:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114783 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1376256~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.15214671, 2024-09-14T06:00:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121464831, 2024-09-14T06:00:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114783 2024-09-14T06:00:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4499999999999998e-07 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358210+0000", 2024-09-14T06:00:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5880000000000001e-06 2024-09-14T06:00:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358214+0000", 2024-09-14T06:00:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3850000000000004e-06 2024-09-14T06:00:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358218+0000", 2024-09-14T06:00:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7799999999999998e-06 2024-09-14T06:00:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479024+0000", 2024-09-14T06:00:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.120805364 2024-09-14T06:00:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479177+0000", 2024-09-14T06:00:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153642 2024-09-14T06:00:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479673+0000", 2024-09-14T06:00:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049572699999999995 2024-09-14T06:00:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114784 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1482752~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152132051999999, 2024-09-14T06:00:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.122316759, 2024-09-14T06:00:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114784 2024-09-14T06:00:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:00:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2399999999999999e-07 2024-09-14T06:00:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358225+0000", 2024-09-14T06:00:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5570000000000001e-06 2024-09-14T06:00:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358229+0000", 2024-09-14T06:00:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5589999999999999e-06 2024-09-14T06:00:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358233+0000", 2024-09-14T06:00:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7270000000000001e-06 2024-09-14T06:00:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479769+0000", 2024-09-14T06:00:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12153594299999999 2024-09-14T06:00:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480000+0000", 2024-09-14T06:00:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000230967 2024-09-14T06:00:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480540+0000", 2024-09-14T06:00:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053968199999999999 2024-09-14T06:00:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114785 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1589248~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152115860999999, 2024-09-14T06:00:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123154237, 2024-09-14T06:00:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114785 2024-09-14T06:00:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3799999999999998e-07 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358241+0000", 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.457e-06 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358245+0000", 2024-09-14T06:00:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.42e-06 2024-09-14T06:00:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358249+0000", 2024-09-14T06:00:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7740000000000002e-06 2024-09-14T06:00:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480626+0000", 2024-09-14T06:00:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12237743600000001 2024-09-14T06:00:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480844+0000", 2024-09-14T06:00:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021792299999999999 2024-09-14T06:00:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481393+0000", 2024-09-14T06:00:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000548889 2024-09-14T06:00:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114786 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1695744~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152101157000001, 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123995568, 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114786 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:00:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.27e-07 2024-09-14T06:00:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358256+0000", 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5460000000000001e-06 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358260+0000", 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3819999999999997e-06 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358264+0000", 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7469999999999999e-06 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481473+0000", 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123209244 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481686+0000", 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000212957 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482249+0000", 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00056336500000000002 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.599 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114867 3.15 3:aea12e8e:::rbd_data.1127cb09e343.000000000000000b:head [stat,truncate 737280] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:00:59.599 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:59.599 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.152086572000002, 2024-09-14T06:00:59.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12722582099999999, 2024-09-14T06:00:59.599 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:00:59.599 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:00:59.599 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:00:59.599 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:00:59.599 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:00:59.599 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:00:59.599 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114867 2024-09-14T06:00:59.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:00:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:00:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358269+0000", 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4799999999999999e-07 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358274+0000", 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.237e-06 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:00:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358279+0000", 2024-09-14T06:00:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7990000000000001e-06 2024-09-14T06:00:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:00:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358284+0000", 2024-09-14T06:00:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1900000000000003e-06 2024-09-14T06:00:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:00:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482355+0000", 2024-09-14T06:00:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.124070718 2024-09-14T06:00:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:00:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482496+0000", 2024-09-14T06:00:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014162699999999999 2024-09-14T06:00:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 3", 2024-09-14T06:00:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482722+0000", 2024-09-14T06:00:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225622 2024-09-14T06:00:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:00:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.484427+0000", 2024-09-14T06:00:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001704929 2024-09-14T06:00:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:00:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485332+0000", 2024-09-14T06:00:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00090576600000000001 2024-09-14T06:00:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:00:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485429+0000", 2024-09-14T06:00:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6540999999999996e-05 2024-09-14T06:00:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:00:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:00:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:00:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485494+0000", 2024-09-14T06:00:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5043999999999996e-05 2024-09-14T06:00:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:00:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:00:59.605 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:00:59.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:00:59.607 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:00:59.604+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:00:59.708 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:00:59.705+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:00:59.732 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:59.732 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:59.732 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:00:59.732 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:59.747 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:00:59.809 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:00:59.805+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:00:59.875 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:00:59.875 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:00:59.875 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:00:59.876 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:00:59.876 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:00:59.890 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:00:59.910 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:00:59.905+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:00.010 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:00.009+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:00.012 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:00.012 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:00.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:00.012 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:00.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.012 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119850 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 3571712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.012 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:00.012 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.258409052000001, 2024-09-14T06:01:00.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050424731, 2024-09-14T06:01:00.013 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.013 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.013 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.013 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.013 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.013 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.013 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119850 2024-09-14T06:01:00.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.013 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6100000000000001e-07 2024-09-14T06:01:00.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.015 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.015 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751247+0000", 2024-09-14T06:01:00.015 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5059999999999998e-06 2024-09-14T06:01:00.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.015 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.015 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751255+0000", 2024-09-14T06:01:00.015 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3080000000000008e-06 2024-09-14T06:01:00.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.015 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751262+0000", 2024-09-14T06:01:00.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1060000000000002e-06 2024-09-14T06:01:00.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801559+0000", 2024-09-14T06:01:00.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050297043 2024-09-14T06:01:00.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801614+0000", 2024-09-14T06:01:00.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5028999999999998e-05 2024-09-14T06:01:00.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801668+0000", 2024-09-14T06:01:00.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4178000000000002e-05 2024-09-14T06:01:00.017 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.017 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.017 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.017 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119851 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 3620864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.017 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:01:00.017 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.258380395, 2024-09-14T06:01:00.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050528479000000001, 2024-09-14T06:01:00.017 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.018 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.018 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.018 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.018 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.018 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119851 2024-09-14T06:01:00.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.018 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.018 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.018 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:01:00.018 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.019 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.019 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:01:00.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.019 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.019 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752502+0000", 2024-09-14T06:01:00.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012294529999999999 2024-09-14T06:01:00.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.019 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.019 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752508+0000", 2024-09-14T06:01:00.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8780000000000003e-06 2024-09-14T06:01:00.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752522+0000", 2024-09-14T06:01:00.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4405e-05 2024-09-14T06:01:00.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752532+0000", 2024-09-14T06:01:00.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6739999999999992e-06 2024-09-14T06:01:00.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801702+0000", 2024-09-14T06:01:00.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049169996000000001 2024-09-14T06:01:00.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801744+0000", 2024-09-14T06:01:00.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2789e-05 2024-09-14T06:01:00.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801801+0000", 2024-09-14T06:01:00.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6283999999999998e-05 2024-09-14T06:01:00.022 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.022 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.022 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.022 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119877 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4898816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.022 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:00.022 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.253650961000002, 2024-09-14T06:01:00.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050416282999999999, 2024-09-14T06:01:00.022 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.022 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.022 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.022 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.023 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119877 2024-09-14T06:01:00.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.023 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.023 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.023 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.023 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:00.023 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.023 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.023 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.023 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:00.023 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.024 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.024 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:00.024 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6300000000000005e-07 2024-09-14T06:01:00.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.024 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.024 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756005+0000", 2024-09-14T06:01:00.024 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7350000000000001e-06 2024-09-14T06:01:00.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.024 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756012+0000", 2024-09-14T06:01:00.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8990000000000004e-06 2024-09-14T06:01:00.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756017+0000", 2024-09-14T06:01:00.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.023e-06 2024-09-14T06:01:00.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806256+0000", 2024-09-14T06:01:00.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050239355999999999 2024-09-14T06:01:00.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.026 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.026 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806331+0000", 2024-09-14T06:01:00.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4800000000000002e-05 2024-09-14T06:01:00.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.026 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.026 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806418+0000", 2024-09-14T06:01:00.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6907e-05 2024-09-14T06:01:00.026 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.026 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.026 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.027 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.027 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119878 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4947968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.027 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:01:00.027 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.253626114999999, 2024-09-14T06:01:00.027 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050582539000000003, 2024-09-14T06:01:00.027 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.027 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.027 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.027 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.027 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.027 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.027 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119878 2024-09-14T06:01:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:01:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:01:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.028 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.029 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756027+0000", 2024-09-14T06:01:00.029 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1399999999999997e-07 2024-09-14T06:01:00.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.029 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.029 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.029 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756029+0000", 2024-09-14T06:01:00.029 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3420000000000002e-06 2024-09-14T06:01:00.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.029 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.029 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.029 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756036+0000", 2024-09-14T06:01:00.029 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9550000000000003e-06 2024-09-14T06:01:00.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.030 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.030 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756041+0000", 2024-09-14T06:01:00.030 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2669999999999997e-06 2024-09-14T06:01:00.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.030 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.030 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806448+0000", 2024-09-14T06:01:00.030 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050407037000000002 2024-09-14T06:01:00.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.030 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.030 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806526+0000", 2024-09-14T06:01:00.031 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7119000000000005e-05 2024-09-14T06:01:00.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.031 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.031 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.031 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806609+0000", 2024-09-14T06:01:00.031 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3405000000000005e-05 2024-09-14T06:01:00.031 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.031 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.031 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.031 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.031 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119879 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4997120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.031 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:00.031 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.253603635000001, 2024-09-14T06:01:00.032 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.05075727, 2024-09-14T06:01:00.032 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.032 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.032 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.032 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.032 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.032 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.032 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119879 2024-09-14T06:01:00.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.033 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.033 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.033 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:00.033 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.033 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.033 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:00.033 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.033 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.033 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:00.034 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9400000000000001e-07 2024-09-14T06:01:00.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.034 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.034 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756058+0000", 2024-09-14T06:01:00.034 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5199999999999997e-06 2024-09-14T06:01:00.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.034 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.034 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756065+0000", 2024-09-14T06:01:00.034 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9800000000000001e-06 2024-09-14T06:01:00.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.035 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.035 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756070+0000", 2024-09-14T06:01:00.035 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2360000000000004e-06 2024-09-14T06:01:00.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.035 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.035 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806639+0000", 2024-09-14T06:01:00.035 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050568702 2024-09-14T06:01:00.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.035 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.035 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806714+0000", 2024-09-14T06:01:00.035 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4825000000000003e-05 2024-09-14T06:01:00.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.036 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.036 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.036 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806806+0000", 2024-09-14T06:01:00.036 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2613000000000003e-05 2024-09-14T06:01:00.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.036 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.036 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.036 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119880 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5046272~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.036 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:00.036 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.253548936000001, 2024-09-14T06:01:00.036 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050918568999999997, 2024-09-14T06:01:00.037 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.037 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.037 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.037 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.037 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.037 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.037 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119880 2024-09-14T06:01:00.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.037 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.037 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.037 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.037 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:00.037 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.038 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.038 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.038 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:00.038 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.038 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.038 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.038 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:00.038 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:01:00.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.038 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.038 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.038 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756107+0000", 2024-09-14T06:01:00.039 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8159999999999998e-06 2024-09-14T06:01:00.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.039 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.039 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.039 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756116+0000", 2024-09-14T06:01:00.039 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4980000000000006e-06 2024-09-14T06:01:00.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.039 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.039 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.039 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756122+0000", 2024-09-14T06:01:00.040 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8809999999999998e-06 2024-09-14T06:01:00.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.040 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.040 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806841+0000", 2024-09-14T06:01:00.040 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050718907000000001 2024-09-14T06:01:00.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.040 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.040 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806927+0000", 2024-09-14T06:01:00.040 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5908999999999994e-05 2024-09-14T06:01:00.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.041 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.041 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807022+0000", 2024-09-14T06:01:00.041 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4901000000000005e-05 2024-09-14T06:01:00.041 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.041 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.041 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.041 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.041 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119881 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5095424~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.041 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:01:00.041 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.253518313000001, 2024-09-14T06:01:00.041 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051097946999999998, 2024-09-14T06:01:00.041 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.042 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.042 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.042 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.042 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.042 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.042 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119881 2024-09-14T06:01:00.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.042 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.042 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.042 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.042 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:01:00.042 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.042 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.043 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.043 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:01:00.043 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.043 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.043 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756135+0000", 2024-09-14T06:01:00.043 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.51e-07 2024-09-14T06:01:00.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.044 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.044 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756137+0000", 2024-09-14T06:01:00.044 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2230000000000001e-06 2024-09-14T06:01:00.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.044 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.044 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.044 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756145+0000", 2024-09-14T06:01:00.044 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6629999999999993e-06 2024-09-14T06:01:00.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.044 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.044 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.044 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756150+0000", 2024-09-14T06:01:00.044 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9150000000000004e-06 2024-09-14T06:01:00.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807054+0000", 2024-09-14T06:01:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050904855999999998 2024-09-14T06:01:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807137+0000", 2024-09-14T06:01:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2248000000000003e-05 2024-09-14T06:01:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807232+0000", 2024-09-14T06:01:00.045 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5490999999999998e-05 2024-09-14T06:01:00.046 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.046 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.046 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.046 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.046 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119882 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5144576~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.046 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:01:00.046 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.253494437000001, 2024-09-14T06:01:00.046 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051297745999999998, 2024-09-14T06:01:00.046 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.046 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.046 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.046 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.047 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.047 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.047 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119882 2024-09-14T06:01:00.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.047 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.047 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.047 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.047 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:01:00.047 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.047 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.047 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.047 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:01:00.048 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.048 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.048 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756159+0000", 2024-09-14T06:01:00.048 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4299999999999998e-07 2024-09-14T06:01:00.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.048 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.048 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756161+0000", 2024-09-14T06:01:00.048 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4959999999999999e-06 2024-09-14T06:01:00.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.048 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.049 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756170+0000", 2024-09-14T06:01:00.049 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1779999999999992e-06 2024-09-14T06:01:00.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.049 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.049 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756176+0000", 2024-09-14T06:01:00.049 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0090000000000004e-06 2024-09-14T06:01:00.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.049 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.049 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807264+0000", 2024-09-14T06:01:00.049 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051087948000000001 2024-09-14T06:01:00.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.050 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.050 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807353+0000", 2024-09-14T06:01:00.050 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8919999999999996e-05 2024-09-14T06:01:00.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.050 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.050 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.050 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807456+0000", 2024-09-14T06:01:00.050 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010275199999999999 2024-09-14T06:01:00.050 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.050 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.050 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.050 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.050 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119883 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5193728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.253467583999999, 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051484553000000002, 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119883 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.051 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:00.052 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.052 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.052 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.052 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:00.052 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.052 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.052 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.052 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:00.052 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8699999999999995e-07 2024-09-14T06:01:00.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.052 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.053 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756188+0000", 2024-09-14T06:01:00.053 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4820000000000001e-06 2024-09-14T06:01:00.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.053 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756195+0000", 2024-09-14T06:01:00.053 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.545e-06 2024-09-14T06:01:00.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.053 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756200+0000", 2024-09-14T06:01:00.053 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.045e-06 2024-09-14T06:01:00.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.054 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.054 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807487+0000", 2024-09-14T06:01:00.054 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051287228999999997 2024-09-14T06:01:00.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.054 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.054 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807572+0000", 2024-09-14T06:01:00.054 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5303999999999995e-05 2024-09-14T06:01:00.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.054 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.054 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807670+0000", 2024-09-14T06:01:00.054 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7460999999999994e-05 2024-09-14T06:01:00.055 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.055 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.055 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.055 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.055 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119884 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5242880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.055 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:01:00.055 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.253427094999999, 2024-09-14T06:01:00.055 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051672403999999998, 2024-09-14T06:01:00.055 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.055 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.055 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.055 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.055 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119884 2024-09-14T06:01:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:01:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:01:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.057 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.057 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756226+0000", 2024-09-14T06:01:00.057 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7899999999999998e-07 2024-09-14T06:01:00.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.057 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.057 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756229+0000", 2024-09-14T06:01:00.057 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9919999999999999e-06 2024-09-14T06:01:00.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.057 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.057 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.057 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756237+0000", 2024-09-14T06:01:00.057 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1280000000000008e-06 2024-09-14T06:01:00.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.058 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.058 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.058 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756244+0000", 2024-09-14T06:01:00.058 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7519999999999999e-06 2024-09-14T06:01:00.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.058 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.058 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.058 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807726+0000", 2024-09-14T06:01:00.058 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051482344999999999 2024-09-14T06:01:00.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.058 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.058 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.058 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807808+0000", 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1845e-05 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807898+0000", 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9662999999999999e-05 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119885 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5292032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.253398690000001, 2024-09-14T06:01:00.059 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051858125999999997, 2024-09-14T06:01:00.060 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.060 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.060 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.060 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.060 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.060 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.060 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119885 2024-09-14T06:01:00.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.060 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.060 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.060 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.060 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:01:00.061 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.061 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.061 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.061 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:01:00.061 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.061 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.061 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.061 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759822+0000", 2024-09-14T06:01:00.061 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035676610000000002 2024-09-14T06:01:00.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759831+0000", 2024-09-14T06:01:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2329999999999995e-06 2024-09-14T06:01:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759842+0000", 2024-09-14T06:01:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0954999999999999e-05 2024-09-14T06:01:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759851+0000", 2024-09-14T06:01:00.062 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1770000000000004e-06 2024-09-14T06:01:00.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.063 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.063 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.063 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807942+0000", 2024-09-14T06:01:00.063 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048091438 2024-09-14T06:01:00.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.063 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.063 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.063 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.808027+0000", 2024-09-14T06:01:00.063 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4227999999999994e-05 2024-09-14T06:01:00.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.063 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.063 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.063 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.808112+0000", 2024-09-14T06:01:00.064 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5433999999999996e-05 2024-09-14T06:01:00.064 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.064 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.064 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.064 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.064 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119897 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5881856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.064 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:01:00.064 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.249594182999999, 2024-09-14T06:01:00.064 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050603113999999998, 2024-09-14T06:01:00.064 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.064 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.064 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.064 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.065 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.065 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.065 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119897 2024-09-14T06:01:00.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.065 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.065 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.065 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.065 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:01:00.065 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.065 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.065 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.065 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:01:00.065 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760059+0000", 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0800000000000001e-07 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760060+0000", 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4050000000000001e-06 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760063+0000", 2024-09-14T06:01:00.066 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2320000000000001e-06 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760066+0000", 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.74e-06 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810454+0000", 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050388355000000003 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810550+0000", 2024-09-14T06:01:00.067 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5441999999999999e-05 2024-09-14T06:01:00.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.068 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.068 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.068 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810662+0000", 2024-09-14T06:01:00.068 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011173199999999999 2024-09-14T06:01:00.068 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.068 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.068 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.068 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.068 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119898 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5931008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.068 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:00.068 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.249582843999999, 2024-09-14T06:01:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050800631999999998, 2024-09-14T06:01:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119898 2024-09-14T06:01:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.069 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0900000000000001e-07 2024-09-14T06:01:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.070 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760071+0000", 2024-09-14T06:01:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0899999999999999e-06 2024-09-14T06:01:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760074+0000", 2024-09-14T06:01:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1470000000000001e-06 2024-09-14T06:01:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.071 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760077+0000", 2024-09-14T06:01:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0170000000000001e-06 2024-09-14T06:01:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810704+0000", 2024-09-14T06:01:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050626811000000001 2024-09-14T06:01:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810779+0000", 2024-09-14T06:01:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4762e-05 2024-09-14T06:01:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.072 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810870+0000", 2024-09-14T06:01:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1595999999999995e-05 2024-09-14T06:01:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119899 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5980160~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.249571830000001, 2024-09-14T06:01:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051034903, 2024-09-14T06:01:00.073 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119899 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.074 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.34e-07 2024-09-14T06:01:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760082+0000", 2024-09-14T06:01:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4190000000000001e-06 2024-09-14T06:01:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.075 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760086+0000", 2024-09-14T06:01:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2629999999999999e-06 2024-09-14T06:01:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760088+0000", 2024-09-14T06:01:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5150000000000001e-06 2024-09-14T06:01:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810919+0000", 2024-09-14T06:01:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050831111999999998 2024-09-14T06:01:00.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811011+0000", 2024-09-14T06:01:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1339000000000001e-05 2024-09-14T06:01:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811116+0000", 2024-09-14T06:01:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105021 2024-09-14T06:01:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119900 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6029312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.249560925000001, 2024-09-14T06:01:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051299599000000001, 2024-09-14T06:01:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119900 2024-09-14T06:01:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.078 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5699999999999999e-07 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.079 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760093+0000", 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1689999999999999e-06 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760096+0000", 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.315e-06 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760101+0000", 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.080 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811162+0000", 2024-09-14T06:01:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051061341000000003 2024-09-14T06:01:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811271+0000", 2024-09-14T06:01:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010851799999999999 2024-09-14T06:01:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811391+0000", 2024-09-14T06:01:00.081 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000120307 2024-09-14T06:01:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119901 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6078464~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:01:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.249519405000001, 2024-09-14T06:01:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051519772999999998, 2024-09-14T06:01:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.082 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119901 2024-09-14T06:01:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:01:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:01:00.083 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760134+0000", 2024-09-14T06:01:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.92e-07 2024-09-14T06:01:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760138+0000", 2024-09-14T06:01:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3869999999999997e-06 2024-09-14T06:01:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.084 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760145+0000", 2024-09-14T06:01:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.878e-06 2024-09-14T06:01:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760151+0000", 2024-09-14T06:01:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4399999999999996e-06 2024-09-14T06:01:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811452+0000", 2024-09-14T06:01:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051301872999999998 2024-09-14T06:01:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811545+0000", 2024-09-14T06:01:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2472000000000005e-05 2024-09-14T06:01:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811653+0000", 2024-09-14T06:01:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108031 2024-09-14T06:01:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.086 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.087 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119902 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.087 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:00.087 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.249492020000002, 2024-09-14T06:01:00.087 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051737544000000003, 2024-09-14T06:01:00.087 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.087 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.087 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.087 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.087 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.087 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.087 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119902 2024-09-14T06:01:00.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.088 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.088 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.088 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.088 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:00.088 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.088 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.088 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.088 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:00.088 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.088 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.088 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.089 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:00.089 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0600000000000001e-07 2024-09-14T06:01:00.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.089 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.089 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.089 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760163+0000", 2024-09-14T06:01:00.089 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2850000000000001e-06 2024-09-14T06:01:00.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.089 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.089 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.089 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760170+0000", 2024-09-14T06:01:00.089 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6030000000000001e-06 2024-09-14T06:01:00.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.090 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.090 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.090 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760176+0000", 2024-09-14T06:01:00.090 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6540000000000004e-06 2024-09-14T06:01:00.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.090 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.090 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.090 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811704+0000", 2024-09-14T06:01:00.090 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051528303999999997 2024-09-14T06:01:00.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.090 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.090 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.090 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811794+0000", 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0142000000000005e-05 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811898+0000", 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010415 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119903 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6176768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.249462356999999, 2024-09-14T06:01:00.091 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051958747999999999, 2024-09-14T06:01:00.092 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.092 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.092 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.092 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.092 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.092 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.092 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119903 2024-09-14T06:01:00.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.092 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.092 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.092 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.092 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:01:00.092 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.092 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.093 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.093 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.093 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:01:00.093 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.093 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.093 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.093 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760191+0000", 2024-09-14T06:01:00.093 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6400000000000002e-07 2024-09-14T06:01:00.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.093 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.093 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.093 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760194+0000", 2024-09-14T06:01:00.093 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7920000000000001e-06 2024-09-14T06:01:00.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.094 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.094 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.094 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760203+0000", 2024-09-14T06:01:00.094 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0669999999999998e-06 2024-09-14T06:01:00.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.094 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.094 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.094 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760208+0000", 2024-09-14T06:01:00.094 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5929999999999996e-06 2024-09-14T06:01:00.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.094 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.094 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811955+0000", 2024-09-14T06:01:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051746357 2024-09-14T06:01:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812046+0000", 2024-09-14T06:01:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1824999999999996e-05 2024-09-14T06:01:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812149+0000", 2024-09-14T06:01:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010255 2024-09-14T06:01:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.095 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.096 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.096 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.096 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119904 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6225920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.096 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:01:00.096 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.249435170000002, 2024-09-14T06:01:00.096 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052164159000000002, 2024-09-14T06:01:00.096 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.096 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.096 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.096 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.096 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.096 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.097 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119904 2024-09-14T06:01:00.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.097 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.097 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.097 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.097 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:01:00.097 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.097 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.097 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.097 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:01:00.097 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.097 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.097 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.098 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.098 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760218+0000", 2024-09-14T06:01:00.098 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2899999999999999e-07 2024-09-14T06:01:00.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.098 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.098 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.098 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760220+0000", 2024-09-14T06:01:00.098 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2879999999999999e-06 2024-09-14T06:01:00.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.098 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.098 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.098 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760226+0000", 2024-09-14T06:01:00.098 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1870000000000002e-06 2024-09-14T06:01:00.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.099 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.099 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.099 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760231+0000", 2024-09-14T06:01:00.099 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0950000000000003e-06 2024-09-14T06:01:00.099 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.099 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.099 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.099 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812192+0000", 2024-09-14T06:01:00.099 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051960587000000003 2024-09-14T06:01:00.099 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.099 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.099 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.099 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812281+0000", 2024-09-14T06:01:00.099 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9225e-05 2024-09-14T06:01:00.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.100 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.100 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.100 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812382+0000", 2024-09-14T06:01:00.100 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000100348 2024-09-14T06:01:00.100 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.100 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.100 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.100 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.100 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119905 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6275072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:00.100 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:01:00.100 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 17.249413131000001, 2024-09-14T06:01:00.100 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052394334000000001, 2024-09-14T06:01:00.101 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.101 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.101 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.101 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.101 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.101 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.101 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119905 2024-09-14T06:01:00.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.101 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.101 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.101 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.101 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:01:00.101 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.102 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.102 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.102 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:01:00.102 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.102 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.102 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.102 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760240+0000", 2024-09-14T06:01:00.102 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:01:00.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.102 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.102 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.103 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760242+0000", 2024-09-14T06:01:00.103 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0959999999999999e-06 2024-09-14T06:01:00.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.103 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.103 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.103 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760249+0000", 2024-09-14T06:01:00.103 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7399999999999998e-06 2024-09-14T06:01:00.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.103 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.103 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.103 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760254+0000", 2024-09-14T06:01:00.103 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9089999999999999e-06 2024-09-14T06:01:00.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.103 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.104 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.104 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812419+0000", 2024-09-14T06:01:00.104 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052165481 2024-09-14T06:01:00.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.104 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.104 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.104 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812510+0000", 2024-09-14T06:01:00.104 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0525000000000005e-05 2024-09-14T06:01:00.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.104 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.104 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.104 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812634+0000", 2024-09-14T06:01:00.104 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012412600000000001 2024-09-14T06:01:00.105 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.105 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.105 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.105 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.105 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.105 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:00.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:01:00.111 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:00.109+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:00.212 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:00.208+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:00.234 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:00.234 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:00.234 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:01:00.234 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:00.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:01:00.298 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2024-09-14T06:01:00.312 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:00.309+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:00.412 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:00.413 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:00.413 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:00.413 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:00.413 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:00.413 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:00.408+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:00.426 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:01:00.515 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:00.512+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:00.590 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:00.590 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:00.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:00.590 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:00.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.590 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114684 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 999424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.590 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:00.590 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.490613016000001, 2024-09-14T06:01:00.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051769745999999998, 2024-09-14T06:01:00.591 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.591 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.591 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.591 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.591 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.591 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.591 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114684 2024-09-14T06:01:00.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.591 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.591 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.591 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:00.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:00.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:00.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3099999999999998e-07 2024-09-14T06:01:00.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097324+0000", 2024-09-14T06:01:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5019999999999999e-06 2024-09-14T06:01:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097333+0000", 2024-09-14T06:01:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6659999999999997e-06 2024-09-14T06:01:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097338+0000", 2024-09-14T06:01:00.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6049999999999997e-06 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.148711+0000", 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051372831000000001 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.148787+0000", 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6205999999999995e-05 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149091+0000", 2024-09-14T06:01:00.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030350499999999997 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114685 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1105920~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.490588267, 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052125193, 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.595 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.596 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114685 2024-09-14T06:01:00.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.596 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.596 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.596 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:00.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.596 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.596 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:00.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:00.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2800000000000002e-07 2024-09-14T06:01:00.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097349+0000", 2024-09-14T06:01:00.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4310000000000001e-06 2024-09-14T06:01:00.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097357+0000", 2024-09-14T06:01:00.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3799999999999994e-06 2024-09-14T06:01:00.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097362+0000", 2024-09-14T06:01:00.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.933e-06 2024-09-14T06:01:00.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149147+0000", 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051784754000000002 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149204+0000", 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7794000000000003e-05 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149471+0000", 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026647299999999998 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114686 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1212416~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.490564000999999, 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052428210000000003, 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114686 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4000000000000002e-07 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097373+0000", 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1160000000000002e-06 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097380+0000", 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8199999999999997e-06 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097385+0000", 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7609999999999998e-06 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149501+0000", 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052115941999999998 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149559+0000", 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8313999999999998e-05 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149798+0000", 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000238817 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.604 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114687 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1318912~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.604 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:01:00.604 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.490541831000002, 2024-09-14T06:01:00.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052786364000000002, 2024-09-14T06:01:00.604 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.604 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.604 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.604 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.604 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.604 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114687 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097393+0000", 2024-09-14T06:01:00.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6499999999999999e-07 2024-09-14T06:01:00.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097395+0000", 2024-09-14T06:01:00.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2129999999999998e-06 2024-09-14T06:01:00.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097403+0000", 2024-09-14T06:01:00.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2360000000000004e-06 2024-09-14T06:01:00.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097408+0000", 2024-09-14T06:01:00.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2460000000000003e-06 2024-09-14T06:01:00.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149848+0000", 2024-09-14T06:01:00.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052439965999999998 2024-09-14T06:01:00.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149919+0000", 2024-09-14T06:01:00.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1148000000000004e-05 2024-09-14T06:01:00.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150179+0000", 2024-09-14T06:01:00.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025909000000000001 2024-09-14T06:01:00.608 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.608 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.608 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.608 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114688 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1425408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.608 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:00.608 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.490517293, 2024-09-14T06:01:00.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053185383000000003, 2024-09-14T06:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114688 2024-09-14T06:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:00.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:00.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2199999999999999e-07 2024-09-14T06:01:00.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097419+0000", 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1670000000000002e-06 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097427+0000", 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7819999999999994e-06 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097432+0000", 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150228+0000", 2024-09-14T06:01:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052796434000000003 2024-09-14T06:01:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150308+0000", 2024-09-14T06:01:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9221999999999995e-05 2024-09-14T06:01:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150602+0000", 2024-09-14T06:01:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000294493 2024-09-14T06:01:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114689 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1531904~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.490494955999999, 2024-09-14T06:01:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053528527999999999, 2024-09-14T06:01:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114689 2024-09-14T06:01:00.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.614 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:00.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:00.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1699999999999999e-07 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097446+0000", 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1090000000000003e-06 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097454+0000", 2024-09-14T06:01:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3860000000000007e-06 2024-09-14T06:01:00.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097458+0000", 2024-09-14T06:01:00.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1919999999999998e-06 2024-09-14T06:01:00.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150648+0000", 2024-09-14T06:01:00.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053190075000000003 2024-09-14T06:01:00.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150705+0000", 2024-09-14T06:01:00.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6484000000000003e-05 2024-09-14T06:01:00.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150968+0000", 2024-09-14T06:01:00.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026286499999999998 2024-09-14T06:01:00.617 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.617 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.617 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.617 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114690 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1638400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.617 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:00.617 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.490469466, 2024-09-14T06:01:00.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053963677000000002, 2024-09-14T06:01:00.618 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.618 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.618 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.618 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.618 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.618 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.618 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114690 2024-09-14T06:01:00.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.618 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:00.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:00.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:00.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0400000000000002e-07 2024-09-14T06:01:00.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.620 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.620 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097466+0000", 2024-09-14T06:01:00.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4389999999999999e-06 2024-09-14T06:01:00.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.620 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.620 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097470+0000", 2024-09-14T06:01:00.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6540000000000001e-06 2024-09-14T06:01:00.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.620 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097474+0000", 2024-09-14T06:01:00.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.301e-06 2024-09-14T06:01:00.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151069+0000", 2024-09-14T06:01:00.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053594827999999997 2024-09-14T06:01:00.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151156+0000", 2024-09-14T06:01:00.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6445000000000003e-05 2024-09-14T06:01:00.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151428+0000", 2024-09-14T06:01:00.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000272706 2024-09-14T06:01:00.622 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.622 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.622 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.622 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114806 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.622 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:01:00.623 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.486508188999998, 2024-09-14T06:01:00.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051625628, 2024-09-14T06:01:00.623 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.623 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.623 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.623 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.623 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.623 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.623 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114806 2024-09-14T06:01:00.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.623 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.624 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.624 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:01:00.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.624 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.624 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:01:00.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.624 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.624 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101427+0000", 2024-09-14T06:01:00.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5600000000000004e-07 2024-09-14T06:01:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101431+0000", 2024-09-14T06:01:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5920000000000002e-06 2024-09-14T06:01:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101462+0000", 2024-09-14T06:01:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0607e-05 2024-09-14T06:01:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101470+0000", 2024-09-14T06:01:00.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6249999999999998e-06 2024-09-14T06:01:00.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.152670+0000", 2024-09-14T06:01:00.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051199972000000003 2024-09-14T06:01:00.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.152763+0000", 2024-09-14T06:01:00.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3274000000000002e-05 2024-09-14T06:01:00.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153051+0000", 2024-09-14T06:01:00.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000288602 2024-09-14T06:01:00.627 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.627 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.627 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.627 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114807 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 442368~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.627 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:01:00.627 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.486435864000001, 2024-09-14T06:01:00.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051947018999999997, 2024-09-14T06:01:00.627 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.627 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.627 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.628 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.628 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.628 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.628 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114807 2024-09-14T06:01:00.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.628 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.628 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.628 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:01:00.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:01:00.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101499+0000", 2024-09-14T06:01:00.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.23e-07 2024-09-14T06:01:00.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101505+0000", 2024-09-14T06:01:00.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2570000000000004e-06 2024-09-14T06:01:00.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.630 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101518+0000", 2024-09-14T06:01:00.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3327e-05 2024-09-14T06:01:00.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.630 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101525+0000", 2024-09-14T06:01:00.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7410000000000003e-06 2024-09-14T06:01:00.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.630 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153108+0000", 2024-09-14T06:01:00.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051582688000000002 2024-09-14T06:01:00.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153209+0000", 2024-09-14T06:01:00.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000101092 2024-09-14T06:01:00.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153445+0000", 2024-09-14T06:01:00.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023619099999999999 2024-09-14T06:01:00.631 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.632 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.632 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.632 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114808 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 548864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.632 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:00.632 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.486397440000001, 2024-09-14T06:01:00.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052334951999999997, 2024-09-14T06:01:00.632 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.632 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.632 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.632 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.632 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.633 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.633 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114808 2024-09-14T06:01:00.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.633 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.633 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.633 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:00.633 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.633 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.633 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:00.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:00.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1600000000000001e-07 2024-09-14T06:01:00.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101540+0000", 2024-09-14T06:01:00.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.942e-06 2024-09-14T06:01:00.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101547+0000", 2024-09-14T06:01:00.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9460000000000001e-06 2024-09-14T06:01:00.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101552+0000", 2024-09-14T06:01:00.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2320000000000001e-06 2024-09-14T06:01:00.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153494+0000", 2024-09-14T06:01:00.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051942200000000001 2024-09-14T06:01:00.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153600+0000", 2024-09-14T06:01:00.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105886 2024-09-14T06:01:00.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153872+0000", 2024-09-14T06:01:00.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027123000000000002 2024-09-14T06:01:00.636 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.636 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.636 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114809 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 655360~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.486130017000001, 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052491571000000001, 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114809 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.637 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101805+0000", 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.094e-06 2024-09-14T06:01:00.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101810+0000", 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3430000000000003e-06 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101824+0000", 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3081999999999999e-05 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101832+0000", 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6950000000000006e-06 2024-09-14T06:01:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.640 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.640 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153908+0000", 2024-09-14T06:01:00.640 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052075444999999998 2024-09-14T06:01:00.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.640 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.640 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153992+0000", 2024-09-14T06:01:00.640 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4829999999999999e-05 2024-09-14T06:01:00.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.640 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154296+0000", 2024-09-14T06:01:00.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030308199999999998 2024-09-14T06:01:00.641 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.641 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.641 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.641 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114810 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 761856~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.641 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:01:00.641 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.486084028000001, 2024-09-14T06:01:00.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052650012000000003, 2024-09-14T06:01:00.641 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.641 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.642 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.642 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.642 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.642 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.642 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114810 2024-09-14T06:01:00.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.642 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:01:00.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:01:00.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101851+0000", 2024-09-14T06:01:00.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.75e-07 2024-09-14T06:01:00.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101854+0000", 2024-09-14T06:01:00.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0620000000000001e-06 2024-09-14T06:01:00.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101863+0000", 2024-09-14T06:01:00.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5719999999999992e-06 2024-09-14T06:01:00.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101869+0000", 2024-09-14T06:01:00.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4229999999999996e-06 2024-09-14T06:01:00.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154350+0000", 2024-09-14T06:01:00.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052480991999999997 2024-09-14T06:01:00.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154429+0000", 2024-09-14T06:01:00.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9482999999999998e-05 2024-09-14T06:01:00.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154500+0000", 2024-09-14T06:01:00.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0905e-05 2024-09-14T06:01:00.645 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.645 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.645 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114811 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 868352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.486055534999998, 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053080507999999998, 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114811 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.646 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.647 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.647 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:01:00.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.647 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.647 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:01:00.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101879+0000", 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0399999999999996e-07 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101882+0000", 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6919999999999998e-06 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101889+0000", 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.058e-06 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101894+0000", 2024-09-14T06:01:00.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1669999999999998e-06 2024-09-14T06:01:00.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154552+0000", 2024-09-14T06:01:00.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052658358000000002 2024-09-14T06:01:00.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154649+0000", 2024-09-14T06:01:00.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6708999999999999e-05 2024-09-14T06:01:00.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.650 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.650 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154959+0000", 2024-09-14T06:01:00.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00031001999999999999 2024-09-14T06:01:00.650 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.650 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.650 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.650 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114812 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 974848~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.650 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.486033076999998, 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053474381000000001, 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114812 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:00.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:00.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:00.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.53e-07 2024-09-14T06:01:00.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101903+0000", 2024-09-14T06:01:00.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1519999999999999e-06 2024-09-14T06:01:00.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101909+0000", 2024-09-14T06:01:00.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9100000000000002e-06 2024-09-14T06:01:00.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101914+0000", 2024-09-14T06:01:00.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4240000000000003e-06 2024-09-14T06:01:00.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.654 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.654 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154995+0000", 2024-09-14T06:01:00.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053081101999999998 2024-09-14T06:01:00.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.654 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.654 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155085+0000", 2024-09-14T06:01:00.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0195e-05 2024-09-14T06:01:00.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.654 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.654 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155375+0000", 2024-09-14T06:01:00.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029024500000000001 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114813 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1081344~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.486012295999998, 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053887802999999998, 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.655 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.656 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114813 2024-09-14T06:01:00.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.656 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:00.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:00.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.657 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.657 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:00.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.75e-07 2024-09-14T06:01:00.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.657 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.657 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101924+0000", 2024-09-14T06:01:00.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.244e-06 2024-09-14T06:01:00.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101931+0000", 2024-09-14T06:01:00.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6789999999999999e-06 2024-09-14T06:01:00.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101936+0000", 2024-09-14T06:01:00.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2320000000000001e-06 2024-09-14T06:01:00.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155435+0000", 2024-09-14T06:01:00.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053498187000000003 2024-09-14T06:01:00.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.659 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.659 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155531+0000", 2024-09-14T06:01:00.659 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6386999999999997e-05 2024-09-14T06:01:00.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.659 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.659 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155810+0000", 2024-09-14T06:01:00.659 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027859899999999998 2024-09-14T06:01:00.659 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.659 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.660 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.660 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114814 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1187840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.660 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:01:00.660 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.485987691999998, 2024-09-14T06:01:00.660 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054301716, 2024-09-14T06:01:00.660 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.660 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.660 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.660 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.660 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.660 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.661 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114814 2024-09-14T06:01:00.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.661 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.661 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:01:00.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.661 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:01:00.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101947+0000", 2024-09-14T06:01:00.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6400000000000003e-07 2024-09-14T06:01:00.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101949+0000", 2024-09-14T06:01:00.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.396e-06 2024-09-14T06:01:00.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101957+0000", 2024-09-14T06:01:00.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5839999999999997e-06 2024-09-14T06:01:00.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.663 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101962+0000", 2024-09-14T06:01:00.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0100000000000003e-06 2024-09-14T06:01:00.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.663 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.663 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155858+0000", 2024-09-14T06:01:00.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053895862000000003 2024-09-14T06:01:00.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.664 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155955+0000", 2024-09-14T06:01:00.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7812000000000005e-05 2024-09-14T06:01:00.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.664 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156248+0000", 2024-09-14T06:01:00.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029258799999999998 2024-09-14T06:01:00.664 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.664 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.664 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.665 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114815 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1294336~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.665 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:01:00.665 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.485965574000002, 2024-09-14T06:01:00.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054641393000000003, 2024-09-14T06:01:00.665 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.665 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.665 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.665 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.666 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.666 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114815 2024-09-14T06:01:00.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.666 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.666 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.666 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:01:00.666 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.667 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.667 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:01:00.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.667 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.667 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101969+0000", 2024-09-14T06:01:00.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3099999999999999e-07 2024-09-14T06:01:00.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.667 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.667 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101971+0000", 2024-09-14T06:01:00.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0150000000000002e-06 2024-09-14T06:01:00.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101982+0000", 2024-09-14T06:01:00.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0725e-05 2024-09-14T06:01:00.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101987+0000", 2024-09-14T06:01:00.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.716e-06 2024-09-14T06:01:00.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156288+0000", 2024-09-14T06:01:00.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054301035999999997 2024-09-14T06:01:00.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156358+0000", 2024-09-14T06:01:00.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9238000000000004e-05 2024-09-14T06:01:00.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156610+0000", 2024-09-14T06:01:00.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025233200000000002 2024-09-14T06:01:00.669 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.670 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.670 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114816 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1400832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.670 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:00.670 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.485938121, 2024-09-14T06:01:00.670 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054933327999999997, 2024-09-14T06:01:00.670 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.670 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.670 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.670 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.670 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.671 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.671 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114816 2024-09-14T06:01:00.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.671 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.671 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.671 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:00.671 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.671 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.671 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:00.671 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.672 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.672 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:00.672 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8100000000000003e-07 2024-09-14T06:01:00.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.672 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.672 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101999+0000", 2024-09-14T06:01:00.672 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.633e-06 2024-09-14T06:01:00.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.673 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102008+0000", 2024-09-14T06:01:00.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4050000000000006e-06 2024-09-14T06:01:00.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.673 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102015+0000", 2024-09-14T06:01:00.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6660000000000002e-06 2024-09-14T06:01:00.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.673 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156644+0000", 2024-09-14T06:01:00.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054628942 2024-09-14T06:01:00.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.674 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.674 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156692+0000", 2024-09-14T06:01:00.674 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8250000000000001e-05 2024-09-14T06:01:00.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.674 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.674 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156929+0000", 2024-09-14T06:01:00.674 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000236951 2024-09-14T06:01:00.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.674 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.674 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.675 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114817 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1507328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.675 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:01:00.675 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.485893531999999, 2024-09-14T06:01:00.675 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.055317495000000001, 2024-09-14T06:01:00.675 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.675 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.675 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.675 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.675 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.675 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.675 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114817 2024-09-14T06:01:00.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.676 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.676 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.676 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:01:00.676 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.676 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.676 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:01:00.676 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.676 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.676 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102041+0000", 2024-09-14T06:01:00.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5099999999999999e-07 2024-09-14T06:01:00.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.677 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.677 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102045+0000", 2024-09-14T06:01:00.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3790000000000002e-06 2024-09-14T06:01:00.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.677 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.677 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102067+0000", 2024-09-14T06:01:00.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2844999999999999e-05 2024-09-14T06:01:00.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102074+0000", 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6340000000000003e-06 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156975+0000", 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054900596000000003 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157070+0000", 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5569000000000006e-05 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157358+0000", 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028782100000000001 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114818 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1613824~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.485527497, 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.055293008999999997, 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:00.679 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:00.680 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:00.680 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:00.680 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:00.680 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114818 2024-09-14T06:01:00.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.680 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:00.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.680 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:00.680 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:00.680 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.680 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.680 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1500000000000003e-07 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102412+0000", 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8860000000000003e-06 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.681 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:00.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102429+0000", 2024-09-14T06:01:00.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7147e-05 2024-09-14T06:01:00.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:00.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102438+0000", 2024-09-14T06:01:00.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.799e-06 2024-09-14T06:01:00.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.682 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:00.682 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157387+0000", 2024-09-14T06:01:00.682 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054948921999999997 2024-09-14T06:01:00.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.682 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.683 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:00.683 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157452+0000", 2024-09-14T06:01:00.683 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4471e-05 2024-09-14T06:01:00.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:00.683 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:00.683 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:00.683 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157700+0000", 2024-09-14T06:01:00.683 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024796900000000001 2024-09-14T06:01:00.683 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.683 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.683 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.683 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:00.683 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:00.684 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:00.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:01:00.685 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:00.680+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:00.785 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:00.780+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:00.852 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:01:00.853 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:00.866 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:01:00.886 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:00.885+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:00.987 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:00.984+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:01.031 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:01.031 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:01.031 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:01.031 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:01.032 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:01.046 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:01:01.087 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:01.085+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:01.189 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:01.184+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:01.210 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:01.210 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:01.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:01.210 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:01.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.210 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3629 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'31, mlcod=31'25)", 2024-09-14T06:01:01.210 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:01.210 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 103.87856379999999, 2024-09-14T06:01:01.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048071900000000002, 2024-09-14T06:01:01.211 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.211 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.211 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.211 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.211 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:01.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.211 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.211 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:01.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329483+0000", 2024-09-14T06:01:01.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-07 2024-09-14T06:01:01.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329488+0000", 2024-09-14T06:01:01.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000004e-06 2024-09-14T06:01:01.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329496+0000", 2024-09-14T06:01:01.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2209999999999997e-06 2024-09-14T06:01:01.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.213 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329501+0000", 2024-09-14T06:01:01.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8729999999999998e-06 2024-09-14T06:01:01.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.213 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329545+0000", 2024-09-14T06:01:01.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4382999999999998e-05 2024-09-14T06:01:01.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329564+0000", 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8947999999999999e-05 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334225+0000", 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004660923 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334289+0000", 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4041999999999994e-05 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.214 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3632 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'34, mlcod=31'27)", 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 103.875441612, 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047983469999999997, 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332605+0000", 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5099999999999999e-07 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332611+0000", 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6999999999999996e-06 2024-09-14T06:01:01.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.217 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.217 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332623+0000", 2024-09-14T06:01:01.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2401e-05 2024-09-14T06:01:01.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.217 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.217 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332629+0000", 2024-09-14T06:01:01.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3720000000000001e-06 2024-09-14T06:01:01.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.217 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.217 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332691+0000", 2024-09-14T06:01:01.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1451000000000005e-05 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332711+0000", 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0285e-05 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337341+0000", 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046295900000000003 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337402+0000", 2024-09-14T06:01:01.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1797000000000005e-05 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3638 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'40, mlcod=31'32)", 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 103.869299697, 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004283345, 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.219 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338747+0000", 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338756+0000", 2024-09-14T06:01:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5909999999999996e-06 2024-09-14T06:01:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338774+0000", 2024-09-14T06:01:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8073000000000001e-05 2024-09-14T06:01:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338785+0000", 2024-09-14T06:01:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1017e-05 2024-09-14T06:01:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338844+0000", 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9292000000000001e-05 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338864+0000", 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9528999999999999e-05 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.342984+0000", 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041207809999999996 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.223 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.343029+0000", 2024-09-14T06:01:01.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5034000000000003e-05 2024-09-14T06:01:01.223 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.223 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.223 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.223 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:17596 3.4 e41/24 3:27f62511:::rbd_data.1127d65075f9.00000000000000ca:head v 41'97, mlcod=41'95)", 2024-09-14T06:01:01.223 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:01.223 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 91.237547133000007, 2024-09-14T06:01:01.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049456559999999997, 2024-09-14T06:01:01.223 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.223 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.223 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970500+0000", 2024-09-14T06:01:01.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9600000000000008e-07 2024-09-14T06:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970614+0000", 2024-09-14T06:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000113956 2024-09-14T06:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970631+0000", 2024-09-14T06:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7150999999999999e-05 2024-09-14T06:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970643+0000", 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1868999999999999e-05 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970711+0000", 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8952e-05 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970738+0000", 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6055999999999999e-05 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975388+0000", 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046502499999999999 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975444+0000", 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6425999999999998e-05 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24289 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'57, mlcod=41'54)", 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 89.052254954000006, 2024-09-14T06:01:01.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.060867738999999997, 2024-09-14T06:01:01.228 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.228 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.228 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.228 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:01.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.228 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:01.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.229 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.229 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155793+0000", 2024-09-14T06:01:01.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9470000000000002e-06 2024-09-14T06:01:01.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.229 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.229 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181776+0000", 2024-09-14T06:01:01.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.02598313 2024-09-14T06:01:01.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.230 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181817+0000", 2024-09-14T06:01:01.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1440000000000003e-05 2024-09-14T06:01:01.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.230 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181834+0000", 2024-09-14T06:01:01.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6979000000000001e-05 2024-09-14T06:01:01.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.230 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181931+0000", 2024-09-14T06:01:01.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7219999999999994e-05 2024-09-14T06:01:01.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.231 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.231 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181964+0000", 2024-09-14T06:01:01.231 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2094999999999997e-05 2024-09-14T06:01:01.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.231 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.231 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216586+0000", 2024-09-14T06:01:01.231 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034622503999999998 2024-09-14T06:01:01.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.231 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.231 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216658+0000", 2024-09-14T06:01:01.231 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2423999999999996e-05 2024-09-14T06:01:01.232 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.232 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.232 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.232 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24309 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'58, mlcod=41'56)", 2024-09-14T06:01:01.232 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:01.232 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.953019849, 2024-09-14T06:01:01.232 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044435519999999999, 2024-09-14T06:01:01.232 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.232 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.232 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.233 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:01.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.233 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:01.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.233 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255027+0000", 2024-09-14T06:01:01.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T06:01:01.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.234 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.234 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255040+0000", 2024-09-14T06:01:01.234 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2773e-05 2024-09-14T06:01:01.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.234 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.234 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255066+0000", 2024-09-14T06:01:01.234 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5459000000000001e-05 2024-09-14T06:01:01.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.234 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255076+0000", 2024-09-14T06:01:01.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0372e-05 2024-09-14T06:01:01.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255151+0000", 2024-09-14T06:01:01.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5444999999999993e-05 2024-09-14T06:01:01.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255176+0000", 2024-09-14T06:01:01.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5089e-05 2024-09-14T06:01:01.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259379+0000", 2024-09-14T06:01:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042025439999999999 2024-09-14T06:01:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259469+0000", 2024-09-14T06:01:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0407000000000004e-05 2024-09-14T06:01:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37361 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'280, mlcod=50'278)", 2024-09-14T06:01:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 77.166859591000005, 2024-09-14T06:01:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075534590000000002, 2024-09-14T06:01:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:01.237 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041187+0000", 2024-09-14T06:01:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2160000000000001e-06 2024-09-14T06:01:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.238 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041208+0000", 2024-09-14T06:01:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0528999999999999e-05 2024-09-14T06:01:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041225+0000", 2024-09-14T06:01:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7255e-05 2024-09-14T06:01:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041235+0000", 2024-09-14T06:01:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4190000000000008e-06 2024-09-14T06:01:01.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041302+0000", 2024-09-14T06:01:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7774000000000005e-05 2024-09-14T06:01:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041330+0000", 2024-09-14T06:01:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7382999999999999e-05 2024-09-14T06:01:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048686+0000", 2024-09-14T06:01:01.240 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073564570000000003 2024-09-14T06:01:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048740+0000", 2024-09-14T06:01:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3426e-05 2024-09-14T06:01:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37362 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'281, mlcod=50'278)", 2024-09-14T06:01:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 77.161959191999998, 2024-09-14T06:01:01.241 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047169380000000004, 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046087+0000", 2024-09-14T06:01:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3600000000000003e-07 2024-09-14T06:01:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046093+0000", 2024-09-14T06:01:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7869999999999998e-06 2024-09-14T06:01:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046106+0000", 2024-09-14T06:01:01.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2636999999999999e-05 2024-09-14T06:01:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046113+0000", 2024-09-14T06:01:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0129999999999996e-06 2024-09-14T06:01:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046170+0000", 2024-09-14T06:01:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7819000000000003e-05 2024-09-14T06:01:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046194+0000", 2024-09-14T06:01:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3167999999999999e-05 2024-09-14T06:01:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050760+0000", 2024-09-14T06:01:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045665999999999997 2024-09-14T06:01:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050803+0000", 2024-09-14T06:01:01.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3177999999999999e-05 2024-09-14T06:01:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39545 3.0 e50/24 3:06bdaf45:::rbd_data.112781171282.0000000000000002:head v 50'347, mlcod=50'345)", 2024-09-14T06:01:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.629578910000006, 2024-09-14T06:01:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047008700000000002, 2024-09-14T06:01:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578468+0000", 2024-09-14T06:01:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1599999999999999e-06 2024-09-14T06:01:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579733+0000", 2024-09-14T06:01:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012647120000000001 2024-09-14T06:01:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579755+0000", 2024-09-14T06:01:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2637999999999999e-05 2024-09-14T06:01:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.249 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.249 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579766+0000", 2024-09-14T06:01:01.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0264e-05 2024-09-14T06:01:01.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.249 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.249 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579832+0000", 2024-09-14T06:01:01.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6531000000000004e-05 2024-09-14T06:01:01.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.249 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.249 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579859+0000", 2024-09-14T06:01:01.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6855999999999998e-05 2024-09-14T06:01:01.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583098+0000", 2024-09-14T06:01:01.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003238632 2024-09-14T06:01:01.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583168+0000", 2024-09-14T06:01:01.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0077e-05 2024-09-14T06:01:01.250 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.250 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.250 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39765 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'410, mlcod=51'406)", 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.203624109000003, 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044953839999999998, 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.252 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:01.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.252 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004423+0000", 2024-09-14T06:01:01.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1909999999999999e-06 2024-09-14T06:01:01.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.252 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004432+0000", 2024-09-14T06:01:01.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2180000000000005e-06 2024-09-14T06:01:01.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004453+0000", 2024-09-14T06:01:01.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1182000000000001e-05 2024-09-14T06:01:01.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004464+0000", 2024-09-14T06:01:01.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1198e-05 2024-09-14T06:01:01.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004520+0000", 2024-09-14T06:01:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5835999999999999e-05 2024-09-14T06:01:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004547+0000", 2024-09-14T06:01:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6454000000000001e-05 2024-09-14T06:01:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008866+0000", 2024-09-14T06:01:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043194679999999999 2024-09-14T06:01:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008917+0000", 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0837000000000001e-05 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39847 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'431, mlcod=51'426)", 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.090340760000004, 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046358010000000002, 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.255 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.256 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:01.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:01.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117706+0000", 2024-09-14T06:01:01.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4899999999999995e-07 2024-09-14T06:01:01.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117711+0000", 2024-09-14T06:01:01.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6890000000000001e-06 2024-09-14T06:01:01.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117724+0000", 2024-09-14T06:01:01.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3054000000000001e-05 2024-09-14T06:01:01.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117736+0000", 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1654999999999999e-05 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117788+0000", 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2197000000000002e-05 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117811+0000", 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2472000000000001e-05 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.258 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122292+0000", 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004481596 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122341+0000", 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8489000000000003e-05 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39865 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'438, mlcod=51'434)", 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.063006462000004, 2024-09-14T06:01:01.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004519426, 2024-09-14T06:01:01.260 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.260 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.260 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.260 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:01.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:01.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.261 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145040+0000", 2024-09-14T06:01:01.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7899999999999998e-07 2024-09-14T06:01:01.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.261 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145044+0000", 2024-09-14T06:01:01.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3789999999999999e-06 2024-09-14T06:01:01.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145053+0000", 2024-09-14T06:01:01.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2650000000000002e-06 2024-09-14T06:01:01.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145058+0000", 2024-09-14T06:01:01.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8169999999999998e-06 2024-09-14T06:01:01.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145105+0000", 2024-09-14T06:01:01.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7176999999999999e-05 2024-09-14T06:01:01.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145119+0000", 2024-09-14T06:01:01.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3179e-05 2024-09-14T06:01:01.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149512+0000", 2024-09-14T06:01:01.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043934389999999999 2024-09-14T06:01:01.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149559+0000", 2024-09-14T06:01:01.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6591000000000002e-05 2024-09-14T06:01:01.264 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.264 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.264 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.264 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40245 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'513, mlcod=52'509)", 2024-09-14T06:01:01.264 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:01.264 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 75.284454433999997, 2024-09-14T06:01:01.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053460410000000002, 2024-09-14T06:01:01.264 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.264 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.264 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.265 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:01.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.265 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:01.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.265 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923592+0000", 2024-09-14T06:01:01.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6599999999999996e-07 2024-09-14T06:01:01.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923598+0000", 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.083e-06 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923609+0000", 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1137e-05 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923617+0000", 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.401e-06 2024-09-14T06:01:01.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924037+0000", 2024-09-14T06:01:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042046 2024-09-14T06:01:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924082+0000", 2024-09-14T06:01:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4617000000000003e-05 2024-09-14T06:01:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928882+0000", 2024-09-14T06:01:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048000889999999996 2024-09-14T06:01:01.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.268 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.268 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928937+0000", 2024-09-14T06:01:01.268 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5587999999999997e-05 2024-09-14T06:01:01.268 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.268 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.268 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.268 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40246 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'514, mlcod=52'509)", 2024-09-14T06:01:01.268 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:01.268 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 75.283419918999996, 2024-09-14T06:01:01.268 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043609649999999996, 2024-09-14T06:01:01.269 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.269 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.269 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.269 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.269 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.269 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:01.269 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.269 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.269 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:01.269 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:01.270 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2099999999999996e-07 2024-09-14T06:01:01.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924631+0000", 2024-09-14T06:01:01.270 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8450000000000002e-06 2024-09-14T06:01:01.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924641+0000", 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0057e-05 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924649+0000", 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5669999999999997e-06 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925127+0000", 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00047783800000000001 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925171+0000", 2024-09-14T06:01:01.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4017000000000002e-05 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928942+0000", 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037716809999999998 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928987+0000", 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4338999999999997e-05 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:46646 3.0 e56/24 3:01acbe3d:::rbd_data.1127f2f8ff9b.0000000000000015:head v 56'541, mlcod=55'538)", 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 70.746633649000003, 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064775850000000001, 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.273 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461415+0000", 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.666e-06 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463456+0000", 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00204177 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.274 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463488+0000", 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1503e-05 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463508+0000", 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9788000000000001e-05 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463697+0000", 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018873499999999999 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.275 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463741+0000", 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4333999999999999e-05 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467845+0000", 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041041430000000002 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467890+0000", 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4645999999999999e-05 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:89402 3.0 e84/24 3:03c9b195:::rbd_data.11271f4525c9.00000000000001ae:head v 84'849, mlcod=83'847)", 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 34.577732912999998, 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0051764460000000003, 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8299999999999997e-07 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630321+0000", 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6070000000000002e-06 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630349+0000", 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7696e-05 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630364+0000", 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4856e-05 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630507+0000", 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014309899999999999 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.280 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630573+0000", 2024-09-14T06:01:01.280 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6126999999999999e-05 2024-09-14T06:01:01.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.280 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.280 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.635358+0000", 2024-09-14T06:01:01.280 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047853879999999998 2024-09-14T06:01:01.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.280 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.280 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.635489+0000", 2024-09-14T06:01:01.280 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013108999999999999 2024-09-14T06:01:01.280 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.280 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:106809 3.9 e93/24 3:96c4c4a7:::rbd_data.1127189bfb31.000000000000000a:head v 93'304, mlcod=92'302)", 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.154373854999999, 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0092272799999999992, 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:01.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:01.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053673+0000", 2024-09-14T06:01:01.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.522e-06 2024-09-14T06:01:01.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056791+0000", 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031181310000000001 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056814+0000", 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2473999999999999e-05 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056825+0000", 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.059e-05 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.283 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056898+0000", 2024-09-14T06:01:01.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2992999999999997e-05 2024-09-14T06:01:01.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.284 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.284 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056918+0000", 2024-09-14T06:01:01.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0809999999999999e-05 2024-09-14T06:01:01.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.284 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.284 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.062810+0000", 2024-09-14T06:01:01.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0058916460000000004 2024-09-14T06:01:01.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.062899+0000", 2024-09-14T06:01:01.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9114000000000001e-05 2024-09-14T06:01:01.285 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.285 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.285 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.285 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:106810 3.9 e93/24 3:96c4c4a7:::rbd_data.1127189bfb31.000000000000000a:head v 93'306, mlcod=92'302)", 2024-09-14T06:01:01.285 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:01.285 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.1510517, 2024-09-14T06:01:01.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0060457269999999999, 2024-09-14T06:01:01.286 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.286 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.286 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.286 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:01.286 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056995+0000", 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8199999999999999e-07 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057001+0000", 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2060000000000004e-06 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.287 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057011+0000", 2024-09-14T06:01:01.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8369999999999992e-06 2024-09-14T06:01:01.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.288 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.288 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057018+0000", 2024-09-14T06:01:01.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9e-06 2024-09-14T06:01:01.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.288 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.288 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.059980+0000", 2024-09-14T06:01:01.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029624500000000002 2024-09-14T06:01:01.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.288 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.060002+0000", 2024-09-14T06:01:01.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2299000000000001e-05 2024-09-14T06:01:01.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.063000+0000", 2024-09-14T06:01:01.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029974170000000001 2024-09-14T06:01:01.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.063040+0000", 2024-09-14T06:01:01.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9836000000000003e-05 2024-09-14T06:01:01.289 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.289 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:114889 3.0 e93/24 3:072a82e8:::rbd_data.1127cb09e343.0000000000000009:head v 93'915, mlcod=92'913)", 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.462828+0000", 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.745217587999999, 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041683099999999997, 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.462828+0000", 2024-09-14T06:01:01.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.462828+0000", 2024-09-14T06:01:01.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.462830+0000", 2024-09-14T06:01:01.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0930000000000001e-06 2024-09-14T06:01:01.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.292 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.292 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463643+0000", 2024-09-14T06:01:01.292 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00081271700000000002 2024-09-14T06:01:01.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.292 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.292 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463677+0000", 2024-09-14T06:01:01.292 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4329000000000003e-05 2024-09-14T06:01:01.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.292 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.292 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463693+0000", 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5713e-05 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463858+0000", 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000164749 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463928+0000", 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0646000000000001e-05 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.293 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.466860+0000", 2024-09-14T06:01:01.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029313970000000001 2024-09-14T06:01:01.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.466996+0000", 2024-09-14T06:01:01.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000136666 2024-09-14T06:01:01.294 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.294 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.294 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.294 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:119911 3.0 e99/24 3:067b0149:::rbd_data.1127206dd91f.0000000000000002:head v 99'930, mlcod=97'928)", 2024-09-14T06:01:01.294 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 18.385305876, 2024-09-14T06:01:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049905519999999997, 2024-09-14T06:01:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:01.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:01.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.296 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:01.296 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822741+0000", 2024-09-14T06:01:01.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.054e-06 2024-09-14T06:01:01.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.296 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:01.296 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824085+0000", 2024-09-14T06:01:01.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001343693 2024-09-14T06:01:01.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.297 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:01.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824114+0000", 2024-09-14T06:01:01.297 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9013000000000002e-05 2024-09-14T06:01:01.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.297 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:01.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824127+0000", 2024-09-14T06:01:01.297 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3869000000000001e-05 2024-09-14T06:01:01.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:01.298 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824222+0000", 2024-09-14T06:01:01.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4616000000000003e-05 2024-09-14T06:01:01.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:01.298 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824247+0000", 2024-09-14T06:01:01.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5205999999999999e-05 2024-09-14T06:01:01.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.298 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.298 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:01.298 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.827664+0000", 2024-09-14T06:01:01.298 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0034165530000000001 2024-09-14T06:01:01.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:01.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:01.299 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:01.299 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.827730+0000", 2024-09-14T06:01:01.299 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6548e-05 2024-09-14T06:01:01.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.299 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.299 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:01.299 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:01.299 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:01.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:01:01.304 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:01.301+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:01.338 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:01:01.401 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:01.397+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:01.502 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:01.497+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:01.512 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:01.512 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:01.512 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:01:01.512 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:01.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:01:01.539 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:01.539 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:01.563 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:01.587 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:01.588 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:01.603 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:01.601+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:01.612 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:01.612 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:01.642 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:01.642 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:01.665 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:01.676 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:01.677 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:01.689 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:01.690 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:01.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:01:01.714 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:01.715 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:01.715 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:01.712+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:01.804 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:01.800+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:01.847 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:01.847 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:01.864 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:01:01.906 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:01.904+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:02.005 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:02.000+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:02.009 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:02.009 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:02.025 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:01:02.107 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:02.104+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:02.171 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:02.171 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:02.189 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:01:02.238 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:02.237+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:02.309 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:02.304+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:02.322 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:02.322 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:02.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T06:01:02.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:01:02.426 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:02.425+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:02.510 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:02.504+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:02.530 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:02.530 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:02.547 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:01:02.610 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:02.608+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:02.707 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:02.708 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:02.711 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:02.708+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:02.722 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:01:02.812 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:02.809+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:02.841 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:02.841 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:02.856 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:01:02.913 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:02.908+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:03.014 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:03.008+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:03.030 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:03.030 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:03.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:01:03.115 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:03.112+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:03.168 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:03.169 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:03.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:01:03.230 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:03.229+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:03.304 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:03.304 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:03.316 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:03.312+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:03.319 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:01:03.326 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2024-09-14T06:01:03.417 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:03.413+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:03.479 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:03.479 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:03.494 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:01:03.518 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:03.512+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:03.618 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:03.617+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:03.660 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:03.660 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:03.674 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:01:03.719 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:03.716+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:03.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:01:03.820 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:03.817+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:03.841 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:03.841 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:03.855 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:01:03.910 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:03.910 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:03.921 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:03.917+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:03.928 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:03.928 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:03.944 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:03.945 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:03.962 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:03.962 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:03.983 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:03.983 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:03.985 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:03.985 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:03.985 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:01:03.985 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:04.000 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:01:04.004 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:04.021 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:04.016+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:04.025 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:04.025 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:04.048 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:04.048 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:04.122 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:04.116+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:04.134 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:04.134 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:04.134 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:04.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:01:04.222 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:04.221+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:04.322 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-14T06:01:04.322 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T06:01:04.322 INFO:tasks.thrashosds.thrasher:Adding osd 7 2024-09-14T06:01:04.323 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 7 2024-09-14T06:01:04.324 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:04.321+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:04.329 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:04.329 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:04.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:04.329 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:04.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.329 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119850 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 3571712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.330 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:04.330 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.576527180999999, 2024-09-14T06:01:04.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050424731, 2024-09-14T06:01:04.330 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.330 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.330 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.330 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.330 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.330 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.330 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119850 2024-09-14T06:01:04.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.330 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6100000000000001e-07 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751247+0000", 2024-09-14T06:01:04.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5059999999999998e-06 2024-09-14T06:01:04.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751255+0000", 2024-09-14T06:01:04.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3080000000000008e-06 2024-09-14T06:01:04.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751262+0000", 2024-09-14T06:01:04.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1060000000000002e-06 2024-09-14T06:01:04.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801559+0000", 2024-09-14T06:01:04.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050297043 2024-09-14T06:01:04.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801614+0000", 2024-09-14T06:01:04.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5028999999999998e-05 2024-09-14T06:01:04.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.334 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.334 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801668+0000", 2024-09-14T06:01:04.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4178000000000002e-05 2024-09-14T06:01:04.334 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.334 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.334 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.335 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119851 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 3620864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.335 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:01:04.335 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.576498524000002, 2024-09-14T06:01:04.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050528479000000001, 2024-09-14T06:01:04.335 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.335 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.335 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.336 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.336 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.336 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.336 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119851 2024-09-14T06:01:04.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.336 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:01:04.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:01:04.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752502+0000", 2024-09-14T06:01:04.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012294529999999999 2024-09-14T06:01:04.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752508+0000", 2024-09-14T06:01:04.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8780000000000003e-06 2024-09-14T06:01:04.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752522+0000", 2024-09-14T06:01:04.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4405e-05 2024-09-14T06:01:04.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.340 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.340 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752532+0000", 2024-09-14T06:01:04.340 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6739999999999992e-06 2024-09-14T06:01:04.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.340 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801702+0000", 2024-09-14T06:01:04.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049169996000000001 2024-09-14T06:01:04.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801744+0000", 2024-09-14T06:01:04.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2789e-05 2024-09-14T06:01:04.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801801+0000", 2024-09-14T06:01:04.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6283999999999998e-05 2024-09-14T06:01:04.342 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.342 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.342 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.343 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119877 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4898816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.343 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:04.343 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.57176909, 2024-09-14T06:01:04.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050416282999999999, 2024-09-14T06:01:04.343 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.343 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.343 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.344 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.344 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.344 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119877 2024-09-14T06:01:04.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.344 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:04.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:04.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:04.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6300000000000005e-07 2024-09-14T06:01:04.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756005+0000", 2024-09-14T06:01:04.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7350000000000001e-06 2024-09-14T06:01:04.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756012+0000", 2024-09-14T06:01:04.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8990000000000004e-06 2024-09-14T06:01:04.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756017+0000", 2024-09-14T06:01:04.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.023e-06 2024-09-14T06:01:04.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.348 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806256+0000", 2024-09-14T06:01:04.349 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050239355999999999 2024-09-14T06:01:04.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.349 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.349 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806331+0000", 2024-09-14T06:01:04.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4800000000000002e-05 2024-09-14T06:01:04.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806418+0000", 2024-09-14T06:01:04.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6907e-05 2024-09-14T06:01:04.350 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.350 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.350 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.351 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119878 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4947968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.351 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:01:04.351 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.571744244000001, 2024-09-14T06:01:04.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050582539000000003, 2024-09-14T06:01:04.351 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.352 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.352 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.352 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.352 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.352 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.352 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119878 2024-09-14T06:01:04.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.352 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.353 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:01:04.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.353 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:01:04.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.353 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756027+0000", 2024-09-14T06:01:04.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1399999999999997e-07 2024-09-14T06:01:04.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756029+0000", 2024-09-14T06:01:04.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3420000000000002e-06 2024-09-14T06:01:04.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756036+0000", 2024-09-14T06:01:04.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9550000000000003e-06 2024-09-14T06:01:04.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756041+0000", 2024-09-14T06:01:04.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2669999999999997e-06 2024-09-14T06:01:04.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806448+0000", 2024-09-14T06:01:04.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050407037000000002 2024-09-14T06:01:04.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806526+0000", 2024-09-14T06:01:04.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7119000000000005e-05 2024-09-14T06:01:04.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806609+0000", 2024-09-14T06:01:04.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3405000000000005e-05 2024-09-14T06:01:04.356 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.357 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.357 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119879 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4997120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.357 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:04.357 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.571721763999999, 2024-09-14T06:01:04.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.05075727, 2024-09-14T06:01:04.357 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.357 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.358 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.358 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.358 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.358 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.358 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119879 2024-09-14T06:01:04.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.358 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:04.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:04.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:04.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9400000000000001e-07 2024-09-14T06:01:04.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756058+0000", 2024-09-14T06:01:04.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5199999999999997e-06 2024-09-14T06:01:04.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756065+0000", 2024-09-14T06:01:04.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9800000000000001e-06 2024-09-14T06:01:04.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756070+0000", 2024-09-14T06:01:04.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2360000000000004e-06 2024-09-14T06:01:04.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806639+0000", 2024-09-14T06:01:04.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050568702 2024-09-14T06:01:04.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806714+0000", 2024-09-14T06:01:04.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4825000000000003e-05 2024-09-14T06:01:04.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806806+0000", 2024-09-14T06:01:04.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2613000000000003e-05 2024-09-14T06:01:04.362 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.363 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.363 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.363 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119880 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5046272~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.363 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:04.363 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.571667065, 2024-09-14T06:01:04.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050918568999999997, 2024-09-14T06:01:04.363 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.363 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.363 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.363 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.364 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.364 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.364 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119880 2024-09-14T06:01:04.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.364 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:04.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:04.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:04.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:01:04.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756107+0000", 2024-09-14T06:01:04.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8159999999999998e-06 2024-09-14T06:01:04.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756116+0000", 2024-09-14T06:01:04.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4980000000000006e-06 2024-09-14T06:01:04.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756122+0000", 2024-09-14T06:01:04.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8809999999999998e-06 2024-09-14T06:01:04.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806841+0000", 2024-09-14T06:01:04.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050718907000000001 2024-09-14T06:01:04.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806927+0000", 2024-09-14T06:01:04.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5908999999999994e-05 2024-09-14T06:01:04.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807022+0000", 2024-09-14T06:01:04.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4901000000000005e-05 2024-09-14T06:01:04.368 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.368 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.368 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.368 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119881 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5095424~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.368 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:01:04.369 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.571636441999999, 2024-09-14T06:01:04.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051097946999999998, 2024-09-14T06:01:04.369 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.369 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.369 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.369 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.369 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.369 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.369 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119881 2024-09-14T06:01:04.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.370 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:01:04.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:01:04.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756135+0000", 2024-09-14T06:01:04.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.51e-07 2024-09-14T06:01:04.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756137+0000", 2024-09-14T06:01:04.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2230000000000001e-06 2024-09-14T06:01:04.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756145+0000", 2024-09-14T06:01:04.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6629999999999993e-06 2024-09-14T06:01:04.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756150+0000", 2024-09-14T06:01:04.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9150000000000004e-06 2024-09-14T06:01:04.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807054+0000", 2024-09-14T06:01:04.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050904855999999998 2024-09-14T06:01:04.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807137+0000", 2024-09-14T06:01:04.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2248000000000003e-05 2024-09-14T06:01:04.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807232+0000", 2024-09-14T06:01:04.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5490999999999998e-05 2024-09-14T06:01:04.374 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.374 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.374 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.374 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119882 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5144576~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.375 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:01:04.375 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.571612565999999, 2024-09-14T06:01:04.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051297745999999998, 2024-09-14T06:01:04.375 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.375 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.375 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.375 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.375 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.375 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.376 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119882 2024-09-14T06:01:04.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.376 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:01:04.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:01:04.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756159+0000", 2024-09-14T06:01:04.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4299999999999998e-07 2024-09-14T06:01:04.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756161+0000", 2024-09-14T06:01:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4959999999999999e-06 2024-09-14T06:01:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756170+0000", 2024-09-14T06:01:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1779999999999992e-06 2024-09-14T06:01:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756176+0000", 2024-09-14T06:01:04.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0090000000000004e-06 2024-09-14T06:01:04.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807264+0000", 2024-09-14T06:01:04.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051087948000000001 2024-09-14T06:01:04.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807353+0000", 2024-09-14T06:01:04.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8919999999999996e-05 2024-09-14T06:01:04.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807456+0000", 2024-09-14T06:01:04.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010275199999999999 2024-09-14T06:01:04.380 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.380 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.380 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.380 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119883 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5193728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.381 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:04.381 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.571585713000001, 2024-09-14T06:01:04.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051484553000000002, 2024-09-14T06:01:04.381 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.381 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.381 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.381 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.381 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.381 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.381 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119883 2024-09-14T06:01:04.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.382 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:04.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:04.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:04.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8699999999999995e-07 2024-09-14T06:01:04.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756188+0000", 2024-09-14T06:01:04.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4820000000000001e-06 2024-09-14T06:01:04.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756195+0000", 2024-09-14T06:01:04.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.545e-06 2024-09-14T06:01:04.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756200+0000", 2024-09-14T06:01:04.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.045e-06 2024-09-14T06:01:04.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807487+0000", 2024-09-14T06:01:04.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051287228999999997 2024-09-14T06:01:04.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807572+0000", 2024-09-14T06:01:04.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5303999999999995e-05 2024-09-14T06:01:04.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807670+0000", 2024-09-14T06:01:04.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7460999999999994e-05 2024-09-14T06:01:04.385 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.386 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.386 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.386 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119884 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5242880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.386 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:01:04.386 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.571545224000001, 2024-09-14T06:01:04.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051672403999999998, 2024-09-14T06:01:04.386 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.386 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.386 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.386 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.387 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.387 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.387 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119884 2024-09-14T06:01:04.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.387 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:01:04.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:01:04.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756226+0000", 2024-09-14T06:01:04.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7899999999999998e-07 2024-09-14T06:01:04.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756229+0000", 2024-09-14T06:01:04.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9919999999999999e-06 2024-09-14T06:01:04.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756237+0000", 2024-09-14T06:01:04.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1280000000000008e-06 2024-09-14T06:01:04.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756244+0000", 2024-09-14T06:01:04.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7519999999999999e-06 2024-09-14T06:01:04.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807726+0000", 2024-09-14T06:01:04.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051482344999999999 2024-09-14T06:01:04.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807808+0000", 2024-09-14T06:01:04.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1845e-05 2024-09-14T06:01:04.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807898+0000", 2024-09-14T06:01:04.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9662999999999999e-05 2024-09-14T06:01:04.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.391 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.392 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119885 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5292032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.392 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:01:04.392 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.571516818999999, 2024-09-14T06:01:04.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051858125999999997, 2024-09-14T06:01:04.392 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.392 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.392 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119885 2024-09-14T06:01:04.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.393 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:01:04.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:01:04.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759822+0000", 2024-09-14T06:01:04.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035676610000000002 2024-09-14T06:01:04.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759831+0000", 2024-09-14T06:01:04.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2329999999999995e-06 2024-09-14T06:01:04.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759842+0000", 2024-09-14T06:01:04.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0954999999999999e-05 2024-09-14T06:01:04.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759851+0000", 2024-09-14T06:01:04.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1770000000000004e-06 2024-09-14T06:01:04.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807942+0000", 2024-09-14T06:01:04.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048091438 2024-09-14T06:01:04.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.808027+0000", 2024-09-14T06:01:04.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4227999999999994e-05 2024-09-14T06:01:04.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.808112+0000", 2024-09-14T06:01:04.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5433999999999996e-05 2024-09-14T06:01:04.397 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.397 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.397 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.397 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119897 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5881856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.397 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:01:04.397 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.567712312000001, 2024-09-14T06:01:04.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050603113999999998, 2024-09-14T06:01:04.397 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.397 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.397 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.398 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.398 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.398 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.398 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119897 2024-09-14T06:01:04.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.398 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:01:04.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:01:04.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760059+0000", 2024-09-14T06:01:04.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0800000000000001e-07 2024-09-14T06:01:04.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760060+0000", 2024-09-14T06:01:04.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4050000000000001e-06 2024-09-14T06:01:04.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760063+0000", 2024-09-14T06:01:04.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2320000000000001e-06 2024-09-14T06:01:04.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760066+0000", 2024-09-14T06:01:04.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.74e-06 2024-09-14T06:01:04.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810454+0000", 2024-09-14T06:01:04.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050388355000000003 2024-09-14T06:01:04.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810550+0000", 2024-09-14T06:01:04.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5441999999999999e-05 2024-09-14T06:01:04.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810662+0000", 2024-09-14T06:01:04.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011173199999999999 2024-09-14T06:01:04.402 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.402 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.402 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.402 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119898 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5931008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.402 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:04.402 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.567700973000001, 2024-09-14T06:01:04.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050800631999999998, 2024-09-14T06:01:04.402 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.402 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.402 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.402 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.403 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.403 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.403 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119898 2024-09-14T06:01:04.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.403 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:04.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:04.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:04.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0900000000000001e-07 2024-09-14T06:01:04.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760071+0000", 2024-09-14T06:01:04.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0899999999999999e-06 2024-09-14T06:01:04.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760074+0000", 2024-09-14T06:01:04.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1470000000000001e-06 2024-09-14T06:01:04.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760077+0000", 2024-09-14T06:01:04.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0170000000000001e-06 2024-09-14T06:01:04.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810704+0000", 2024-09-14T06:01:04.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050626811000000001 2024-09-14T06:01:04.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810779+0000", 2024-09-14T06:01:04.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4762e-05 2024-09-14T06:01:04.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810870+0000", 2024-09-14T06:01:04.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1595999999999995e-05 2024-09-14T06:01:04.407 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.407 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.407 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.408 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119899 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5980160~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.408 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:04.408 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.567689958999999, 2024-09-14T06:01:04.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051034903, 2024-09-14T06:01:04.408 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.408 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.408 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.408 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.408 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.409 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.409 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119899 2024-09-14T06:01:04.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.409 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:04.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:04.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:04.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.34e-07 2024-09-14T06:01:04.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760082+0000", 2024-09-14T06:01:04.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4190000000000001e-06 2024-09-14T06:01:04.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760086+0000", 2024-09-14T06:01:04.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2629999999999999e-06 2024-09-14T06:01:04.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760088+0000", 2024-09-14T06:01:04.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5150000000000001e-06 2024-09-14T06:01:04.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810919+0000", 2024-09-14T06:01:04.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050831111999999998 2024-09-14T06:01:04.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811011+0000", 2024-09-14T06:01:04.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1339000000000001e-05 2024-09-14T06:01:04.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811116+0000", 2024-09-14T06:01:04.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105021 2024-09-14T06:01:04.414 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.414 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.414 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.415 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119900 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6029312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.415 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:04.415 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.567679053999999, 2024-09-14T06:01:04.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051299599000000001, 2024-09-14T06:01:04.415 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.415 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.415 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.415 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.415 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.416 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.416 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119900 2024-09-14T06:01:04.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.416 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:04.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:04.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:04.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5699999999999999e-07 2024-09-14T06:01:04.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760093+0000", 2024-09-14T06:01:04.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1689999999999999e-06 2024-09-14T06:01:04.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760096+0000", 2024-09-14T06:01:04.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.315e-06 2024-09-14T06:01:04.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760101+0000", 2024-09-14T06:01:04.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T06:01:04.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811162+0000", 2024-09-14T06:01:04.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051061341000000003 2024-09-14T06:01:04.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811271+0000", 2024-09-14T06:01:04.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010851799999999999 2024-09-14T06:01:04.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811391+0000", 2024-09-14T06:01:04.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000120307 2024-09-14T06:01:04.420 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.420 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.420 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.420 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119901 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6078464~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.420 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:01:04.421 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.567637533999999, 2024-09-14T06:01:04.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051519772999999998, 2024-09-14T06:01:04.421 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.421 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.421 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.421 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.421 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.421 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.421 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119901 2024-09-14T06:01:04.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.421 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:01:04.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:01:04.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760134+0000", 2024-09-14T06:01:04.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.92e-07 2024-09-14T06:01:04.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760138+0000", 2024-09-14T06:01:04.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3869999999999997e-06 2024-09-14T06:01:04.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760145+0000", 2024-09-14T06:01:04.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.878e-06 2024-09-14T06:01:04.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760151+0000", 2024-09-14T06:01:04.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4399999999999996e-06 2024-09-14T06:01:04.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811452+0000", 2024-09-14T06:01:04.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051301872999999998 2024-09-14T06:01:04.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811545+0000", 2024-09-14T06:01:04.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2472000000000005e-05 2024-09-14T06:01:04.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811653+0000", 2024-09-14T06:01:04.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108031 2024-09-14T06:01:04.425 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.425 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.425 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.425 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119902 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.426 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:04.426 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.567610149, 2024-09-14T06:01:04.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051737544000000003, 2024-09-14T06:01:04.426 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.426 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.426 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.426 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.426 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.426 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.426 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119902 2024-09-14T06:01:04.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.426 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:04.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:04.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:04.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0600000000000001e-07 2024-09-14T06:01:04.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760163+0000", 2024-09-14T06:01:04.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2850000000000001e-06 2024-09-14T06:01:04.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760170+0000", 2024-09-14T06:01:04.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6030000000000001e-06 2024-09-14T06:01:04.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760176+0000", 2024-09-14T06:01:04.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6540000000000004e-06 2024-09-14T06:01:04.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811704+0000", 2024-09-14T06:01:04.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051528303999999997 2024-09-14T06:01:04.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811794+0000", 2024-09-14T06:01:04.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0142000000000005e-05 2024-09-14T06:01:04.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811898+0000", 2024-09-14T06:01:04.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010415 2024-09-14T06:01:04.430 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.430 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.430 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.431 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119903 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6176768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.431 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:01:04.431 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.567580486000001, 2024-09-14T06:01:04.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051958747999999999, 2024-09-14T06:01:04.431 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.431 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.431 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.431 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.432 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.432 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.432 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119903 2024-09-14T06:01:04.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.432 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:01:04.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:01:04.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760191+0000", 2024-09-14T06:01:04.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6400000000000002e-07 2024-09-14T06:01:04.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760194+0000", 2024-09-14T06:01:04.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7920000000000001e-06 2024-09-14T06:01:04.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760203+0000", 2024-09-14T06:01:04.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0669999999999998e-06 2024-09-14T06:01:04.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760208+0000", 2024-09-14T06:01:04.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5929999999999996e-06 2024-09-14T06:01:04.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811955+0000", 2024-09-14T06:01:04.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051746357 2024-09-14T06:01:04.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.435 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.435 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812046+0000", 2024-09-14T06:01:04.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1824999999999996e-05 2024-09-14T06:01:04.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812149+0000", 2024-09-14T06:01:04.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010255 2024-09-14T06:01:04.436 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.436 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.436 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.436 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119904 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6225920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.436 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:01:04.437 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.567553299, 2024-09-14T06:01:04.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052164159000000002, 2024-09-14T06:01:04.437 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.437 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.437 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.437 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.437 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.437 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.437 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119904 2024-09-14T06:01:04.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.438 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:01:04.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:01:04.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760218+0000", 2024-09-14T06:01:04.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2899999999999999e-07 2024-09-14T06:01:04.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.440 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760220+0000", 2024-09-14T06:01:04.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2879999999999999e-06 2024-09-14T06:01:04.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.440 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.440 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760226+0000", 2024-09-14T06:01:04.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1870000000000002e-06 2024-09-14T06:01:04.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.440 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.440 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760231+0000", 2024-09-14T06:01:04.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0950000000000003e-06 2024-09-14T06:01:04.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812192+0000", 2024-09-14T06:01:04.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051960587000000003 2024-09-14T06:01:04.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812281+0000", 2024-09-14T06:01:04.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9225e-05 2024-09-14T06:01:04.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812382+0000", 2024-09-14T06:01:04.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000100348 2024-09-14T06:01:04.442 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.442 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.442 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.442 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119905 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6275072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:04.443 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:01:04.443 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 21.567531259999999, 2024-09-14T06:01:04.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052394334000000001, 2024-09-14T06:01:04.443 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.443 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.443 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.443 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.443 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.443 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.443 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119905 2024-09-14T06:01:04.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.444 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:01:04.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.444 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.444 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:01:04.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760240+0000", 2024-09-14T06:01:04.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:01:04.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760242+0000", 2024-09-14T06:01:04.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0959999999999999e-06 2024-09-14T06:01:04.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.446 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.446 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760249+0000", 2024-09-14T06:01:04.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7399999999999998e-06 2024-09-14T06:01:04.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.446 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760254+0000", 2024-09-14T06:01:04.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9089999999999999e-06 2024-09-14T06:01:04.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812419+0000", 2024-09-14T06:01:04.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052165481 2024-09-14T06:01:04.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812510+0000", 2024-09-14T06:01:04.448 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0525000000000005e-05 2024-09-14T06:01:04.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812634+0000", 2024-09-14T06:01:04.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012412600000000001 2024-09-14T06:01:04.449 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.449 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.449 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.450 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.450 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.450 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:04.452 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:04.448+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:04.453 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:01:04.553 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:04.548+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:04.612 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:04.613 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:04.613 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:01:04.613 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:04.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:01:04.655 INFO:tasks.ceph.mon.a.smithi006.stderr:2024-09-14T06:01:04.652+0000 7fea0eeb4640 -1 mon.a@0(leader).osd e121 definitely_dead 0 2024-09-14T06:01:04.655 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:04.652+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:04.755 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:04.752+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:04.774 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:04.775 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:04.775 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:04.775 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:04.775 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:04.789 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:01:04.856 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:04.853+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:04.957 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:04.953+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:04.960 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:04.960 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:04.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:04.961 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:04.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.961 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114684 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 999424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:04.961 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:04.961 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.861067446, 2024-09-14T06:01:04.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051769745999999998, 2024-09-14T06:01:04.961 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.961 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.961 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.961 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.962 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.962 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.962 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114684 2024-09-14T06:01:04.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.962 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:04.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.962 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:04.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:04.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3099999999999998e-07 2024-09-14T06:01:04.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097324+0000", 2024-09-14T06:01:04.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5019999999999999e-06 2024-09-14T06:01:04.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097333+0000", 2024-09-14T06:01:04.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6659999999999997e-06 2024-09-14T06:01:04.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097338+0000", 2024-09-14T06:01:04.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6049999999999997e-06 2024-09-14T06:01:04.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.148711+0000", 2024-09-14T06:01:04.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051372831000000001 2024-09-14T06:01:04.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.148787+0000", 2024-09-14T06:01:04.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6205999999999995e-05 2024-09-14T06:01:04.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149091+0000", 2024-09-14T06:01:04.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030350499999999997 2024-09-14T06:01:04.965 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.965 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.966 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.966 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114685 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1105920~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:04.966 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:04.966 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.861042696999998, 2024-09-14T06:01:04.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052125193, 2024-09-14T06:01:04.966 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.966 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.966 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.966 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.966 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.966 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.967 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114685 2024-09-14T06:01:04.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.967 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:04.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:04.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2800000000000002e-07 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097349+0000", 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4310000000000001e-06 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097357+0000", 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3799999999999994e-06 2024-09-14T06:01:04.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097362+0000", 2024-09-14T06:01:04.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.933e-06 2024-09-14T06:01:04.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149147+0000", 2024-09-14T06:01:04.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051784754000000002 2024-09-14T06:01:04.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149204+0000", 2024-09-14T06:01:04.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7794000000000003e-05 2024-09-14T06:01:04.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149471+0000", 2024-09-14T06:01:04.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026647299999999998 2024-09-14T06:01:04.970 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.970 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.970 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.970 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114686 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1212416~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:04.970 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:04.970 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.861018431000002, 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052428210000000003, 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114686 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:04.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:04.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4000000000000002e-07 2024-09-14T06:01:04.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097373+0000", 2024-09-14T06:01:04.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1160000000000002e-06 2024-09-14T06:01:04.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097380+0000", 2024-09-14T06:01:04.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8199999999999997e-06 2024-09-14T06:01:04.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097385+0000", 2024-09-14T06:01:04.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7609999999999998e-06 2024-09-14T06:01:04.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149501+0000", 2024-09-14T06:01:04.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052115941999999998 2024-09-14T06:01:04.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149559+0000", 2024-09-14T06:01:04.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8313999999999998e-05 2024-09-14T06:01:04.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149798+0000", 2024-09-14T06:01:04.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000238817 2024-09-14T06:01:04.974 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.974 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114687 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1318912~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.860996261, 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052786364000000002, 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114687 2024-09-14T06:01:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:01:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:01:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097393+0000", 2024-09-14T06:01:04.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6499999999999999e-07 2024-09-14T06:01:04.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097395+0000", 2024-09-14T06:01:04.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2129999999999998e-06 2024-09-14T06:01:04.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097403+0000", 2024-09-14T06:01:04.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2360000000000004e-06 2024-09-14T06:01:04.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097408+0000", 2024-09-14T06:01:04.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2460000000000003e-06 2024-09-14T06:01:04.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149848+0000", 2024-09-14T06:01:04.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052439965999999998 2024-09-14T06:01:04.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149919+0000", 2024-09-14T06:01:04.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1148000000000004e-05 2024-09-14T06:01:04.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.979 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.979 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150179+0000", 2024-09-14T06:01:04.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025909000000000001 2024-09-14T06:01:04.979 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.979 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.979 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.979 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114688 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1425408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:04.979 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:04.979 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.860971722999999, 2024-09-14T06:01:04.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053185383000000003, 2024-09-14T06:01:04.980 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.980 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.980 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.980 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.980 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.980 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.980 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114688 2024-09-14T06:01:04.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.980 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.980 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.980 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.980 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:04.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:04.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:04.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2199999999999999e-07 2024-09-14T06:01:04.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097419+0000", 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1670000000000002e-06 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097427+0000", 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7819999999999994e-06 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097432+0000", 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150228+0000", 2024-09-14T06:01:04.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052796434000000003 2024-09-14T06:01:04.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150308+0000", 2024-09-14T06:01:04.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9221999999999995e-05 2024-09-14T06:01:04.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150602+0000", 2024-09-14T06:01:04.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000294493 2024-09-14T06:01:04.984 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.984 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.984 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.984 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.984 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114689 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1531904~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:04.984 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:04.984 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.860949386000001, 2024-09-14T06:01:04.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053528527999999999, 2024-09-14T06:01:04.984 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.984 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.984 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.984 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.985 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.985 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.985 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114689 2024-09-14T06:01:04.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.985 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:04.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:04.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:04.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1699999999999999e-07 2024-09-14T06:01:04.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097446+0000", 2024-09-14T06:01:04.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1090000000000003e-06 2024-09-14T06:01:04.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097454+0000", 2024-09-14T06:01:04.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3860000000000007e-06 2024-09-14T06:01:04.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097458+0000", 2024-09-14T06:01:04.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1919999999999998e-06 2024-09-14T06:01:04.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150648+0000", 2024-09-14T06:01:04.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053190075000000003 2024-09-14T06:01:04.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.988 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.988 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.988 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150705+0000", 2024-09-14T06:01:04.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6484000000000003e-05 2024-09-14T06:01:04.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.988 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.988 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.988 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150968+0000", 2024-09-14T06:01:04.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026286499999999998 2024-09-14T06:01:04.988 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.988 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.988 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.989 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114690 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1638400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:04.989 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:04.989 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.860923895999999, 2024-09-14T06:01:04.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053963677000000002, 2024-09-14T06:01:04.989 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.989 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.989 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.989 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.989 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.989 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.989 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114690 2024-09-14T06:01:04.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.990 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:04.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:04.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0400000000000002e-07 2024-09-14T06:01:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097466+0000", 2024-09-14T06:01:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4389999999999999e-06 2024-09-14T06:01:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097470+0000", 2024-09-14T06:01:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6540000000000001e-06 2024-09-14T06:01:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097474+0000", 2024-09-14T06:01:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.301e-06 2024-09-14T06:01:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151069+0000", 2024-09-14T06:01:04.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053594827999999997 2024-09-14T06:01:04.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151156+0000", 2024-09-14T06:01:04.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6445000000000003e-05 2024-09-14T06:01:04.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151428+0000", 2024-09-14T06:01:04.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000272706 2024-09-14T06:01:04.994 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.994 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.995 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.995 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114806 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:04.995 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:01:04.995 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.856962619000001, 2024-09-14T06:01:04.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051625628, 2024-09-14T06:01:04.995 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:04.995 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:04.995 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:04.995 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:04.995 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:04.995 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114806 2024-09-14T06:01:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:01:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:01:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:04.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101427+0000", 2024-09-14T06:01:04.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5600000000000004e-07 2024-09-14T06:01:04.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:04.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101431+0000", 2024-09-14T06:01:04.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5920000000000002e-06 2024-09-14T06:01:04.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:04.997 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101462+0000", 2024-09-14T06:01:04.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0607e-05 2024-09-14T06:01:04.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:04.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101470+0000", 2024-09-14T06:01:04.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6249999999999998e-06 2024-09-14T06:01:04.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:04.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.152670+0000", 2024-09-14T06:01:04.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051199972000000003 2024-09-14T06:01:04.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:04.999 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.152763+0000", 2024-09-14T06:01:04.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3274000000000002e-05 2024-09-14T06:01:04.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.999 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.999 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:04.999 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153051+0000", 2024-09-14T06:01:04.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000288602 2024-09-14T06:01:04.999 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.999 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:04.999 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:04.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:04.999 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:04.999 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114807 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 442368~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:05.000 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:01:05.000 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.856890293999999, 2024-09-14T06:01:05.000 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051947018999999997, 2024-09-14T06:01:05.000 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.000 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.000 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:05.000 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:05.000 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:05.000 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:05.000 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114807 2024-09-14T06:01:05.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.000 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.000 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:01:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:01:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101499+0000", 2024-09-14T06:01:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.23e-07 2024-09-14T06:01:05.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.002 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.002 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101505+0000", 2024-09-14T06:01:05.002 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2570000000000004e-06 2024-09-14T06:01:05.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.002 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.002 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101518+0000", 2024-09-14T06:01:05.002 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3327e-05 2024-09-14T06:01:05.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.002 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.002 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101525+0000", 2024-09-14T06:01:05.003 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7410000000000003e-06 2024-09-14T06:01:05.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.003 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153108+0000", 2024-09-14T06:01:05.003 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051582688000000002 2024-09-14T06:01:05.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.003 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153209+0000", 2024-09-14T06:01:05.003 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000101092 2024-09-14T06:01:05.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153445+0000", 2024-09-14T06:01:05.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023619099999999999 2024-09-14T06:01:05.004 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.004 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.004 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.004 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114808 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 548864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:05.004 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:05.004 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.85685187, 2024-09-14T06:01:05.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052334951999999997, 2024-09-14T06:01:05.004 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.004 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.005 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:05.005 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:05.005 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:05.005 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:05.005 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114808 2024-09-14T06:01:05.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.005 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.005 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.005 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.005 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:05.005 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.005 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.005 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.006 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:05.006 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.006 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.006 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:05.006 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1600000000000001e-07 2024-09-14T06:01:05.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.006 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.006 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101540+0000", 2024-09-14T06:01:05.006 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.942e-06 2024-09-14T06:01:05.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101547+0000", 2024-09-14T06:01:05.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9460000000000001e-06 2024-09-14T06:01:05.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101552+0000", 2024-09-14T06:01:05.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2320000000000001e-06 2024-09-14T06:01:05.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153494+0000", 2024-09-14T06:01:05.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051942200000000001 2024-09-14T06:01:05.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153600+0000", 2024-09-14T06:01:05.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105886 2024-09-14T06:01:05.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153872+0000", 2024-09-14T06:01:05.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027123000000000002 2024-09-14T06:01:05.008 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.008 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.008 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.009 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.009 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114809 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 655360~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:05.009 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:01:05.009 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.856584446999999, 2024-09-14T06:01:05.009 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052491571000000001, 2024-09-14T06:01:05.009 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.009 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.009 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:05.009 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:05.009 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:05.009 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:05.009 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114809 2024-09-14T06:01:05.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.010 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.010 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.010 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:01:05.010 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.010 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.010 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:01:05.010 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.010 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.011 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101805+0000", 2024-09-14T06:01:05.011 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.094e-06 2024-09-14T06:01:05.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.011 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.011 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.011 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101810+0000", 2024-09-14T06:01:05.011 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3430000000000003e-06 2024-09-14T06:01:05.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.011 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.011 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.011 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101824+0000", 2024-09-14T06:01:05.011 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3081999999999999e-05 2024-09-14T06:01:05.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.011 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101832+0000", 2024-09-14T06:01:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6950000000000006e-06 2024-09-14T06:01:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153908+0000", 2024-09-14T06:01:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052075444999999998 2024-09-14T06:01:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153992+0000", 2024-09-14T06:01:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4829999999999999e-05 2024-09-14T06:01:05.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.013 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.013 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154296+0000", 2024-09-14T06:01:05.013 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030308199999999998 2024-09-14T06:01:05.013 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.013 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.013 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.013 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114810 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 761856~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:05.013 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:01:05.013 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.856538457999999, 2024-09-14T06:01:05.014 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052650012000000003, 2024-09-14T06:01:05.014 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.014 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.014 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:05.014 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:05.014 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:05.014 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:05.014 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114810 2024-09-14T06:01:05.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.014 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.014 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.014 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.014 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101851+0000", 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.75e-07 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.015 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101854+0000", 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0620000000000001e-06 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101863+0000", 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5719999999999992e-06 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101869+0000", 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4229999999999996e-06 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154350+0000", 2024-09-14T06:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052480991999999997 2024-09-14T06:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154429+0000", 2024-09-14T06:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9482999999999998e-05 2024-09-14T06:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154500+0000", 2024-09-14T06:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0905e-05 2024-09-14T06:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.017 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.018 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.018 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114811 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 868352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:05.018 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:01:05.018 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.856509965000001, 2024-09-14T06:01:05.018 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053080507999999998, 2024-09-14T06:01:05.018 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.018 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:05.018 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:05.018 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:05.018 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:05.019 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114811 2024-09-14T06:01:05.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.019 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.019 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.019 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:01:05.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.019 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.019 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:01:05.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101879+0000", 2024-09-14T06:01:05.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0399999999999996e-07 2024-09-14T06:01:05.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101882+0000", 2024-09-14T06:01:05.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6919999999999998e-06 2024-09-14T06:01:05.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.020 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.020 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101889+0000", 2024-09-14T06:01:05.020 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.058e-06 2024-09-14T06:01:05.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101894+0000", 2024-09-14T06:01:05.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1669999999999998e-06 2024-09-14T06:01:05.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.021 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154552+0000", 2024-09-14T06:01:05.021 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052658358000000002 2024-09-14T06:01:05.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.021 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.022 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154649+0000", 2024-09-14T06:01:05.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6708999999999999e-05 2024-09-14T06:01:05.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.022 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.022 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154959+0000", 2024-09-14T06:01:05.022 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00031001999999999999 2024-09-14T06:01:05.022 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.022 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.022 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.022 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.022 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114812 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 974848~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:05.022 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:05.023 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.856487507000001, 2024-09-14T06:01:05.023 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053474381000000001, 2024-09-14T06:01:05.023 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.023 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.023 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:05.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:05.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:05.023 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:05.023 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114812 2024-09-14T06:01:05.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.023 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.023 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.023 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.53e-07 2024-09-14T06:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101903+0000", 2024-09-14T06:01:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1519999999999999e-06 2024-09-14T06:01:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101909+0000", 2024-09-14T06:01:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9100000000000002e-06 2024-09-14T06:01:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101914+0000", 2024-09-14T06:01:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4240000000000003e-06 2024-09-14T06:01:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154995+0000", 2024-09-14T06:01:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053081101999999998 2024-09-14T06:01:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155085+0000", 2024-09-14T06:01:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0195e-05 2024-09-14T06:01:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.026 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155375+0000", 2024-09-14T06:01:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029024500000000001 2024-09-14T06:01:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114813 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1081344~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.856466726000001, 2024-09-14T06:01:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053887802999999998, 2024-09-14T06:01:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.027 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114813 2024-09-14T06:01:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.028 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.75e-07 2024-09-14T06:01:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101924+0000", 2024-09-14T06:01:05.029 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.244e-06 2024-09-14T06:01:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101931+0000", 2024-09-14T06:01:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6789999999999999e-06 2024-09-14T06:01:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101936+0000", 2024-09-14T06:01:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2320000000000001e-06 2024-09-14T06:01:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.030 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155435+0000", 2024-09-14T06:01:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053498187000000003 2024-09-14T06:01:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155531+0000", 2024-09-14T06:01:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6386999999999997e-05 2024-09-14T06:01:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155810+0000", 2024-09-14T06:01:05.031 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027859899999999998 2024-09-14T06:01:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114814 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1187840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:01:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.856442122000001, 2024-09-14T06:01:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054301716, 2024-09-14T06:01:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:05.032 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114814 2024-09-14T06:01:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:01:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:01:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101947+0000", 2024-09-14T06:01:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6400000000000003e-07 2024-09-14T06:01:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101949+0000", 2024-09-14T06:01:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.396e-06 2024-09-14T06:01:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.034 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101957+0000", 2024-09-14T06:01:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5839999999999997e-06 2024-09-14T06:01:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101962+0000", 2024-09-14T06:01:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0100000000000003e-06 2024-09-14T06:01:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.035 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155858+0000", 2024-09-14T06:01:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053895862000000003 2024-09-14T06:01:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155955+0000", 2024-09-14T06:01:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7812000000000005e-05 2024-09-14T06:01:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156248+0000", 2024-09-14T06:01:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029258799999999998 2024-09-14T06:01:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.036 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.037 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.037 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.037 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114815 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1294336~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:05.037 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:01:05.037 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.856420004, 2024-09-14T06:01:05.037 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054641393000000003, 2024-09-14T06:01:05.037 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.037 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.037 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:05.037 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:05.037 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:05.038 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:05.038 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114815 2024-09-14T06:01:05.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.038 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.038 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.038 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.038 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:01:05.038 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.038 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.038 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.038 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:01:05.038 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.039 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.039 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.039 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101969+0000", 2024-09-14T06:01:05.039 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3099999999999999e-07 2024-09-14T06:01:05.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.039 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.039 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.039 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101971+0000", 2024-09-14T06:01:05.039 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0150000000000002e-06 2024-09-14T06:01:05.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.039 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.039 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.040 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101982+0000", 2024-09-14T06:01:05.040 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0725e-05 2024-09-14T06:01:05.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.040 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.040 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101987+0000", 2024-09-14T06:01:05.040 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.716e-06 2024-09-14T06:01:05.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.040 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.040 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156288+0000", 2024-09-14T06:01:05.040 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054301035999999997 2024-09-14T06:01:05.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.041 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.041 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.041 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156358+0000", 2024-09-14T06:01:05.041 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9238000000000004e-05 2024-09-14T06:01:05.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.041 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.041 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.041 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156610+0000", 2024-09-14T06:01:05.041 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025233200000000002 2024-09-14T06:01:05.041 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.041 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.041 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114816 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1400832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.856392550999999, 2024-09-14T06:01:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054933327999999997, 2024-09-14T06:01:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114816 2024-09-14T06:01:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.042 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.043 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.043 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:05.043 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.043 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.043 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:05.043 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.043 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.043 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:05.044 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8100000000000003e-07 2024-09-14T06:01:05.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.044 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.044 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.044 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101999+0000", 2024-09-14T06:01:05.044 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.633e-06 2024-09-14T06:01:05.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.044 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.044 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.044 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102008+0000", 2024-09-14T06:01:05.044 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4050000000000006e-06 2024-09-14T06:01:05.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.044 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.045 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.045 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102015+0000", 2024-09-14T06:01:05.045 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6660000000000002e-06 2024-09-14T06:01:05.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.045 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.045 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.045 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156644+0000", 2024-09-14T06:01:05.045 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054628942 2024-09-14T06:01:05.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.045 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.045 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.045 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156692+0000", 2024-09-14T06:01:05.045 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8250000000000001e-05 2024-09-14T06:01:05.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.046 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.046 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.046 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156929+0000", 2024-09-14T06:01:05.046 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000236951 2024-09-14T06:01:05.046 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.046 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.046 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.046 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.046 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114817 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1507328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:05.046 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:01:05.046 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.856347962000001, 2024-09-14T06:01:05.046 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.055317495000000001, 2024-09-14T06:01:05.047 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.047 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.047 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:05.047 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:05.047 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:05.047 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:05.047 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114817 2024-09-14T06:01:05.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.047 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.047 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.047 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.047 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:01:05.047 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.048 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.048 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:01:05.048 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.048 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.048 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102041+0000", 2024-09-14T06:01:05.048 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5099999999999999e-07 2024-09-14T06:01:05.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.048 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.048 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102045+0000", 2024-09-14T06:01:05.049 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3790000000000002e-06 2024-09-14T06:01:05.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.049 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.049 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102067+0000", 2024-09-14T06:01:05.049 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2844999999999999e-05 2024-09-14T06:01:05.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.049 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.049 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102074+0000", 2024-09-14T06:01:05.049 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6340000000000003e-06 2024-09-14T06:01:05.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.049 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.050 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156975+0000", 2024-09-14T06:01:05.050 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054900596000000003 2024-09-14T06:01:05.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.050 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.050 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.050 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157070+0000", 2024-09-14T06:01:05.050 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5569000000000006e-05 2024-09-14T06:01:05.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.050 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.050 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.050 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157358+0000", 2024-09-14T06:01:05.050 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028782100000000001 2024-09-14T06:01:05.051 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.051 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.051 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.051 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.051 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114818 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1613824~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:05.051 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:05.051 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.855981926999998, 2024-09-14T06:01:05.051 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.055293008999999997, 2024-09-14T06:01:05.051 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.051 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.051 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:05.051 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:05.051 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:05.052 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:05.052 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114818 2024-09-14T06:01:05.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.052 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.052 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.052 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.052 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:05.052 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.052 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.052 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.052 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:05.052 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.053 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:05.053 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1500000000000003e-07 2024-09-14T06:01:05.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.053 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102412+0000", 2024-09-14T06:01:05.053 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8860000000000003e-06 2024-09-14T06:01:05.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.053 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.054 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102429+0000", 2024-09-14T06:01:05.054 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7147e-05 2024-09-14T06:01:05.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.054 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.054 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102438+0000", 2024-09-14T06:01:05.054 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.799e-06 2024-09-14T06:01:05.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.054 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.054 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.054 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157387+0000", 2024-09-14T06:01:05.054 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054948921999999997 2024-09-14T06:01:05.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.055 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.055 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.055 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157452+0000", 2024-09-14T06:01:05.055 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4471e-05 2024-09-14T06:01:05.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.055 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.055 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.055 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157700+0000", 2024-09-14T06:01:05.055 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024796900000000001 2024-09-14T06:01:05.055 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.055 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.055 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.055 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.055 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.056 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:05.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:01:05.058 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:05.057+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:05.160 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:05.156+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:05.187 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:05.187 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:05.188 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:01:05.188 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:05.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:01:05.287 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:05.284+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:05.319 INFO:teuthology.orchestra.run.smithi006.stderr:marked in osd.7. 2024-09-14T06:01:05.352 INFO:tasks.thrashosds.thrasher:Added osd 7 2024-09-14T06:01:05.361 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T06:01:05.361 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:05.357+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:05.378 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:05.378 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:05.379 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:05.379 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:05.379 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:05.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:01:05.482 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:05.480+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:05.563 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:05.564 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:05.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:05.564 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:05.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.564 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3629 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'31, mlcod=31'25)", 2024-09-14T06:01:05.564 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:05.564 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 108.23356626, 2024-09-14T06:01:05.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048071900000000002, 2024-09-14T06:01:05.564 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.564 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.564 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.564 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329483+0000", 2024-09-14T06:01:05.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-07 2024-09-14T06:01:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329488+0000", 2024-09-14T06:01:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000004e-06 2024-09-14T06:01:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329496+0000", 2024-09-14T06:01:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2209999999999997e-06 2024-09-14T06:01:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.566 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329501+0000", 2024-09-14T06:01:05.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8729999999999998e-06 2024-09-14T06:01:05.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329545+0000", 2024-09-14T06:01:05.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4382999999999998e-05 2024-09-14T06:01:05.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329564+0000", 2024-09-14T06:01:05.567 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8947999999999999e-05 2024-09-14T06:01:05.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.567 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334225+0000", 2024-09-14T06:01:05.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004660923 2024-09-14T06:01:05.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.568 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.568 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334289+0000", 2024-09-14T06:01:05.568 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4041999999999994e-05 2024-09-14T06:01:05.568 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.568 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.568 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.568 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.568 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3632 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'34, mlcod=31'27)", 2024-09-14T06:01:05.569 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:05.569 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 108.230444072, 2024-09-14T06:01:05.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047983469999999997, 2024-09-14T06:01:05.569 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.569 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.569 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.569 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.569 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.569 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:05.569 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.569 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.570 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.570 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:05.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.570 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.570 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332605+0000", 2024-09-14T06:01:05.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5099999999999999e-07 2024-09-14T06:01:05.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.570 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.570 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.570 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332611+0000", 2024-09-14T06:01:05.570 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6999999999999996e-06 2024-09-14T06:01:05.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332623+0000", 2024-09-14T06:01:05.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2401e-05 2024-09-14T06:01:05.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332629+0000", 2024-09-14T06:01:05.571 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3720000000000001e-06 2024-09-14T06:01:05.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.571 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.571 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.571 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332691+0000", 2024-09-14T06:01:05.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1451000000000005e-05 2024-09-14T06:01:05.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332711+0000", 2024-09-14T06:01:05.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0285e-05 2024-09-14T06:01:05.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.572 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.572 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337341+0000", 2024-09-14T06:01:05.572 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046295900000000003 2024-09-14T06:01:05.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.572 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337402+0000", 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1797000000000005e-05 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3638 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'40, mlcod=31'32)", 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 108.224302157, 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004283345, 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.573 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.574 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.574 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.574 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:05.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.574 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.574 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:05.574 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.574 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.574 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.574 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.574 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338747+0000", 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338756+0000", 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5909999999999996e-06 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338774+0000", 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8073000000000001e-05 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.575 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338785+0000", 2024-09-14T06:01:05.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1017e-05 2024-09-14T06:01:05.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338844+0000", 2024-09-14T06:01:05.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9292000000000001e-05 2024-09-14T06:01:05.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.576 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338864+0000", 2024-09-14T06:01:05.576 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9528999999999999e-05 2024-09-14T06:01:05.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.576 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.576 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.577 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.342984+0000", 2024-09-14T06:01:05.577 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041207809999999996 2024-09-14T06:01:05.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.577 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.577 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.343029+0000", 2024-09-14T06:01:05.577 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5034000000000003e-05 2024-09-14T06:01:05.577 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.577 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.577 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.577 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.577 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:17596 3.4 e41/24 3:27f62511:::rbd_data.1127d65075f9.00000000000000ca:head v 41'97, mlcod=41'95)", 2024-09-14T06:01:05.577 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:05.578 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 95.592549593000001, 2024-09-14T06:01:05.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049456559999999997, 2024-09-14T06:01:05.578 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.578 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.578 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.578 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.578 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.578 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:05.578 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.578 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.578 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.578 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970500+0000", 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9600000000000008e-07 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970614+0000", 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000113956 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.579 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970631+0000", 2024-09-14T06:01:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7150999999999999e-05 2024-09-14T06:01:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970643+0000", 2024-09-14T06:01:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1868999999999999e-05 2024-09-14T06:01:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970711+0000", 2024-09-14T06:01:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8952e-05 2024-09-14T06:01:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970738+0000", 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6055999999999999e-05 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975388+0000", 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046502499999999999 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975444+0000", 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6425999999999998e-05 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.581 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.582 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.582 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24289 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'57, mlcod=41'54)", 2024-09-14T06:01:05.582 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:05.582 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.407257414, 2024-09-14T06:01:05.582 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.060867738999999997, 2024-09-14T06:01:05.582 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.582 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.582 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.582 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.582 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.582 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.583 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:05.583 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.583 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.583 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:05.583 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.583 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.583 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.583 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155793+0000", 2024-09-14T06:01:05.583 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9470000000000002e-06 2024-09-14T06:01:05.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181776+0000", 2024-09-14T06:01:05.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.02598313 2024-09-14T06:01:05.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181817+0000", 2024-09-14T06:01:05.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1440000000000003e-05 2024-09-14T06:01:05.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.584 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.584 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.584 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181834+0000", 2024-09-14T06:01:05.584 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6979000000000001e-05 2024-09-14T06:01:05.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.585 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.585 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.585 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181931+0000", 2024-09-14T06:01:05.585 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7219999999999994e-05 2024-09-14T06:01:05.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.585 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.585 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.585 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181964+0000", 2024-09-14T06:01:05.585 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2094999999999997e-05 2024-09-14T06:01:05.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.585 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.585 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216586+0000", 2024-09-14T06:01:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034622503999999998 2024-09-14T06:01:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216658+0000", 2024-09-14T06:01:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2423999999999996e-05 2024-09-14T06:01:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.586 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24309 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'58, mlcod=41'56)", 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.308022308999995, 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044435519999999999, 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.587 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255027+0000", 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255040+0000", 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2773e-05 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.588 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255066+0000", 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5459000000000001e-05 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255076+0000", 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0372e-05 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255151+0000", 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5444999999999993e-05 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.589 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255176+0000", 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5089e-05 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259379+0000", 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042025439999999999 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259469+0000", 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0407000000000004e-05 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37361 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'280, mlcod=50'278)", 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 81.521862050999999, 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075534590000000002, 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:05.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041187+0000", 2024-09-14T06:01:05.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2160000000000001e-06 2024-09-14T06:01:05.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041208+0000", 2024-09-14T06:01:05.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0528999999999999e-05 2024-09-14T06:01:05.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041225+0000", 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7255e-05 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041235+0000", 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4190000000000008e-06 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041302+0000", 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7774000000000005e-05 2024-09-14T06:01:05.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041330+0000", 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7382999999999999e-05 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048686+0000", 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073564570000000003 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048740+0000", 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3426e-05 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.594 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37362 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'281, mlcod=50'278)", 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 81.516961652000006, 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047169380000000004, 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:05.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046087+0000", 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3600000000000003e-07 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046093+0000", 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7869999999999998e-06 2024-09-14T06:01:05.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046106+0000", 2024-09-14T06:01:05.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2636999999999999e-05 2024-09-14T06:01:05.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046113+0000", 2024-09-14T06:01:05.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0129999999999996e-06 2024-09-14T06:01:05.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046170+0000", 2024-09-14T06:01:05.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7819000000000003e-05 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046194+0000", 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3167999999999999e-05 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050760+0000", 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045665999999999997 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050803+0000", 2024-09-14T06:01:05.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3177999999999999e-05 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39545 3.0 e50/24 3:06bdaf45:::rbd_data.112781171282.0000000000000002:head v 50'347, mlcod=50'345)", 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.984581370000001, 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047008700000000002, 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:05.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.600 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.600 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:05.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.600 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.600 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578468+0000", 2024-09-14T06:01:05.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1599999999999999e-06 2024-09-14T06:01:05.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.600 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579733+0000", 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012647120000000001 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579755+0000", 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2637999999999999e-05 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579766+0000", 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0264e-05 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579832+0000", 2024-09-14T06:01:05.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6531000000000004e-05 2024-09-14T06:01:05.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579859+0000", 2024-09-14T06:01:05.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6855999999999998e-05 2024-09-14T06:01:05.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583098+0000", 2024-09-14T06:01:05.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003238632 2024-09-14T06:01:05.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.603 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.603 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583168+0000", 2024-09-14T06:01:05.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0077e-05 2024-09-14T06:01:05.603 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.603 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.603 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.603 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39765 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'410, mlcod=51'406)", 2024-09-14T06:01:05.603 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:05.603 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.558626568999998, 2024-09-14T06:01:05.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044953839999999998, 2024-09-14T06:01:05.603 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.603 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004423+0000", 2024-09-14T06:01:05.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1909999999999999e-06 2024-09-14T06:01:05.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004432+0000", 2024-09-14T06:01:05.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2180000000000005e-06 2024-09-14T06:01:05.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.605 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.605 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004453+0000", 2024-09-14T06:01:05.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1182000000000001e-05 2024-09-14T06:01:05.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.605 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004464+0000", 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1198e-05 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004520+0000", 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5835999999999999e-05 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004547+0000", 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6454000000000001e-05 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008866+0000", 2024-09-14T06:01:05.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043194679999999999 2024-09-14T06:01:05.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008917+0000", 2024-09-14T06:01:05.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0837000000000001e-05 2024-09-14T06:01:05.607 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.607 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.607 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.607 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39847 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'431, mlcod=51'426)", 2024-09-14T06:01:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.445343219999998, 2024-09-14T06:01:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046358010000000002, 2024-09-14T06:01:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:05.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.609 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117706+0000", 2024-09-14T06:01:05.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4899999999999995e-07 2024-09-14T06:01:05.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.609 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117711+0000", 2024-09-14T06:01:05.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6890000000000001e-06 2024-09-14T06:01:05.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117724+0000", 2024-09-14T06:01:05.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3054000000000001e-05 2024-09-14T06:01:05.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117736+0000", 2024-09-14T06:01:05.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1654999999999999e-05 2024-09-14T06:01:05.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117788+0000", 2024-09-14T06:01:05.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2197000000000002e-05 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117811+0000", 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2472000000000001e-05 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122292+0000", 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004481596 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122341+0000", 2024-09-14T06:01:05.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8489000000000003e-05 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39865 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'438, mlcod=51'434)", 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.418008921999999, 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004519426, 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145040+0000", 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7899999999999998e-07 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145044+0000", 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3789999999999999e-06 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145053+0000", 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2650000000000002e-06 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145058+0000", 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8169999999999998e-06 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.614 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145105+0000", 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7176999999999999e-05 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145119+0000", 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3179e-05 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149512+0000", 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043934389999999999 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149559+0000", 2024-09-14T06:01:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6591000000000002e-05 2024-09-14T06:01:05.616 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.616 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.616 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.616 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40245 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'513, mlcod=52'509)", 2024-09-14T06:01:05.616 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:05.616 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 79.639456894000006, 2024-09-14T06:01:05.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053460410000000002, 2024-09-14T06:01:05.616 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.616 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.616 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.616 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923592+0000", 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6599999999999996e-07 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923598+0000", 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.083e-06 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923609+0000", 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1137e-05 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923617+0000", 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.401e-06 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924037+0000", 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042046 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924082+0000", 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4617000000000003e-05 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928882+0000", 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048000889999999996 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.620 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928937+0000", 2024-09-14T06:01:05.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5587999999999997e-05 2024-09-14T06:01:05.620 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.620 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.620 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.620 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40246 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'514, mlcod=52'509)", 2024-09-14T06:01:05.620 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:05.620 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 79.638422379000005, 2024-09-14T06:01:05.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043609649999999996, 2024-09-14T06:01:05.620 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.621 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.621 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:05.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:05.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:05.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2099999999999996e-07 2024-09-14T06:01:05.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924631+0000", 2024-09-14T06:01:05.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8450000000000002e-06 2024-09-14T06:01:05.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924641+0000", 2024-09-14T06:01:05.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0057e-05 2024-09-14T06:01:05.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.623 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.623 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924649+0000", 2024-09-14T06:01:05.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5669999999999997e-06 2024-09-14T06:01:05.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.623 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.623 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925127+0000", 2024-09-14T06:01:05.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00047783800000000001 2024-09-14T06:01:05.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.623 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.623 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925171+0000", 2024-09-14T06:01:05.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4017000000000002e-05 2024-09-14T06:01:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928942+0000", 2024-09-14T06:01:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037716809999999998 2024-09-14T06:01:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928987+0000", 2024-09-14T06:01:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4338999999999997e-05 2024-09-14T06:01:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.625 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:46646 3.0 e56/24 3:01acbe3d:::rbd_data.1127f2f8ff9b.0000000000000015:head v 56'541, mlcod=55'538)", 2024-09-14T06:01:05.625 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:05.625 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 75.101636108999998, 2024-09-14T06:01:05.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064775850000000001, 2024-09-14T06:01:05.625 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.625 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.625 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.625 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:05.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:05.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461415+0000", 2024-09-14T06:01:05.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.666e-06 2024-09-14T06:01:05.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463456+0000", 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00204177 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463488+0000", 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1503e-05 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463508+0000", 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9788000000000001e-05 2024-09-14T06:01:05.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463697+0000", 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018873499999999999 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463741+0000", 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4333999999999999e-05 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467845+0000", 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041041430000000002 2024-09-14T06:01:05.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467890+0000", 2024-09-14T06:01:05.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4645999999999999e-05 2024-09-14T06:01:05.629 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.629 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.629 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.629 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:89402 3.0 e84/24 3:03c9b195:::rbd_data.11271f4525c9.00000000000001ae:head v 84'849, mlcod=83'847)", 2024-09-14T06:01:05.629 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:05.629 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 38.932735373, 2024-09-14T06:01:05.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0051764460000000003, 2024-09-14T06:01:05.629 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.630 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.630 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.630 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:05.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.630 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:05.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8299999999999997e-07 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630321+0000", 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6070000000000002e-06 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630349+0000", 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7696e-05 2024-09-14T06:01:05.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630364+0000", 2024-09-14T06:01:05.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4856e-05 2024-09-14T06:01:05.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630507+0000", 2024-09-14T06:01:05.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014309899999999999 2024-09-14T06:01:05.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630573+0000", 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6126999999999999e-05 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.635358+0000", 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047853879999999998 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.635489+0000", 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013108999999999999 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:106809 3.9 e93/24 3:96c4c4a7:::rbd_data.1127189bfb31.000000000000000a:head v 93'304, mlcod=92'302)", 2024-09-14T06:01:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 29.509376315000001, 2024-09-14T06:01:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0092272799999999992, 2024-09-14T06:01:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053673+0000", 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.522e-06 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056791+0000", 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031181310000000001 2024-09-14T06:01:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056814+0000", 2024-09-14T06:01:05.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2473999999999999e-05 2024-09-14T06:01:05.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056825+0000", 2024-09-14T06:01:05.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.059e-05 2024-09-14T06:01:05.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056898+0000", 2024-09-14T06:01:05.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2992999999999997e-05 2024-09-14T06:01:05.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.637 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.637 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056918+0000", 2024-09-14T06:01:05.637 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0809999999999999e-05 2024-09-14T06:01:05.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.637 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.637 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.062810+0000", 2024-09-14T06:01:05.637 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0058916460000000004 2024-09-14T06:01:05.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.062899+0000", 2024-09-14T06:01:05.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9114000000000001e-05 2024-09-14T06:01:05.638 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.638 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.638 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.638 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:106810 3.9 e93/24 3:96c4c4a7:::rbd_data.1127189bfb31.000000000000000a:head v 93'306, mlcod=92'302)", 2024-09-14T06:01:05.638 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:05.638 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 29.506054160000001, 2024-09-14T06:01:05.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0060457269999999999, 2024-09-14T06:01:05.639 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.639 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.639 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.639 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.639 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.639 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:05.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.639 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.639 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:05.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.640 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.640 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056995+0000", 2024-09-14T06:01:05.640 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8199999999999999e-07 2024-09-14T06:01:05.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.640 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.640 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057001+0000", 2024-09-14T06:01:05.640 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2060000000000004e-06 2024-09-14T06:01:05.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.640 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.640 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057011+0000", 2024-09-14T06:01:05.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8369999999999992e-06 2024-09-14T06:01:05.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057018+0000", 2024-09-14T06:01:05.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9e-06 2024-09-14T06:01:05.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.059980+0000", 2024-09-14T06:01:05.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029624500000000002 2024-09-14T06:01:05.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.060002+0000", 2024-09-14T06:01:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2299000000000001e-05 2024-09-14T06:01:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.063000+0000", 2024-09-14T06:01:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029974170000000001 2024-09-14T06:01:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.063040+0000", 2024-09-14T06:01:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9836000000000003e-05 2024-09-14T06:01:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.642 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.643 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.643 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:114889 3.0 e93/24 3:072a82e8:::rbd_data.1127cb09e343.0000000000000009:head v 93'915, mlcod=92'913)", 2024-09-14T06:01:05.643 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.462828+0000", 2024-09-14T06:01:05.643 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 28.100220048000001, 2024-09-14T06:01:05.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041683099999999997, 2024-09-14T06:01:05.643 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.643 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.643 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.643 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.462828+0000", 2024-09-14T06:01:05.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.462828+0000", 2024-09-14T06:01:05.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.462830+0000", 2024-09-14T06:01:05.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0930000000000001e-06 2024-09-14T06:01:05.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463643+0000", 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00081271700000000002 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463677+0000", 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4329000000000003e-05 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463693+0000", 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5713e-05 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463858+0000", 2024-09-14T06:01:05.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000164749 2024-09-14T06:01:05.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463928+0000", 2024-09-14T06:01:05.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0646000000000001e-05 2024-09-14T06:01:05.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.466860+0000", 2024-09-14T06:01:05.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029313970000000001 2024-09-14T06:01:05.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.466996+0000", 2024-09-14T06:01:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000136666 2024-09-14T06:01:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:119911 3.0 e99/24 3:067b0149:::rbd_data.1127206dd91f.0000000000000002:head v 99'930, mlcod=97'928)", 2024-09-14T06:01:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 22.740308335999998, 2024-09-14T06:01:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049905519999999997, 2024-09-14T06:01:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:05.648 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:05.648 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:05.648 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:05.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:05.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:05.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:05.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:05.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:05.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:05.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822741+0000", 2024-09-14T06:01:05.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.054e-06 2024-09-14T06:01:05.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:05.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824085+0000", 2024-09-14T06:01:05.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001343693 2024-09-14T06:01:05.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:05.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824114+0000", 2024-09-14T06:01:05.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9013000000000002e-05 2024-09-14T06:01:05.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.650 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:05.650 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824127+0000", 2024-09-14T06:01:05.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3869000000000001e-05 2024-09-14T06:01:05.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.650 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:05.650 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824222+0000", 2024-09-14T06:01:05.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4616000000000003e-05 2024-09-14T06:01:05.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.650 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:05.650 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824247+0000", 2024-09-14T06:01:05.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5205999999999999e-05 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.827664+0000", 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0034165530000000001 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.827730+0000", 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6548e-05 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:05.652 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:05.652 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:05.561+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:05.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:01:05.695 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:05.692+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:05.765 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:05.760+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:05.815 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:05.815 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:05.815 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:01:05.816 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:05.830 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:01:05.871 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:05.868+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:05.966 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:05.965+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:05.997 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:05.997 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:05.997 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:05.998 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:05.998 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:06.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:01:06.067 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:06.065+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:06.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:01:06.134 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:06.134 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:06.134 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:06.134 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:06.134 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.135 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54659 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 616448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.135 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:06.135 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.993329169000006, 2024-09-14T06:01:06.135 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092177035000000004, 2024-09-14T06:01:06.135 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.135 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.135 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.135 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.135 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.135 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.135 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54659 2024-09-14T06:01:06.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.135 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.136 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.136 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.136 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:06.136 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.136 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.136 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.136 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:06.136 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.136 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.136 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.136 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.136 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139718+0000", 2024-09-14T06:01:06.136 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9699999999999996e-07 2024-09-14T06:01:06.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.137 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.137 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.137 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139731+0000", 2024-09-14T06:01:06.137 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2993000000000001e-05 2024-09-14T06:01:06.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.137 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.137 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.137 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139738+0000", 2024-09-14T06:01:06.137 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4610000000000002e-06 2024-09-14T06:01:06.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.137 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.138 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.138 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139744+0000", 2024-09-14T06:01:06.138 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6389999999999997e-06 2024-09-14T06:01:06.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.138 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.138 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231570+0000", 2024-09-14T06:01:06.138 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091826216000000002 2024-09-14T06:01:06.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.138 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.138 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231662+0000", 2024-09-14T06:01:06.138 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2101000000000005e-05 2024-09-14T06:01:06.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.139 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.139 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.139 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231894+0000", 2024-09-14T06:01:06.139 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023212800000000001 2024-09-14T06:01:06.139 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.139 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.139 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.140 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.140 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54660 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 622592~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.140 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:06.140 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.993293835000003, 2024-09-14T06:01:06.140 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092366887999999994, 2024-09-14T06:01:06.140 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.140 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.140 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.140 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.140 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.140 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.140 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54660 2024-09-14T06:01:06.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.141 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.141 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.141 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:06.141 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.141 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.141 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:06.141 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.142 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.142 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:06.142 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T06:01:06.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.142 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.142 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139755+0000", 2024-09-14T06:01:06.142 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T06:01:06.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.142 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.142 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139762+0000", 2024-09-14T06:01:06.142 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6719999999999998e-06 2024-09-14T06:01:06.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.143 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.143 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139767+0000", 2024-09-14T06:01:06.143 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9819999999999999e-06 2024-09-14T06:01:06.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.143 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.143 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231917+0000", 2024-09-14T06:01:06.143 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092149872999999993 2024-09-14T06:01:06.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.143 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.143 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231969+0000", 2024-09-14T06:01:06.143 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2642000000000002e-05 2024-09-14T06:01:06.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.144 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.144 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.144 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232120+0000", 2024-09-14T06:01:06.144 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015011899999999999 2024-09-14T06:01:06.144 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.144 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.144 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.144 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.144 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54844 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 0~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.144 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:06.144 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.993272344000005, 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092708507999999995, 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54844 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139775+0000", 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3500000000000002e-07 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139777+0000", 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.979e-06 2024-09-14T06:01:06.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.147 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.147 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139787+0000", 2024-09-14T06:01:06.147 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0779e-05 2024-09-14T06:01:06.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.147 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.147 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139799+0000", 2024-09-14T06:01:06.147 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1719000000000001e-05 2024-09-14T06:01:06.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.147 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.147 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232151+0000", 2024-09-14T06:01:06.148 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092351767000000001 2024-09-14T06:01:06.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.148 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.148 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232217+0000", 2024-09-14T06:01:06.148 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6655000000000005e-05 2024-09-14T06:01:06.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.148 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.148 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232483+0000", 2024-09-14T06:01:06.148 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026517400000000002 2024-09-14T06:01:06.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.148 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.149 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54845 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 55296~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.149 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:06.149 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.993238672999993, 2024-09-14T06:01:06.149 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093127583999999999, 2024-09-14T06:01:06.149 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.149 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.149 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.149 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.149 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.149 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54845 2024-09-14T06:01:06.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.150 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.150 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.150 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:06.150 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.150 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.150 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:06.150 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.151 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.151 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:06.151 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4899999999999995e-07 2024-09-14T06:01:06.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.151 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.151 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.151 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139811+0000", 2024-09-14T06:01:06.151 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000001e-06 2024-09-14T06:01:06.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.151 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.151 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.151 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139821+0000", 2024-09-14T06:01:06.152 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0168e-05 2024-09-14T06:01:06.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.152 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.152 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139826+0000", 2024-09-14T06:01:06.152 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2780000000000001e-06 2024-09-14T06:01:06.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.152 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.152 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232556+0000", 2024-09-14T06:01:06.152 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092729729999999996 2024-09-14T06:01:06.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.152 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.153 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232652+0000", 2024-09-14T06:01:06.153 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680999999999994e-05 2024-09-14T06:01:06.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.153 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.153 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.153 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232935+0000", 2024-09-14T06:01:06.153 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000283758 2024-09-14T06:01:06.153 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.153 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.153 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.153 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.153 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54846 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.154 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:06.154 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.993212365999995, 2024-09-14T06:01:06.154 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093492079000000006, 2024-09-14T06:01:06.154 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.154 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.154 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.154 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.154 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.154 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.154 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54846 2024-09-14T06:01:06.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.154 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.155 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.155 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:06.155 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.155 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.155 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:06.155 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.155 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.155 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139835+0000", 2024-09-14T06:01:06.155 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T06:01:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139837+0000", 2024-09-14T06:01:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1059999999999998e-06 2024-09-14T06:01:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139845+0000", 2024-09-14T06:01:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4300000000000006e-06 2024-09-14T06:01:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.156 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139851+0000", 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232987+0000", 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093136073999999999 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233075+0000", 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7318999999999995e-05 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.157 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233326+0000", 2024-09-14T06:01:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025159 2024-09-14T06:01:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54847 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 67584~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.993186649999998, 2024-09-14T06:01:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093777452999999997, 2024-09-14T06:01:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.158 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54847 2024-09-14T06:01:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T06:01:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139862+0000", 2024-09-14T06:01:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0200000000000001e-06 2024-09-14T06:01:06.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.161 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.161 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139870+0000", 2024-09-14T06:01:06.161 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0520000000000002e-06 2024-09-14T06:01:06.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.161 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.161 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139875+0000", 2024-09-14T06:01:06.161 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:01:06.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.161 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.162 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233389+0000", 2024-09-14T06:01:06.162 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093514054999999999 2024-09-14T06:01:06.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.162 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.162 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233443+0000", 2024-09-14T06:01:06.162 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3913999999999999e-05 2024-09-14T06:01:06.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.162 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.162 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233637+0000", 2024-09-14T06:01:06.162 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019392899999999999 2024-09-14T06:01:06.163 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.163 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.163 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.163 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54848 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 73728~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.163 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:06.163 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.993163554000006, 2024-09-14T06:01:06.163 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094064464, 2024-09-14T06:01:06.163 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.163 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.163 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.163 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.164 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.164 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.164 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54848 2024-09-14T06:01:06.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.164 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.164 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.164 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:06.164 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.164 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.165 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:06.165 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.165 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.165 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.165 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:06.165 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T06:01:06.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.165 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.165 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.165 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139885+0000", 2024-09-14T06:01:06.165 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9929999999999998e-06 2024-09-14T06:01:06.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139893+0000", 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9759999999999995e-06 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139898+0000", 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6059999999999996e-06 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233681+0000", 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093782921000000005 2024-09-14T06:01:06.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233730+0000", 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9410999999999998e-05 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233947+0000", 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021710300000000001 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.167 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54849 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.168 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:06.168 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.993140097999998, 2024-09-14T06:01:06.168 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094499257000000003, 2024-09-14T06:01:06.168 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.168 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.168 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.168 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.168 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.168 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.168 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54849 2024-09-14T06:01:06.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.168 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.169 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.169 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:06.169 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.169 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.169 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:06.169 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.169 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.169 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139907+0000", 2024-09-14T06:01:06.169 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T06:01:06.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.170 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.170 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139909+0000", 2024-09-14T06:01:06.170 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T06:01:06.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.170 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.170 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139916+0000", 2024-09-14T06:01:06.170 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T06:01:06.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.170 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.170 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139921+0000", 2024-09-14T06:01:06.171 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:01:06.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.171 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.171 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234032+0000", 2024-09-14T06:01:06.171 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094111037999999994 2024-09-14T06:01:06.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.171 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.171 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234150+0000", 2024-09-14T06:01:06.171 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118408 2024-09-14T06:01:06.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.172 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.172 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234406+0000", 2024-09-14T06:01:06.172 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025540600000000001 2024-09-14T06:01:06.172 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.172 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.172 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.172 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54850 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 135168~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.172 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:06.172 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.993118390000006, 2024-09-14T06:01:06.172 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094814605999999996, 2024-09-14T06:01:06.172 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.172 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.173 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.173 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.173 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.173 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.173 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54850 2024-09-14T06:01:06.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.173 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.173 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.173 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:06.173 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.173 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.174 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:06.174 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.174 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.174 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139929+0000", 2024-09-14T06:01:06.174 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T06:01:06.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.174 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.174 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139931+0000", 2024-09-14T06:01:06.174 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.024e-06 2024-09-14T06:01:06.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139937+0000", 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3770000000000001e-06 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139942+0000", 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0289999999999996e-06 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234447+0000", 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094505426000000003 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234539+0000", 2024-09-14T06:01:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1793999999999996e-05 2024-09-14T06:01:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234743+0000", 2024-09-14T06:01:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020354600000000001 2024-09-14T06:01:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.176 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54851 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 141312~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.177 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:06.177 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.993096678000001, 2024-09-14T06:01:06.177 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095179749999999994, 2024-09-14T06:01:06.177 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.177 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.177 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.177 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.177 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.177 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54851 2024-09-14T06:01:06.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.177 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.177 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:01:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139952+0000", 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0600000000000002e-06 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139959+0000", 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.584e-06 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139964+0000", 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8890000000000001e-06 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.180 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.180 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234786+0000", 2024-09-14T06:01:06.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094822241000000002 2024-09-14T06:01:06.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.180 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.180 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234877+0000", 2024-09-14T06:01:06.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1158999999999999e-05 2024-09-14T06:01:06.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.180 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.180 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235130+0000", 2024-09-14T06:01:06.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025235999999999998 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54852 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 147456~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.99307555, 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095437742000000006, 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.181 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54852 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.182 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140125+0000", 2024-09-14T06:01:06.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154332 2024-09-14T06:01:06.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140130+0000", 2024-09-14T06:01:06.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.284e-06 2024-09-14T06:01:06.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.183 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.183 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140140+0000", 2024-09-14T06:01:06.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0789e-05 2024-09-14T06:01:06.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140147+0000", 2024-09-14T06:01:06.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9879999999999998e-06 2024-09-14T06:01:06.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235174+0000", 2024-09-14T06:01:06.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095026749999999993 2024-09-14T06:01:06.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.185 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.185 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235230+0000", 2024-09-14T06:01:06.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6224000000000002e-05 2024-09-14T06:01:06.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.185 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.185 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235409+0000", 2024-09-14T06:01:06.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017837500000000001 2024-09-14T06:01:06.185 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.185 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.185 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.185 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54853 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 202752~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.186 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:06.186 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.992886728000002, 2024-09-14T06:01:06.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095632919999999996, 2024-09-14T06:01:06.186 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.186 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.186 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.186 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.186 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.186 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54853 2024-09-14T06:01:06.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.186 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:06.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:06.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147748+0000", 2024-09-14T06:01:06.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075884910000000002 2024-09-14T06:01:06.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.188 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147798+0000", 2024-09-14T06:01:06.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0152999999999999e-05 2024-09-14T06:01:06.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.188 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147814+0000", 2024-09-14T06:01:06.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5866e-05 2024-09-14T06:01:06.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.188 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.188 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147831+0000", 2024-09-14T06:01:06.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6991999999999999e-05 2024-09-14T06:01:06.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.189 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.189 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235451+0000", 2024-09-14T06:01:06.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087620077000000005 2024-09-14T06:01:06.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.189 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.189 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235539+0000", 2024-09-14T06:01:06.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7800000000000006e-05 2024-09-14T06:01:06.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.189 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.190 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235793+0000", 2024-09-14T06:01:06.190 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025354099999999998 2024-09-14T06:01:06.190 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.190 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.190 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.190 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54870 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 503808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.190 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:06.190 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.984641181000001, 2024-09-14T06:01:06.190 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092420756000000007, 2024-09-14T06:01:06.190 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.190 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.190 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.191 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.191 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.191 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.191 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54870 2024-09-14T06:01:06.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.191 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:06.191 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:06.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148406+0000", 2024-09-14T06:01:06.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T06:01:06.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148409+0000", 2024-09-14T06:01:06.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T06:01:06.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.193 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.193 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148418+0000", 2024-09-14T06:01:06.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7329999999999998e-06 2024-09-14T06:01:06.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.193 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.193 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148425+0000", 2024-09-14T06:01:06.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2079999999999997e-06 2024-09-14T06:01:06.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.193 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.193 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240591+0000", 2024-09-14T06:01:06.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092166441000000002 2024-09-14T06:01:06.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.194 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.194 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240648+0000", 2024-09-14T06:01:06.194 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6733e-05 2024-09-14T06:01:06.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.194 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.194 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240826+0000", 2024-09-14T06:01:06.194 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017834700000000001 2024-09-14T06:01:06.194 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.194 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.194 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54871 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 509952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.984611220999994, 2024-09-14T06:01:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092702341999999993, 2024-09-14T06:01:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54871 2024-09-14T06:01:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.195 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:06.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:06.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148436+0000", 2024-09-14T06:01:06.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5499999999999998e-07 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148439+0000", 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8090000000000001e-06 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148449+0000", 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0115000000000001e-05 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148466+0000", 2024-09-14T06:01:06.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6761000000000001e-05 2024-09-14T06:01:06.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.198 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.198 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240857+0000", 2024-09-14T06:01:06.198 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092391089999999995 2024-09-14T06:01:06.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.198 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.198 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240939+0000", 2024-09-14T06:01:06.198 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2387999999999998e-05 2024-09-14T06:01:06.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.198 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.198 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241138+0000", 2024-09-14T06:01:06.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000198624 2024-09-14T06:01:06.199 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.199 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.199 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.199 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54872 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 516096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:06.199 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:06.199 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 71.984570023000003, 2024-09-14T06:01:06.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093126020000000004, 2024-09-14T06:01:06.199 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.199 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.199 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54872 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:06.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155484+0000", 2024-09-14T06:01:06.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070072429999999998 2024-09-14T06:01:06.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155490+0000", 2024-09-14T06:01:06.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6379999999999998e-06 2024-09-14T06:01:06.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155504+0000", 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4065e-05 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155513+0000", 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6799999999999999e-06 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241216+0000", 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085702922000000001 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.202 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241277+0000", 2024-09-14T06:01:06.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0980000000000002e-05 2024-09-14T06:01:06.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241602+0000", 2024-09-14T06:01:06.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032549199999999998 2024-09-14T06:01:06.203 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.203 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.203 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.203 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123238 3.7 3.c0662d67 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:06.204 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:06.204 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 6.7180983530000002, 2024-09-14T06:01:06.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88300249500000005, 2024-09-14T06:01:06.204 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.204 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.204 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:01:06.204 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.204 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.204 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.204 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123238 2024-09-14T06:01:06.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.204 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:06.205 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:06.205 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414949+0000", 2024-09-14T06:01:06.205 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8899999999999998e-07 2024-09-14T06:01:06.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.206 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.206 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414953+0000", 2024-09-14T06:01:06.206 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1439999999999996e-06 2024-09-14T06:01:06.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.206 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.206 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414974+0000", 2024-09-14T06:01:06.206 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0630000000000001e-05 2024-09-14T06:01:06.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.206 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.206 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414982+0000", 2024-09-14T06:01:06.207 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9840000000000001e-06 2024-09-14T06:01:06.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.207 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.207 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415051+0000", 2024-09-14T06:01:06.207 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9787000000000001e-05 2024-09-14T06:01:06.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.207 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:06.207 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415062+0000", 2024-09-14T06:01:06.207 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0674e-05 2024-09-14T06:01:06.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297935+0000", 2024-09-14T06:01:06.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88287307400000004 2024-09-14T06:01:06.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297951+0000", 2024-09-14T06:01:06.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5413e-05 2024-09-14T06:01:06.208 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.208 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.208 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.209 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123240 3.15 3:a806c175:::rbd_data.112793b455a2.0000000000000005:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:06.209 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:06.209 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 6.718042638, 2024-09-14T06:01:06.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.950432851, 2024-09-14T06:01:06.209 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.209 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.209 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:06.209 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.209 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.209 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.209 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123240 2024-09-14T06:01:06.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.210 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.210 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:06.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.210 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:06.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.211 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.211 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:06.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3399999999999999e-07 2024-09-14T06:01:06.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.211 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.211 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415008+0000", 2024-09-14T06:01:06.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6090000000000001e-06 2024-09-14T06:01:06.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.211 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.211 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415017+0000", 2024-09-14T06:01:06.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0100000000000001e-06 2024-09-14T06:01:06.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415025+0000", 2024-09-14T06:01:06.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9109999999999993e-06 2024-09-14T06:01:06.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415114+0000", 2024-09-14T06:01:06.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9086999999999996e-05 2024-09-14T06:01:06.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:06.213 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415132+0000", 2024-09-14T06:01:06.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7405e-05 2024-09-14T06:01:06.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.213 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297130+0000", 2024-09-14T06:01:06.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88199837000000003 2024-09-14T06:01:06.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:06.213 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297152+0000", 2024-09-14T06:01:06.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2103000000000002e-05 2024-09-14T06:01:06.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.214 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361290+0000", 2024-09-14T06:01:06.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.064138091 2024-09-14T06:01:06.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.214 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361714+0000", 2024-09-14T06:01:06.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042403999999999999 2024-09-14T06:01:06.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361955+0000", 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000240981 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365095+0000", 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031403960000000002 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365192+0000", 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6976000000000001e-05 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:06.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365274+0000", 2024-09-14T06:01:06.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1293999999999998e-05 2024-09-14T06:01:06.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365437+0000", 2024-09-14T06:01:06.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016294399999999999 2024-09-14T06:01:06.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.216 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123244 3.7 3.d0cc8287 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 6.7179971350000001, 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88296528100000005, 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123244 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.217 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415050+0000", 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1500000000000004e-07 2024-09-14T06:01:06.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415053+0000", 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1219999999999999e-06 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415065+0000", 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1549000000000001e-05 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415071+0000", 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4359999999999999e-06 2024-09-14T06:01:06.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415133+0000", 2024-09-14T06:01:06.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2249999999999995e-05 2024-09-14T06:01:06.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:06.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415141+0000", 2024-09-14T06:01:06.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5480000000000004e-06 2024-09-14T06:01:06.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.298007+0000", 2024-09-14T06:01:06.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88286582199999997 2024-09-14T06:01:06.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.221 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.221 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.298015+0000", 2024-09-14T06:01:06.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8390000000000007e-06 2024-09-14T06:01:06.221 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.221 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.221 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.221 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123245 3.15 3:ae492430:::rbd_data.112793b455a2.000000000000000a:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:06.221 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:06.222 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 6.715929483, 2024-09-14T06:01:06.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9484952870000001, 2024-09-14T06:01:06.222 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.222 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.222 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:06.222 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.222 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.222 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.222 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123245 2024-09-14T06:01:06.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.222 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.222 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:06.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.223 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.223 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:06.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.223 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.223 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417118+0000", 2024-09-14T06:01:06.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0189999999999999e-06 2024-09-14T06:01:06.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417123+0000", 2024-09-14T06:01:06.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7380000000000002e-06 2024-09-14T06:01:06.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417137+0000", 2024-09-14T06:01:06.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4538999999999999e-05 2024-09-14T06:01:06.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417146+0000", 2024-09-14T06:01:06.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3669999999999997e-06 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417236+0000", 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9976999999999996e-05 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417249+0000", 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3325e-05 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297197+0000", 2024-09-14T06:01:06.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.87994787699999999 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297209+0000", 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2486e-05 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363278+0000", 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.066068257 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363460+0000", 2024-09-14T06:01:06.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000182022 2024-09-14T06:01:06.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.227 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:06.227 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363641+0000", 2024-09-14T06:01:06.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018182199999999999 2024-09-14T06:01:06.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.227 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:06.227 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365170+0000", 2024-09-14T06:01:06.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00152838 2024-09-14T06:01:06.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.227 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365451+0000", 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028076000000000002 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365504+0000", 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3334000000000001e-05 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365612+0000", 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108384 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.228 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.229 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123248 3.15 3:a9835311:::rbd_data.112793b455a2.000000000000000d:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:06.229 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:06.229 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 6.7152622590000002, 2024-09-14T06:01:06.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.948835844, 2024-09-14T06:01:06.229 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:06.229 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:06.229 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:06.229 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:06.229 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:06.229 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:06.229 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123248 2024-09-14T06:01:06.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.230 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:06.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:06.230 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:06.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:06.230 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:06.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:06.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:06.231 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417785+0000", 2024-09-14T06:01:06.231 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.054e-06 2024-09-14T06:01:06.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.231 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:06.231 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417790+0000", 2024-09-14T06:01:06.231 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.186e-06 2024-09-14T06:01:06.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.231 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:06.231 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417806+0000", 2024-09-14T06:01:06.231 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5430999999999998e-05 2024-09-14T06:01:06.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417816+0000", 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7729999999999994e-06 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417875+0000", 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8950999999999999e-05 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417884+0000", 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4369999999999996e-06 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.233 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297235+0000", 2024-09-14T06:01:06.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.87935095699999999 2024-09-14T06:01:06.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.233 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:06.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297241+0000", 2024-09-14T06:01:06.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2790000000000004e-06 2024-09-14T06:01:06.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.233 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:06.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364231+0000", 2024-09-14T06:01:06.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.066989736 2024-09-14T06:01:06.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.234 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:06.234 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364369+0000", 2024-09-14T06:01:06.234 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000137766 2024-09-14T06:01:06.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.234 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:06.234 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364563+0000", 2024-09-14T06:01:06.234 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019418500000000001 2024-09-14T06:01:06.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:06.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365625+0000", 2024-09-14T06:01:06.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0010621000000000001 2024-09-14T06:01:06.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:06.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366188+0000", 2024-09-14T06:01:06.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00056258499999999999 2024-09-14T06:01:06.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:06.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366318+0000", 2024-09-14T06:01:06.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012983299999999999 2024-09-14T06:01:06.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:06.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:06.236 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:06.236 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366620+0000", 2024-09-14T06:01:06.236 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030257100000000001 2024-09-14T06:01:06.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.236 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:06.236 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:06.236 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:06.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:01:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:06.239 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:06.232+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:06.241 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:06.241 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:06.257 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:06.257 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:06.276 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:06.276 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:06.295 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:06.314 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:06.314 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:06.330 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2024-09-14T06:01:06.338 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:06.336+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:06.340 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:06.341 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:06.381 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:06.381 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:06.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:01:06.440 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:06.436+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:06.518 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:06.518 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:06.532 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:01:06.582 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:06.581+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:06.642 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:06.637+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:06.655 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:06.655 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:06.670 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:01:06.743 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:06.740+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:06.835 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:06.835 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:06.844 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:06.840+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:06.849 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:01:06.945 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:06.940+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:06.973 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:06.974 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:06.988 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:01:07.046 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:07.044+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:07.104 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:07.104 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:07.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:01:07.162 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:07.161+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:07.237 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:07.237 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:07.248 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:07.244+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:07.251 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:01:07.348 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:07.345+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:07.428 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:07.428 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:07.443 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:01:07.486 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:07.485+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:07.550 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:07.544+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:07.610 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:07.610 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:07.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:01:07.651 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:07.648+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:07.742 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:07.742 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:07.752 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:07.748+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:07.758 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:01:07.852 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:07.849+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:07.900 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:07.901 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:07.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:01:07.954 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:07.948+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:08.055 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:08.052+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:08.096 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:08.096 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:08.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:01:08.156 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:08.153+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:08.246 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:08.246 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:08.258 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:08.253+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:08.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:01:08.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T06:01:08.359 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:08.357+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:08.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:01:08.400 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:08.400 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:08.420 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:01:08.463 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:08.460+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:08.553 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:08.560 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:08.557+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:08.571 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:08.571 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:08.588 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:08.588 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:08.590 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:08.590 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:08.590 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:08.590 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:08.590 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.590 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119850 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 3571712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.837688375999999, 2024-09-14T06:01:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050424731, 2024-09-14T06:01:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119850 2024-09-14T06:01:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6100000000000001e-07 2024-09-14T06:01:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751247+0000", 2024-09-14T06:01:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5059999999999998e-06 2024-09-14T06:01:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751255+0000", 2024-09-14T06:01:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3080000000000008e-06 2024-09-14T06:01:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751262+0000", 2024-09-14T06:01:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1060000000000002e-06 2024-09-14T06:01:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801559+0000", 2024-09-14T06:01:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050297043 2024-09-14T06:01:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801614+0000", 2024-09-14T06:01:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5028999999999998e-05 2024-09-14T06:01:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.595 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801668+0000", 2024-09-14T06:01:08.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4178000000000002e-05 2024-09-14T06:01:08.595 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.595 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.595 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.595 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.595 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119851 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 3620864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.595 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:01:08.595 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.837659719000001, 2024-09-14T06:01:08.595 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050528479000000001, 2024-09-14T06:01:08.595 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.595 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119851 2024-09-14T06:01:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:01:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:01:08.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752502+0000", 2024-09-14T06:01:08.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012294529999999999 2024-09-14T06:01:08.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.597 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.597 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.597 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752508+0000", 2024-09-14T06:01:08.597 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8780000000000003e-06 2024-09-14T06:01:08.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752522+0000", 2024-09-14T06:01:08.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4405e-05 2024-09-14T06:01:08.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.598 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.598 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752532+0000", 2024-09-14T06:01:08.598 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6739999999999992e-06 2024-09-14T06:01:08.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.598 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801702+0000", 2024-09-14T06:01:08.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049169996000000001 2024-09-14T06:01:08.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801744+0000", 2024-09-14T06:01:08.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2789e-05 2024-09-14T06:01:08.599 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.599 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.599 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.599 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801801+0000", 2024-09-14T06:01:08.599 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6283999999999998e-05 2024-09-14T06:01:08.600 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.600 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.600 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.600 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119877 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4898816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.600 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:08.600 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.832930285, 2024-09-14T06:01:08.600 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050416282999999999, 2024-09-14T06:01:08.600 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.600 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.600 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.600 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.601 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.601 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.601 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119877 2024-09-14T06:01:08.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.601 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:08.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.601 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.601 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.601 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:08.601 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:08.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6300000000000005e-07 2024-09-14T06:01:08.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756005+0000", 2024-09-14T06:01:08.602 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7350000000000001e-06 2024-09-14T06:01:08.602 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.602 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.602 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.602 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756012+0000", 2024-09-14T06:01:08.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8990000000000004e-06 2024-09-14T06:01:08.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.603 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.603 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756017+0000", 2024-09-14T06:01:08.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.023e-06 2024-09-14T06:01:08.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.603 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.603 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806256+0000", 2024-09-14T06:01:08.603 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050239355999999999 2024-09-14T06:01:08.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806331+0000", 2024-09-14T06:01:08.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4800000000000002e-05 2024-09-14T06:01:08.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.604 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.604 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806418+0000", 2024-09-14T06:01:08.604 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6907e-05 2024-09-14T06:01:08.604 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.604 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.604 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.604 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.605 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119878 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4947968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.605 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:01:08.605 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.832905439000001, 2024-09-14T06:01:08.605 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050582539000000003, 2024-09-14T06:01:08.605 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.605 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.605 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.605 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.605 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.605 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.605 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119878 2024-09-14T06:01:08.605 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.605 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756027+0000", 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1399999999999997e-07 2024-09-14T06:01:08.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756029+0000", 2024-09-14T06:01:08.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3420000000000002e-06 2024-09-14T06:01:08.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756036+0000", 2024-09-14T06:01:08.607 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9550000000000003e-06 2024-09-14T06:01:08.607 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.607 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.607 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.607 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756041+0000", 2024-09-14T06:01:08.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2669999999999997e-06 2024-09-14T06:01:08.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806448+0000", 2024-09-14T06:01:08.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050407037000000002 2024-09-14T06:01:08.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.608 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806526+0000", 2024-09-14T06:01:08.608 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7119000000000005e-05 2024-09-14T06:01:08.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.608 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.609 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806609+0000", 2024-09-14T06:01:08.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3405000000000005e-05 2024-09-14T06:01:08.609 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.609 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.609 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.609 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.609 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119879 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4997120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.609 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:08.609 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.832882958999999, 2024-09-14T06:01:08.609 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.05075727, 2024-09-14T06:01:08.609 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.609 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.609 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.610 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.610 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.610 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.610 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119879 2024-09-14T06:01:08.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.610 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.610 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:08.610 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.610 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.610 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.610 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9400000000000001e-07 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756058+0000", 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5199999999999997e-06 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.611 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756065+0000", 2024-09-14T06:01:08.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9800000000000001e-06 2024-09-14T06:01:08.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756070+0000", 2024-09-14T06:01:08.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2360000000000004e-06 2024-09-14T06:01:08.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.612 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.612 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.612 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806639+0000", 2024-09-14T06:01:08.612 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050568702 2024-09-14T06:01:08.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806714+0000", 2024-09-14T06:01:08.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4825000000000003e-05 2024-09-14T06:01:08.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.613 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.613 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.613 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806806+0000", 2024-09-14T06:01:08.613 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2613000000000003e-05 2024-09-14T06:01:08.613 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.613 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.613 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.614 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.614 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119880 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5046272~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.614 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:08.614 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.832828259999999, 2024-09-14T06:01:08.614 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050918568999999997, 2024-09-14T06:01:08.614 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.614 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.614 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.614 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.614 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.614 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.614 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119880 2024-09-14T06:01:08.614 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.615 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:08.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.615 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:08.615 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.615 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.615 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:08.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:01:08.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756107+0000", 2024-09-14T06:01:08.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8159999999999998e-06 2024-09-14T06:01:08.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.616 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.616 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.616 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756116+0000", 2024-09-14T06:01:08.616 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4980000000000006e-06 2024-09-14T06:01:08.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756122+0000", 2024-09-14T06:01:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8809999999999998e-06 2024-09-14T06:01:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806841+0000", 2024-09-14T06:01:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050718907000000001 2024-09-14T06:01:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806927+0000", 2024-09-14T06:01:08.617 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5908999999999994e-05 2024-09-14T06:01:08.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.618 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.618 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807022+0000", 2024-09-14T06:01:08.618 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4901000000000005e-05 2024-09-14T06:01:08.618 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.618 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.618 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.618 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.618 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.618 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119881 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5095424~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.618 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:01:08.618 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.832797636999999, 2024-09-14T06:01:08.619 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051097946999999998, 2024-09-14T06:01:08.619 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.619 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.619 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.619 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.619 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.619 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.619 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119881 2024-09-14T06:01:08.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.619 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.619 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.619 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.619 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:01:08.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.620 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.620 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:01:08.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.620 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.620 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756135+0000", 2024-09-14T06:01:08.620 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.51e-07 2024-09-14T06:01:08.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.620 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756137+0000", 2024-09-14T06:01:08.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2230000000000001e-06 2024-09-14T06:01:08.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756145+0000", 2024-09-14T06:01:08.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6629999999999993e-06 2024-09-14T06:01:08.621 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.621 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.621 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.621 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756150+0000", 2024-09-14T06:01:08.621 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9150000000000004e-06 2024-09-14T06:01:08.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807054+0000", 2024-09-14T06:01:08.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050904855999999998 2024-09-14T06:01:08.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807137+0000", 2024-09-14T06:01:08.622 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2248000000000003e-05 2024-09-14T06:01:08.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.622 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.622 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.622 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807232+0000", 2024-09-14T06:01:08.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5490999999999998e-05 2024-09-14T06:01:08.623 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.623 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.623 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.623 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.623 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.623 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119882 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5144576~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.623 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:01:08.623 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.832773760999999, 2024-09-14T06:01:08.623 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051297745999999998, 2024-09-14T06:01:08.623 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.623 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.623 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.623 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119882 2024-09-14T06:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756159+0000", 2024-09-14T06:01:08.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4299999999999998e-07 2024-09-14T06:01:08.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.625 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756161+0000", 2024-09-14T06:01:08.625 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4959999999999999e-06 2024-09-14T06:01:08.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.625 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756170+0000", 2024-09-14T06:01:08.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1779999999999992e-06 2024-09-14T06:01:08.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756176+0000", 2024-09-14T06:01:08.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0090000000000004e-06 2024-09-14T06:01:08.626 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.626 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.626 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.626 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807264+0000", 2024-09-14T06:01:08.626 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051087948000000001 2024-09-14T06:01:08.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807353+0000", 2024-09-14T06:01:08.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8919999999999996e-05 2024-09-14T06:01:08.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.627 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.627 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.627 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807456+0000", 2024-09-14T06:01:08.627 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010275199999999999 2024-09-14T06:01:08.627 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.627 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.627 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119883 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5193728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.832746908000001, 2024-09-14T06:01:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051484553000000002, 2024-09-14T06:01:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119883 2024-09-14T06:01:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.629 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:08.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.629 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:08.629 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.629 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:08.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8699999999999995e-07 2024-09-14T06:01:08.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.630 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756188+0000", 2024-09-14T06:01:08.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4820000000000001e-06 2024-09-14T06:01:08.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.630 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.630 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.630 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756195+0000", 2024-09-14T06:01:08.630 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.545e-06 2024-09-14T06:01:08.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756200+0000", 2024-09-14T06:01:08.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.045e-06 2024-09-14T06:01:08.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807487+0000", 2024-09-14T06:01:08.631 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051287228999999997 2024-09-14T06:01:08.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.631 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.631 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.631 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807572+0000", 2024-09-14T06:01:08.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5303999999999995e-05 2024-09-14T06:01:08.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.632 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.632 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807670+0000", 2024-09-14T06:01:08.632 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7460999999999994e-05 2024-09-14T06:01:08.632 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.632 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.632 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.632 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.632 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.632 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119884 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5242880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.632 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:01:08.633 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.832706419000001, 2024-09-14T06:01:08.633 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051672403999999998, 2024-09-14T06:01:08.633 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.633 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.633 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.633 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.633 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.633 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.633 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119884 2024-09-14T06:01:08.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.633 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.633 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.633 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.633 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:01:08.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:01:08.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.634 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.634 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756226+0000", 2024-09-14T06:01:08.634 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7899999999999998e-07 2024-09-14T06:01:08.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.634 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756229+0000", 2024-09-14T06:01:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9919999999999999e-06 2024-09-14T06:01:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756237+0000", 2024-09-14T06:01:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1280000000000008e-06 2024-09-14T06:01:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756244+0000", 2024-09-14T06:01:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7519999999999999e-06 2024-09-14T06:01:08.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807726+0000", 2024-09-14T06:01:08.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051482344999999999 2024-09-14T06:01:08.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807808+0000", 2024-09-14T06:01:08.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1845e-05 2024-09-14T06:01:08.636 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.636 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.636 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.636 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807898+0000", 2024-09-14T06:01:08.636 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9662999999999999e-05 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119885 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5292032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.832678013999999, 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051858125999999997, 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.637 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119885 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.638 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.639 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759822+0000", 2024-09-14T06:01:08.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035676610000000002 2024-09-14T06:01:08.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.639 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.639 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759831+0000", 2024-09-14T06:01:08.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2329999999999995e-06 2024-09-14T06:01:08.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.639 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.639 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759842+0000", 2024-09-14T06:01:08.639 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0954999999999999e-05 2024-09-14T06:01:08.639 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.639 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759851+0000", 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1770000000000004e-06 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807942+0000", 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048091438 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.808027+0000", 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4227999999999994e-05 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.640 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.641 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.641 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.808112+0000", 2024-09-14T06:01:08.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5433999999999996e-05 2024-09-14T06:01:08.641 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.641 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.641 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.641 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.641 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119897 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5881856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.641 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:01:08.641 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.828873507000001, 2024-09-14T06:01:08.641 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050603113999999998, 2024-09-14T06:01:08.641 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.641 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119897 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:01:08.642 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760059+0000", 2024-09-14T06:01:08.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0800000000000001e-07 2024-09-14T06:01:08.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760060+0000", 2024-09-14T06:01:08.643 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4050000000000001e-06 2024-09-14T06:01:08.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.643 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.643 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.643 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760063+0000", 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2320000000000001e-06 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760066+0000", 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.74e-06 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810454+0000", 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050388355000000003 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.644 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810550+0000", 2024-09-14T06:01:08.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5441999999999999e-05 2024-09-14T06:01:08.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.645 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.645 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810662+0000", 2024-09-14T06:01:08.645 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011173199999999999 2024-09-14T06:01:08.645 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.645 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.645 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.645 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.645 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119898 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5931008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.645 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.828862168000001, 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050800631999999998, 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119898 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:08.646 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0900000000000001e-07 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760071+0000", 2024-09-14T06:01:08.647 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0899999999999999e-06 2024-09-14T06:01:08.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760074+0000", 2024-09-14T06:01:08.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1470000000000001e-06 2024-09-14T06:01:08.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760077+0000", 2024-09-14T06:01:08.648 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0170000000000001e-06 2024-09-14T06:01:08.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.648 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.648 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.648 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810704+0000", 2024-09-14T06:01:08.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050626811000000001 2024-09-14T06:01:08.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810779+0000", 2024-09-14T06:01:08.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4762e-05 2024-09-14T06:01:08.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.649 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.649 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.649 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810870+0000", 2024-09-14T06:01:08.649 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1595999999999995e-05 2024-09-14T06:01:08.649 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.649 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.649 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.650 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.650 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119899 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5980160~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.650 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:08.650 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.828851153999999, 2024-09-14T06:01:08.650 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051034903, 2024-09-14T06:01:08.650 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.650 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.650 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.650 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.650 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.650 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.650 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119899 2024-09-14T06:01:08.650 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:08.651 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.34e-07 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760082+0000", 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4190000000000001e-06 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760086+0000", 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2629999999999999e-06 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760088+0000", 2024-09-14T06:01:08.652 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5150000000000001e-06 2024-09-14T06:01:08.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810919+0000", 2024-09-14T06:01:08.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050831111999999998 2024-09-14T06:01:08.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811011+0000", 2024-09-14T06:01:08.653 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1339000000000001e-05 2024-09-14T06:01:08.653 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.653 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.653 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.653 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811116+0000", 2024-09-14T06:01:08.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105021 2024-09-14T06:01:08.654 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.654 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.654 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.654 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.654 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.654 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119900 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6029312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.654 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:08.654 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.828840248999999, 2024-09-14T06:01:08.654 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051299599000000001, 2024-09-14T06:01:08.654 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.654 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.654 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.655 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.655 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.655 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.655 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119900 2024-09-14T06:01:08.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.655 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.655 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.655 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:08.655 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.655 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.655 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5699999999999999e-07 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760093+0000", 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1689999999999999e-06 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.656 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760096+0000", 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.315e-06 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760101+0000", 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811162+0000", 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051061341000000003 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.657 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811271+0000", 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010851799999999999 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811391+0000", 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000120307 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119901 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6078464~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.828798728999999, 2024-09-14T06:01:08.658 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051519772999999998, 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119901 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.660 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.660 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:01:08.660 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.660 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.660 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760134+0000", 2024-09-14T06:01:08.660 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.92e-07 2024-09-14T06:01:08.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.660 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.660 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.660 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760138+0000", 2024-09-14T06:01:08.660 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3869999999999997e-06 2024-09-14T06:01:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760145+0000", 2024-09-14T06:01:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.878e-06 2024-09-14T06:01:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760151+0000", 2024-09-14T06:01:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4399999999999996e-06 2024-09-14T06:01:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.661 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811452+0000", 2024-09-14T06:01:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051301872999999998 2024-09-14T06:01:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811545+0000", 2024-09-14T06:01:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2472000000000005e-05 2024-09-14T06:01:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811653+0000", 2024-09-14T06:01:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108031 2024-09-14T06:01:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.662 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119902 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.828771344, 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051737544000000003, 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119902 2024-09-14T06:01:08.663 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.664 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0600000000000001e-07 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760163+0000", 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2850000000000001e-06 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760170+0000", 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6030000000000001e-06 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.665 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760176+0000", 2024-09-14T06:01:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6540000000000004e-06 2024-09-14T06:01:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811704+0000", 2024-09-14T06:01:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051528303999999997 2024-09-14T06:01:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811794+0000", 2024-09-14T06:01:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0142000000000005e-05 2024-09-14T06:01:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.666 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811898+0000", 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010415 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119903 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6176768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.828741681, 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051958747999999999, 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.667 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119903 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:01:08.668 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760191+0000", 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6400000000000002e-07 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760194+0000", 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7920000000000001e-06 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760203+0000", 2024-09-14T06:01:08.669 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0669999999999998e-06 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760208+0000", 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5929999999999996e-06 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811955+0000", 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051746357 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812046+0000", 2024-09-14T06:01:08.670 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1824999999999996e-05 2024-09-14T06:01:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812149+0000", 2024-09-14T06:01:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010255 2024-09-14T06:01:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119904 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6225920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:01:08.671 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.828714494, 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052164159000000002, 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119904 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760218+0000", 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2899999999999999e-07 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760220+0000", 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2879999999999999e-06 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.673 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760226+0000", 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1870000000000002e-06 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760231+0000", 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0950000000000003e-06 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812192+0000", 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051960587000000003 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.674 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812281+0000", 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9225e-05 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812382+0000", 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000100348 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119905 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6275072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:01:08.675 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 25.828692454999999, 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052394334000000001, 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119905 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760240+0000", 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760242+0000", 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0959999999999999e-06 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760249+0000", 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7399999999999998e-06 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760254+0000", 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9089999999999999e-06 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812419+0000", 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052165481 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.678 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:08.679 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812510+0000", 2024-09-14T06:01:08.679 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0525000000000005e-05 2024-09-14T06:01:08.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:08.679 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:08.679 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:08.679 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812634+0000", 2024-09-14T06:01:08.679 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012412600000000001 2024-09-14T06:01:08.679 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.679 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.679 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.679 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:08.679 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:08.679 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:08.681 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:08.681 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:01:08.681 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:08.682 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:08.682 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:08.682 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:08.682 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:08.682 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:08.683 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:08.683 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:08.676+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:08.689 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:08.690 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:08.781 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:08.776+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:08.805 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:08.806 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:08.806 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:01:08.806 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:08.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:01:08.883 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:08.881+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:08.983 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:08.981+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:08.992 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:08.992 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:08.992 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:08.992 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:08.992 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:09.006 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:01:09.084 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:09.080+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:09.136 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:09.136 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:09.136 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:09.136 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:09.136 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.136 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114684 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 999424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.136 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.036568268000003, 2024-09-14T06:01:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051769745999999998, 2024-09-14T06:01:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114684 2024-09-14T06:01:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.138 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:09.138 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.138 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.138 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:09.138 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.138 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.138 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.138 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:09.138 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3099999999999998e-07 2024-09-14T06:01:09.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.139 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.139 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.139 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097324+0000", 2024-09-14T06:01:09.139 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5019999999999999e-06 2024-09-14T06:01:09.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.139 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.139 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.139 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097333+0000", 2024-09-14T06:01:09.139 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6659999999999997e-06 2024-09-14T06:01:09.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.139 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.139 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.139 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097338+0000", 2024-09-14T06:01:09.140 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6049999999999997e-06 2024-09-14T06:01:09.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.140 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.140 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.140 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.148711+0000", 2024-09-14T06:01:09.140 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051372831000000001 2024-09-14T06:01:09.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.140 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.140 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.140 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.148787+0000", 2024-09-14T06:01:09.140 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6205999999999995e-05 2024-09-14T06:01:09.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149091+0000", 2024-09-14T06:01:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030350499999999997 2024-09-14T06:01:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114685 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1105920~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.036543518999999, 2024-09-14T06:01:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052125193, 2024-09-14T06:01:09.142 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.142 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.142 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.142 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.142 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.142 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.142 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114685 2024-09-14T06:01:09.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.142 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.142 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.142 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.142 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:09.142 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2800000000000002e-07 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097349+0000", 2024-09-14T06:01:09.143 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4310000000000001e-06 2024-09-14T06:01:09.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.144 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.144 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.144 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097357+0000", 2024-09-14T06:01:09.144 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3799999999999994e-06 2024-09-14T06:01:09.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.144 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.144 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.144 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097362+0000", 2024-09-14T06:01:09.144 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.933e-06 2024-09-14T06:01:09.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.144 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.144 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.145 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149147+0000", 2024-09-14T06:01:09.145 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051784754000000002 2024-09-14T06:01:09.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.145 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.145 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149204+0000", 2024-09-14T06:01:09.145 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7794000000000003e-05 2024-09-14T06:01:09.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.145 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.145 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149471+0000", 2024-09-14T06:01:09.145 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026647299999999998 2024-09-14T06:01:09.145 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.146 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.146 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.146 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114686 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1212416~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.146 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:09.146 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.036519253000002, 2024-09-14T06:01:09.146 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052428210000000003, 2024-09-14T06:01:09.146 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.146 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.146 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.146 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.146 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114686 2024-09-14T06:01:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.148 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.148 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:09.148 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4000000000000002e-07 2024-09-14T06:01:09.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.148 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.148 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097373+0000", 2024-09-14T06:01:09.148 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1160000000000002e-06 2024-09-14T06:01:09.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.148 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.148 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.148 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097380+0000", 2024-09-14T06:01:09.148 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8199999999999997e-06 2024-09-14T06:01:09.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.149 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.149 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097385+0000", 2024-09-14T06:01:09.149 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7609999999999998e-06 2024-09-14T06:01:09.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.149 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.149 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149501+0000", 2024-09-14T06:01:09.149 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052115941999999998 2024-09-14T06:01:09.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149559+0000", 2024-09-14T06:01:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8313999999999998e-05 2024-09-14T06:01:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149798+0000", 2024-09-14T06:01:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000238817 2024-09-14T06:01:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.150 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114687 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1318912~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:01:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.036497083, 2024-09-14T06:01:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052786364000000002, 2024-09-14T06:01:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114687 2024-09-14T06:01:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.151 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:01:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:01:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097393+0000", 2024-09-14T06:01:09.152 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6499999999999999e-07 2024-09-14T06:01:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097395+0000", 2024-09-14T06:01:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2129999999999998e-06 2024-09-14T06:01:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097403+0000", 2024-09-14T06:01:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2360000000000004e-06 2024-09-14T06:01:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.153 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097408+0000", 2024-09-14T06:01:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2460000000000003e-06 2024-09-14T06:01:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149848+0000", 2024-09-14T06:01:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052439965999999998 2024-09-14T06:01:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149919+0000", 2024-09-14T06:01:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1148000000000004e-05 2024-09-14T06:01:09.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150179+0000", 2024-09-14T06:01:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025909000000000001 2024-09-14T06:01:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114688 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1425408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.036472545000002, 2024-09-14T06:01:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053185383000000003, 2024-09-14T06:01:09.155 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114688 2024-09-14T06:01:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:09.156 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2199999999999999e-07 2024-09-14T06:01:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.157 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097419+0000", 2024-09-14T06:01:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1670000000000002e-06 2024-09-14T06:01:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097427+0000", 2024-09-14T06:01:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7819999999999994e-06 2024-09-14T06:01:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097432+0000", 2024-09-14T06:01:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:01:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150228+0000", 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052796434000000003 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150308+0000", 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9221999999999995e-05 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150602+0000", 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000294493 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.159 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114689 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1531904~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.036450207999998, 2024-09-14T06:01:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053528527999999999, 2024-09-14T06:01:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.160 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114689 2024-09-14T06:01:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1699999999999999e-07 2024-09-14T06:01:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097446+0000", 2024-09-14T06:01:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1090000000000003e-06 2024-09-14T06:01:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097454+0000", 2024-09-14T06:01:09.162 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3860000000000007e-06 2024-09-14T06:01:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097458+0000", 2024-09-14T06:01:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1919999999999998e-06 2024-09-14T06:01:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150648+0000", 2024-09-14T06:01:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053190075000000003 2024-09-14T06:01:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.163 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.164 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150705+0000", 2024-09-14T06:01:09.164 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6484000000000003e-05 2024-09-14T06:01:09.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.164 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.164 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150968+0000", 2024-09-14T06:01:09.164 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026286499999999998 2024-09-14T06:01:09.164 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.164 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.164 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.164 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114690 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1638400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.165 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:09.165 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.036424717999999, 2024-09-14T06:01:09.165 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053963677000000002, 2024-09-14T06:01:09.165 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.165 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.165 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.165 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.165 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.165 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.165 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114690 2024-09-14T06:01:09.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.165 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.165 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.166 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.166 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:09.166 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.166 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.166 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:09.166 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.166 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.166 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:09.166 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0400000000000002e-07 2024-09-14T06:01:09.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.167 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.167 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097466+0000", 2024-09-14T06:01:09.167 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4389999999999999e-06 2024-09-14T06:01:09.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.167 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.167 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097470+0000", 2024-09-14T06:01:09.167 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6540000000000001e-06 2024-09-14T06:01:09.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.167 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.167 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.167 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097474+0000", 2024-09-14T06:01:09.168 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.301e-06 2024-09-14T06:01:09.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.168 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.168 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151069+0000", 2024-09-14T06:01:09.168 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053594827999999997 2024-09-14T06:01:09.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.168 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.168 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151156+0000", 2024-09-14T06:01:09.168 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6445000000000003e-05 2024-09-14T06:01:09.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.169 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.169 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151428+0000", 2024-09-14T06:01:09.169 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000272706 2024-09-14T06:01:09.169 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.169 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.169 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.169 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114806 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.169 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:01:09.169 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.032463440999997, 2024-09-14T06:01:09.169 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051625628, 2024-09-14T06:01:09.169 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.170 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.170 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.170 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.170 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.170 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.170 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114806 2024-09-14T06:01:09.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.170 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.170 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.170 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:01:09.170 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.171 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.171 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:01:09.171 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.171 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.171 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101427+0000", 2024-09-14T06:01:09.171 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5600000000000004e-07 2024-09-14T06:01:09.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.171 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.171 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101431+0000", 2024-09-14T06:01:09.171 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5920000000000002e-06 2024-09-14T06:01:09.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.172 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.172 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101462+0000", 2024-09-14T06:01:09.172 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0607e-05 2024-09-14T06:01:09.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.172 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.172 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101470+0000", 2024-09-14T06:01:09.172 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6249999999999998e-06 2024-09-14T06:01:09.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.172 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.172 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.152670+0000", 2024-09-14T06:01:09.173 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051199972000000003 2024-09-14T06:01:09.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.173 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.173 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.152763+0000", 2024-09-14T06:01:09.173 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3274000000000002e-05 2024-09-14T06:01:09.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.173 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.173 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153051+0000", 2024-09-14T06:01:09.173 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000288602 2024-09-14T06:01:09.173 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.173 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114807 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 442368~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.032391115999999, 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051947018999999997, 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114807 2024-09-14T06:01:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.175 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.175 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.175 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:01:09.175 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.175 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.175 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:01:09.175 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.175 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.176 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101499+0000", 2024-09-14T06:01:09.176 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.23e-07 2024-09-14T06:01:09.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.176 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.176 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101505+0000", 2024-09-14T06:01:09.176 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2570000000000004e-06 2024-09-14T06:01:09.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.176 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.176 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101518+0000", 2024-09-14T06:01:09.176 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3327e-05 2024-09-14T06:01:09.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.177 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.177 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101525+0000", 2024-09-14T06:01:09.177 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7410000000000003e-06 2024-09-14T06:01:09.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.177 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.177 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153108+0000", 2024-09-14T06:01:09.177 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051582688000000002 2024-09-14T06:01:09.177 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.177 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.177 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153209+0000", 2024-09-14T06:01:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000101092 2024-09-14T06:01:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153445+0000", 2024-09-14T06:01:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023619099999999999 2024-09-14T06:01:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114808 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 548864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:09.178 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.032352692000003, 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052334951999999997, 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114808 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1600000000000001e-07 2024-09-14T06:01:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.180 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101540+0000", 2024-09-14T06:01:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.942e-06 2024-09-14T06:01:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101547+0000", 2024-09-14T06:01:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9460000000000001e-06 2024-09-14T06:01:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101552+0000", 2024-09-14T06:01:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2320000000000001e-06 2024-09-14T06:01:09.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153494+0000", 2024-09-14T06:01:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051942200000000001 2024-09-14T06:01:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153600+0000", 2024-09-14T06:01:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105886 2024-09-14T06:01:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.182 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153872+0000", 2024-09-14T06:01:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027123000000000002 2024-09-14T06:01:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114809 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 655360~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:01:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.032085269, 2024-09-14T06:01:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052491571000000001, 2024-09-14T06:01:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.183 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114809 2024-09-14T06:01:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:01:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.184 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:01:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101805+0000", 2024-09-14T06:01:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.094e-06 2024-09-14T06:01:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101810+0000", 2024-09-14T06:01:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3430000000000003e-06 2024-09-14T06:01:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101824+0000", 2024-09-14T06:01:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3081999999999999e-05 2024-09-14T06:01:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101832+0000", 2024-09-14T06:01:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6950000000000006e-06 2024-09-14T06:01:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153908+0000", 2024-09-14T06:01:09.186 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052075444999999998 2024-09-14T06:01:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153992+0000", 2024-09-14T06:01:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4829999999999999e-05 2024-09-14T06:01:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154296+0000", 2024-09-14T06:01:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030308199999999998 2024-09-14T06:01:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.187 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114810 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 761856~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:01:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.032039279999999, 2024-09-14T06:01:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052650012000000003, 2024-09-14T06:01:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.188 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114810 2024-09-14T06:01:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:01:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:01:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101851+0000", 2024-09-14T06:01:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.75e-07 2024-09-14T06:01:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101854+0000", 2024-09-14T06:01:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0620000000000001e-06 2024-09-14T06:01:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.190 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101863+0000", 2024-09-14T06:01:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5719999999999992e-06 2024-09-14T06:01:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101869+0000", 2024-09-14T06:01:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4229999999999996e-06 2024-09-14T06:01:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154350+0000", 2024-09-14T06:01:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052480991999999997 2024-09-14T06:01:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154429+0000", 2024-09-14T06:01:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9482999999999998e-05 2024-09-14T06:01:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154500+0000", 2024-09-14T06:01:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0905e-05 2024-09-14T06:01:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.192 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114811 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 868352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:01:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.032010786999997, 2024-09-14T06:01:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053080507999999998, 2024-09-14T06:01:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114811 2024-09-14T06:01:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:01:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:01:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101879+0000", 2024-09-14T06:01:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0399999999999996e-07 2024-09-14T06:01:09.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101882+0000", 2024-09-14T06:01:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6919999999999998e-06 2024-09-14T06:01:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101889+0000", 2024-09-14T06:01:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.058e-06 2024-09-14T06:01:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101894+0000", 2024-09-14T06:01:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1669999999999998e-06 2024-09-14T06:01:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154552+0000", 2024-09-14T06:01:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052658358000000002 2024-09-14T06:01:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154649+0000", 2024-09-14T06:01:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6708999999999999e-05 2024-09-14T06:01:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.196 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154959+0000", 2024-09-14T06:01:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00031001999999999999 2024-09-14T06:01:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114812 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 974848~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.031988329000001, 2024-09-14T06:01:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053474381000000001, 2024-09-14T06:01:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.197 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114812 2024-09-14T06:01:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:09.198 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.53e-07 2024-09-14T06:01:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101903+0000", 2024-09-14T06:01:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1519999999999999e-06 2024-09-14T06:01:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.199 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101909+0000", 2024-09-14T06:01:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9100000000000002e-06 2024-09-14T06:01:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101914+0000", 2024-09-14T06:01:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4240000000000003e-06 2024-09-14T06:01:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154995+0000", 2024-09-14T06:01:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053081101999999998 2024-09-14T06:01:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155085+0000", 2024-09-14T06:01:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0195e-05 2024-09-14T06:01:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155375+0000", 2024-09-14T06:01:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029024500000000001 2024-09-14T06:01:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114813 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1081344~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.031967547999997, 2024-09-14T06:01:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053887802999999998, 2024-09-14T06:01:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114813 2024-09-14T06:01:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:09.203 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.75e-07 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101924+0000", 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.244e-06 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101931+0000", 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6789999999999999e-06 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101936+0000", 2024-09-14T06:01:09.204 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2320000000000001e-06 2024-09-14T06:01:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155435+0000", 2024-09-14T06:01:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053498187000000003 2024-09-14T06:01:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155531+0000", 2024-09-14T06:01:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6386999999999997e-05 2024-09-14T06:01:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.205 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155810+0000", 2024-09-14T06:01:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027859899999999998 2024-09-14T06:01:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114814 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1187840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:01:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.031942944000001, 2024-09-14T06:01:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054301716, 2024-09-14T06:01:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.206 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114814 2024-09-14T06:01:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:01:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.207 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:01:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101947+0000", 2024-09-14T06:01:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6400000000000003e-07 2024-09-14T06:01:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101949+0000", 2024-09-14T06:01:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.396e-06 2024-09-14T06:01:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101957+0000", 2024-09-14T06:01:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5839999999999997e-06 2024-09-14T06:01:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101962+0000", 2024-09-14T06:01:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0100000000000003e-06 2024-09-14T06:01:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.209 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155858+0000", 2024-09-14T06:01:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053895862000000003 2024-09-14T06:01:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155955+0000", 2024-09-14T06:01:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7812000000000005e-05 2024-09-14T06:01:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156248+0000", 2024-09-14T06:01:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029258799999999998 2024-09-14T06:01:09.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114815 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1294336~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:01:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.031920825999997, 2024-09-14T06:01:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054641393000000003, 2024-09-14T06:01:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.211 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114815 2024-09-14T06:01:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:01:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:01:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101969+0000", 2024-09-14T06:01:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3099999999999999e-07 2024-09-14T06:01:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101971+0000", 2024-09-14T06:01:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0150000000000002e-06 2024-09-14T06:01:09.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101982+0000", 2024-09-14T06:01:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0725e-05 2024-09-14T06:01:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101987+0000", 2024-09-14T06:01:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.716e-06 2024-09-14T06:01:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.214 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156288+0000", 2024-09-14T06:01:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054301035999999997 2024-09-14T06:01:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156358+0000", 2024-09-14T06:01:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9238000000000004e-05 2024-09-14T06:01:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156610+0000", 2024-09-14T06:01:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025233200000000002 2024-09-14T06:01:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.215 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114816 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1400832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.031893373000003, 2024-09-14T06:01:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054933327999999997, 2024-09-14T06:01:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.216 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114816 2024-09-14T06:01:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8100000000000003e-07 2024-09-14T06:01:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101999+0000", 2024-09-14T06:01:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.633e-06 2024-09-14T06:01:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102008+0000", 2024-09-14T06:01:09.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4050000000000006e-06 2024-09-14T06:01:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102015+0000", 2024-09-14T06:01:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6660000000000002e-06 2024-09-14T06:01:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156644+0000", 2024-09-14T06:01:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054628942 2024-09-14T06:01:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.219 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156692+0000", 2024-09-14T06:01:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8250000000000001e-05 2024-09-14T06:01:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156929+0000", 2024-09-14T06:01:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000236951 2024-09-14T06:01:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.220 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114817 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1507328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:01:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.031848783999997, 2024-09-14T06:01:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.055317495000000001, 2024-09-14T06:01:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114817 2024-09-14T06:01:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.221 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:01:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:01:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102041+0000", 2024-09-14T06:01:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5099999999999999e-07 2024-09-14T06:01:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102045+0000", 2024-09-14T06:01:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3790000000000002e-06 2024-09-14T06:01:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102067+0000", 2024-09-14T06:01:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2844999999999999e-05 2024-09-14T06:01:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102074+0000", 2024-09-14T06:01:09.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6340000000000003e-06 2024-09-14T06:01:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156975+0000", 2024-09-14T06:01:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054900596000000003 2024-09-14T06:01:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157070+0000", 2024-09-14T06:01:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5569000000000006e-05 2024-09-14T06:01:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157358+0000", 2024-09-14T06:01:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028782100000000001 2024-09-14T06:01:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114818 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1613824~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.031482748999998, 2024-09-14T06:01:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.055293008999999997, 2024-09-14T06:01:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.225 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114818 2024-09-14T06:01:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1500000000000003e-07 2024-09-14T06:01:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102412+0000", 2024-09-14T06:01:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8860000000000003e-06 2024-09-14T06:01:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102429+0000", 2024-09-14T06:01:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7147e-05 2024-09-14T06:01:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102438+0000", 2024-09-14T06:01:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.799e-06 2024-09-14T06:01:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157387+0000", 2024-09-14T06:01:09.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054948921999999997 2024-09-14T06:01:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157452+0000", 2024-09-14T06:01:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4471e-05 2024-09-14T06:01:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157700+0000", 2024-09-14T06:01:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024796900000000001 2024-09-14T06:01:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.229 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.230 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.230 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:09.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:01:09.232 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:09.228+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:09.297 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2024-09-14T06:01:09.332 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:09.329+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:09.425 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:09.426 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:09.426 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:01:09.426 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:09.432 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:09.428+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:09.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:01:09.533 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:09.529+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:09.613 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:09.614 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:09.614 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:09.614 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:09.614 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:09.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:01:09.634 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:09.629+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:09.735 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:09.733+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:09.753 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:09.753 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:09.753 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:09.753 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3629 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'31, mlcod=31'25)", 2024-09-14T06:01:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 112.421231554, 2024-09-14T06:01:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048071900000000002, 2024-09-14T06:01:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329483+0000", 2024-09-14T06:01:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-07 2024-09-14T06:01:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329488+0000", 2024-09-14T06:01:09.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000004e-06 2024-09-14T06:01:09.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329496+0000", 2024-09-14T06:01:09.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2209999999999997e-06 2024-09-14T06:01:09.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329501+0000", 2024-09-14T06:01:09.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8729999999999998e-06 2024-09-14T06:01:09.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329545+0000", 2024-09-14T06:01:09.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4382999999999998e-05 2024-09-14T06:01:09.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329564+0000", 2024-09-14T06:01:09.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8947999999999999e-05 2024-09-14T06:01:09.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.757 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.757 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334225+0000", 2024-09-14T06:01:09.758 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004660923 2024-09-14T06:01:09.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.758 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.758 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334289+0000", 2024-09-14T06:01:09.758 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4041999999999994e-05 2024-09-14T06:01:09.758 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.758 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.758 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.758 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3632 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'34, mlcod=31'27)", 2024-09-14T06:01:09.758 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:09.759 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 112.418109366, 2024-09-14T06:01:09.759 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047983469999999997, 2024-09-14T06:01:09.759 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.759 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.759 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.759 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.759 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.759 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:09.759 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.759 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:09.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332605+0000", 2024-09-14T06:01:09.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5099999999999999e-07 2024-09-14T06:01:09.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332611+0000", 2024-09-14T06:01:09.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6999999999999996e-06 2024-09-14T06:01:09.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332623+0000", 2024-09-14T06:01:09.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2401e-05 2024-09-14T06:01:09.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332629+0000", 2024-09-14T06:01:09.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3720000000000001e-06 2024-09-14T06:01:09.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332691+0000", 2024-09-14T06:01:09.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1451000000000005e-05 2024-09-14T06:01:09.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332711+0000", 2024-09-14T06:01:09.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0285e-05 2024-09-14T06:01:09.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337341+0000", 2024-09-14T06:01:09.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046295900000000003 2024-09-14T06:01:09.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337402+0000", 2024-09-14T06:01:09.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1797000000000005e-05 2024-09-14T06:01:09.765 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.765 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.765 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.766 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3638 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'40, mlcod=31'32)", 2024-09-14T06:01:09.766 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:09.766 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 112.411967451, 2024-09-14T06:01:09.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004283345, 2024-09-14T06:01:09.766 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.766 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.766 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.766 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:09.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:09.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338747+0000", 2024-09-14T06:01:09.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:01:09.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338756+0000", 2024-09-14T06:01:09.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5909999999999996e-06 2024-09-14T06:01:09.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.768 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.768 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338774+0000", 2024-09-14T06:01:09.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8073000000000001e-05 2024-09-14T06:01:09.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.768 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.768 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338785+0000", 2024-09-14T06:01:09.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1017e-05 2024-09-14T06:01:09.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338844+0000", 2024-09-14T06:01:09.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9292000000000001e-05 2024-09-14T06:01:09.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338864+0000", 2024-09-14T06:01:09.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9528999999999999e-05 2024-09-14T06:01:09.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.769 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.769 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.342984+0000", 2024-09-14T06:01:09.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041207809999999996 2024-09-14T06:01:09.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.770 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.770 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.343029+0000", 2024-09-14T06:01:09.770 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5034000000000003e-05 2024-09-14T06:01:09.770 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.770 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.770 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.770 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:17596 3.4 e41/24 3:27f62511:::rbd_data.1127d65075f9.00000000000000ca:head v 41'97, mlcod=41'95)", 2024-09-14T06:01:09.770 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:09.771 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 99.780214887, 2024-09-14T06:01:09.771 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049456559999999997, 2024-09-14T06:01:09.771 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.771 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.771 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.771 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.771 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:09.771 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.772 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:09.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.772 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.772 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970500+0000", 2024-09-14T06:01:09.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9600000000000008e-07 2024-09-14T06:01:09.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.772 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.772 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970614+0000", 2024-09-14T06:01:09.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000113956 2024-09-14T06:01:09.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970631+0000", 2024-09-14T06:01:09.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7150999999999999e-05 2024-09-14T06:01:09.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970643+0000", 2024-09-14T06:01:09.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1868999999999999e-05 2024-09-14T06:01:09.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970711+0000", 2024-09-14T06:01:09.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8952e-05 2024-09-14T06:01:09.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970738+0000", 2024-09-14T06:01:09.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6055999999999999e-05 2024-09-14T06:01:09.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975388+0000", 2024-09-14T06:01:09.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046502499999999999 2024-09-14T06:01:09.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.775 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975444+0000", 2024-09-14T06:01:09.775 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6425999999999998e-05 2024-09-14T06:01:09.775 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.775 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.775 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.775 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24289 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'57, mlcod=41'54)", 2024-09-14T06:01:09.775 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:09.775 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 97.594922707999999, 2024-09-14T06:01:09.775 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.060867738999999997, 2024-09-14T06:01:09.775 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.775 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.776 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.776 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.776 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.776 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:09.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.776 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.776 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:09.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.776 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.777 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155793+0000", 2024-09-14T06:01:09.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9470000000000002e-06 2024-09-14T06:01:09.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.777 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.777 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181776+0000", 2024-09-14T06:01:09.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.02598313 2024-09-14T06:01:09.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.777 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.777 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181817+0000", 2024-09-14T06:01:09.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1440000000000003e-05 2024-09-14T06:01:09.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181834+0000", 2024-09-14T06:01:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6979000000000001e-05 2024-09-14T06:01:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181931+0000", 2024-09-14T06:01:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7219999999999994e-05 2024-09-14T06:01:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181964+0000", 2024-09-14T06:01:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2094999999999997e-05 2024-09-14T06:01:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216586+0000", 2024-09-14T06:01:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034622503999999998 2024-09-14T06:01:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216658+0000", 2024-09-14T06:01:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2423999999999996e-05 2024-09-14T06:01:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.779 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24309 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'58, mlcod=41'56)", 2024-09-14T06:01:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 97.495687602999993, 2024-09-14T06:01:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044435519999999999, 2024-09-14T06:01:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.780 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:09.781 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.781 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.781 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:09.781 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.781 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.781 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255027+0000", 2024-09-14T06:01:09.781 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T06:01:09.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255040+0000", 2024-09-14T06:01:09.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2773e-05 2024-09-14T06:01:09.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255066+0000", 2024-09-14T06:01:09.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5459000000000001e-05 2024-09-14T06:01:09.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255076+0000", 2024-09-14T06:01:09.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0372e-05 2024-09-14T06:01:09.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255151+0000", 2024-09-14T06:01:09.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5444999999999993e-05 2024-09-14T06:01:09.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255176+0000", 2024-09-14T06:01:09.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5089e-05 2024-09-14T06:01:09.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259379+0000", 2024-09-14T06:01:09.784 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042025439999999999 2024-09-14T06:01:09.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.784 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.784 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259469+0000", 2024-09-14T06:01:09.784 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0407000000000004e-05 2024-09-14T06:01:09.784 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.784 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.784 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.784 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37361 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'280, mlcod=50'278)", 2024-09-14T06:01:09.784 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:09.785 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 85.709527344999998, 2024-09-14T06:01:09.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075534590000000002, 2024-09-14T06:01:09.785 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.785 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.785 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.785 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.785 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.785 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:09.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.785 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:09.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041187+0000", 2024-09-14T06:01:09.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2160000000000001e-06 2024-09-14T06:01:09.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041208+0000", 2024-09-14T06:01:09.786 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0528999999999999e-05 2024-09-14T06:01:09.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041225+0000", 2024-09-14T06:01:09.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7255e-05 2024-09-14T06:01:09.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041235+0000", 2024-09-14T06:01:09.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4190000000000008e-06 2024-09-14T06:01:09.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041302+0000", 2024-09-14T06:01:09.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7774000000000005e-05 2024-09-14T06:01:09.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.788 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041330+0000", 2024-09-14T06:01:09.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7382999999999999e-05 2024-09-14T06:01:09.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.788 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048686+0000", 2024-09-14T06:01:09.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073564570000000003 2024-09-14T06:01:09.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.789 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048740+0000", 2024-09-14T06:01:09.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3426e-05 2024-09-14T06:01:09.789 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.789 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.789 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.789 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37362 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'281, mlcod=50'278)", 2024-09-14T06:01:09.789 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:09.789 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 85.704626946000005, 2024-09-14T06:01:09.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047169380000000004, 2024-09-14T06:01:09.790 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.790 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.790 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.790 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.790 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.790 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:09.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.790 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.790 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:09.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046087+0000", 2024-09-14T06:01:09.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3600000000000003e-07 2024-09-14T06:01:09.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046093+0000", 2024-09-14T06:01:09.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7869999999999998e-06 2024-09-14T06:01:09.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046106+0000", 2024-09-14T06:01:09.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2636999999999999e-05 2024-09-14T06:01:09.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046113+0000", 2024-09-14T06:01:09.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0129999999999996e-06 2024-09-14T06:01:09.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046170+0000", 2024-09-14T06:01:09.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7819000000000003e-05 2024-09-14T06:01:09.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046194+0000", 2024-09-14T06:01:09.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3167999999999999e-05 2024-09-14T06:01:09.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050760+0000", 2024-09-14T06:01:09.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045665999999999997 2024-09-14T06:01:09.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050803+0000", 2024-09-14T06:01:09.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3177999999999999e-05 2024-09-14T06:01:09.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.794 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.794 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39545 3.0 e50/24 3:06bdaf45:::rbd_data.112781171282.0000000000000002:head v 50'347, mlcod=50'345)", 2024-09-14T06:01:09.794 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:09.794 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 85.172246663999999, 2024-09-14T06:01:09.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047008700000000002, 2024-09-14T06:01:09.794 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.794 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.794 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:09.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:09.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578468+0000", 2024-09-14T06:01:09.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1599999999999999e-06 2024-09-14T06:01:09.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579733+0000", 2024-09-14T06:01:09.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012647120000000001 2024-09-14T06:01:09.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579755+0000", 2024-09-14T06:01:09.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2637999999999999e-05 2024-09-14T06:01:09.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579766+0000", 2024-09-14T06:01:09.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0264e-05 2024-09-14T06:01:09.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.797 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579832+0000", 2024-09-14T06:01:09.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6531000000000004e-05 2024-09-14T06:01:09.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.797 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579859+0000", 2024-09-14T06:01:09.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6855999999999998e-05 2024-09-14T06:01:09.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.798 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583098+0000", 2024-09-14T06:01:09.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003238632 2024-09-14T06:01:09.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.798 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583168+0000", 2024-09-14T06:01:09.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0077e-05 2024-09-14T06:01:09.798 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.798 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.798 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.799 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39765 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'410, mlcod=51'406)", 2024-09-14T06:01:09.799 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:09.799 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.746291862999996, 2024-09-14T06:01:09.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044953839999999998, 2024-09-14T06:01:09.799 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.799 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.799 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.799 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.799 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.799 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:09.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:09.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004423+0000", 2024-09-14T06:01:09.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1909999999999999e-06 2024-09-14T06:01:09.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004432+0000", 2024-09-14T06:01:09.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2180000000000005e-06 2024-09-14T06:01:09.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004453+0000", 2024-09-14T06:01:09.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1182000000000001e-05 2024-09-14T06:01:09.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004464+0000", 2024-09-14T06:01:09.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1198e-05 2024-09-14T06:01:09.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004520+0000", 2024-09-14T06:01:09.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5835999999999999e-05 2024-09-14T06:01:09.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004547+0000", 2024-09-14T06:01:09.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6454000000000001e-05 2024-09-14T06:01:09.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008866+0000", 2024-09-14T06:01:09.803 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043194679999999999 2024-09-14T06:01:09.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.803 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.803 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008917+0000", 2024-09-14T06:01:09.803 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0837000000000001e-05 2024-09-14T06:01:09.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.803 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.803 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.803 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39847 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'431, mlcod=51'426)", 2024-09-14T06:01:09.804 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:09.804 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.633008513999997, 2024-09-14T06:01:09.804 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046358010000000002, 2024-09-14T06:01:09.804 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.804 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.804 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.804 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.804 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.804 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:09.804 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.804 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:09.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117706+0000", 2024-09-14T06:01:09.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4899999999999995e-07 2024-09-14T06:01:09.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.805 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.805 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.805 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117711+0000", 2024-09-14T06:01:09.805 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6890000000000001e-06 2024-09-14T06:01:09.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.806 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.806 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117724+0000", 2024-09-14T06:01:09.806 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3054000000000001e-05 2024-09-14T06:01:09.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.806 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.806 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117736+0000", 2024-09-14T06:01:09.806 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1654999999999999e-05 2024-09-14T06:01:09.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.806 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.807 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.807 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117788+0000", 2024-09-14T06:01:09.807 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2197000000000002e-05 2024-09-14T06:01:09.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.807 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.807 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117811+0000", 2024-09-14T06:01:09.807 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2472000000000001e-05 2024-09-14T06:01:09.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.807 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.807 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.807 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122292+0000", 2024-09-14T06:01:09.807 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004481596 2024-09-14T06:01:09.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.808 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.808 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122341+0000", 2024-09-14T06:01:09.808 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8489000000000003e-05 2024-09-14T06:01:09.808 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.808 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.808 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.808 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.808 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39865 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'438, mlcod=51'434)", 2024-09-14T06:01:09.808 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:09.808 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.605674215999997, 2024-09-14T06:01:09.808 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004519426, 2024-09-14T06:01:09.809 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.809 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.809 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.809 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.809 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:09.809 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.809 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.809 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.809 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:09.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.810 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.810 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145040+0000", 2024-09-14T06:01:09.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7899999999999998e-07 2024-09-14T06:01:09.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.810 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.810 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.810 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145044+0000", 2024-09-14T06:01:09.810 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3789999999999999e-06 2024-09-14T06:01:09.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.811 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145053+0000", 2024-09-14T06:01:09.811 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2650000000000002e-06 2024-09-14T06:01:09.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.811 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145058+0000", 2024-09-14T06:01:09.811 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8169999999999998e-06 2024-09-14T06:01:09.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.811 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.811 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.811 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145105+0000", 2024-09-14T06:01:09.812 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7176999999999999e-05 2024-09-14T06:01:09.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.812 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.812 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145119+0000", 2024-09-14T06:01:09.812 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3179e-05 2024-09-14T06:01:09.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.812 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.812 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149512+0000", 2024-09-14T06:01:09.812 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043934389999999999 2024-09-14T06:01:09.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.812 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.813 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.813 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149559+0000", 2024-09-14T06:01:09.813 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6591000000000002e-05 2024-09-14T06:01:09.813 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.813 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.813 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.813 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.813 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40245 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'513, mlcod=52'509)", 2024-09-14T06:01:09.813 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:09.813 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 83.827122188000004, 2024-09-14T06:01:09.813 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053460410000000002, 2024-09-14T06:01:09.813 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.813 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.814 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.814 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:09.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.814 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:09.814 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.814 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.814 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.815 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923592+0000", 2024-09-14T06:01:09.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6599999999999996e-07 2024-09-14T06:01:09.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.815 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.815 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923598+0000", 2024-09-14T06:01:09.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.083e-06 2024-09-14T06:01:09.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.815 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.815 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923609+0000", 2024-09-14T06:01:09.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1137e-05 2024-09-14T06:01:09.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.816 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.816 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923617+0000", 2024-09-14T06:01:09.816 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.401e-06 2024-09-14T06:01:09.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.816 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.816 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924037+0000", 2024-09-14T06:01:09.816 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042046 2024-09-14T06:01:09.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.816 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.816 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.816 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924082+0000", 2024-09-14T06:01:09.817 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4617000000000003e-05 2024-09-14T06:01:09.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.817 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.817 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928882+0000", 2024-09-14T06:01:09.817 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048000889999999996 2024-09-14T06:01:09.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.817 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.817 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928937+0000", 2024-09-14T06:01:09.817 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5587999999999997e-05 2024-09-14T06:01:09.817 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.817 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.818 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.818 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40246 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'514, mlcod=52'509)", 2024-09-14T06:01:09.818 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:09.818 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 83.826087673000004, 2024-09-14T06:01:09.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043609649999999996, 2024-09-14T06:01:09.818 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.818 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.818 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.818 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.818 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.818 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:09.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.819 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.819 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:09.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.819 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.819 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:09.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2099999999999996e-07 2024-09-14T06:01:09.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.820 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.820 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924631+0000", 2024-09-14T06:01:09.820 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8450000000000002e-06 2024-09-14T06:01:09.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.820 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.820 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924641+0000", 2024-09-14T06:01:09.820 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0057e-05 2024-09-14T06:01:09.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.820 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.820 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924649+0000", 2024-09-14T06:01:09.820 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5669999999999997e-06 2024-09-14T06:01:09.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.821 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.821 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925127+0000", 2024-09-14T06:01:09.821 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00047783800000000001 2024-09-14T06:01:09.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.821 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.821 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925171+0000", 2024-09-14T06:01:09.821 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4017000000000002e-05 2024-09-14T06:01:09.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.821 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.822 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928942+0000", 2024-09-14T06:01:09.822 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037716809999999998 2024-09-14T06:01:09.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.822 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.822 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928987+0000", 2024-09-14T06:01:09.822 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4338999999999997e-05 2024-09-14T06:01:09.822 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.822 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.822 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.822 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:46646 3.0 e56/24 3:01acbe3d:::rbd_data.1127f2f8ff9b.0000000000000015:head v 56'541, mlcod=55'538)", 2024-09-14T06:01:09.822 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:09.823 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 79.289301402999996, 2024-09-14T06:01:09.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064775850000000001, 2024-09-14T06:01:09.823 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.823 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.823 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.823 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.823 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:09.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:09.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.824 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461415+0000", 2024-09-14T06:01:09.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.666e-06 2024-09-14T06:01:09.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.824 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463456+0000", 2024-09-14T06:01:09.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00204177 2024-09-14T06:01:09.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.825 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.825 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463488+0000", 2024-09-14T06:01:09.825 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1503e-05 2024-09-14T06:01:09.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.825 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.825 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463508+0000", 2024-09-14T06:01:09.825 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9788000000000001e-05 2024-09-14T06:01:09.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.825 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.825 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463697+0000", 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018873499999999999 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463741+0000", 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4333999999999999e-05 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467845+0000", 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041041430000000002 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.826 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467890+0000", 2024-09-14T06:01:09.827 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4645999999999999e-05 2024-09-14T06:01:09.827 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.827 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.827 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.827 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:89402 3.0 e84/24 3:03c9b195:::rbd_data.11271f4525c9.00000000000001ae:head v 84'849, mlcod=83'847)", 2024-09-14T06:01:09.827 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:09.827 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 43.120400666999998, 2024-09-14T06:01:09.827 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0051764460000000003, 2024-09-14T06:01:09.827 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.827 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.828 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.828 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.828 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.828 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:09.828 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.828 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.828 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:09.828 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.829 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.829 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:09.829 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8299999999999997e-07 2024-09-14T06:01:09.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.829 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.829 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.829 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630321+0000", 2024-09-14T06:01:09.829 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6070000000000002e-06 2024-09-14T06:01:09.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.829 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.829 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.829 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630349+0000", 2024-09-14T06:01:09.829 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7696e-05 2024-09-14T06:01:09.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.830 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.830 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630364+0000", 2024-09-14T06:01:09.830 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4856e-05 2024-09-14T06:01:09.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.830 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.830 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630507+0000", 2024-09-14T06:01:09.830 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014309899999999999 2024-09-14T06:01:09.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.831 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.831 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630573+0000", 2024-09-14T06:01:09.831 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6126999999999999e-05 2024-09-14T06:01:09.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.831 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.831 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.635358+0000", 2024-09-14T06:01:09.831 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047853879999999998 2024-09-14T06:01:09.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.831 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.831 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.635489+0000", 2024-09-14T06:01:09.831 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013108999999999999 2024-09-14T06:01:09.832 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.832 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.832 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.832 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.832 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:106809 3.9 e93/24 3:96c4c4a7:::rbd_data.1127189bfb31.000000000000000a:head v 93'304, mlcod=92'302)", 2024-09-14T06:01:09.832 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:09.832 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 33.697041609000003, 2024-09-14T06:01:09.832 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0092272799999999992, 2024-09-14T06:01:09.832 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.832 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.832 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.833 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.833 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.833 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:09.833 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.833 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.833 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:09.833 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.833 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.834 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053673+0000", 2024-09-14T06:01:09.834 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.522e-06 2024-09-14T06:01:09.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.834 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.834 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.834 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056791+0000", 2024-09-14T06:01:09.834 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031181310000000001 2024-09-14T06:01:09.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.834 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.834 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.834 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056814+0000", 2024-09-14T06:01:09.834 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2473999999999999e-05 2024-09-14T06:01:09.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.835 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.835 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.835 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056825+0000", 2024-09-14T06:01:09.835 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.059e-05 2024-09-14T06:01:09.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.835 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.835 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.835 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056898+0000", 2024-09-14T06:01:09.835 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2992999999999997e-05 2024-09-14T06:01:09.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.835 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.835 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.835 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056918+0000", 2024-09-14T06:01:09.836 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0809999999999999e-05 2024-09-14T06:01:09.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.836 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.836 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.836 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.062810+0000", 2024-09-14T06:01:09.836 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0058916460000000004 2024-09-14T06:01:09.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.836 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.836 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.836 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.062899+0000", 2024-09-14T06:01:09.836 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9114000000000001e-05 2024-09-14T06:01:09.836 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.837 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.837 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.837 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:106810 3.9 e93/24 3:96c4c4a7:::rbd_data.1127189bfb31.000000000000000a:head v 93'306, mlcod=92'302)", 2024-09-14T06:01:09.837 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:09.837 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 33.693719454000004, 2024-09-14T06:01:09.837 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0060457269999999999, 2024-09-14T06:01:09.837 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.837 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.837 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.837 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.838 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.838 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:09.838 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.838 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.838 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.838 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:09.838 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.838 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.838 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.838 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056995+0000", 2024-09-14T06:01:09.838 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8199999999999999e-07 2024-09-14T06:01:09.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.839 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.839 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057001+0000", 2024-09-14T06:01:09.839 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2060000000000004e-06 2024-09-14T06:01:09.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.839 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.839 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057011+0000", 2024-09-14T06:01:09.839 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8369999999999992e-06 2024-09-14T06:01:09.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.839 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.840 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057018+0000", 2024-09-14T06:01:09.840 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9e-06 2024-09-14T06:01:09.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.840 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.840 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.059980+0000", 2024-09-14T06:01:09.840 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029624500000000002 2024-09-14T06:01:09.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.840 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.840 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.060002+0000", 2024-09-14T06:01:09.840 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2299000000000001e-05 2024-09-14T06:01:09.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.063000+0000", 2024-09-14T06:01:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029974170000000001 2024-09-14T06:01:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.063040+0000", 2024-09-14T06:01:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9836000000000003e-05 2024-09-14T06:01:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:114889 3.0 e93/24 3:072a82e8:::rbd_data.1127cb09e343.0000000000000009:head v 93'915, mlcod=92'913)", 2024-09-14T06:01:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.462828+0000", 2024-09-14T06:01:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 32.287885342000003, 2024-09-14T06:01:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041683099999999997, 2024-09-14T06:01:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.462828+0000", 2024-09-14T06:01:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.843 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.843 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.462828+0000", 2024-09-14T06:01:09.843 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.843 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.843 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.462830+0000", 2024-09-14T06:01:09.843 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0930000000000001e-06 2024-09-14T06:01:09.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.843 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.843 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463643+0000", 2024-09-14T06:01:09.843 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00081271700000000002 2024-09-14T06:01:09.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.844 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.844 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463677+0000", 2024-09-14T06:01:09.844 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4329000000000003e-05 2024-09-14T06:01:09.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.844 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.844 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463693+0000", 2024-09-14T06:01:09.844 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5713e-05 2024-09-14T06:01:09.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.844 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.844 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463858+0000", 2024-09-14T06:01:09.845 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000164749 2024-09-14T06:01:09.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.845 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.845 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.845 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463928+0000", 2024-09-14T06:01:09.845 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0646000000000001e-05 2024-09-14T06:01:09.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.845 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.845 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.845 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.466860+0000", 2024-09-14T06:01:09.845 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029313970000000001 2024-09-14T06:01:09.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.846 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.846 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.466996+0000", 2024-09-14T06:01:09.846 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000136666 2024-09-14T06:01:09.846 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.846 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.846 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.846 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:119911 3.0 e99/24 3:067b0149:::rbd_data.1127206dd91f.0000000000000002:head v 99'930, mlcod=97'928)", 2024-09-14T06:01:09.846 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:09.846 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 26.92797363, 2024-09-14T06:01:09.846 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049905519999999997, 2024-09-14T06:01:09.846 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:09.847 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:09.847 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:09.847 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:09.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.847 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:09.847 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:09.847 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.847 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:09.847 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:09.847 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:09.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.848 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:09.848 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822741+0000", 2024-09-14T06:01:09.848 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.054e-06 2024-09-14T06:01:09.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.848 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:09.848 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824085+0000", 2024-09-14T06:01:09.848 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001343693 2024-09-14T06:01:09.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.848 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:09.848 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824114+0000", 2024-09-14T06:01:09.848 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9013000000000002e-05 2024-09-14T06:01:09.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:09.849 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824127+0000", 2024-09-14T06:01:09.849 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3869000000000001e-05 2024-09-14T06:01:09.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:09.849 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824222+0000", 2024-09-14T06:01:09.849 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4616000000000003e-05 2024-09-14T06:01:09.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824247+0000", 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5205999999999999e-05 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.827664+0000", 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0034165530000000001 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.827730+0000", 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6548e-05 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.850 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.851 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:09.851 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:09.851 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:09.852 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:01:09.853 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:09.848+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:09.953 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:09.949+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:10.032 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:10.032 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:10.032 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:01:10.033 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:10.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:01:10.053 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:10.049+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:10.154 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:10.148+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:10.171 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:10.171 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:10.171 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:10.172 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:10.172 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:10.186 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:01:10.275 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:10.272+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:10.353 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-14T06:01:10.353 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T06:01:10.353 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-14T06:01:10.354 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T06:01:10.354 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T06:01:10.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-14T06:01:10.355 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:10.353+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:10.370 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54659 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 616448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:10.370 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.226689754000006, 2024-09-14T06:01:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092177035000000004, 2024-09-14T06:01:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54659 2024-09-14T06:01:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139718+0000", 2024-09-14T06:01:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9699999999999996e-07 2024-09-14T06:01:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139731+0000", 2024-09-14T06:01:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2993000000000001e-05 2024-09-14T06:01:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139738+0000", 2024-09-14T06:01:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4610000000000002e-06 2024-09-14T06:01:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139744+0000", 2024-09-14T06:01:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6389999999999997e-06 2024-09-14T06:01:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231570+0000", 2024-09-14T06:01:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091826216000000002 2024-09-14T06:01:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231662+0000", 2024-09-14T06:01:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2101000000000005e-05 2024-09-14T06:01:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231894+0000", 2024-09-14T06:01:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023212800000000001 2024-09-14T06:01:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54660 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 622592~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.226654420000003, 2024-09-14T06:01:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092366887999999994, 2024-09-14T06:01:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.377 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54660 2024-09-14T06:01:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T06:01:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139755+0000", 2024-09-14T06:01:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T06:01:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139762+0000", 2024-09-14T06:01:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6719999999999998e-06 2024-09-14T06:01:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139767+0000", 2024-09-14T06:01:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9819999999999999e-06 2024-09-14T06:01:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231917+0000", 2024-09-14T06:01:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092149872999999993 2024-09-14T06:01:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231969+0000", 2024-09-14T06:01:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2642000000000002e-05 2024-09-14T06:01:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232120+0000", 2024-09-14T06:01:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015011899999999999 2024-09-14T06:01:10.381 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54844 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 0~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.226632929000004, 2024-09-14T06:01:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092708507999999995, 2024-09-14T06:01:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.382 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54844 2024-09-14T06:01:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139775+0000", 2024-09-14T06:01:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3500000000000002e-07 2024-09-14T06:01:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139777+0000", 2024-09-14T06:01:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.979e-06 2024-09-14T06:01:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139787+0000", 2024-09-14T06:01:10.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0779e-05 2024-09-14T06:01:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139799+0000", 2024-09-14T06:01:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1719000000000001e-05 2024-09-14T06:01:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232151+0000", 2024-09-14T06:01:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092351767000000001 2024-09-14T06:01:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232217+0000", 2024-09-14T06:01:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6655000000000005e-05 2024-09-14T06:01:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232483+0000", 2024-09-14T06:01:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026517400000000002 2024-09-14T06:01:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.386 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54845 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 55296~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.226599257999993, 2024-09-14T06:01:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093127583999999999, 2024-09-14T06:01:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.387 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54845 2024-09-14T06:01:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4899999999999995e-07 2024-09-14T06:01:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139811+0000", 2024-09-14T06:01:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000001e-06 2024-09-14T06:01:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139821+0000", 2024-09-14T06:01:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0168e-05 2024-09-14T06:01:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139826+0000", 2024-09-14T06:01:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2780000000000001e-06 2024-09-14T06:01:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232556+0000", 2024-09-14T06:01:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092729729999999996 2024-09-14T06:01:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232652+0000", 2024-09-14T06:01:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680999999999994e-05 2024-09-14T06:01:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232935+0000", 2024-09-14T06:01:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000283758 2024-09-14T06:01:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.391 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54846 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.226572950999994, 2024-09-14T06:01:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093492079000000006, 2024-09-14T06:01:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54846 2024-09-14T06:01:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139835+0000", 2024-09-14T06:01:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T06:01:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139837+0000", 2024-09-14T06:01:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1059999999999998e-06 2024-09-14T06:01:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139845+0000", 2024-09-14T06:01:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4300000000000006e-06 2024-09-14T06:01:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139851+0000", 2024-09-14T06:01:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T06:01:10.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232987+0000", 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093136073999999999 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233075+0000", 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7318999999999995e-05 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233326+0000", 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025159 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.395 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54847 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 67584~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.226547234999998, 2024-09-14T06:01:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093777452999999997, 2024-09-14T06:01:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.396 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54847 2024-09-14T06:01:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T06:01:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139862+0000", 2024-09-14T06:01:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0200000000000001e-06 2024-09-14T06:01:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139870+0000", 2024-09-14T06:01:10.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0520000000000002e-06 2024-09-14T06:01:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139875+0000", 2024-09-14T06:01:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:01:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233389+0000", 2024-09-14T06:01:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093514054999999999 2024-09-14T06:01:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233443+0000", 2024-09-14T06:01:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3913999999999999e-05 2024-09-14T06:01:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233637+0000", 2024-09-14T06:01:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019392899999999999 2024-09-14T06:01:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.400 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54848 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 73728~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.226524139000006, 2024-09-14T06:01:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094064464, 2024-09-14T06:01:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54848 2024-09-14T06:01:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T06:01:10.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139885+0000", 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9929999999999998e-06 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139893+0000", 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9759999999999995e-06 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139898+0000", 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6059999999999996e-06 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233681+0000", 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093782921000000005 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233730+0000", 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9410999999999998e-05 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233947+0000", 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021710300000000001 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.404 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54849 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.226500682999998, 2024-09-14T06:01:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094499257000000003, 2024-09-14T06:01:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.405 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54849 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.406 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139907+0000", 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139909+0000", 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139916+0000", 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139921+0000", 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234032+0000", 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094111037999999994 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234150+0000", 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118408 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234406+0000", 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025540600000000001 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54850 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 135168~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.226478975000006, 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094814605999999996, 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.409 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54850 2024-09-14T06:01:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139929+0000", 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139931+0000", 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.024e-06 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139937+0000", 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3770000000000001e-06 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139942+0000", 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0289999999999996e-06 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234447+0000", 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094505426000000003 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234539+0000", 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1793999999999996e-05 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234743+0000", 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020354600000000001 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54851 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 141312~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.226457263, 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095179749999999994, 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.413 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54851 2024-09-14T06:01:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:01:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139952+0000", 2024-09-14T06:01:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0600000000000002e-06 2024-09-14T06:01:10.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139959+0000", 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.584e-06 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139964+0000", 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8890000000000001e-06 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234786+0000", 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094822241000000002 2024-09-14T06:01:10.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234877+0000", 2024-09-14T06:01:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1158999999999999e-05 2024-09-14T06:01:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235130+0000", 2024-09-14T06:01:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025235999999999998 2024-09-14T06:01:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54852 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 147456~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.226436135, 2024-09-14T06:01:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095437742000000006, 2024-09-14T06:01:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54852 2024-09-14T06:01:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140125+0000", 2024-09-14T06:01:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154332 2024-09-14T06:01:10.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140130+0000", 2024-09-14T06:01:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.284e-06 2024-09-14T06:01:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140140+0000", 2024-09-14T06:01:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0789e-05 2024-09-14T06:01:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140147+0000", 2024-09-14T06:01:10.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9879999999999998e-06 2024-09-14T06:01:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235174+0000", 2024-09-14T06:01:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095026749999999993 2024-09-14T06:01:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235230+0000", 2024-09-14T06:01:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6224000000000002e-05 2024-09-14T06:01:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235409+0000", 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017837500000000001 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54853 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 202752~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.226247313000002, 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095632919999999996, 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.422 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54853 2024-09-14T06:01:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.423 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147748+0000", 2024-09-14T06:01:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075884910000000002 2024-09-14T06:01:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147798+0000", 2024-09-14T06:01:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0152999999999999e-05 2024-09-14T06:01:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.424 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147814+0000", 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5866e-05 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147831+0000", 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6991999999999999e-05 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235451+0000", 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087620077000000005 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.425 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235539+0000", 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7800000000000006e-05 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235793+0000", 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025354099999999998 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54870 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 503808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.426 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.218001766, 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092420756000000007, 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54870 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148406+0000", 2024-09-14T06:01:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T06:01:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148409+0000", 2024-09-14T06:01:10.428 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T06:01:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148418+0000", 2024-09-14T06:01:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7329999999999998e-06 2024-09-14T06:01:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148425+0000", 2024-09-14T06:01:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2079999999999997e-06 2024-09-14T06:01:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.429 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240591+0000", 2024-09-14T06:01:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092166441000000002 2024-09-14T06:01:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240648+0000", 2024-09-14T06:01:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6733e-05 2024-09-14T06:01:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240826+0000", 2024-09-14T06:01:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017834700000000001 2024-09-14T06:01:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.430 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54871 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 509952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.217971805999994, 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092702341999999993, 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54871 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.431 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148436+0000", 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5499999999999998e-07 2024-09-14T06:01:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148439+0000", 2024-09-14T06:01:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8090000000000001e-06 2024-09-14T06:01:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148449+0000", 2024-09-14T06:01:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0115000000000001e-05 2024-09-14T06:01:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.433 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148466+0000", 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6761000000000001e-05 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240857+0000", 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092391089999999995 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240939+0000", 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2387999999999998e-05 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.434 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241138+0000", 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000198624 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54872 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 516096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 76.217930608000003, 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093126020000000004, 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.435 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54872 2024-09-14T06:01:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155484+0000", 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070072429999999998 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155490+0000", 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6379999999999998e-06 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155504+0000", 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4065e-05 2024-09-14T06:01:10.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155513+0000", 2024-09-14T06:01:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6799999999999999e-06 2024-09-14T06:01:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241216+0000", 2024-09-14T06:01:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085702922000000001 2024-09-14T06:01:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241277+0000", 2024-09-14T06:01:10.438 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0980000000000002e-05 2024-09-14T06:01:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241602+0000", 2024-09-14T06:01:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032549199999999998 2024-09-14T06:01:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123238 3.7 3.c0662d67 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 10.951458938, 2024-09-14T06:01:10.439 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88300249500000005, 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123238 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.440 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414949+0000", 2024-09-14T06:01:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8899999999999998e-07 2024-09-14T06:01:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414953+0000", 2024-09-14T06:01:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1439999999999996e-06 2024-09-14T06:01:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414974+0000", 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0630000000000001e-05 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414982+0000", 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9840000000000001e-06 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415051+0000", 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9787000000000001e-05 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.442 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415062+0000", 2024-09-14T06:01:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0674e-05 2024-09-14T06:01:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297935+0000", 2024-09-14T06:01:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88287307400000004 2024-09-14T06:01:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297951+0000", 2024-09-14T06:01:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5413e-05 2024-09-14T06:01:10.443 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123240 3.15 3:a806c175:::rbd_data.112793b455a2.0000000000000005:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 10.951403223, 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.950432851, 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.444 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123240 2024-09-14T06:01:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.445 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3399999999999999e-07 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415008+0000", 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6090000000000001e-06 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415017+0000", 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0100000000000001e-06 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.446 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415025+0000", 2024-09-14T06:01:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9109999999999993e-06 2024-09-14T06:01:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415114+0000", 2024-09-14T06:01:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9086999999999996e-05 2024-09-14T06:01:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415132+0000", 2024-09-14T06:01:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7405e-05 2024-09-14T06:01:10.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297130+0000", 2024-09-14T06:01:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88199837000000003 2024-09-14T06:01:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297152+0000", 2024-09-14T06:01:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2103000000000002e-05 2024-09-14T06:01:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.448 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361290+0000", 2024-09-14T06:01:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.064138091 2024-09-14T06:01:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361714+0000", 2024-09-14T06:01:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042403999999999999 2024-09-14T06:01:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361955+0000", 2024-09-14T06:01:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000240981 2024-09-14T06:01:10.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365095+0000", 2024-09-14T06:01:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031403960000000002 2024-09-14T06:01:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365192+0000", 2024-09-14T06:01:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6976000000000001e-05 2024-09-14T06:01:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:10.450 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365274+0000", 2024-09-14T06:01:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1293999999999998e-05 2024-09-14T06:01:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365437+0000", 2024-09-14T06:01:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016294399999999999 2024-09-14T06:01:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123244 3.7 3.d0cc8287 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:10.451 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 10.951357720000001, 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88296528100000005, 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123244 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:10.452 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415050+0000", 2024-09-14T06:01:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1500000000000004e-07 2024-09-14T06:01:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.453 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415053+0000", 2024-09-14T06:01:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1219999999999999e-06 2024-09-14T06:01:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415065+0000", 2024-09-14T06:01:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1549000000000001e-05 2024-09-14T06:01:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415071+0000", 2024-09-14T06:01:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4359999999999999e-06 2024-09-14T06:01:10.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415133+0000", 2024-09-14T06:01:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2249999999999995e-05 2024-09-14T06:01:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415141+0000", 2024-09-14T06:01:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5480000000000004e-06 2024-09-14T06:01:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.298007+0000", 2024-09-14T06:01:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88286582199999997 2024-09-14T06:01:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.298015+0000", 2024-09-14T06:01:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8390000000000007e-06 2024-09-14T06:01:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123245 3.15 3:ae492430:::rbd_data.112793b455a2.000000000000000a:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:10.456 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 10.949290068, 2024-09-14T06:01:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9484952870000001, 2024-09-14T06:01:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123245 2024-09-14T06:01:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.457 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417118+0000", 2024-09-14T06:01:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0189999999999999e-06 2024-09-14T06:01:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.458 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417123+0000", 2024-09-14T06:01:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7380000000000002e-06 2024-09-14T06:01:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417137+0000", 2024-09-14T06:01:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4538999999999999e-05 2024-09-14T06:01:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417146+0000", 2024-09-14T06:01:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3669999999999997e-06 2024-09-14T06:01:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.459 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417236+0000", 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9976999999999996e-05 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417249+0000", 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3325e-05 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297197+0000", 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.87994787699999999 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.460 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297209+0000", 2024-09-14T06:01:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2486e-05 2024-09-14T06:01:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363278+0000", 2024-09-14T06:01:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.066068257 2024-09-14T06:01:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.461 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363460+0000", 2024-09-14T06:01:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000182022 2024-09-14T06:01:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363641+0000", 2024-09-14T06:01:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018182199999999999 2024-09-14T06:01:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365170+0000", 2024-09-14T06:01:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00152838 2024-09-14T06:01:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.462 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365451+0000", 2024-09-14T06:01:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028076000000000002 2024-09-14T06:01:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365504+0000", 2024-09-14T06:01:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3334000000000001e-05 2024-09-14T06:01:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365612+0000", 2024-09-14T06:01:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108384 2024-09-14T06:01:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.463 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123248 3.15 3:a9835311:::rbd_data.112793b455a2.000000000000000d:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 10.948622843999999, 2024-09-14T06:01:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.948835844, 2024-09-14T06:01:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:10.464 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123248 2024-09-14T06:01:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.465 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417785+0000", 2024-09-14T06:01:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.054e-06 2024-09-14T06:01:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417790+0000", 2024-09-14T06:01:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.186e-06 2024-09-14T06:01:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417806+0000", 2024-09-14T06:01:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5430999999999998e-05 2024-09-14T06:01:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417816+0000", 2024-09-14T06:01:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7729999999999994e-06 2024-09-14T06:01:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417875+0000", 2024-09-14T06:01:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8950999999999999e-05 2024-09-14T06:01:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417884+0000", 2024-09-14T06:01:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4369999999999996e-06 2024-09-14T06:01:10.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297235+0000", 2024-09-14T06:01:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.87935095699999999 2024-09-14T06:01:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297241+0000", 2024-09-14T06:01:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2790000000000004e-06 2024-09-14T06:01:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364231+0000", 2024-09-14T06:01:10.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.066989736 2024-09-14T06:01:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364369+0000", 2024-09-14T06:01:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000137766 2024-09-14T06:01:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364563+0000", 2024-09-14T06:01:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019418500000000001 2024-09-14T06:01:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365625+0000", 2024-09-14T06:01:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0010621000000000001 2024-09-14T06:01:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366188+0000", 2024-09-14T06:01:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00056258499999999999 2024-09-14T06:01:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366318+0000", 2024-09-14T06:01:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012983299999999999 2024-09-14T06:01:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:10.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366620+0000", 2024-09-14T06:01:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030257100000000001 2024-09-14T06:01:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:10.471 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:10.471 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:10.473 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:01:10.473 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:10.468+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:10.483 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:10.483 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "" 2024-09-14T06:01:10.484 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:10.573 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:10.569+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:10.600 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:10.600 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:10.600 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:10.600 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:10.617 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:01:10.674 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:10.668+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:10.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:01:10.774 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:10.773+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:10.790 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:10.791 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:10.791 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:10.791 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:10.791 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:10.808 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:01:10.894 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:10.892+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:10.900 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:10.900 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:10.920 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:10.937 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:10.937 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:10.954 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:10.955 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:10.975 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:10.975 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:10.975 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:10.972+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:10.995 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:10.995 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:10.995 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:10.996 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:11.012 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:01:11.017 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:11.018 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:11.036 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:11.103 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:11.100+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:11.176 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:11.172+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:11.187 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:11.187 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:11.202 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:01:11.278 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:11.272+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:11.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T06:01:11.338 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:11.339 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:11.355 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:01:11.378 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:11.376+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:11.479 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:11.476+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:11.481 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:11.481 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:11.497 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:01:11.580 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:11.576+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:11.671 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:11.671 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:11.681 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:11.676+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:11.686 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:01:11.783 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:11.780+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:11.804 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:11.804 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:11.818 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:01:11.884 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:11.880+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:11.942 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:11.942 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:11.956 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:01:12.002 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:12.000+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:12.079 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:12.079 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:12.086 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:12.080+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:12.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:01:12.187 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:12.184+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:12.257 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:12.258 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:12.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:01:12.299 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2024-09-14T06:01:12.318 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:12.316+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:12.389 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:12.384+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:12.407 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:12.407 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:12.422 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:01:12.490 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:12.488+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:12.562 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:12.562 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:12.576 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:01:12.591 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:12.588+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:12.692 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:12.688+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:12.699 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:12.699 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:12.713 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:01:12.793 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:12.788+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:12.876 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:12.876 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:12.890 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:01:12.893 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:12.888+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:12.994 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:12.988+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:13.010 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:13.010 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:13.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:01:13.056 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:01:13.111 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:13.108+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:13.193 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:13.194 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:13.194 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:13.192+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:13.208 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:01:13.211 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:13.211 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:13.228 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:13.228 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:13.245 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:13.245 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:13.261 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:13.282 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:13.296 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:13.292+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:13.304 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:13.304 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:13.330 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:13.330 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:13.335 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114684 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 999424~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.235942616999999, 2024-09-14T06:01:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051769745999999998, 2024-09-14T06:01:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.335 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114684 2024-09-14T06:01:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.336 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097321+0000", 2024-09-14T06:01:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3099999999999998e-07 2024-09-14T06:01:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097324+0000", 2024-09-14T06:01:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5019999999999999e-06 2024-09-14T06:01:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097333+0000", 2024-09-14T06:01:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6659999999999997e-06 2024-09-14T06:01:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097338+0000", 2024-09-14T06:01:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6049999999999997e-06 2024-09-14T06:01:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.148711+0000", 2024-09-14T06:01:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051372831000000001 2024-09-14T06:01:13.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.148787+0000", 2024-09-14T06:01:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6205999999999995e-05 2024-09-14T06:01:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149091+0000", 2024-09-14T06:01:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030350499999999997 2024-09-14T06:01:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114685 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1105920~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.235917868000001, 2024-09-14T06:01:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052125193, 2024-09-14T06:01:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114685 2024-09-14T06:01:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.340 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097346+0000", 2024-09-14T06:01:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2800000000000002e-07 2024-09-14T06:01:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097349+0000", 2024-09-14T06:01:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4310000000000001e-06 2024-09-14T06:01:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097357+0000", 2024-09-14T06:01:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3799999999999994e-06 2024-09-14T06:01:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097362+0000", 2024-09-14T06:01:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.933e-06 2024-09-14T06:01:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149147+0000", 2024-09-14T06:01:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051784754000000002 2024-09-14T06:01:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149204+0000", 2024-09-14T06:01:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7794000000000003e-05 2024-09-14T06:01:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149471+0000", 2024-09-14T06:01:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026647299999999998 2024-09-14T06:01:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114686 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1212416~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.235893601999997, 2024-09-14T06:01:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052428210000000003, 2024-09-14T06:01:13.344 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114686 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097370+0000", 2024-09-14T06:01:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4000000000000002e-07 2024-09-14T06:01:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097373+0000", 2024-09-14T06:01:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1160000000000002e-06 2024-09-14T06:01:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097380+0000", 2024-09-14T06:01:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8199999999999997e-06 2024-09-14T06:01:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097385+0000", 2024-09-14T06:01:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7609999999999998e-06 2024-09-14T06:01:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149501+0000", 2024-09-14T06:01:13.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052115941999999998 2024-09-14T06:01:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149559+0000", 2024-09-14T06:01:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8313999999999998e-05 2024-09-14T06:01:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149798+0000", 2024-09-14T06:01:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000238817 2024-09-14T06:01:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114687 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1318912~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:01:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.235871432000003, 2024-09-14T06:01:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052786364000000002, 2024-09-14T06:01:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114687 2024-09-14T06:01:13.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:01:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097392+0000", 2024-09-14T06:01:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097393+0000", 2024-09-14T06:01:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6499999999999999e-07 2024-09-14T06:01:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097395+0000", 2024-09-14T06:01:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2129999999999998e-06 2024-09-14T06:01:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097403+0000", 2024-09-14T06:01:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2360000000000004e-06 2024-09-14T06:01:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097408+0000", 2024-09-14T06:01:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2460000000000003e-06 2024-09-14T06:01:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149848+0000", 2024-09-14T06:01:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052439965999999998 2024-09-14T06:01:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.149919+0000", 2024-09-14T06:01:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1148000000000004e-05 2024-09-14T06:01:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150179+0000", 2024-09-14T06:01:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025909000000000001 2024-09-14T06:01:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114688 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1425408~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.235846893999998, 2024-09-14T06:01:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053185383000000003, 2024-09-14T06:01:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.353 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114688 2024-09-14T06:01:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097417+0000", 2024-09-14T06:01:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2199999999999999e-07 2024-09-14T06:01:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097419+0000", 2024-09-14T06:01:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1670000000000002e-06 2024-09-14T06:01:13.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097427+0000", 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7819999999999994e-06 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097432+0000", 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150228+0000", 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052796434000000003 2024-09-14T06:01:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150308+0000", 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9221999999999995e-05 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150602+0000", 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000294493 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114689 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1531904~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.235824557000001, 2024-09-14T06:01:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053528527999999999, 2024-09-14T06:01:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114689 2024-09-14T06:01:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.358 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097439+0000", 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1699999999999999e-07 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097446+0000", 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1090000000000003e-06 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097454+0000", 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3860000000000007e-06 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097458+0000", 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1919999999999998e-06 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150648+0000", 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053190075000000003 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150705+0000", 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6484000000000003e-05 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.150968+0000", 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026286499999999998 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.361 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114690 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1638400~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.235799067000002, 2024-09-14T06:01:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053963677000000002, 2024-09-14T06:01:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.362 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114690 2024-09-14T06:01:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097465+0000", 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0400000000000002e-07 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097466+0000", 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4389999999999999e-06 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097470+0000", 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6540000000000001e-06 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.097474+0000", 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.301e-06 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151069+0000", 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053594827999999997 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151156+0000", 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6445000000000003e-05 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.151428+0000", 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000272706 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114806 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.23183779, 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051625628, 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.366 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114806 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101426+0000", 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101427+0000", 2024-09-14T06:01:13.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5600000000000004e-07 2024-09-14T06:01:13.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101431+0000", 2024-09-14T06:01:13.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5920000000000002e-06 2024-09-14T06:01:13.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101462+0000", 2024-09-14T06:01:13.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0607e-05 2024-09-14T06:01:13.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101470+0000", 2024-09-14T06:01:13.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6249999999999998e-06 2024-09-14T06:01:13.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.152670+0000", 2024-09-14T06:01:13.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051199972000000003 2024-09-14T06:01:13.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.152763+0000", 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.3274000000000002e-05 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153051+0000", 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000288602 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114807 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 442368~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.231765465000002, 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051947018999999997, 2024-09-14T06:01:13.370 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114807 2024-09-14T06:01:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:01:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101498+0000", 2024-09-14T06:01:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101499+0000", 2024-09-14T06:01:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.23e-07 2024-09-14T06:01:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.372 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101505+0000", 2024-09-14T06:01:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2570000000000004e-06 2024-09-14T06:01:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101518+0000", 2024-09-14T06:01:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3327e-05 2024-09-14T06:01:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101525+0000", 2024-09-14T06:01:13.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7410000000000003e-06 2024-09-14T06:01:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153108+0000", 2024-09-14T06:01:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051582688000000002 2024-09-14T06:01:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153209+0000", 2024-09-14T06:01:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000101092 2024-09-14T06:01:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153445+0000", 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023619099999999999 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114808 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 548864~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.231727040999999, 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052334951999999997, 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.375 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114808 2024-09-14T06:01:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101537+0000", 2024-09-14T06:01:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1600000000000001e-07 2024-09-14T06:01:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101540+0000", 2024-09-14T06:01:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.942e-06 2024-09-14T06:01:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101547+0000", 2024-09-14T06:01:13.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9460000000000001e-06 2024-09-14T06:01:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101552+0000", 2024-09-14T06:01:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2320000000000001e-06 2024-09-14T06:01:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153494+0000", 2024-09-14T06:01:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051942200000000001 2024-09-14T06:01:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153600+0000", 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105886 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153872+0000", 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027123000000000002 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114809 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 655360~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:01:13.379 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.231459618000002, 2024-09-14T06:01:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052491571000000001, 2024-09-14T06:01:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114809 2024-09-14T06:01:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101804+0000", 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101805+0000", 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.094e-06 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101810+0000", 2024-09-14T06:01:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3430000000000003e-06 2024-09-14T06:01:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101824+0000", 2024-09-14T06:01:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3081999999999999e-05 2024-09-14T06:01:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101832+0000", 2024-09-14T06:01:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6950000000000006e-06 2024-09-14T06:01:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153908+0000", 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052075444999999998 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.153992+0000", 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4829999999999999e-05 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154296+0000", 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030308199999999998 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114810 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 761856~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:01:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.231413629000002, 2024-09-14T06:01:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052650012000000003, 2024-09-14T06:01:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.384 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114810 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101850+0000", 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101851+0000", 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.75e-07 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101854+0000", 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0620000000000001e-06 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101863+0000", 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5719999999999992e-06 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101869+0000", 2024-09-14T06:01:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4229999999999996e-06 2024-09-14T06:01:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154350+0000", 2024-09-14T06:01:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052480991999999997 2024-09-14T06:01:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154429+0000", 2024-09-14T06:01:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9482999999999998e-05 2024-09-14T06:01:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154500+0000", 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0905e-05 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114811 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 868352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.231385136, 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053080507999999998, 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114811 2024-09-14T06:01:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:01:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101878+0000", 2024-09-14T06:01:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101879+0000", 2024-09-14T06:01:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0399999999999996e-07 2024-09-14T06:01:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101882+0000", 2024-09-14T06:01:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6919999999999998e-06 2024-09-14T06:01:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101889+0000", 2024-09-14T06:01:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.058e-06 2024-09-14T06:01:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101894+0000", 2024-09-14T06:01:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.1669999999999998e-06 2024-09-14T06:01:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154552+0000", 2024-09-14T06:01:13.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052658358000000002 2024-09-14T06:01:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154649+0000", 2024-09-14T06:01:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6708999999999999e-05 2024-09-14T06:01:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154959+0000", 2024-09-14T06:01:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00031001999999999999 2024-09-14T06:01:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114812 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 974848~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.231362677999996, 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053474381000000001, 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114812 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101901+0000", 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.53e-07 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101903+0000", 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1519999999999999e-06 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101909+0000", 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9100000000000002e-06 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101914+0000", 2024-09-14T06:01:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4240000000000003e-06 2024-09-14T06:01:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.154995+0000", 2024-09-14T06:01:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053081101999999998 2024-09-14T06:01:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155085+0000", 2024-09-14T06:01:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0195e-05 2024-09-14T06:01:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155375+0000", 2024-09-14T06:01:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029024500000000001 2024-09-14T06:01:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114813 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1081344~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.231341897, 2024-09-14T06:01:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053887802999999998, 2024-09-14T06:01:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.397 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114813 2024-09-14T06:01:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101922+0000", 2024-09-14T06:01:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.75e-07 2024-09-14T06:01:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101924+0000", 2024-09-14T06:01:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.244e-06 2024-09-14T06:01:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101931+0000", 2024-09-14T06:01:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6789999999999999e-06 2024-09-14T06:01:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101936+0000", 2024-09-14T06:01:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2320000000000001e-06 2024-09-14T06:01:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155435+0000", 2024-09-14T06:01:13.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053498187000000003 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155531+0000", 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6386999999999997e-05 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155810+0000", 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00027859899999999998 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114814 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1187840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:01:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.231317292999996, 2024-09-14T06:01:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054301716, 2024-09-14T06:01:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114814 2024-09-14T06:01:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101946+0000", 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101947+0000", 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6400000000000003e-07 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101949+0000", 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.396e-06 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101957+0000", 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5839999999999997e-06 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101962+0000", 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0100000000000003e-06 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155858+0000", 2024-09-14T06:01:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.053895862000000003 2024-09-14T06:01:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.155955+0000", 2024-09-14T06:01:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7812000000000005e-05 2024-09-14T06:01:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156248+0000", 2024-09-14T06:01:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00029258799999999998 2024-09-14T06:01:13.405 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114815 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1294336~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:01:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.231295175, 2024-09-14T06:01:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054641393000000003, 2024-09-14T06:01:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.406 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114815 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101968+0000", 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101969+0000", 2024-09-14T06:01:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3099999999999999e-07 2024-09-14T06:01:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101971+0000", 2024-09-14T06:01:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0150000000000002e-06 2024-09-14T06:01:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101982+0000", 2024-09-14T06:01:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0725e-05 2024-09-14T06:01:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101987+0000", 2024-09-14T06:01:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.716e-06 2024-09-14T06:01:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156288+0000", 2024-09-14T06:01:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054301035999999997 2024-09-14T06:01:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156358+0000", 2024-09-14T06:01:13.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9238000000000004e-05 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156610+0000", 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025233200000000002 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114816 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1400832~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.231267721999998, 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054933327999999997, 2024-09-14T06:01:13.410 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114816 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101996+0000", 2024-09-14T06:01:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8100000000000003e-07 2024-09-14T06:01:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.101999+0000", 2024-09-14T06:01:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.633e-06 2024-09-14T06:01:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102008+0000", 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4050000000000006e-06 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102015+0000", 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6660000000000002e-06 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156644+0000", 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054628942 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.413 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156692+0000", 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8250000000000001e-05 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156929+0000", 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000236951 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114817 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1507328~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.414 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:01:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.231223133, 2024-09-14T06:01:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.055317495000000001, 2024-09-14T06:01:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114817 2024-09-14T06:01:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.415 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102040+0000", 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102041+0000", 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5099999999999999e-07 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.416 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102045+0000", 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.3790000000000002e-06 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102067+0000", 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2844999999999999e-05 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102074+0000", 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6340000000000003e-06 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.417 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.156975+0000", 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054900596000000003 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157070+0000", 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5569000000000006e-05 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157358+0000", 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028782100000000001 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.418 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:114818 3.19 3:9af2f11f:::rbd_data.1127189bfb31.0000000000000004:26 [read 1613824~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.230857098000001, 2024-09-14T06:01:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.055293008999999997, 2024-09-14T06:01:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:13.419 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 114818 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.420 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102407+0000", 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1500000000000003e-07 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102412+0000", 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8860000000000003e-06 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102429+0000", 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7147e-05 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.421 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.102438+0000", 2024-09-14T06:01:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.799e-06 2024-09-14T06:01:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157387+0000", 2024-09-14T06:01:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.054948921999999997 2024-09-14T06:01:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157452+0000", 2024-09-14T06:01:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4471e-05 2024-09-14T06:01:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.422 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.423 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.157700+0000", 2024-09-14T06:01:13.423 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00024796900000000001 2024-09-14T06:01:13.423 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.423 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.423 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.423 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.423 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.423 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:13.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:01:13.425 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:13.425 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:13.426 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:13.420+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:13.525 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:13.520+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:13.602 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:13.602 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:13.602 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:01:13.602 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:13.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:01:13.663 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:13.660+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:13.727 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:13.724+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:13.740 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:13.741 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:13.741 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:13.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:01:13.843 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:13.840+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:13.928 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:13.924+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:13.931 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:13.931 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:13.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:13.931 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:13.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.931 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3629 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'31, mlcod=31'25)", 2024-09-14T06:01:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 116.599752791, 2024-09-14T06:01:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048071900000000002, 2024-09-14T06:01:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329483+0000", 2024-09-14T06:01:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-07 2024-09-14T06:01:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329488+0000", 2024-09-14T06:01:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000004e-06 2024-09-14T06:01:13.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329496+0000", 2024-09-14T06:01:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2209999999999997e-06 2024-09-14T06:01:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329501+0000", 2024-09-14T06:01:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8729999999999998e-06 2024-09-14T06:01:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329545+0000", 2024-09-14T06:01:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4382999999999998e-05 2024-09-14T06:01:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329564+0000", 2024-09-14T06:01:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8947999999999999e-05 2024-09-14T06:01:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334225+0000", 2024-09-14T06:01:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004660923 2024-09-14T06:01:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334289+0000", 2024-09-14T06:01:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4041999999999994e-05 2024-09-14T06:01:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3632 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'34, mlcod=31'27)", 2024-09-14T06:01:13.936 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 116.59663060299999, 2024-09-14T06:01:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047983469999999997, 2024-09-14T06:01:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332605+0000", 2024-09-14T06:01:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5099999999999999e-07 2024-09-14T06:01:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332611+0000", 2024-09-14T06:01:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6999999999999996e-06 2024-09-14T06:01:13.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332623+0000", 2024-09-14T06:01:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2401e-05 2024-09-14T06:01:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332629+0000", 2024-09-14T06:01:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3720000000000001e-06 2024-09-14T06:01:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332691+0000", 2024-09-14T06:01:13.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1451000000000005e-05 2024-09-14T06:01:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332711+0000", 2024-09-14T06:01:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0285e-05 2024-09-14T06:01:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337341+0000", 2024-09-14T06:01:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046295900000000003 2024-09-14T06:01:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337402+0000", 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1797000000000005e-05 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3638 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'40, mlcod=31'32)", 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 116.59048868799999, 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004283345, 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338747+0000", 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338756+0000", 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5909999999999996e-06 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338774+0000", 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8073000000000001e-05 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338785+0000", 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1017e-05 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338844+0000", 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9292000000000001e-05 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338864+0000", 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9528999999999999e-05 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.342984+0000", 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041207809999999996 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.343029+0000", 2024-09-14T06:01:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5034000000000003e-05 2024-09-14T06:01:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:17596 3.4 e41/24 3:27f62511:::rbd_data.1127d65075f9.00000000000000ca:head v 41'97, mlcod=41'95)", 2024-09-14T06:01:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 103.958736124, 2024-09-14T06:01:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049456559999999997, 2024-09-14T06:01:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.945 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970500+0000", 2024-09-14T06:01:13.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9600000000000008e-07 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970614+0000", 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000113956 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970631+0000", 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7150999999999999e-05 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970643+0000", 2024-09-14T06:01:13.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1868999999999999e-05 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970711+0000", 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8952e-05 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970738+0000", 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6055999999999999e-05 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975388+0000", 2024-09-14T06:01:13.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046502499999999999 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975444+0000", 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6425999999999998e-05 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24289 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'57, mlcod=41'54)", 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 101.773443945, 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.060867738999999997, 2024-09-14T06:01:13.949 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155793+0000", 2024-09-14T06:01:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9470000000000002e-06 2024-09-14T06:01:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181776+0000", 2024-09-14T06:01:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.02598313 2024-09-14T06:01:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181817+0000", 2024-09-14T06:01:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1440000000000003e-05 2024-09-14T06:01:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181834+0000", 2024-09-14T06:01:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6979000000000001e-05 2024-09-14T06:01:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181931+0000", 2024-09-14T06:01:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7219999999999994e-05 2024-09-14T06:01:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181964+0000", 2024-09-14T06:01:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2094999999999997e-05 2024-09-14T06:01:13.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216586+0000", 2024-09-14T06:01:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034622503999999998 2024-09-14T06:01:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216658+0000", 2024-09-14T06:01:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2423999999999996e-05 2024-09-14T06:01:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24309 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'58, mlcod=41'56)", 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 101.67420884000001, 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044435519999999999, 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.954 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255027+0000", 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255040+0000", 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2773e-05 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.955 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255066+0000", 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5459000000000001e-05 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255076+0000", 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0372e-05 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255151+0000", 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5444999999999993e-05 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255176+0000", 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5089e-05 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259379+0000", 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042025439999999999 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259469+0000", 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0407000000000004e-05 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37361 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'280, mlcod=50'278)", 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 89.888048581999996, 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075534590000000002, 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041187+0000", 2024-09-14T06:01:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2160000000000001e-06 2024-09-14T06:01:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041208+0000", 2024-09-14T06:01:13.959 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0528999999999999e-05 2024-09-14T06:01:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041225+0000", 2024-09-14T06:01:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7255e-05 2024-09-14T06:01:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041235+0000", 2024-09-14T06:01:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4190000000000008e-06 2024-09-14T06:01:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.960 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041302+0000", 2024-09-14T06:01:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7774000000000005e-05 2024-09-14T06:01:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041330+0000", 2024-09-14T06:01:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7382999999999999e-05 2024-09-14T06:01:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048686+0000", 2024-09-14T06:01:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073564570000000003 2024-09-14T06:01:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.961 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048740+0000", 2024-09-14T06:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3426e-05 2024-09-14T06:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37362 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'281, mlcod=50'278)", 2024-09-14T06:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 89.883148183000003, 2024-09-14T06:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047169380000000004, 2024-09-14T06:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.962 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046087+0000", 2024-09-14T06:01:13.963 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3600000000000003e-07 2024-09-14T06:01:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046093+0000", 2024-09-14T06:01:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7869999999999998e-06 2024-09-14T06:01:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046106+0000", 2024-09-14T06:01:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2636999999999999e-05 2024-09-14T06:01:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.964 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046113+0000", 2024-09-14T06:01:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0129999999999996e-06 2024-09-14T06:01:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046170+0000", 2024-09-14T06:01:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7819000000000003e-05 2024-09-14T06:01:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046194+0000", 2024-09-14T06:01:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3167999999999999e-05 2024-09-14T06:01:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.965 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050760+0000", 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045665999999999997 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050803+0000", 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3177999999999999e-05 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39545 3.0 e50/24 3:06bdaf45:::rbd_data.112781171282.0000000000000002:head v 50'347, mlcod=50'345)", 2024-09-14T06:01:13.966 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 89.350767900999998, 2024-09-14T06:01:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047008700000000002, 2024-09-14T06:01:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.967 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578468+0000", 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1599999999999999e-06 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579733+0000", 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012647120000000001 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.968 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579755+0000", 2024-09-14T06:01:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2637999999999999e-05 2024-09-14T06:01:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579766+0000", 2024-09-14T06:01:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0264e-05 2024-09-14T06:01:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579832+0000", 2024-09-14T06:01:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6531000000000004e-05 2024-09-14T06:01:13.969 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579859+0000", 2024-09-14T06:01:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6855999999999998e-05 2024-09-14T06:01:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583098+0000", 2024-09-14T06:01:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003238632 2024-09-14T06:01:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.970 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583168+0000", 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0077e-05 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39765 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'410, mlcod=51'406)", 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.924813099999994, 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044953839999999998, 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.971 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004423+0000", 2024-09-14T06:01:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1909999999999999e-06 2024-09-14T06:01:13.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004432+0000", 2024-09-14T06:01:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2180000000000005e-06 2024-09-14T06:01:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004453+0000", 2024-09-14T06:01:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1182000000000001e-05 2024-09-14T06:01:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.973 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004464+0000", 2024-09-14T06:01:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1198e-05 2024-09-14T06:01:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004520+0000", 2024-09-14T06:01:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5835999999999999e-05 2024-09-14T06:01:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004547+0000", 2024-09-14T06:01:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6454000000000001e-05 2024-09-14T06:01:13.974 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008866+0000", 2024-09-14T06:01:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043194679999999999 2024-09-14T06:01:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008917+0000", 2024-09-14T06:01:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0837000000000001e-05 2024-09-14T06:01:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.975 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39847 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'431, mlcod=51'426)", 2024-09-14T06:01:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.811529750999995, 2024-09-14T06:01:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046358010000000002, 2024-09-14T06:01:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117706+0000", 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4899999999999995e-07 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117711+0000", 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6890000000000001e-06 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.977 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117724+0000", 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3054000000000001e-05 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117736+0000", 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1654999999999999e-05 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117788+0000", 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2197000000000002e-05 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.978 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117811+0000", 2024-09-14T06:01:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2472000000000001e-05 2024-09-14T06:01:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122292+0000", 2024-09-14T06:01:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004481596 2024-09-14T06:01:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122341+0000", 2024-09-14T06:01:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8489000000000003e-05 2024-09-14T06:01:13.979 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39865 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'438, mlcod=51'434)", 2024-09-14T06:01:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.784195452999995, 2024-09-14T06:01:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004519426, 2024-09-14T06:01:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.980 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145040+0000", 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7899999999999998e-07 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.981 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145044+0000", 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3789999999999999e-06 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145053+0000", 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2650000000000002e-06 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145058+0000", 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8169999999999998e-06 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.982 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145105+0000", 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7176999999999999e-05 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145119+0000", 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3179e-05 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149512+0000", 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043934389999999999 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.983 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149559+0000", 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6591000000000002e-05 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40245 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'513, mlcod=52'509)", 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.005643425000002, 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053460410000000002, 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923592+0000", 2024-09-14T06:01:13.985 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6599999999999996e-07 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923598+0000", 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.083e-06 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923609+0000", 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1137e-05 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923617+0000", 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.401e-06 2024-09-14T06:01:13.986 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924037+0000", 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042046 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924082+0000", 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4617000000000003e-05 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928882+0000", 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048000889999999996 2024-09-14T06:01:13.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928937+0000", 2024-09-14T06:01:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5587999999999997e-05 2024-09-14T06:01:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40246 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'514, mlcod=52'509)", 2024-09-14T06:01:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.004608910000002, 2024-09-14T06:01:13.988 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043609649999999996, 2024-09-14T06:01:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2099999999999996e-07 2024-09-14T06:01:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924631+0000", 2024-09-14T06:01:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8450000000000002e-06 2024-09-14T06:01:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924641+0000", 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0057e-05 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924649+0000", 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5669999999999997e-06 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925127+0000", 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00047783800000000001 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.991 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925171+0000", 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4017000000000002e-05 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928942+0000", 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037716809999999998 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928987+0000", 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4338999999999997e-05 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:46646 3.0 e56/24 3:01acbe3d:::rbd_data.1127f2f8ff9b.0000000000000015:head v 56'541, mlcod=55'538)", 2024-09-14T06:01:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 83.467822639999994, 2024-09-14T06:01:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064775850000000001, 2024-09-14T06:01:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461415+0000", 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.666e-06 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463456+0000", 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00204177 2024-09-14T06:01:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463488+0000", 2024-09-14T06:01:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1503e-05 2024-09-14T06:01:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463508+0000", 2024-09-14T06:01:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9788000000000001e-05 2024-09-14T06:01:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463697+0000", 2024-09-14T06:01:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018873499999999999 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463741+0000", 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4333999999999999e-05 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467845+0000", 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041041430000000002 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467890+0000", 2024-09-14T06:01:13.996 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4645999999999999e-05 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:89402 3.0 e84/24 3:03c9b195:::rbd_data.11271f4525c9.00000000000001ae:head v 84'849, mlcod=83'847)", 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 47.298921903999997, 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0051764460000000003, 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.997 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8299999999999997e-07 2024-09-14T06:01:13.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630321+0000", 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6070000000000002e-06 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630349+0000", 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7696e-05 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630364+0000", 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4856e-05 2024-09-14T06:01:13.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630507+0000", 2024-09-14T06:01:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014309899999999999 2024-09-14T06:01:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630573+0000", 2024-09-14T06:01:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6126999999999999e-05 2024-09-14T06:01:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:14.000 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.635358+0000", 2024-09-14T06:01:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047853879999999998 2024-09-14T06:01:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.635489+0000", 2024-09-14T06:01:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013108999999999999 2024-09-14T06:01:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:106809 3.9 e93/24 3:96c4c4a7:::rbd_data.1127189bfb31.000000000000000a:head v 93'304, mlcod=92'302)", 2024-09-14T06:01:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:14.001 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 37.875562846000001, 2024-09-14T06:01:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0092272799999999992, 2024-09-14T06:01:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:14.002 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053673+0000", 2024-09-14T06:01:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.522e-06 2024-09-14T06:01:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056791+0000", 2024-09-14T06:01:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031181310000000001 2024-09-14T06:01:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.003 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056814+0000", 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2473999999999999e-05 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056825+0000", 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.059e-05 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056898+0000", 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2992999999999997e-05 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.004 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056918+0000", 2024-09-14T06:01:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0809999999999999e-05 2024-09-14T06:01:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.062810+0000", 2024-09-14T06:01:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0058916460000000004 2024-09-14T06:01:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.062899+0000", 2024-09-14T06:01:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9114000000000001e-05 2024-09-14T06:01:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.005 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:106810 3.9 e93/24 3:96c4c4a7:::rbd_data.1127189bfb31.000000000000000a:head v 93'306, mlcod=92'302)", 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 37.872240691000002, 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0060457269999999999, 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056995+0000", 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8199999999999999e-07 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057001+0000", 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2060000000000004e-06 2024-09-14T06:01:14.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057011+0000", 2024-09-14T06:01:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8369999999999992e-06 2024-09-14T06:01:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057018+0000", 2024-09-14T06:01:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9e-06 2024-09-14T06:01:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.059980+0000", 2024-09-14T06:01:14.008 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029624500000000002 2024-09-14T06:01:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.060002+0000", 2024-09-14T06:01:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2299000000000001e-05 2024-09-14T06:01:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.063000+0000", 2024-09-14T06:01:14.009 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029974170000000001 2024-09-14T06:01:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.063040+0000", 2024-09-14T06:01:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9836000000000003e-05 2024-09-14T06:01:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:114889 3.0 e93/24 3:072a82e8:::rbd_data.1127cb09e343.0000000000000009:head v 93'915, mlcod=92'913)", 2024-09-14T06:01:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:37.462828+0000", 2024-09-14T06:01:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 36.466406579000001, 2024-09-14T06:01:14.010 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041683099999999997, 2024-09-14T06:01:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.462828+0000", 2024-09-14T06:01:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.462828+0000", 2024-09-14T06:01:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.462830+0000", 2024-09-14T06:01:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0930000000000001e-06 2024-09-14T06:01:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463643+0000", 2024-09-14T06:01:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00081271700000000002 2024-09-14T06:01:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463677+0000", 2024-09-14T06:01:14.012 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.4329000000000003e-05 2024-09-14T06:01:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463693+0000", 2024-09-14T06:01:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5713e-05 2024-09-14T06:01:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463858+0000", 2024-09-14T06:01:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000164749 2024-09-14T06:01:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.013 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.463928+0000", 2024-09-14T06:01:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0646000000000001e-05 2024-09-14T06:01:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.466860+0000", 2024-09-14T06:01:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029313970000000001 2024-09-14T06:01:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:37.466996+0000", 2024-09-14T06:01:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000136666 2024-09-14T06:01:14.014 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:119911 3.0 e99/24 3:067b0149:::rbd_data.1127206dd91f.0000000000000002:head v 99'930, mlcod=97'928)", 2024-09-14T06:01:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 31.106494866999999, 2024-09-14T06:01:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049905519999999997, 2024-09-14T06:01:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.015 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822741+0000", 2024-09-14T06:01:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.054e-06 2024-09-14T06:01:14.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824085+0000", 2024-09-14T06:01:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001343693 2024-09-14T06:01:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824114+0000", 2024-09-14T06:01:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9013000000000002e-05 2024-09-14T06:01:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824127+0000", 2024-09-14T06:01:14.017 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3869000000000001e-05 2024-09-14T06:01:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824222+0000", 2024-09-14T06:01:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4616000000000003e-05 2024-09-14T06:01:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824247+0000", 2024-09-14T06:01:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5205999999999999e-05 2024-09-14T06:01:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:14.018 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.827664+0000", 2024-09-14T06:01:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0034165530000000001 2024-09-14T06:01:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.827730+0000", 2024-09-14T06:01:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6548e-05 2024-09-14T06:01:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.019 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.019 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:14.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:01:14.029 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:14.024+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:14.130 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:14.124+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:14.194 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:14.195 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:14.195 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:01:14.195 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:14.209 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:01:14.231 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:14.228+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:14.337 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:14.332+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:14.338 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T06:01:14.399 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:14.399 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:14.399 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:14.399 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:14.399 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:14.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:01:14.466 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:14.464+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:14.534 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:14.528+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:14.545 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54659 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 616448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.404356856999996, 2024-09-14T06:01:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092177035000000004, 2024-09-14T06:01:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.546 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54659 2024-09-14T06:01:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139718+0000", 2024-09-14T06:01:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9699999999999996e-07 2024-09-14T06:01:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139731+0000", 2024-09-14T06:01:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2993000000000001e-05 2024-09-14T06:01:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.548 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139738+0000", 2024-09-14T06:01:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4610000000000002e-06 2024-09-14T06:01:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139744+0000", 2024-09-14T06:01:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6389999999999997e-06 2024-09-14T06:01:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231570+0000", 2024-09-14T06:01:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091826216000000002 2024-09-14T06:01:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231662+0000", 2024-09-14T06:01:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2101000000000005e-05 2024-09-14T06:01:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231894+0000", 2024-09-14T06:01:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023212800000000001 2024-09-14T06:01:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.550 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54660 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 622592~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.404321522999993, 2024-09-14T06:01:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092366887999999994, 2024-09-14T06:01:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54660 2024-09-14T06:01:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T06:01:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139755+0000", 2024-09-14T06:01:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T06:01:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139762+0000", 2024-09-14T06:01:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6719999999999998e-06 2024-09-14T06:01:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139767+0000", 2024-09-14T06:01:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9819999999999999e-06 2024-09-14T06:01:14.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231917+0000", 2024-09-14T06:01:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092149872999999993 2024-09-14T06:01:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231969+0000", 2024-09-14T06:01:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2642000000000002e-05 2024-09-14T06:01:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232120+0000", 2024-09-14T06:01:14.554 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015011899999999999 2024-09-14T06:01:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54844 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 0~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.404300031999995, 2024-09-14T06:01:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092708507999999995, 2024-09-14T06:01:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.555 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54844 2024-09-14T06:01:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:14.556 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139775+0000", 2024-09-14T06:01:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3500000000000002e-07 2024-09-14T06:01:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139777+0000", 2024-09-14T06:01:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.979e-06 2024-09-14T06:01:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.557 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139787+0000", 2024-09-14T06:01:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0779e-05 2024-09-14T06:01:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139799+0000", 2024-09-14T06:01:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1719000000000001e-05 2024-09-14T06:01:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232151+0000", 2024-09-14T06:01:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092351767000000001 2024-09-14T06:01:14.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232217+0000", 2024-09-14T06:01:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6655000000000005e-05 2024-09-14T06:01:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232483+0000", 2024-09-14T06:01:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026517400000000002 2024-09-14T06:01:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.559 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54845 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 55296~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.404266360999998, 2024-09-14T06:01:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093127583999999999, 2024-09-14T06:01:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54845 2024-09-14T06:01:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.560 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:14.561 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4899999999999995e-07 2024-09-14T06:01:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139811+0000", 2024-09-14T06:01:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000001e-06 2024-09-14T06:01:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139821+0000", 2024-09-14T06:01:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0168e-05 2024-09-14T06:01:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.562 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139826+0000", 2024-09-14T06:01:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2780000000000001e-06 2024-09-14T06:01:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232556+0000", 2024-09-14T06:01:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092729729999999996 2024-09-14T06:01:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232652+0000", 2024-09-14T06:01:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680999999999994e-05 2024-09-14T06:01:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.563 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232935+0000", 2024-09-14T06:01:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000283758 2024-09-14T06:01:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54846 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.404240053999999, 2024-09-14T06:01:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093492079000000006, 2024-09-14T06:01:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.564 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54846 2024-09-14T06:01:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.565 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139835+0000", 2024-09-14T06:01:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T06:01:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139837+0000", 2024-09-14T06:01:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1059999999999998e-06 2024-09-14T06:01:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.566 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.567 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.567 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139845+0000", 2024-09-14T06:01:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4300000000000006e-06 2024-09-14T06:01:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.708 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139851+0000", 2024-09-14T06:01:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T06:01:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232987+0000", 2024-09-14T06:01:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093136073999999999 2024-09-14T06:01:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233075+0000", 2024-09-14T06:01:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7318999999999995e-05 2024-09-14T06:01:14.709 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233326+0000", 2024-09-14T06:01:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025159 2024-09-14T06:01:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54847 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 67584~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.404214338000003, 2024-09-14T06:01:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093777452999999997, 2024-09-14T06:01:14.710 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54847 2024-09-14T06:01:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T06:01:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139862+0000", 2024-09-14T06:01:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0200000000000001e-06 2024-09-14T06:01:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139870+0000", 2024-09-14T06:01:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0520000000000002e-06 2024-09-14T06:01:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139875+0000", 2024-09-14T06:01:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:01:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233389+0000", 2024-09-14T06:01:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093514054999999999 2024-09-14T06:01:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233443+0000", 2024-09-14T06:01:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3913999999999999e-05 2024-09-14T06:01:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233637+0000", 2024-09-14T06:01:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019392899999999999 2024-09-14T06:01:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.714 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54848 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 73728~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.404191241999996, 2024-09-14T06:01:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094064464, 2024-09-14T06:01:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.715 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54848 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.716 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T06:01:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139885+0000", 2024-09-14T06:01:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9929999999999998e-06 2024-09-14T06:01:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.717 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139893+0000", 2024-09-14T06:01:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9759999999999995e-06 2024-09-14T06:01:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139898+0000", 2024-09-14T06:01:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6059999999999996e-06 2024-09-14T06:01:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233681+0000", 2024-09-14T06:01:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093782921000000005 2024-09-14T06:01:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.718 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233730+0000", 2024-09-14T06:01:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9410999999999998e-05 2024-09-14T06:01:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233947+0000", 2024-09-14T06:01:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021710300000000001 2024-09-14T06:01:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.719 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54849 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.404167786000002, 2024-09-14T06:01:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094499257000000003, 2024-09-14T06:01:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.720 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54849 2024-09-14T06:01:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:14.721 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139907+0000", 2024-09-14T06:01:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T06:01:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139909+0000", 2024-09-14T06:01:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T06:01:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.722 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139916+0000", 2024-09-14T06:01:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T06:01:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139921+0000", 2024-09-14T06:01:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:01:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234032+0000", 2024-09-14T06:01:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094111037999999994 2024-09-14T06:01:14.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234150+0000", 2024-09-14T06:01:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118408 2024-09-14T06:01:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234406+0000", 2024-09-14T06:01:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025540600000000001 2024-09-14T06:01:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.724 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54850 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 135168~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.404146077999997, 2024-09-14T06:01:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094814605999999996, 2024-09-14T06:01:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.725 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54850 2024-09-14T06:01:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.726 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139929+0000", 2024-09-14T06:01:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T06:01:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139931+0000", 2024-09-14T06:01:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.024e-06 2024-09-14T06:01:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139937+0000", 2024-09-14T06:01:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3770000000000001e-06 2024-09-14T06:01:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139942+0000", 2024-09-14T06:01:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0289999999999996e-06 2024-09-14T06:01:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.728 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234447+0000", 2024-09-14T06:01:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094505426000000003 2024-09-14T06:01:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234539+0000", 2024-09-14T06:01:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1793999999999996e-05 2024-09-14T06:01:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234743+0000", 2024-09-14T06:01:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020354600000000001 2024-09-14T06:01:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54851 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 141312~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.404124366000005, 2024-09-14T06:01:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095179749999999994, 2024-09-14T06:01:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54851 2024-09-14T06:01:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.731 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:14.732 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:01:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139952+0000", 2024-09-14T06:01:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0600000000000002e-06 2024-09-14T06:01:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139959+0000", 2024-09-14T06:01:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.584e-06 2024-09-14T06:01:14.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139964+0000", 2024-09-14T06:01:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8890000000000001e-06 2024-09-14T06:01:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234786+0000", 2024-09-14T06:01:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094822241000000002 2024-09-14T06:01:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234877+0000", 2024-09-14T06:01:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1158999999999999e-05 2024-09-14T06:01:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235130+0000", 2024-09-14T06:01:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025235999999999998 2024-09-14T06:01:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.735 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54852 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 147456~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.404103238000005, 2024-09-14T06:01:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095437742000000006, 2024-09-14T06:01:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.736 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54852 2024-09-14T06:01:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140125+0000", 2024-09-14T06:01:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154332 2024-09-14T06:01:14.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140130+0000", 2024-09-14T06:01:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.284e-06 2024-09-14T06:01:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140140+0000", 2024-09-14T06:01:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0789e-05 2024-09-14T06:01:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140147+0000", 2024-09-14T06:01:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9879999999999998e-06 2024-09-14T06:01:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235174+0000", 2024-09-14T06:01:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095026749999999993 2024-09-14T06:01:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.740 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235230+0000", 2024-09-14T06:01:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6224000000000002e-05 2024-09-14T06:01:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235409+0000", 2024-09-14T06:01:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017837500000000001 2024-09-14T06:01:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54853 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 202752~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.741 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.403914416000006, 2024-09-14T06:01:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095632919999999996, 2024-09-14T06:01:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54853 2024-09-14T06:01:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.742 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147748+0000", 2024-09-14T06:01:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075884910000000002 2024-09-14T06:01:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147798+0000", 2024-09-14T06:01:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0152999999999999e-05 2024-09-14T06:01:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147814+0000", 2024-09-14T06:01:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5866e-05 2024-09-14T06:01:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.744 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147831+0000", 2024-09-14T06:01:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6991999999999999e-05 2024-09-14T06:01:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235451+0000", 2024-09-14T06:01:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087620077000000005 2024-09-14T06:01:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235539+0000", 2024-09-14T06:01:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7800000000000006e-05 2024-09-14T06:01:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.745 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235793+0000", 2024-09-14T06:01:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025354099999999998 2024-09-14T06:01:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54870 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 503808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.395668869000005, 2024-09-14T06:01:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092420756000000007, 2024-09-14T06:01:14.746 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54870 2024-09-14T06:01:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.747 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148406+0000", 2024-09-14T06:01:14.748 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T06:01:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148409+0000", 2024-09-14T06:01:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T06:01:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148418+0000", 2024-09-14T06:01:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7329999999999998e-06 2024-09-14T06:01:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.749 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148425+0000", 2024-09-14T06:01:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2079999999999997e-06 2024-09-14T06:01:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240591+0000", 2024-09-14T06:01:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092166441000000002 2024-09-14T06:01:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240648+0000", 2024-09-14T06:01:14.750 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6733e-05 2024-09-14T06:01:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240826+0000", 2024-09-14T06:01:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017834700000000001 2024-09-14T06:01:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54871 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 509952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.395638908999999, 2024-09-14T06:01:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092702341999999993, 2024-09-14T06:01:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54871 2024-09-14T06:01:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148436+0000", 2024-09-14T06:01:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5499999999999998e-07 2024-09-14T06:01:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148439+0000", 2024-09-14T06:01:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8090000000000001e-06 2024-09-14T06:01:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148449+0000", 2024-09-14T06:01:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0115000000000001e-05 2024-09-14T06:01:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148466+0000", 2024-09-14T06:01:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6761000000000001e-05 2024-09-14T06:01:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240857+0000", 2024-09-14T06:01:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092391089999999995 2024-09-14T06:01:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240939+0000", 2024-09-14T06:01:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2387999999999998e-05 2024-09-14T06:01:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241138+0000", 2024-09-14T06:01:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000198624 2024-09-14T06:01:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54872 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 516096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 80.395597710999994, 2024-09-14T06:01:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093126020000000004, 2024-09-14T06:01:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54872 2024-09-14T06:01:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155484+0000", 2024-09-14T06:01:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070072429999999998 2024-09-14T06:01:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155490+0000", 2024-09-14T06:01:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6379999999999998e-06 2024-09-14T06:01:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155504+0000", 2024-09-14T06:01:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4065e-05 2024-09-14T06:01:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155513+0000", 2024-09-14T06:01:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6799999999999999e-06 2024-09-14T06:01:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241216+0000", 2024-09-14T06:01:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085702922000000001 2024-09-14T06:01:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241277+0000", 2024-09-14T06:01:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0980000000000002e-05 2024-09-14T06:01:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241602+0000", 2024-09-14T06:01:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032549199999999998 2024-09-14T06:01:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123238 3.7 3.c0662d67 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 15.129126040999999, 2024-09-14T06:01:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88300249500000005, 2024-09-14T06:01:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:01:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123238 2024-09-14T06:01:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414949+0000", 2024-09-14T06:01:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8899999999999998e-07 2024-09-14T06:01:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414953+0000", 2024-09-14T06:01:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1439999999999996e-06 2024-09-14T06:01:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414974+0000", 2024-09-14T06:01:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0630000000000001e-05 2024-09-14T06:01:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414982+0000", 2024-09-14T06:01:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9840000000000001e-06 2024-09-14T06:01:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415051+0000", 2024-09-14T06:01:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9787000000000001e-05 2024-09-14T06:01:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415062+0000", 2024-09-14T06:01:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0674e-05 2024-09-14T06:01:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297935+0000", 2024-09-14T06:01:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88287307400000004 2024-09-14T06:01:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297951+0000", 2024-09-14T06:01:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5413e-05 2024-09-14T06:01:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123240 3.15 3:a806c175:::rbd_data.112793b455a2.0000000000000005:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 15.129070326000001, 2024-09-14T06:01:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.950432851, 2024-09-14T06:01:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123240 2024-09-14T06:01:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3399999999999999e-07 2024-09-14T06:01:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415008+0000", 2024-09-14T06:01:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6090000000000001e-06 2024-09-14T06:01:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415017+0000", 2024-09-14T06:01:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0100000000000001e-06 2024-09-14T06:01:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415025+0000", 2024-09-14T06:01:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9109999999999993e-06 2024-09-14T06:01:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415114+0000", 2024-09-14T06:01:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9086999999999996e-05 2024-09-14T06:01:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415132+0000", 2024-09-14T06:01:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7405e-05 2024-09-14T06:01:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297130+0000", 2024-09-14T06:01:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88199837000000003 2024-09-14T06:01:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297152+0000", 2024-09-14T06:01:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2103000000000002e-05 2024-09-14T06:01:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361290+0000", 2024-09-14T06:01:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.064138091 2024-09-14T06:01:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361714+0000", 2024-09-14T06:01:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042403999999999999 2024-09-14T06:01:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361955+0000", 2024-09-14T06:01:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000240981 2024-09-14T06:01:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365095+0000", 2024-09-14T06:01:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031403960000000002 2024-09-14T06:01:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365192+0000", 2024-09-14T06:01:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6976000000000001e-05 2024-09-14T06:01:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365274+0000", 2024-09-14T06:01:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1293999999999998e-05 2024-09-14T06:01:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365437+0000", 2024-09-14T06:01:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016294399999999999 2024-09-14T06:01:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123244 3.7 3.d0cc8287 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 15.129024823, 2024-09-14T06:01:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88296528100000005, 2024-09-14T06:01:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:01:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123244 2024-09-14T06:01:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415050+0000", 2024-09-14T06:01:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1500000000000004e-07 2024-09-14T06:01:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415053+0000", 2024-09-14T06:01:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1219999999999999e-06 2024-09-14T06:01:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415065+0000", 2024-09-14T06:01:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1549000000000001e-05 2024-09-14T06:01:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415071+0000", 2024-09-14T06:01:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4359999999999999e-06 2024-09-14T06:01:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415133+0000", 2024-09-14T06:01:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2249999999999995e-05 2024-09-14T06:01:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415141+0000", 2024-09-14T06:01:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5480000000000004e-06 2024-09-14T06:01:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.298007+0000", 2024-09-14T06:01:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88286582199999997 2024-09-14T06:01:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.298015+0000", 2024-09-14T06:01:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8390000000000007e-06 2024-09-14T06:01:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123245 3.15 3:ae492430:::rbd_data.112793b455a2.000000000000000a:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 15.126957171000001, 2024-09-14T06:01:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9484952870000001, 2024-09-14T06:01:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123245 2024-09-14T06:01:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417118+0000", 2024-09-14T06:01:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0189999999999999e-06 2024-09-14T06:01:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417123+0000", 2024-09-14T06:01:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7380000000000002e-06 2024-09-14T06:01:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417137+0000", 2024-09-14T06:01:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4538999999999999e-05 2024-09-14T06:01:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.788 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417146+0000", 2024-09-14T06:01:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3669999999999997e-06 2024-09-14T06:01:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417236+0000", 2024-09-14T06:01:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9976999999999996e-05 2024-09-14T06:01:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.789 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417249+0000", 2024-09-14T06:01:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3325e-05 2024-09-14T06:01:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297197+0000", 2024-09-14T06:01:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.87994787699999999 2024-09-14T06:01:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:14.790 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297209+0000", 2024-09-14T06:01:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2486e-05 2024-09-14T06:01:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363278+0000", 2024-09-14T06:01:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.066068257 2024-09-14T06:01:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363460+0000", 2024-09-14T06:01:14.791 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000182022 2024-09-14T06:01:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363641+0000", 2024-09-14T06:01:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018182199999999999 2024-09-14T06:01:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365170+0000", 2024-09-14T06:01:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00152838 2024-09-14T06:01:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.792 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365451+0000", 2024-09-14T06:01:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028076000000000002 2024-09-14T06:01:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365504+0000", 2024-09-14T06:01:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3334000000000001e-05 2024-09-14T06:01:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.793 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365612+0000", 2024-09-14T06:01:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108384 2024-09-14T06:01:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123248 3.15 3:a9835311:::rbd_data.112793b455a2.000000000000000d:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 15.126289947, 2024-09-14T06:01:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.948835844, 2024-09-14T06:01:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:14.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123248 2024-09-14T06:01:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417785+0000", 2024-09-14T06:01:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.054e-06 2024-09-14T06:01:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.796 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417790+0000", 2024-09-14T06:01:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.186e-06 2024-09-14T06:01:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417806+0000", 2024-09-14T06:01:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5430999999999998e-05 2024-09-14T06:01:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417816+0000", 2024-09-14T06:01:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7729999999999994e-06 2024-09-14T06:01:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417875+0000", 2024-09-14T06:01:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8950999999999999e-05 2024-09-14T06:01:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:14.798 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417884+0000", 2024-09-14T06:01:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4369999999999996e-06 2024-09-14T06:01:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297235+0000", 2024-09-14T06:01:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.87935095699999999 2024-09-14T06:01:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297241+0000", 2024-09-14T06:01:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2790000000000004e-06 2024-09-14T06:01:14.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364231+0000", 2024-09-14T06:01:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.066989736 2024-09-14T06:01:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364369+0000", 2024-09-14T06:01:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000137766 2024-09-14T06:01:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.800 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364563+0000", 2024-09-14T06:01:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019418500000000001 2024-09-14T06:01:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365625+0000", 2024-09-14T06:01:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0010621000000000001 2024-09-14T06:01:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366188+0000", 2024-09-14T06:01:14.801 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00056258499999999999 2024-09-14T06:01:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366318+0000", 2024-09-14T06:01:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012983299999999999 2024-09-14T06:01:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366620+0000", 2024-09-14T06:01:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030257100000000001 2024-09-14T06:01:14.802 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.803 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.803 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:14.803 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:14.803 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:14.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:01:14.805 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:14.804+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:14.906 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:14.900+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:14.937 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:14.937 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:14.937 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:14.937 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:14.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:01:15.006 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:15.000+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:15.107 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:15.104+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:15.120 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:15.120 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:15.120 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:15.120 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:15.120 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:15.134 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:01:15.208 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:15.204+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:15.302 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:15.302 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:15.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:15.302 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:15.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.302 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23550 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 606208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.303 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:01:15.303 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.35191639600001, 2024-09-14T06:01:15.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048793072999999999, 2024-09-14T06:01:15.303 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.303 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.303 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.303 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23550 2024-09-14T06:01:15.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.303 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:01:15.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:01:15.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:01:15.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7800000000000002e-07 2024-09-14T06:01:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948677+0000", 2024-09-14T06:01:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1949999999999997e-06 2024-09-14T06:01:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948687+0000", 2024-09-14T06:01:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0849000000000001e-05 2024-09-14T06:01:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948692+0000", 2024-09-14T06:01:15.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8670000000000002e-06 2024-09-14T06:01:15.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997290+0000", 2024-09-14T06:01:15.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048597596999999999 2024-09-14T06:01:15.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997367+0000", 2024-09-14T06:01:15.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7236000000000004e-05 2024-09-14T06:01:15.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997462+0000", 2024-09-14T06:01:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4951000000000006e-05 2024-09-14T06:01:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23551 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 620544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:01:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.35188553899999, 2024-09-14T06:01:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048938838999999998, 2024-09-14T06:01:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23551 2024-09-14T06:01:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:01:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:01:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:01:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1e-07 2024-09-14T06:01:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948701+0000", 2024-09-14T06:01:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2950000000000001e-06 2024-09-14T06:01:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948705+0000", 2024-09-14T06:01:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7929999999999999e-06 2024-09-14T06:01:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948709+0000", 2024-09-14T06:01:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T06:01:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997535+0000", 2024-09-14T06:01:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048826181000000003 2024-09-14T06:01:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997580+0000", 2024-09-14T06:01:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5355000000000002e-05 2024-09-14T06:01:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997639+0000", 2024-09-14T06:01:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8479e-05 2024-09-14T06:01:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.351870062, 2024-09-14T06:01:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T06:01:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T06:01:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T06:01:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T06:01:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T06:01:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T06:01:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T06:01:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T06:01:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T06:01:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T06:01:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T06:01:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T06:01:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T06:01:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T06:01:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T06:01:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T06:01:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.351850787, 2024-09-14T06:01:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T06:01:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T06:01:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T06:01:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T06:01:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T06:01:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T06:01:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T06:01:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T06:01:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T06:01:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T06:01:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T06:01:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T06:01:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T06:01:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T06:01:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T06:01:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.351831211, 2024-09-14T06:01:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T06:01:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T06:01:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T06:01:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T06:01:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T06:01:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T06:01:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T06:01:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:01:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T06:01:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T06:01:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T06:01:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T06:01:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T06:01:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T06:01:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T06:01:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T06:01:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.351811754, 2024-09-14T06:01:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T06:01:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T06:01:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T06:01:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T06:01:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T06:01:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T06:01:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T06:01:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T06:01:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T06:01:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T06:01:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T06:01:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T06:01:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T06:01:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T06:01:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T06:01:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.351792703, 2024-09-14T06:01:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T06:01:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T06:01:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T06:01:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T06:01:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T06:01:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T06:01:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T06:01:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T06:01:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T06:01:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T06:01:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T06:01:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T06:01:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T06:01:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T06:01:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T06:01:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.351773022, 2024-09-14T06:01:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T06:01:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T06:01:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T06:01:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T06:01:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T06:01:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T06:01:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T06:01:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:01:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T06:01:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T06:01:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T06:01:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T06:01:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T06:01:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T06:01:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T06:01:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T06:01:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.340 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.340 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.340 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:15.340 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.351753071, 2024-09-14T06:01:15.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T06:01:15.340 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.340 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.340 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.340 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.340 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.340 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.340 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T06:01:15.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.341 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:15.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:15.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T06:01:15.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T06:01:15.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T06:01:15.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:01:15.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T06:01:15.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T06:01:15.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T06:01:15.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T06:01:15.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T06:01:15.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T06:01:15.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T06:01:15.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T06:01:15.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T06:01:15.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T06:01:15.344 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.344 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.344 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.344 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.345 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:15.345 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.351733759, 2024-09-14T06:01:15.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T06:01:15.345 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.345 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.345 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.345 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.345 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.345 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.345 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T06:01:15.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.345 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:15.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:15.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:15.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T06:01:15.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T06:01:15.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T06:01:15.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T06:01:15.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T06:01:15.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T06:01:15.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T06:01:15.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T06:01:15.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T06:01:15.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T06:01:15.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T06:01:15.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T06:01:15.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T06:01:15.349 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.349 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.349 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.349 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.349 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:15.349 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.35171399799999, 2024-09-14T06:01:15.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T06:01:15.349 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.349 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.350 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.350 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T06:01:15.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.350 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:15.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T06:01:15.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T06:01:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T06:01:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T06:01:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T06:01:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T06:01:15.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T06:01:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T06:01:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T06:01:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T06:01:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T06:01:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.35169307699999, 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T06:01:15.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T06:01:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T06:01:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T06:01:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T06:01:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T06:01:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T06:01:15.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T06:01:15.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T06:01:15.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T06:01:15.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T06:01:15.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T06:01:15.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T06:01:15.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T06:01:15.358 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.358 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.358 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.358 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.358 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:15.358 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.350533743, 2024-09-14T06:01:15.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T06:01:15.358 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.359 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.359 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.359 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T06:01:15.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.359 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:15.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:15.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T06:01:15.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T06:01:15.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T06:01:15.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T06:01:15.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T06:01:15.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T06:01:15.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T06:01:15.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T06:01:15.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T06:01:15.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T06:01:15.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T06:01:15.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T06:01:15.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T06:01:15.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T06:01:15.362 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.363 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.363 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.363 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.363 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:15.363 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.350234961, 2024-09-14T06:01:15.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T06:01:15.363 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.363 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.363 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.363 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.363 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.363 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.364 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T06:01:15.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.364 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:15.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:15.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T06:01:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T06:01:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T06:01:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T06:01:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T06:01:15.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T06:01:15.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T06:01:15.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T06:01:15.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T06:01:15.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T06:01:15.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T06:01:15.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T06:01:15.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T06:01:15.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T06:01:15.367 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.367 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.367 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.367 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.367 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:15.368 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.350084223, 2024-09-14T06:01:15.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T06:01:15.368 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.368 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.368 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:15.368 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.368 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.368 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.368 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T06:01:15.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.368 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:15.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:15.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T06:01:15.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T06:01:15.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T06:01:15.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T06:01:15.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T06:01:15.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T06:01:15.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T06:01:15.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T06:01:15.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.371 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.372 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T06:01:15.372 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:15.372 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 103.72478266, 2024-09-14T06:01:15.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T06:01:15.372 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.372 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.372 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:15.372 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:15.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:15.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T06:01:15.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T06:01:15.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T06:01:15.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T06:01:15.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T06:01:15.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T06:01:15.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T06:01:15.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T06:01:15.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T06:01:15.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T06:01:15.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T06:01:15.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T06:01:15.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:15.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T06:01:15.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T06:01:15.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T06:01:15.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T06:01:15.376 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.376 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.376 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 103.201692721, 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:15.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:15.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T06:01:15.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T06:01:15.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T06:01:15.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T06:01:15.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T06:01:15.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T06:01:15.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T06:01:15.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T06:01:15.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T06:01:15.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T06:01:15.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T06:01:15.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T06:01:15.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T06:01:15.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T06:01:15.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T06:01:15.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:15.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T06:01:15.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T06:01:15.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:15.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T06:01:15.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T06:01:15.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:15.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T06:01:15.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T06:01:15.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T06:01:15.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T06:01:15.382 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.382 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.382 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.383 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123243 3.f 3:f182c8b1:::rbd_data.112793b455a2.0000000000000008:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:15.383 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:15.383 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.885658259, 2024-09-14T06:01:15.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9453718680000001, 2024-09-14T06:01:15.383 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.383 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.383 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:15.383 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.383 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.383 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.383 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123243 2024-09-14T06:01:15.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.383 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:15.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:15.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414929+0000", 2024-09-14T06:01:15.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.761e-06 2024-09-14T06:01:15.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414935+0000", 2024-09-14T06:01:15.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1310000000000003e-06 2024-09-14T06:01:15.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414953+0000", 2024-09-14T06:01:15.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.806e-05 2024-09-14T06:01:15.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414962+0000", 2024-09-14T06:01:15.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8040000000000007e-06 2024-09-14T06:01:15.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.415129+0000", 2024-09-14T06:01:15.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016696699999999999 2024-09-14T06:01:15.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:15.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.415160+0000", 2024-09-14T06:01:15.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1361e-05 2024-09-14T06:01:15.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.306423+0000", 2024-09-14T06:01:15.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.89126284499999997 2024-09-14T06:01:15.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:15.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.306458+0000", 2024-09-14T06:01:15.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4864999999999999e-05 2024-09-14T06:01:15.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.356709+0000", 2024-09-14T06:01:15.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0502506730000001 2024-09-14T06:01:15.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357372+0000", 2024-09-14T06:01:15.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00066291500000000003 2024-09-14T06:01:15.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T06:01:15.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357702+0000", 2024-09-14T06:01:15.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00033040400000000002 2024-09-14T06:01:15.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:15.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359330+0000", 2024-09-14T06:01:15.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001628004 2024-09-14T06:01:15.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:15.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359899+0000", 2024-09-14T06:01:15.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00056937000000000003 2024-09-14T06:01:15.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:15.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360016+0000", 2024-09-14T06:01:15.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116688 2024-09-14T06:01:15.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360299+0000", 2024-09-14T06:01:15.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028301999999999998 2024-09-14T06:01:15.390 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.390 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.390 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.390 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123246 3.e 3:757f91a9:::rbd_data.112793b455a2.000000000000000b:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:15.390 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:15.390 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.883165658999999, 2024-09-14T06:01:15.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.971537646, 2024-09-14T06:01:15.390 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.390 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123246 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:15.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417422+0000", 2024-09-14T06:01:15.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3029999999999998e-06 2024-09-14T06:01:15.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417433+0000", 2024-09-14T06:01:15.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1333e-05 2024-09-14T06:01:15.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417496+0000", 2024-09-14T06:01:15.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2856999999999998e-05 2024-09-14T06:01:15.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417521+0000", 2024-09-14T06:01:15.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5041999999999998e-05 2024-09-14T06:01:15.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417631+0000", 2024-09-14T06:01:15.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010957 2024-09-14T06:01:15.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:15.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417641+0000", 2024-09-14T06:01:15.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0655999999999999e-05 2024-09-14T06:01:15.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301111+0000", 2024-09-14T06:01:15.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.883469175 2024-09-14T06:01:15.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:15.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301143+0000", 2024-09-14T06:01:15.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1998000000000001e-05 2024-09-14T06:01:15.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385119+0000", 2024-09-14T06:01:15.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0839765729999999 2024-09-14T06:01:15.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385594+0000", 2024-09-14T06:01:15.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000475014 2024-09-14T06:01:15.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385905+0000", 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031112300000000001 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388402+0000", 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024969110000000001 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388492+0000", 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9740000000000005e-05 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:15.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388646+0000", 2024-09-14T06:01:15.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153788 2024-09-14T06:01:15.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388957+0000", 2024-09-14T06:01:15.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000311563 2024-09-14T06:01:15.397 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.397 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.397 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.398 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123247 3.e 3:71933c91:::rbd_data.112793b455a2.000000000000000c:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:15.398 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:15.398 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 15.882986618, 2024-09-14T06:01:15.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9716223099999999, 2024-09-14T06:01:15.398 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:15.398 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:15.398 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:15.398 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:15.398 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:15.398 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123247 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:15.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417601+0000", 2024-09-14T06:01:15.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:01:15.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:15.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417613+0000", 2024-09-14T06:01:15.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2041999999999999e-05 2024-09-14T06:01:15.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:15.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417636+0000", 2024-09-14T06:01:15.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3071999999999999e-05 2024-09-14T06:01:15.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:15.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417652+0000", 2024-09-14T06:01:15.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6512999999999999e-05 2024-09-14T06:01:15.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417722+0000", 2024-09-14T06:01:15.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0201000000000001e-05 2024-09-14T06:01:15.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:15.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417729+0000", 2024-09-14T06:01:15.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4420000000000003e-06 2024-09-14T06:01:15.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301770+0000", 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88404090999999996 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301798+0000", 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8619000000000002e-05 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387130+0000", 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0853317760000001 2024-09-14T06:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:15.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387314+0000", 2024-09-14T06:01:15.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018428699999999999 2024-09-14T06:01:15.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:15.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387786+0000", 2024-09-14T06:01:15.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047110000000000001 2024-09-14T06:01:15.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:15.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388983+0000", 2024-09-14T06:01:15.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011978640000000001 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389032+0000", 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8349000000000001e-05 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389082+0000", 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0291999999999999e-05 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389221+0000", 2024-09-14T06:01:15.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013898599999999999 2024-09-14T06:01:15.405 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.405 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.405 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.405 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:15.405 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:15.405 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:15.406 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2024-09-14T06:01:15.407 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:01:15.407 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:15.400+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:15.426 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:01:15.498 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-14T06:01:15.499 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T06:01:15.499 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-14T06:01:15.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T06:01:15.507 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:15.504+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:15.533 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:15.534 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:15.534 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:15.534 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:15.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:01:15.634 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:15.632+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:15.636 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:15.636 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:15.654 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:15.655 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:15.671 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:15.671 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:15.687 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:15.688 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:15.707 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:15.707 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:15.707 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:15.704+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:15.715 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:15.715 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:15.727 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:15.728 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:15.729 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:01:15.745 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:15.746 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:15.763 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:15.764 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:15.808 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:15.804+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:01:15.831 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:15.831 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 132, 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "8db933fa-392d-4966-864a-b73b8a91dd2d", 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2024-09-14T05:58:34.536616+0000", 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2024-09-14T06:01:15.383264+0000", 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2024-09-14T05:59:39.727882+0000", 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2024-09-14T06:01:05.316677+0000", 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 6, 2024-09-14T06:01:15.832 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 3, 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "luminous", 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "squid", 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_crimson": false, 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2024-09-14T05:58:47.505149+0000", 2024-09-14T06:01:15.833 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "is_stretch_pool": false, 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2024-09-14T06:01:15.834 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "18", 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2024-09-14T06:01:15.835 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2024-09-14T06:01:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2024-09-14T06:01:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2024-09-14T06:01:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2024-09-14T06:01:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2024-09-14T06:01:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2024-09-14T06:01:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2024-09-14T06:01:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2024-09-14T06:01:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2024-09-14T06:01:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2024-09-14T06:01:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2024-09-14T06:01:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2024-09-14T06:01:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2024-09-14T06:01:15.836 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2024-09-14T06:01:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T06:01:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T06:01:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T06:01:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2024-09-14T06:01:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2024-09-14T06:01:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2024-09-14T06:01:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2024-09-14T06:01:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2024-09-14T06:01:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2024-09-14T06:01:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2024-09-14T06:01:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2024-09-14T06:01:15.837 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2024-09-14T06:01:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2024-09-14T06:01:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T06:01:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2024-09-14T06:01:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2024-09-14T06:01:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2024-09-14T06:01:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2024-09-14T06:01:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2024-09-14T06:01:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2024-09-14T06:01:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2024-09-14T06:01:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2024-09-14T06:01:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2024-09-14T06:01:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2024-09-14T06:01:15.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "read_balance": { 2024-09-14T06:01:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "score_type": "Fair distribution", 2024-09-14T06:01:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "score_acting": 6.9000000953674316, 2024-09-14T06:01:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "score_stable": 6.9000000953674316, 2024-09-14T06:01:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "optimal_score": 0.28999999165534973, 2024-09-14T06:01:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_acting": 2, 2024-09-14T06:01:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_stable": 2, 2024-09-14T06:01:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity_weighted": 0.875, 2024-09-14T06:01:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity": 1, 2024-09-14T06:01:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-14T06:01:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 2, 2024-09-14T06:01:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "rbd", 2024-09-14T06:01:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2024-09-14T05:58:52.779258+0000", 2024-09-14T06:01:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 8193, 2024-09-14T06:01:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T06:01:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2024-09-14T06:01:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2024-09-14T06:01:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2024-09-14T06:01:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2024-09-14T06:01:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2024-09-14T06:01:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2024-09-14T06:01:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T06:01:15.840 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T06:01:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "is_stretch_pool": false, 2024-09-14T06:01:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2024-09-14T06:01:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2024-09-14T06:01:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 8, 2024-09-14T06:01:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 8, 2024-09-14T06:01:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 8, 2024-09-14T06:01:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 8, 2024-09-14T06:01:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 8, 2024-09-14T06:01:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2024-09-14T06:01:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2024-09-14T06:01:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2024-09-14T06:01:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2024-09-14T06:01:15.841 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2024-09-14T06:01:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2024-09-14T06:01:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2024-09-14T06:01:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "22", 2024-09-14T06:01:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2024-09-14T06:01:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T06:01:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T06:01:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2024-09-14T06:01:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2024-09-14T06:01:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 2, 2024-09-14T06:01:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 22, 2024-09-14T06:01:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2024-09-14T06:01:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2024-09-14T06:01:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2024-09-14T06:01:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2024-09-14T06:01:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2024-09-14T06:01:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2024-09-14T06:01:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2024-09-14T06:01:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2024-09-14T06:01:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2024-09-14T06:01:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2024-09-14T06:01:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2024-09-14T06:01:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T06:01:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T06:01:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T06:01:15.843 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2024-09-14T06:01:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2024-09-14T06:01:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2024-09-14T06:01:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2024-09-14T06:01:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2024-09-14T06:01:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2024-09-14T06:01:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2024-09-14T06:01:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2024-09-14T06:01:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2024-09-14T06:01:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2024-09-14T06:01:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T06:01:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2024-09-14T06:01:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2024-09-14T06:01:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2024-09-14T06:01:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2024-09-14T06:01:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2024-09-14T06:01:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2024-09-14T06:01:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2024-09-14T06:01:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2024-09-14T06:01:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "read_balance": { 2024-09-14T06:01:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "score_type": "Fair distribution", 2024-09-14T06:01:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "score_acting": 1.75, 2024-09-14T06:01:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "score_stable": 1.75, 2024-09-14T06:01:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "optimal_score": 1, 2024-09-14T06:01:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_acting": 1.75, 2024-09-14T06:01:15.845 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_stable": 1.75, 2024-09-14T06:01:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity_weighted": 0.875, 2024-09-14T06:01:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity": 1, 2024-09-14T06:01:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-14T06:01:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2024-09-14T06:01:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "pool_client.0", 2024-09-14T06:01:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2024-09-14T05:59:04.433909+0000", 2024-09-14T06:01:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 8193, 2024-09-14T06:01:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T06:01:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2024-09-14T06:01:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2024-09-14T06:01:15.846 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2024-09-14T06:01:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2024-09-14T06:01:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2024-09-14T06:01:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2024-09-14T06:01:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T06:01:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T06:01:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "is_stretch_pool": false, 2024-09-14T06:01:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2024-09-14T06:01:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2024-09-14T06:01:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2024-09-14T06:01:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2024-09-14T06:01:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2024-09-14T06:01:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2024-09-14T06:01:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2024-09-14T06:01:15.847 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2024-09-14T06:01:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2024-09-14T06:01:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2024-09-14T06:01:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2024-09-14T06:01:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2024-09-14T06:01:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2024-09-14T06:01:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2024-09-14T06:01:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "132", 2024-09-14T06:01:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2024-09-14T06:01:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T06:01:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T06:01:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2024-09-14T06:01:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2024-09-14T06:01:15.848 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 40, 2024-09-14T06:01:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 132, 2024-09-14T06:01:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2024-09-14T06:01:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2024-09-14T06:01:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2024-09-14T06:01:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2024-09-14T06:01:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2024-09-14T06:01:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2024-09-14T06:01:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2024-09-14T06:01:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2024-09-14T06:01:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2024-09-14T06:01:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2024-09-14T06:01:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2024-09-14T06:01:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T06:01:15.849 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T06:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T06:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2024-09-14T06:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2024-09-14T06:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2024-09-14T06:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2024-09-14T06:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2024-09-14T06:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2024-09-14T06:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2024-09-14T06:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2024-09-14T06:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2024-09-14T06:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2024-09-14T06:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T06:01:15.850 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "read_balance": { 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "score_type": "Fair distribution", 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "score_acting": 1.3200000524520874, 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "score_stable": 1.3200000524520874, 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "optimal_score": 1.1399999856948853, 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_acting": 1.5, 2024-09-14T06:01:15.851 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_stable": 1.5, 2024-09-14T06:01:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity_weighted": 0.875, 2024-09-14T06:01:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity": 1, 2024-09-14T06:01:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-14T06:01:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2024-09-14T06:01:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2024-09-14T06:01:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "9ef61ed5-359d-4de3-be54-41d3a66c393a", 2024-09-14T06:01:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:15.852 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:01:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 15, 2024-09-14T06:01:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 27, 2024-09-14T06:01:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 46, 2024-09-14T06:01:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 129, 2024-09-14T06:01:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 28, 2024-09-14T06:01:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2024-09-14T06:01:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.854 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2024-09-14T06:01:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2024-09-14T06:01:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.855 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.856 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2024-09-14T06:01:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6825/643732088", 2024-09-14T06:01:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6827/643732088", 2024-09-14T06:01:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/643732088", 2024-09-14T06:01:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/643732088", 2024-09-14T06:01:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2024-09-14T06:01:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "f180c483-9b53-4808-b5ec-537bf956087d", 2024-09-14T06:01:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:01:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:01:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:01:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:01:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2024-09-14T06:01:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:01:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:15.858 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2024-09-14T06:01:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2024-09-14T06:01:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2024-09-14T06:01:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2024-09-14T06:01:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2024-09-14T06:01:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2024-09-14T06:01:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.861 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6815/1278360579", 2024-09-14T06:01:15.862 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/1278360579", 2024-09-14T06:01:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6823/1278360579", 2024-09-14T06:01:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6821/1278360579", 2024-09-14T06:01:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2024-09-14T06:01:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "bc59bb00-b3b0-4483-a5b1-cc5907cf660a", 2024-09-14T06:01:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:15.863 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 0, 2024-09-14T06:01:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:01:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:01:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 15, 2024-09-14T06:01:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 124, 2024-09-14T06:01:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:01:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2024-09-14T06:01:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:15.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2024-09-14T06:01:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2024-09-14T06:01:15.865 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:15.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.867 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.868 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2024-09-14T06:01:15.868 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:15.868 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.868 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.868 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/4171349592", 2024-09-14T06:01:15.868 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/4171349592", 2024-09-14T06:01:15.868 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6817/4171349592", 2024-09-14T06:01:15.868 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6814/4171349592", 2024-09-14T06:01:15.868 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:15.868 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:15.868 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:15.868 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "7aa9fc3b-29c5-4e9a-a894-e2abfb586263", 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 126, 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:15.869 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.871 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.872 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2024-09-14T06:01:15.872 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:15.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.872 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.872 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2024-09-14T06:01:15.872 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:15.872 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.872 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.872 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:15.872 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.872 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.873 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2024-09-14T06:01:15.873 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:15.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.873 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.873 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2024-09-14T06:01:15.873 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:15.873 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.873 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.873 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/3999210088", 2024-09-14T06:01:15.873 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/3999210088", 2024-09-14T06:01:15.873 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/3999210088", 2024-09-14T06:01:15.873 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/3999210088", 2024-09-14T06:01:15.874 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:15.874 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:15.874 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:15.874 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.874 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2024-09-14T06:01:15.874 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "a0665f54-f53d-4536-a322-4974c2f23aa1", 2024-09-14T06:01:15.874 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:15.874 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:15.874 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:15.874 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:01:15.874 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:01:15.874 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:01:15.875 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:01:15.875 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2024-09-14T06:01:15.875 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:01:15.875 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:15.875 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:15.875 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.875 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.875 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6824", 2024-09-14T06:01:15.875 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:15.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.875 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.876 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6825", 2024-09-14T06:01:15.876 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:15.876 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.876 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.876 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:15.876 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.876 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.876 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6826", 2024-09-14T06:01:15.876 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:15.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.876 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.877 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6827", 2024-09-14T06:01:15.877 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:15.877 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.877 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.877 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:15.877 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.877 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.877 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6830", 2024-09-14T06:01:15.877 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:15.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.877 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6831", 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6828", 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.878 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6829", 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6825/575863621", 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6827/575863621", 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6831/575863621", 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6829/575863621", 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.879 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2024-09-14T06:01:15.880 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "302ab31c-c228-44da-a0d2-58505ad571cf", 2024-09-14T06:01:15.880 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:15.880 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:15.880 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:15.880 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:01:15.880 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:01:15.880 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:01:15.880 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:01:15.880 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 128, 2024-09-14T06:01:15.880 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:01:15.880 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:15.880 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:15.880 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6808", 2024-09-14T06:01:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6809", 2024-09-14T06:01:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6810", 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6811", 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.882 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6814", 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6815", 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.883 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6812", 2024-09-14T06:01:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6813", 2024-09-14T06:01:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6809/2498345645", 2024-09-14T06:01:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6811/2498345645", 2024-09-14T06:01:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6815/2498345645", 2024-09-14T06:01:15.884 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6813/2498345645", 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "1adbca34-daef-4229-b25e-40dec6800f85", 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:01:15.885 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:01:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 122, 2024-09-14T06:01:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:01:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6816", 2024-09-14T06:01:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.886 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6817", 2024-09-14T06:01:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6818", 2024-09-14T06:01:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6819", 2024-09-14T06:01:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6822", 2024-09-14T06:01:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6823", 2024-09-14T06:01:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6820", 2024-09-14T06:01:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6821", 2024-09-14T06:01:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6817/267756224", 2024-09-14T06:01:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6819/267756224", 2024-09-14T06:01:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6823/267756224", 2024-09-14T06:01:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6821/267756224", 2024-09-14T06:01:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:15.890 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2024-09-14T06:01:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "a75d9794-68bf-4e8c-bf75-448a7a783769", 2024-09-14T06:01:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:01:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:01:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:01:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:01:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 129, 2024-09-14T06:01:15.891 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:01:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6800", 2024-09-14T06:01:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6801", 2024-09-14T06:01:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.892 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6802", 2024-09-14T06:01:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6803", 2024-09-14T06:01:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:15.893 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6806", 2024-09-14T06:01:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.894 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6807", 2024-09-14T06:01:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6804", 2024-09-14T06:01:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:15.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6805", 2024-09-14T06:01:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6801/4119173763", 2024-09-14T06:01:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6803/4119173763", 2024-09-14T06:01:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6807/4119173763", 2024-09-14T06:01:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6805/4119173763", 2024-09-14T06:01:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:15.897 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2024-09-14T06:01:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2024-09-14T06:01:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.791330+0000", 2024-09-14T06:01:15.898 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 28 2024-09-14T06:01:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2024-09-14T06:01:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.526550+0000", 2024-09-14T06:01:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:01:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2024-09-14T06:01:15.899 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.664242+0000", 2024-09-14T06:01:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:01:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2024-09-14T06:01:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.327736+0000", 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.687393+0000", 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.901 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.314438+0000", 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:15.902 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.487578+0000", 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.106833+0000", 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [ 2024-09-14T06:01:15.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: "pgid": "1.0", 2024-09-14T06:01:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2024-09-14T06:01:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: 4, 2024-09-14T06:01:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: 1 2024-09-14T06:01:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: "pgid": "3.7", 2024-09-14T06:01:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2024-09-14T06:01:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: 5, 2024-09-14T06:01:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: 7 2024-09-14T06:01:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:15.905 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [], 2024-09-14T06:01:15.905 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_primaries": [], 2024-09-14T06:01:15.905 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2024-09-14T06:01:15.905 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2024-09-14T06:01:15.905 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2024-09-14T06:01:15.905 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2024-09-14T06:01:15.905 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2024-09-14T06:01:15.905 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2024-09-14T06:01:15.905 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2024-09-14T06:01:15.905 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2024-09-14T06:01:15.905 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2024-09-14T06:01:15.905 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2024-09-14T06:01:15.905 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2024-09-14T06:01:15.905 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:15.906 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [ 2024-09-14T06:01:15.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.906 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2024-09-14T06:01:15.906 INFO:teuthology.orchestra.run.smithi006.stdout: "snaps": [ 2024-09-14T06:01:15.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.906 INFO:teuthology.orchestra.run.smithi006.stdout: "begin": 18, 2024-09-14T06:01:15.906 INFO:teuthology.orchestra.run.smithi006.stdout: "length": 6 2024-09-14T06:01:15.906 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.906 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.906 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.906 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:15.906 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [ 2024-09-14T06:01:15.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.907 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2024-09-14T06:01:15.907 INFO:teuthology.orchestra.run.smithi006.stdout: "snaps": [ 2024-09-14T06:01:15.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:15.907 INFO:teuthology.orchestra.run.smithi006.stdout: "begin": 18, 2024-09-14T06:01:15.907 INFO:teuthology.orchestra.run.smithi006.stdout: "length": 1 2024-09-14T06:01:15.907 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.907 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:15.907 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.907 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:15.907 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2024-09-14T06:01:15.907 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2024-09-14T06:01:15.907 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2024-09-14T06:01:15.907 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2024-09-14T06:01:15.907 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2024-09-14T06:01:15.908 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2024-09-14T06:01:15.908 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2024-09-14T06:01:15.908 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2024-09-14T06:01:15.908 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2024-09-14T06:01:15.908 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:15.908 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:15.910 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:15.910 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:15.911 INFO:tasks.thrashosds.thrasher:j is {'epoch': 132, 'fsid': '8db933fa-392d-4966-864a-b73b8a91dd2d', 'created': '2024-09-14T05:58:34.536616+0000', 'modified': '2024-09-14T06:01:15.383264+0000', 'last_up_change': '2024-09-14T05:59:39.727882+0000', 'last_in_change': '2024-09-14T06:01:05.316677+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T05:58:47.505149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T05:58:52.779258+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T05:59:04.433909+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '132', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 40, 'snap_epoch': 132, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3200000524520874, 'score_stable': 1.3200000524520874, 'optimal_score': 1.1399999856948853, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}], 'osds': [{'osd': 0, 'uuid': '9ef61ed5-359d-4de3-be54-41d3a66c393a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 15, 'last_clean_end': 27, 'up_from': 46, 'up_thru': 129, 'down_at': 28, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6824', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6825', 'nonce': 643732088}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6826', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6827', 'nonce': 643732088}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6830', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6831', 'nonce': 643732088}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6828', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6829', 'nonce': 643732088}]}, 'public_addr': '172.21.15.6:6825/643732088', 'cluster_addr': '172.21.15.6:6827/643732088', 'heartbeat_back_addr': '172.21.15.6:6831/643732088', 'heartbeat_front_addr': '172.21.15.6:6829/643732088', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f180c483-9b53-4808-b5ec-537bf956087d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 128, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6812', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6815', 'nonce': 1278360579}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6818', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6819', 'nonce': 1278360579}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6822', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6823', 'nonce': 1278360579}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6820', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6821', 'nonce': 1278360579}]}, 'public_addr': '172.21.15.6:6815/1278360579', 'cluster_addr': '172.21.15.6:6819/1278360579', 'heartbeat_back_addr': '172.21.15.6:6823/1278360579', 'heartbeat_front_addr': '172.21.15.6:6821/1278360579', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'bc59bb00-b3b0-4483-a5b1-cc5907cf660a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 124, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6808', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6809', 'nonce': 4171349592}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6810', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6811', 'nonce': 4171349592}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6816', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6817', 'nonce': 4171349592}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6813', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6814', 'nonce': 4171349592}]}, 'public_addr': '172.21.15.6:6809/4171349592', 'cluster_addr': '172.21.15.6:6811/4171349592', 'heartbeat_back_addr': '172.21.15.6:6817/4171349592', 'heartbeat_front_addr': '172.21.15.6:6814/4171349592', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '7aa9fc3b-29c5-4e9a-a894-e2abfb586263', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 126, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6800', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6801', 'nonce': 3999210088}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6802', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6803', 'nonce': 3999210088}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6806', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6807', 'nonce': 3999210088}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6804', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6805', 'nonce': 3999210088}]}, 'public_addr': '172.21.15.6:6801/3999210088', 'cluster_addr': '172.21.15.6:6803/3999210088', 'heartbeat_back_addr': '172.21.15.6:6807/3999210088', 'heartbeat_front_addr': '172.21.15.6:6805/3999210088', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'a0665f54-f53d-4536-a322-4974c2f23aa1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 128, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6824', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6825', 'nonce': 575863621}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6826', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6827', 'nonce': 575863621}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6830', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6831', 'nonce': 575863621}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6828', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6829', 'nonce': 575863621}]}, 'public_addr': '172.21.15.154:6825/575863621', 'cluster_addr': '172.21.15.154:6827/575863621', 'heartbeat_back_addr': '172.21.15.154:6831/575863621', 'heartbeat_front_addr': '172.21.15.154:6829/575863621', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '302ab31c-c228-44da-a0d2-58505ad571cf', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 128, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6808', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6809', 'nonce': 2498345645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6810', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6811', 'nonce': 2498345645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6814', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6815', 'nonce': 2498345645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6812', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6813', 'nonce': 2498345645}]}, 'public_addr': '172.21.15.154:6809/2498345645', 'cluster_addr': '172.21.15.154:6811/2498345645', 'heartbeat_back_addr': '172.21.15.154:6815/2498345645', 'heartbeat_front_addr': '172.21.15.154:6813/2498345645', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '1adbca34-daef-4229-b25e-40dec6800f85', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6816', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6817', 'nonce': 267756224}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6818', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6819', 'nonce': 267756224}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6822', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6823', 'nonce': 267756224}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6820', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6821', 'nonce': 267756224}]}, 'public_addr': '172.21.15.154:6817/267756224', 'cluster_addr': '172.21.15.154:6819/267756224', 'heartbeat_back_addr': '172.21.15.154:6823/267756224', 'heartbeat_front_addr': '172.21.15.154:6821/267756224', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a75d9794-68bf-4e8c-bf75-448a7a783769', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 129, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 4119173763}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 4119173763}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 4119173763}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 4119173763}]}, 'public_addr': '172.21.15.154:6801/4119173763', 'cluster_addr': '172.21.15.154:6803/4119173763', 'heartbeat_back_addr': '172.21.15.154:6807/4119173763', 'heartbeat_front_addr': '172.21.15.154:6805/4119173763', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.791330+0000', 'dead_epoch': 28}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.526550+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.664242+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.327736+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.687393+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.314438+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.487578+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.106833+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '1.0', 'osds': [4, 1]}, {'pgid': '3.7', 'osds': [5, 7]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 18, 'length': 6}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 18, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T06:01:15.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T06:01:15.911 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:01:15.912 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:15.904+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:16.010 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:16.004+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:16.071 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:16.072 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:16.086 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:01:16.130 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:16.128+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:16.208 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:16.208 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:16.212 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:16.208+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:16.222 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:01:16.266 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:01:16.267 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T06:01:16.285 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-09-14T06:01:15.503520+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":564870294,"num_objects":1683,"num_object_clones":204,"num_object_copies":3366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1683,"num_whiteouts":1150,"num_read":162555,"num_read_kb":824140,"num_write":23893,"num_write_kb":447307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3225,"num_bytes_recovered":61284923,"num_keys_recovered":216,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19969,"ondisk_log_size":19969,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":543604,"kb_used_data":134516,"kb_used_omap":15,"kb_used_meta":408560,"kb_avail":754431116,"statfs":{"total":773094113280,"available":772537462784,"internally_reserved":0,"allocated":137744384,"data_stored":175606692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":418366236},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-15881088,"num_objects":-73,"num_object_clones":-4,"num_object_copies":-146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-290,"num_objects_misplaced":-411,"num_objects_unfound":0,"num_objects_dirty":-73,"num_whiteouts":-3,"num_read":587,"num_read_kb":503,"num_write":139,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1395,"num_bytes_recovered":22679419,"num_keys_recovered":68,"num_objects_omap":-3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001492"},"pg_stats":[{"pgid":"3.1f","version":"129'753","reported_seq":2671,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-14T06:01:13.306064+0000","last_change":"2024-09-14T06:01:12.312760+0000","last_active":"2024-09-14T06:01:13.306064+0000","last_peered":"2024-09-14T06:01:13.306064+0000","last_clean":"2024-09-14T06:01:13.306064+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T06:01:13.306064+0000","last_undegraded":"2024-09-14T06:01:13.306064+0000","last_fullsized":"2024-09-14T06:01:13.306064+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:44.551515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001914565,"stat_sum":{"num_bytes":32678531,"num_objects":59,"num_object_clones":7,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":40,"num_read":4383,"num_read_kb":14681,"num_write":945,"num_write_kb":5431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"14","length":"6"}]},{"pgid":"3.1e","version":"127'577","reported_seq":3143,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.309720+0000","last_change":"2024-09-14T06:01:10.306878+0000","last_active":"2024-09-14T06:01:11.309720+0000","last_peered":"2024-09-14T06:01:11.309720+0000","last_clean":"2024-09-14T06:01:11.309720+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T06:01:11.309720+0000","last_undegraded":"2024-09-14T06:01:11.309720+0000","last_fullsized":"2024-09-14T06:01:11.309720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:39.454076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011614069999999999,"stat_sum":{"num_bytes":8153258,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":26,"num_read":3487,"num_read_kb":12274,"num_write":710,"num_write_kb":12362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.1d","version":"127'379","reported_seq":6105,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.305076+0000","last_change":"2024-09-14T06:01:10.317233+0000","last_active":"2024-09-14T06:01:11.305076+0000","last_peered":"2024-09-14T06:01:11.305076+0000","last_clean":"2024-09-14T06:01:11.305076+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T06:01:11.305076+0000","last_undegraded":"2024-09-14T06:01:11.305076+0000","last_fullsized":"2024-09-14T06:01:11.305076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:55.411855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003902703,"stat_sum":{"num_bytes":11053367,"num_objects":53,"num_object_clones":3,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":40,"num_read":5568,"num_read_kb":35857,"num_write":372,"num_write_kb":26930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.1c","version":"127'554","reported_seq":4695,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.353878+0000","last_change":"2024-09-14T06:01:10.311057+0000","last_active":"2024-09-14T06:01:11.353878+0000","last_peered":"2024-09-14T06:01:11.353878+0000","last_clean":"2024-09-14T06:01:11.353878+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T06:01:11.353878+0000","last_undegraded":"2024-09-14T06:01:11.353878+0000","last_fullsized":"2024-09-14T06:01:11.353878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:46.172937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002189472,"stat_sum":{"num_bytes":11068089,"num_objects":52,"num_object_clones":6,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":35,"num_read":4928,"num_read_kb":20583,"num_write":611,"num_write_kb":8689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.1b","version":"130'540","reported_seq":1535,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-14T06:01:13.492007+0000","last_change":"2024-09-14T06:01:12.310199+0000","last_active":"2024-09-14T06:01:13.492007+0000","last_peered":"2024-09-14T06:01:13.492007+0000","last_clean":"2024-09-14T06:01:13.492007+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T06:01:13.492007+0000","last_undegraded":"2024-09-14T06:01:13.492007+0000","last_fullsized":"2024-09-14T06:01:13.492007+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:27.632706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001226434,"stat_sum":{"num_bytes":4169796,"num_objects":44,"num_object_clones":8,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":31,"num_read":2331,"num_read_kb":6128,"num_write":587,"num_write_kb":6281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"14","length":"6"}]},{"pgid":"3.1a","version":"125'933","reported_seq":5767,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.360808+0000","last_change":"2024-09-14T06:01:10.301523+0000","last_active":"2024-09-14T06:01:11.360808+0000","last_peered":"2024-09-14T06:01:11.360808+0000","last_clean":"2024-09-14T06:01:11.360808+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T06:01:11.360808+0000","last_undegraded":"2024-09-14T06:01:11.360808+0000","last_fullsized":"2024-09-14T06:01:11.360808+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:50.544785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024484120000000001,"stat_sum":{"num_bytes":3645553,"num_objects":50,"num_object_clones":2,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":37,"num_read":8007,"num_read_kb":44249,"num_write":1251,"num_write_kb":19834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.19","version":"127'518","reported_seq":3136,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.309105+0000","last_change":"2024-09-14T06:01:10.299692+0000","last_active":"2024-09-14T06:01:11.309105+0000","last_peered":"2024-09-14T06:01:11.309105+0000","last_clean":"2024-09-14T06:01:11.309105+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T06:01:11.309105+0000","last_undegraded":"2024-09-14T06:01:11.309105+0000","last_fullsized":"2024-09-14T06:01:11.309105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:24.516590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00113955,"stat_sum":{"num_bytes":24964071,"num_objects":46,"num_object_clones":4,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":34,"num_read":3553,"num_read_kb":21732,"num_write":593,"num_write_kb":16615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.18","version":"127'508","reported_seq":5964,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.308523+0000","last_change":"2024-09-14T06:01:10.306409+0000","last_active":"2024-09-14T06:01:11.308523+0000","last_peered":"2024-09-14T06:01:11.308523+0000","last_clean":"2024-09-14T06:01:11.308523+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T06:01:11.308523+0000","last_undegraded":"2024-09-14T06:01:11.308523+0000","last_fullsized":"2024-09-14T06:01:11.308523+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:10.023917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001237721,"stat_sum":{"num_bytes":45778646,"num_objects":59,"num_object_clones":9,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":38,"num_read":6957,"num_read_kb":51189,"num_write":495,"num_write_kb":14197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.17","version":"129'412","reported_seq":3260,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-14T06:01:13.306013+0000","last_change":"2024-09-14T06:01:12.312802+0000","last_active":"2024-09-14T06:01:13.306013+0000","last_peered":"2024-09-14T06:01:13.306013+0000","last_clean":"2024-09-14T06:01:13.306013+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T06:01:13.306013+0000","last_undegraded":"2024-09-14T06:01:13.306013+0000","last_fullsized":"2024-09-14T06:01:13.306013+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:55:20.713355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020099200000000001,"stat_sum":{"num_bytes":13741310,"num_objects":48,"num_object_clones":8,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":33,"num_read":3591,"num_read_kb":21292,"num_write":357,"num_write_kb":6976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"14","length":"6"}]},{"pgid":"3.16","version":"121'1458","reported_seq":4215,"reported_epoch":127,"state":"peering","last_fresh":"2024-09-14T06:01:10.638603+0000","last_change":"2024-09-14T06:01:11.305741+0000","last_active":"2024-09-14T06:01:11.305741+0000","last_peered":"2024-09-14T06:01:10.638603+0000","last_clean":"2024-09-14T06:01:04.340705+0000","last_became_active":"2024-09-14T06:01:07.809231+0000","last_became_peered":"2024-09-14T06:01:07.809231+0000","last_unstale":"2024-09-14T06:01:10.638603+0000","last_undegraded":"2024-09-14T06:01:10.638603+0000","last_fullsized":"2024-09-14T06:01:07.332022+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1458,"log_dups_size":0,"ondisk_log_size":1458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.014003888000000001,"stat_sum":{"num_bytes":25554944,"num_objects":52,"num_object_clones":8,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":33,"num_read":8264,"num_read_kb":22572,"num_write":2461,"num_write_kb":21400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":246,"num_bytes_recovered":5782955,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,7],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"18","length":"2"}]},{"pgid":"3.15","version":"128'742","reported_seq":6547,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.316672+0000","last_change":"2024-09-14T06:01:11.316672+0000","last_active":"2024-09-14T06:01:11.316672+0000","last_peered":"2024-09-14T06:01:11.316672+0000","last_clean":"2024-09-14T06:01:11.316672+0000","last_became_active":"2024-09-14T06:01:11.310954+0000","last_became_peered":"2024-09-14T06:01:11.310954+0000","last_unstale":"2024-09-14T06:01:11.316672+0000","last_undegraded":"2024-09-14T06:01:11.316672+0000","last_fullsized":"2024-09-14T06:01:11.316672+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:08.262239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023903190000000001,"stat_sum":{"num_bytes":37533632,"num_objects":69,"num_object_clones":11,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":44,"num_read":7625,"num_read_kb":54828,"num_write":829,"num_write_kb":20153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":314,"num_bytes_recovered":5293699,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.14","version":"120'590","reported_seq":5556,"reported_epoch":127,"state":"peering","last_fresh":"2024-09-14T06:01:10.407182+0000","last_change":"2024-09-14T06:01:11.301363+0000","last_active":"2024-09-14T06:01:11.301363+0000","last_peered":"2024-09-14T06:01:10.407182+0000","last_clean":"2024-09-14T06:01:04.298616+0000","last_became_active":"2024-09-14T06:01:07.803265+0000","last_became_peered":"2024-09-14T06:01:07.803265+0000","last_unstale":"2024-09-14T06:01:10.407182+0000","last_undegraded":"2024-09-14T06:01:10.407182+0000","last_fullsized":"2024-09-14T06:01:07.328915+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0059535209999999998,"stat_sum":{"num_bytes":16226860,"num_objects":50,"num_object_clones":7,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":33,"num_read":5515,"num_read_kb":30465,"num_write":796,"num_write_kb":16045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":1542204,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6,7],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"18","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":245,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.303933+0000","last_change":"2024-09-14T06:01:06.338467+0000","last_active":"2024-09-14T06:01:11.303933+0000","last_peered":"2024-09-14T06:01:11.303933+0000","last_clean":"2024-09-14T06:01:11.303933+0000","last_became_active":"2024-09-14T06:01:06.337939+0000","last_became_peered":"2024-09-14T06:01:06.337939+0000","last_unstale":"2024-09-14T06:01:11.303933+0000","last_undegraded":"2024-09-14T06:01:11.303933+0000","last_fullsized":"2024-09-14T06:01:11.303933+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:06.843302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"130'1080","reported_seq":5224,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-14T06:01:13.305954+0000","last_change":"2024-09-14T06:01:12.311490+0000","last_active":"2024-09-14T06:01:13.305954+0000","last_peered":"2024-09-14T06:01:13.305954+0000","last_clean":"2024-09-14T06:01:13.305954+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T06:01:13.305954+0000","last_undegraded":"2024-09-14T06:01:13.305954+0000","last_fullsized":"2024-09-14T06:01:13.305954+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:48.540094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001832272,"stat_sum":{"num_bytes":13150618,"num_objects":50,"num_object_clones":6,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":34,"num_read":8335,"num_read_kb":25378,"num_write":1436,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"14","length":"6"}]},{"pgid":"2.6","version":"0'0","reported_seq":233,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.311117+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T06:01:11.311117+0000","last_peered":"2024-09-14T06:01:11.311117+0000","last_clean":"2024-09-14T06:01:11.311117+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T06:01:11.311117+0000","last_undegraded":"2024-09-14T06:01:11.311117+0000","last_fullsized":"2024-09-14T06:01:11.311117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"127'413","reported_seq":4626,"reported_epoch":128,"state":"creating+peering","last_fresh":"2024-09-14T06:01:11.019708+0000","last_change":"2024-09-14T06:01:11.663980+0000","last_active":"2024-09-14T06:01:11.663980+0000","last_peered":"2024-09-14T06:01:11.019708+0000","last_clean":"2024-09-14T06:01:04.413350+0000","last_became_active":"2024-09-14T06:01:07.806285+0000","last_became_peered":"2024-09-14T06:01:07.806285+0000","last_unstale":"2024-09-14T06:01:11.019708+0000","last_undegraded":"2024-09-14T06:01:11.019708+0000","last_fullsized":"2024-09-14T06:01:07.335856+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0068275200000000001,"stat_sum":{"num_bytes":48297577,"num_objects":54,"num_object_clones":6,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":33,"num_read":3979,"num_read_kb":32297,"num_write":409,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":395,"num_bytes_recovered":12102195,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"18","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.304476+0000","last_change":"2024-09-14T06:01:06.341522+0000","last_active":"2024-09-14T06:01:11.304476+0000","last_peered":"2024-09-14T06:01:11.304476+0000","last_clean":"2024-09-14T06:01:11.304476+0000","last_became_active":"2024-09-14T06:01:06.341175+0000","last_became_peered":"2024-09-14T06:01:06.341175+0000","last_unstale":"2024-09-14T06:01:11.304476+0000","last_undegraded":"2024-09-14T06:01:11.304476+0000","last_fullsized":"2024-09-14T06:01:11.304476+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:47.800325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"127'399","reported_seq":4084,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.310030+0000","last_change":"2024-09-14T06:01:10.300703+0000","last_active":"2024-09-14T06:01:11.310030+0000","last_peered":"2024-09-14T06:01:11.310030+0000","last_clean":"2024-09-14T06:01:11.310030+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T06:01:11.310030+0000","last_undegraded":"2024-09-14T06:01:11.310030+0000","last_fullsized":"2024-09-14T06:01:11.310030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:37:33.647443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002042397,"stat_sum":{"num_bytes":3829651,"num_objects":43,"num_object_clones":2,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":35,"num_read":3751,"num_read_kb":24829,"num_write":432,"num_write_kb":9879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"2.4","version":"0'0","reported_seq":242,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.310132+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T06:01:11.310132+0000","last_peered":"2024-09-14T06:01:11.310132+0000","last_clean":"2024-09-14T06:01:11.310132+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T06:01:11.310132+0000","last_undegraded":"2024-09-14T06:01:11.310132+0000","last_fullsized":"2024-09-14T06:01:11.310132+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"127'463","reported_seq":3987,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.305291+0000","last_change":"2024-09-14T06:01:10.314058+0000","last_active":"2024-09-14T06:01:11.305291+0000","last_peered":"2024-09-14T06:01:11.305291+0000","last_clean":"2024-09-14T06:01:11.305291+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T06:01:11.305291+0000","last_undegraded":"2024-09-14T06:01:11.305291+0000","last_fullsized":"2024-09-14T06:01:11.305291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:39:35.685811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039967220000000003,"stat_sum":{"num_bytes":9279292,"num_objects":47,"num_object_clones":7,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":31,"num_read":4796,"num_read_kb":19484,"num_write":452,"num_write_kb":8553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.3","version":"128'597","reported_seq":3338,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.348747+0000","last_change":"2024-09-14T06:01:10.302966+0000","last_active":"2024-09-14T06:01:11.348747+0000","last_peered":"2024-09-14T06:01:11.348747+0000","last_clean":"2024-09-14T06:01:11.348747+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T06:01:11.348747+0000","last_undegraded":"2024-09-14T06:01:11.348747+0000","last_fullsized":"2024-09-14T06:01:11.348747+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:30.675107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028098070000000001,"stat_sum":{"num_bytes":31468584,"num_objects":51,"num_object_clones":5,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":36,"num_read":3888,"num_read_kb":39352,"num_write":569,"num_write_kb":15912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"2.2","version":"22'2","reported_seq":235,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.305083+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T06:01:11.305083+0000","last_peered":"2024-09-14T06:01:11.305083+0000","last_clean":"2024-09-14T06:01:11.305083+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T06:01:11.305083+0000","last_undegraded":"2024-09-14T06:01:11.305083+0000","last_fullsized":"2024-09-14T06:01:11.305083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"125'965","reported_seq":2862,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.309350+0000","last_change":"2024-09-14T06:01:10.299662+0000","last_active":"2024-09-14T06:01:11.309350+0000","last_peered":"2024-09-14T06:01:11.309350+0000","last_clean":"2024-09-14T06:01:11.309350+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T06:01:11.309350+0000","last_undegraded":"2024-09-14T06:01:11.309350+0000","last_fullsized":"2024-09-14T06:01:11.309350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:03:25.380293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001135247,"stat_sum":{"num_bytes":12998466,"num_objects":63,"num_object_clones":7,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":44,"num_read":4830,"num_read_kb":20135,"num_write":1417,"num_write_kb":18367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"2.1","version":"0'0","reported_seq":102,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.308764+0000","last_change":"2024-09-14T06:00:25.625653+0000","last_active":"2024-09-14T06:01:11.308764+0000","last_peered":"2024-09-14T06:01:11.308764+0000","last_clean":"2024-09-14T06:01:11.308764+0000","last_became_active":"2024-09-14T06:00:25.625192+0000","last_became_peered":"2024-09-14T06:00:25.625192+0000","last_unstale":"2024-09-14T06:01:11.308764+0000","last_undegraded":"2024-09-14T06:01:11.308764+0000","last_fullsized":"2024-09-14T06:01:11.308764+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:36.805054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"129'486","reported_seq":2717,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-14T06:01:13.305799+0000","last_change":"2024-09-14T06:01:12.310664+0000","last_active":"2024-09-14T06:01:13.305799+0000","last_peered":"2024-09-14T06:01:13.305799+0000","last_clean":"2024-09-14T06:01:13.305799+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T06:01:13.305799+0000","last_undegraded":"2024-09-14T06:01:13.305799+0000","last_fullsized":"2024-09-14T06:01:13.305799+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:02:03.026726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015330770000000001,"stat_sum":{"num_bytes":9016818,"num_objects":51,"num_object_clones":8,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":37,"num_read":2961,"num_read_kb":24088,"num_write":462,"num_write_kb":10967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"14","length":"6"}]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.303088+0000","last_change":"2024-09-14T06:01:06.333463+0000","last_active":"2024-09-14T06:01:11.303088+0000","last_peered":"2024-09-14T06:01:11.303088+0000","last_clean":"2024-09-14T06:01:11.303088+0000","last_became_active":"2024-09-14T06:01:06.332068+0000","last_became_peered":"2024-09-14T06:01:06.332068+0000","last_unstale":"2024-09-14T06:01:11.303088+0000","last_undegraded":"2024-09-14T06:01:11.303088+0000","last_fullsized":"2024-09-14T06:01:11.303088+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:21.846750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"125'341","reported_seq":2401,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.309168+0000","last_change":"2024-09-14T06:01:10.307368+0000","last_active":"2024-09-14T06:01:11.309168+0000","last_peered":"2024-09-14T06:01:11.309168+0000","last_clean":"2024-09-14T06:01:11.309168+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T06:01:11.309168+0000","last_undegraded":"2024-09-14T06:01:11.309168+0000","last_fullsized":"2024-09-14T06:01:11.309168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:10:28.115627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001445893,"stat_sum":{"num_bytes":7352712,"num_objects":48,"num_object_clones":6,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":34,"num_read":1846,"num_read_kb":21996,"num_write":368,"num_write_kb":9648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"2.3","version":"20'1","reported_seq":234,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.304910+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T06:01:11.304910+0000","last_peered":"2024-09-14T06:01:11.304910+0000","last_clean":"2024-09-14T06:01:11.304910+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T06:01:11.304910+0000","last_undegraded":"2024-09-14T06:01:11.304910+0000","last_fullsized":"2024-09-14T06:01:11.304910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":66,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.300409+0000","last_change":"2024-09-14T06:00:48.871361+0000","last_active":"2024-09-14T06:01:11.300409+0000","last_peered":"2024-09-14T06:01:11.300409+0000","last_clean":"2024-09-14T06:01:11.300409+0000","last_became_active":"2024-09-14T06:00:48.845773+0000","last_became_peered":"2024-09-14T06:00:48.845773+0000","last_unstale":"2024-09-14T06:01:11.300409+0000","last_undegraded":"2024-09-14T06:01:11.300409+0000","last_fullsized":"2024-09-14T06:01:11.300409+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:59.588543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"128'702","reported_seq":2218,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.323177+0000","last_change":"2024-09-14T06:01:10.305512+0000","last_active":"2024-09-14T06:01:11.323177+0000","last_peered":"2024-09-14T06:01:11.323177+0000","last_clean":"2024-09-14T06:01:11.323177+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T06:01:11.323177+0000","last_undegraded":"2024-09-14T06:01:11.323177+0000","last_fullsized":"2024-09-14T06:01:11.323177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:27.869933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00067950400000000005,"stat_sum":{"num_bytes":17118728,"num_objects":54,"num_object_clones":6,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":36,"num_read":3313,"num_read_kb":6629,"num_write":904,"num_write_kb":4400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.9","version":"127'366","reported_seq":4741,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.301220+0000","last_change":"2024-09-14T06:01:10.301328+0000","last_active":"2024-09-14T06:01:11.301220+0000","last_peered":"2024-09-14T06:01:11.301220+0000","last_clean":"2024-09-14T06:01:11.301220+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T06:01:11.301220+0000","last_undegraded":"2024-09-14T06:01:11.301220+0000","last_fullsized":"2024-09-14T06:01:11.301220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:44:13.327975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023005310000000002,"stat_sum":{"num_bytes":27364474,"num_objects":46,"num_object_clones":4,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":31,"num_read":4613,"num_read_kb":34486,"num_write":353,"num_write_kb":27482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.a","version":"128'644","reported_seq":2516,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.383187+0000","last_change":"2024-09-14T06:01:10.417531+0000","last_active":"2024-09-14T06:01:11.383187+0000","last_peered":"2024-09-14T06:01:11.383187+0000","last_clean":"2024-09-14T06:01:11.383187+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T06:01:11.383187+0000","last_undegraded":"2024-09-14T06:01:11.383187+0000","last_fullsized":"2024-09-14T06:01:11.383187+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:12.136950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069402099999999996,"stat_sum":{"num_bytes":6621295,"num_objects":55,"num_object_clones":8,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":36,"num_read":3295,"num_read_kb":12413,"num_write":742,"num_write_kb":6088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.b","version":"127'859","reported_seq":3574,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.309375+0000","last_change":"2024-09-14T06:01:10.306985+0000","last_active":"2024-09-14T06:01:11.309375+0000","last_peered":"2024-09-14T06:01:11.309375+0000","last_clean":"2024-09-14T06:01:11.309375+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T06:01:11.309375+0000","last_undegraded":"2024-09-14T06:01:11.309375+0000","last_fullsized":"2024-09-14T06:01:11.309375+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:05.991851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011807779999999999,"stat_sum":{"num_bytes":2713677,"num_objects":45,"num_object_clones":6,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":30,"num_read":5690,"num_read_kb":26983,"num_write":1277,"num_write_kb":14118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.c","version":"127'596","reported_seq":5125,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.305448+0000","last_change":"2024-09-14T06:01:10.313973+0000","last_active":"2024-09-14T06:01:11.305448+0000","last_peered":"2024-09-14T06:01:11.305448+0000","last_clean":"2024-09-14T06:01:11.305448+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T06:01:11.305448+0000","last_undegraded":"2024-09-14T06:01:11.305448+0000","last_fullsized":"2024-09-14T06:01:11.305448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:26.157553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043349069999999998,"stat_sum":{"num_bytes":30042963,"num_objects":49,"num_object_clones":3,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":40,"num_read":6117,"num_read_kb":23676,"num_write":511,"num_write_kb":12874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.d","version":"125'374","reported_seq":3536,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.304337+0000","last_change":"2024-09-14T06:01:10.323465+0000","last_active":"2024-09-14T06:01:11.304337+0000","last_peered":"2024-09-14T06:01:11.304337+0000","last_clean":"2024-09-14T06:01:11.304337+0000","last_became_active":"2024-09-14T06:01:10.315076+0000","last_became_peered":"2024-09-14T06:01:10.315076+0000","last_unstale":"2024-09-14T06:01:11.304337+0000","last_undegraded":"2024-09-14T06:01:11.304337+0000","last_fullsized":"2024-09-14T06:01:11.304337+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:40.841685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047053490000000002,"stat_sum":{"num_bytes":14191186,"num_objects":54,"num_object_clones":8,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":39,"num_read":3520,"num_read_kb":21592,"num_write":386,"num_write_kb":13467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":2150148,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.e","version":"125'577","reported_seq":5001,"reported_epoch":128,"state":"active+remapped","last_fresh":"2024-09-14T06:01:11.382908+0000","last_change":"2024-09-14T06:01:11.383175+0000","last_active":"2024-09-14T06:01:11.382908+0000","last_peered":"2024-09-14T06:01:11.382908+0000","last_clean":"2024-09-14T06:01:04.318382+0000","last_became_active":"2024-09-14T06:01:07.808768+0000","last_became_peered":"2024-09-14T06:01:07.808768+0000","last_unstale":"2024-09-14T06:01:11.382908+0000","last_undegraded":"2024-09-14T06:01:11.382908+0000","last_fullsized":"2024-09-14T06:01:11.382908+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0086666509999999992,"stat_sum":{"num_bytes":9738351,"num_objects":57,"num_object_clones":8,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":36,"num_read":5786,"num_read_kb":24619,"num_write":551,"num_write_kb":11398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":302,"num_bytes_recovered":1794796,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[1,4],"avail_no_missing":["1","4","7"],"object_location_counts":[{"shards":"1,4","objects":57}],"blocked_by":[],"up_primary":7,"acting_primary":1,"purged_snaps":[{"start":"18","length":"2"}]},{"pgid":"3.f","version":"128'598","reported_seq":6438,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.314789+0000","last_change":"2024-09-14T06:01:11.314789+0000","last_active":"2024-09-14T06:01:11.314789+0000","last_peered":"2024-09-14T06:01:11.314789+0000","last_clean":"2024-09-14T06:01:11.314789+0000","last_became_active":"2024-09-14T06:01:11.308576+0000","last_became_peered":"2024-09-14T06:01:11.308576+0000","last_unstale":"2024-09-14T06:01:11.314789+0000","last_undegraded":"2024-09-14T06:01:11.314789+0000","last_fullsized":"2024-09-14T06:01:11.314789+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:54.825172+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0043130449999999997,"stat_sum":{"num_bytes":8638957,"num_objects":46,"num_object_clones":2,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":33,"num_read":7128,"num_read_kb":14620,"num_write":661,"num_write_kb":6363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":2812424,"num_keys_recovered":33,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.10","version":"127'861","reported_seq":3989,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.303994+0000","last_change":"2024-09-14T06:01:10.417762+0000","last_active":"2024-09-14T06:01:11.303994+0000","last_peered":"2024-09-14T06:01:11.303994+0000","last_clean":"2024-09-14T06:01:11.303994+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T06:01:11.303994+0000","last_undegraded":"2024-09-14T06:01:11.303994+0000","last_fullsized":"2024-09-14T06:01:11.303994+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:52.281740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053206300000000005,"stat_sum":{"num_bytes":8979789,"num_objects":71,"num_object_clones":9,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":50,"num_read":6087,"num_read_kb":18862,"num_write":1138,"num_write_kb":11801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.11","version":"128'509","reported_seq":6422,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.384806+0000","last_change":"2024-09-14T06:01:10.324253+0000","last_active":"2024-09-14T06:01:11.384806+0000","last_peered":"2024-09-14T06:01:11.384806+0000","last_clean":"2024-09-14T06:01:11.384806+0000","last_became_active":"2024-09-14T06:01:10.313436+0000","last_became_peered":"2024-09-14T06:01:10.313436+0000","last_unstale":"2024-09-14T06:01:11.384806+0000","last_undegraded":"2024-09-14T06:01:11.384806+0000","last_fullsized":"2024-09-14T06:01:11.384806+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:21.247717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058329920000000004,"stat_sum":{"num_bytes":38786238,"num_objects":62,"num_object_clones":6,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":41,"num_read":6149,"num_read_kb":34071,"num_write":594,"num_write_kb":31048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":284,"num_bytes_recovered":12777008,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"15","length":"5"}]},{"pgid":"3.12","version":"130'671","reported_seq":6357,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-14T06:01:13.491136+0000","last_change":"2024-09-14T06:01:13.316570+0000","last_active":"2024-09-14T06:01:13.491136+0000","last_peered":"2024-09-14T06:01:13.491136+0000","last_clean":"2024-09-14T06:01:13.491136+0000","last_became_active":"2024-09-14T06:01:13.308786+0000","last_became_peered":"2024-09-14T06:01:13.308786+0000","last_unstale":"2024-09-14T06:01:13.491136+0000","last_undegraded":"2024-09-14T06:01:13.491136+0000","last_fullsized":"2024-09-14T06:01:13.491136+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:51.978477+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0045457539999999999,"stat_sum":{"num_bytes":10822074,"num_objects":55,"num_object_clones":6,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":41,"num_read":6654,"num_read_kb":29017,"num_write":685,"num_write_kb":10836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":345,"num_bytes_recovered":3407405,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"14","length":"6"}]},{"pgid":"3.13","version":"127'429","reported_seq":6397,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-14T06:01:11.303766+0000","last_change":"2024-09-14T06:01:10.304957+0000","last_active":"2024-09-14T06:01:11.303766+0000","last_peered":"2024-09-14T06:01:11.303766+0000","last_clean":"2024-09-14T06:01:11.303766+0000","last_became_active":"2024-09-14T06:01:09.310474+0000","last_became_peered":"2024-09-14T06:01:09.310474+0000","last_unstale":"2024-09-14T06:01:11.303766+0000","last_undegraded":"2024-09-14T06:01:11.303766+0000","last_fullsized":"2024-09-14T06:01:11.303766+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:33:14.986921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001840178,"stat_sum":{"num_bytes":19300400,"num_objects":55,"num_object_clones":11,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":29,"num_read":5542,"num_read_kb":33708,"num_write":436,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":300,"num_bytes_recovered":8189194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"15","length":"5"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":564279907,"num_objects":1679,"num_object_clones":204,"num_object_copies":3358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1679,"num_whiteouts":1150,"num_read":162489,"num_read_kb":824085,"num_write":23790,"num_write_kb":445677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3223,"num_bytes_recovered":60694555,"num_keys_recovered":216,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122626048,"data_stored":166097818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19894,"ondisk_log_size":19894,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46356,"kb_used_data":6840,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94325484,"statfs":{"total":96636764160,"available":96589295616,"internally_reserved":0,"allocated":7004160,"data_stored":9254977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495636,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69416,"kb_used_data":15052,"kb_used_omap":4,"kb_used_meta":54331,"kb_avail":94302424,"statfs":{"total":96636764160,"available":96565682176,"internally_reserved":0,"allocated":15413248,"data_stored":21961468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":55635632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542177,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88704,"kb_used_data":22768,"kb_used_omap":1,"kb_used_meta":65918,"kb_avail":94283136,"statfs":{"total":96636764160,"available":96545931264,"internally_reserved":0,"allocated":23314432,"data_stored":28847007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":67500490},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47372,"kb_used_data":7860,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94324468,"statfs":{"total":96636764160,"available":96588255232,"internally_reserved":0,"allocated":8048640,"data_stored":10020843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542176,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68916,"kb_used_data":19680,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94302924,"statfs":{"total":96636764160,"available":96566194176,"internally_reserved":0,"allocated":20152320,"data_stored":23048079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542177,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83868,"kb_used_data":26312,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94287972,"statfs":{"total":96636764160,"available":96550883328,"internally_reserved":0,"allocated":26943488,"data_stored":34665059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74532,"kb_used_data":20976,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94297308,"statfs":{"total":96636764160,"available":96560443392,"internally_reserved":0,"allocated":21479424,"data_stored":26259017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64440,"kb_used_data":15028,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307400,"statfs":{"total":96636764160,"available":96570777600,"internally_reserved":0,"allocated":15388672,"data_stored":21550242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13864960,"data_stored":21228000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13266944,"data_stored":20238653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4931584,"data_stored":7462989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19955712,"data_stored":25536440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22323200,"data_stored":29657636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18624512,"data_stored":22326858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6524928,"data_stored":9299641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23134208,"data_stored":30347601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T06:01:16.287 INFO:tasks.thrashosds.thrasher:Setting 3.12 to [2, 5, 7, 3] 2024-09-14T06:01:16.287 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.12', '2', '5', '7', '3'] 2024-09-14T06:01:16.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.12 2 5 7 3 2024-09-14T06:01:16.327 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:16.324+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:16.395 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:16.395 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:16.413 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:01:16.414 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:16.408+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:16.514 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:16.512+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:16.547 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:16.547 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:16.562 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:01:16.654 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:16.652+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:16.715 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:16.712+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:16.730 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:16.731 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:16.744 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:01:16.816 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:16.812+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:16.909 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:16.909 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:16.917 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:16.912+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:16.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:01:17.018 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:17.016+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:17.056 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:17.057 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:17.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:01:17.118 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:17.116+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:17.191 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:17.192 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:17.206 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:01:17.219 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:17.216+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:17.320 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:17.320+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:17.333 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:17.333 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:17.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:01:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:set 3.12 pg_upmap_items mapping to [2->5,7->3] 2024-09-14T06:01:17.423 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:17.416+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:17.429 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T06:01:17.484 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:17.484 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:17.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:01:17.522 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:17.520+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:17.623 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:17.620+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:17.630 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:17.631 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:17.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:01:17.724 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:17.720+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:17.757 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:17.757 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:17.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:01:17.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:01:17.859 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:17.856+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:17.924 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:17.925 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:17.925 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:17.920+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:17.939 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:01:17.953 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:17.953 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:17.969 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:17.969 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:17.985 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:18.002 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:18.022 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:18.023 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:18.026 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:18.024+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:18.043 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:18.064 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:18.065 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:18.065 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:18.065 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:18.065 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:18.065 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:18.078 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:01:18.085 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:18.085 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:18.151 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:18.148+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:18.208 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:18.208 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:18.208 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:18.209 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:18.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.209 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3629 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'31, mlcod=31'25)", 2024-09-14T06:01:18.209 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:18.209 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 120.878059523, 2024-09-14T06:01:18.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048071900000000002, 2024-09-14T06:01:18.209 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.209 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.209 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.209 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.209 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.209 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:18.209 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329482+0000", 2024-09-14T06:01:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329483+0000", 2024-09-14T06:01:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0999999999999998e-07 2024-09-14T06:01:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.210 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329488+0000", 2024-09-14T06:01:18.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0900000000000004e-06 2024-09-14T06:01:18.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.211 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.211 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329496+0000", 2024-09-14T06:01:18.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2209999999999997e-06 2024-09-14T06:01:18.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.211 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.211 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329501+0000", 2024-09-14T06:01:18.211 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8729999999999998e-06 2024-09-14T06:01:18.211 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329545+0000", 2024-09-14T06:01:18.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4382999999999998e-05 2024-09-14T06:01:18.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.329564+0000", 2024-09-14T06:01:18.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8947999999999999e-05 2024-09-14T06:01:18.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.212 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.212 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334225+0000", 2024-09-14T06:01:18.212 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004660923 2024-09-14T06:01:18.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.213 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.213 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.334289+0000", 2024-09-14T06:01:18.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4041999999999994e-05 2024-09-14T06:01:18.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.213 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.213 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.213 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.213 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3632 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'34, mlcod=31'27)", 2024-09-14T06:01:18.213 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:18.213 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 120.874937335, 2024-09-14T06:01:18.213 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047983469999999997, 2024-09-14T06:01:18.213 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.214 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.214 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.214 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.214 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:18.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.214 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.214 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332604+0000", 2024-09-14T06:01:18.214 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332605+0000", 2024-09-14T06:01:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5099999999999999e-07 2024-09-14T06:01:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332611+0000", 2024-09-14T06:01:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6999999999999996e-06 2024-09-14T06:01:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332623+0000", 2024-09-14T06:01:18.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2401e-05 2024-09-14T06:01:18.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332629+0000", 2024-09-14T06:01:18.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3720000000000001e-06 2024-09-14T06:01:18.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.216 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332691+0000", 2024-09-14T06:01:18.216 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1451000000000005e-05 2024-09-14T06:01:18.216 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.216 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.216 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.217 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.332711+0000", 2024-09-14T06:01:18.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0285e-05 2024-09-14T06:01:18.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.217 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.217 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337341+0000", 2024-09-14T06:01:18.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046295900000000003 2024-09-14T06:01:18.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.217 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.217 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.337402+0000", 2024-09-14T06:01:18.217 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1797000000000005e-05 2024-09-14T06:01:18.217 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.218 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.218 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.218 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:3638 3.4 e31/24 3:2209f761:::rbd_object_map.1127a326aacb:head v 31'40, mlcod=31'32)", 2024-09-14T06:01:18.218 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:18.218 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 120.86879542, 2024-09-14T06:01:18.218 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004283345, 2024-09-14T06:01:18.218 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.218 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.218 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.218 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.218 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338746+0000", 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338747+0000", 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.219 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338756+0000", 2024-09-14T06:01:18.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5909999999999996e-06 2024-09-14T06:01:18.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338774+0000", 2024-09-14T06:01:18.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.8073000000000001e-05 2024-09-14T06:01:18.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.220 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.220 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.220 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338785+0000", 2024-09-14T06:01:18.220 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1017e-05 2024-09-14T06:01:18.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.221 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.221 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338844+0000", 2024-09-14T06:01:18.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.9292000000000001e-05 2024-09-14T06:01:18.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.221 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.221 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.338864+0000", 2024-09-14T06:01:18.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9528999999999999e-05 2024-09-14T06:01:18.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.221 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.221 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.342984+0000", 2024-09-14T06:01:18.221 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041207809999999996 2024-09-14T06:01:18.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.222 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.222 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:17.343029+0000", 2024-09-14T06:01:18.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5034000000000003e-05 2024-09-14T06:01:18.222 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.222 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.222 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.222 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.222 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:17596 3.4 e41/24 3:27f62511:::rbd_data.1127d65075f9.00000000000000ca:head v 41'97, mlcod=41'95)", 2024-09-14T06:01:18.222 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:18.222 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 108.237042856, 2024-09-14T06:01:18.222 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049456559999999997, 2024-09-14T06:01:18.223 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.223 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.223 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.223 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.223 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.223 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:18.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.223 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.223 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970499+0000", 2024-09-14T06:01:18.223 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970500+0000", 2024-09-14T06:01:18.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9600000000000008e-07 2024-09-14T06:01:18.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.224 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970614+0000", 2024-09-14T06:01:18.224 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000113956 2024-09-14T06:01:18.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.224 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970631+0000", 2024-09-14T06:01:18.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7150999999999999e-05 2024-09-14T06:01:18.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.225 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970643+0000", 2024-09-14T06:01:18.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1868999999999999e-05 2024-09-14T06:01:18.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.225 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.225 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970711+0000", 2024-09-14T06:01:18.225 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8952e-05 2024-09-14T06:01:18.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.225 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.970738+0000", 2024-09-14T06:01:18.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6055999999999999e-05 2024-09-14T06:01:18.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975388+0000", 2024-09-14T06:01:18.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046502499999999999 2024-09-14T06:01:18.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.226 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.226 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:29.975444+0000", 2024-09-14T06:01:18.226 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6425999999999998e-05 2024-09-14T06:01:18.226 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24289 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'57, mlcod=41'54)", 2024-09-14T06:01:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 106.051750677, 2024-09-14T06:01:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.060867738999999997, 2024-09-14T06:01:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.227 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155791+0000", 2024-09-14T06:01:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.155793+0000", 2024-09-14T06:01:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9470000000000002e-06 2024-09-14T06:01:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181776+0000", 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.02598313 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181817+0000", 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1440000000000003e-05 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181834+0000", 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6979000000000001e-05 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181931+0000", 2024-09-14T06:01:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7219999999999994e-05 2024-09-14T06:01:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.181964+0000", 2024-09-14T06:01:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2094999999999997e-05 2024-09-14T06:01:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216586+0000", 2024-09-14T06:01:18.230 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.034622503999999998 2024-09-14T06:01:18.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.231 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.231 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.216658+0000", 2024-09-14T06:01:18.231 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2423999999999996e-05 2024-09-14T06:01:18.231 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.231 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.231 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.231 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.231 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.231 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:24309 3.9 e41/24 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head v 41'58, mlcod=41'56)", 2024-09-14T06:01:18.231 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:18.231 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 105.952515572, 2024-09-14T06:01:18.231 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044435519999999999, 2024-09-14T06:01:18.232 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.232 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.232 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.232 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.232 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.232 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:18.232 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.232 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.232 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255026+0000", 2024-09-14T06:01:18.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.233 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255027+0000", 2024-09-14T06:01:18.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.463e-06 2024-09-14T06:01:18.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.233 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.233 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255040+0000", 2024-09-14T06:01:18.233 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2773e-05 2024-09-14T06:01:18.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.234 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.234 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255066+0000", 2024-09-14T06:01:18.234 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5459000000000001e-05 2024-09-14T06:01:18.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.234 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.234 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255076+0000", 2024-09-14T06:01:18.234 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0372e-05 2024-09-14T06:01:18.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.234 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.234 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255151+0000", 2024-09-14T06:01:18.234 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5444999999999993e-05 2024-09-14T06:01:18.234 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.255176+0000", 2024-09-14T06:01:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5089e-05 2024-09-14T06:01:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259379+0000", 2024-09-14T06:01:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0042025439999999999 2024-09-14T06:01:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:32.259469+0000", 2024-09-14T06:01:18.235 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0407000000000004e-05 2024-09-14T06:01:18.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.236 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.236 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.236 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.236 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37361 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'280, mlcod=50'278)", 2024-09-14T06:01:18.236 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:18.236 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 94.166355314, 2024-09-14T06:01:18.236 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075534590000000002, 2024-09-14T06:01:18.236 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.236 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.236 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.236 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.237 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.237 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:18.237 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.237 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.237 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041186+0000", 2024-09-14T06:01:18.237 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.237 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.237 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041187+0000", 2024-09-14T06:01:18.237 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2160000000000001e-06 2024-09-14T06:01:18.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.238 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.238 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041208+0000", 2024-09-14T06:01:18.238 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0528999999999999e-05 2024-09-14T06:01:18.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.238 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.238 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041225+0000", 2024-09-14T06:01:18.238 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7255e-05 2024-09-14T06:01:18.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.238 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.239 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041235+0000", 2024-09-14T06:01:18.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4190000000000008e-06 2024-09-14T06:01:18.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.239 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041302+0000", 2024-09-14T06:01:18.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7774000000000005e-05 2024-09-14T06:01:18.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.239 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.239 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.041330+0000", 2024-09-14T06:01:18.239 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7382999999999999e-05 2024-09-14T06:01:18.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.240 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.240 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048686+0000", 2024-09-14T06:01:18.240 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0073564570000000003 2024-09-14T06:01:18.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.240 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.240 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.240 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.048740+0000", 2024-09-14T06:01:18.240 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3426e-05 2024-09-14T06:01:18.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.240 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:37362 3.0 e50/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 50'281, mlcod=50'278)", 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 94.161454914999993, 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047169380000000004, 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.242 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.242 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046086+0000", 2024-09-14T06:01:18.242 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.242 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.242 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046087+0000", 2024-09-14T06:01:18.242 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3600000000000003e-07 2024-09-14T06:01:18.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.242 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.242 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.242 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046093+0000", 2024-09-14T06:01:18.242 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7869999999999998e-06 2024-09-14T06:01:18.242 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.243 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046106+0000", 2024-09-14T06:01:18.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2636999999999999e-05 2024-09-14T06:01:18.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.243 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046113+0000", 2024-09-14T06:01:18.243 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0129999999999996e-06 2024-09-14T06:01:18.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.243 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.243 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.243 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046170+0000", 2024-09-14T06:01:18.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7819000000000003e-05 2024-09-14T06:01:18.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.244 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.244 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.046194+0000", 2024-09-14T06:01:18.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3167999999999999e-05 2024-09-14T06:01:18.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.244 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.244 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050760+0000", 2024-09-14T06:01:18.244 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0045665999999999997 2024-09-14T06:01:18.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.244 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.050803+0000", 2024-09-14T06:01:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3177999999999999e-05 2024-09-14T06:01:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39545 3.0 e50/24 3:06bdaf45:::rbd_data.112781171282.0000000000000002:head v 50'347, mlcod=50'345)", 2024-09-14T06:01:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.629074633000002, 2024-09-14T06:01:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047008700000000002, 2024-09-14T06:01:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.246 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.246 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.246 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.246 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:18.246 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.246 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.246 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578467+0000", 2024-09-14T06:01:18.246 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.246 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.246 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.246 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.578468+0000", 2024-09-14T06:01:18.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1599999999999999e-06 2024-09-14T06:01:18.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579733+0000", 2024-09-14T06:01:18.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012647120000000001 2024-09-14T06:01:18.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.247 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.247 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579755+0000", 2024-09-14T06:01:18.247 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2637999999999999e-05 2024-09-14T06:01:18.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579766+0000", 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0264e-05 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579832+0000", 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6531000000000004e-05 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.579859+0000", 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6855999999999998e-05 2024-09-14T06:01:18.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583098+0000", 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.003238632 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:44.583168+0000", 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.0077e-05 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39765 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'410, mlcod=51'406)", 2024-09-14T06:01:18.249 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:18.250 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.203119831999999, 2024-09-14T06:01:18.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0044953839999999998, 2024-09-14T06:01:18.250 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.250 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.250 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.250 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.250 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:18.250 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.250 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.250 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004422+0000", 2024-09-14T06:01:18.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004423+0000", 2024-09-14T06:01:18.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1909999999999999e-06 2024-09-14T06:01:18.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.251 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.251 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.251 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004432+0000", 2024-09-14T06:01:18.251 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2180000000000005e-06 2024-09-14T06:01:18.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.252 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004453+0000", 2024-09-14T06:01:18.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1182000000000001e-05 2024-09-14T06:01:18.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.252 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004464+0000", 2024-09-14T06:01:18.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1198e-05 2024-09-14T06:01:18.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.252 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.252 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.252 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004520+0000", 2024-09-14T06:01:18.252 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5835999999999999e-05 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.004547+0000", 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6454000000000001e-05 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008866+0000", 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043194679999999999 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.008917+0000", 2024-09-14T06:01:18.253 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0837000000000001e-05 2024-09-14T06:01:18.254 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.254 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.254 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.254 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39847 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'431, mlcod=51'426)", 2024-09-14T06:01:18.254 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:18.254 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.089836482999999, 2024-09-14T06:01:18.254 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0046358010000000002, 2024-09-14T06:01:18.254 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.254 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.254 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.254 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.254 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:18.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117705+0000", 2024-09-14T06:01:18.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.255 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.255 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.255 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117706+0000", 2024-09-14T06:01:18.255 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4899999999999995e-07 2024-09-14T06:01:18.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117711+0000", 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6890000000000001e-06 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117724+0000", 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3054000000000001e-05 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117736+0000", 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1654999999999999e-05 2024-09-14T06:01:18.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117788+0000", 2024-09-14T06:01:18.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2197000000000002e-05 2024-09-14T06:01:18.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.117811+0000", 2024-09-14T06:01:18.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2472000000000001e-05 2024-09-14T06:01:18.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.257 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.257 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.257 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122292+0000", 2024-09-14T06:01:18.257 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004481596 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.122341+0000", 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8489000000000003e-05 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:39865 3.0 e51/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 51'438, mlcod=51'434)", 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.062502185, 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.004519426, 2024-09-14T06:01:18.258 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.259 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.259 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.259 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:18.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.259 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.259 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145039+0000", 2024-09-14T06:01:18.259 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.259 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.259 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145040+0000", 2024-09-14T06:01:18.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7899999999999998e-07 2024-09-14T06:01:18.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145044+0000", 2024-09-14T06:01:18.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3789999999999999e-06 2024-09-14T06:01:18.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.260 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.260 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.260 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145053+0000", 2024-09-14T06:01:18.260 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2650000000000002e-06 2024-09-14T06:01:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145058+0000", 2024-09-14T06:01:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8169999999999998e-06 2024-09-14T06:01:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145105+0000", 2024-09-14T06:01:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7176999999999999e-05 2024-09-14T06:01:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.261 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.145119+0000", 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3179e-05 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149512+0000", 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043934389999999999 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.149559+0000", 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6591000000000002e-05 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.262 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.263 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40245 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'513, mlcod=52'509)", 2024-09-14T06:01:18.263 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:18.263 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 92.283950157000007, 2024-09-14T06:01:18.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0053460410000000002, 2024-09-14T06:01:18.263 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.263 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.263 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.263 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.263 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.263 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.263 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:18.263 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923591+0000", 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923592+0000", 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6599999999999996e-07 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923598+0000", 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.083e-06 2024-09-14T06:01:18.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.265 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923609+0000", 2024-09-14T06:01:18.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1137e-05 2024-09-14T06:01:18.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.265 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.923617+0000", 2024-09-14T06:01:18.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.401e-06 2024-09-14T06:01:18.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.265 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.265 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.265 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924037+0000", 2024-09-14T06:01:18.265 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042046 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924082+0000", 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4617000000000003e-05 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928882+0000", 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0048000889999999996 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928937+0000", 2024-09-14T06:01:18.266 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5587999999999997e-05 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:40246 3.0 e52/24 3:04a8d5ef:::rbd_object_map.112781171282:head v 52'514, mlcod=52'509)", 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 92.282915642000006, 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0043609649999999996, 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.267 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924626+0000", 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2099999999999996e-07 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.268 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.269 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924631+0000", 2024-09-14T06:01:18.269 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8450000000000002e-06 2024-09-14T06:01:18.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.269 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.269 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924641+0000", 2024-09-14T06:01:18.269 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0057e-05 2024-09-14T06:01:18.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.269 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.269 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.924649+0000", 2024-09-14T06:01:18.269 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5669999999999997e-06 2024-09-14T06:01:18.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925127+0000", 2024-09-14T06:01:18.270 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00047783800000000001 2024-09-14T06:01:18.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.925171+0000", 2024-09-14T06:01:18.270 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4017000000000002e-05 2024-09-14T06:01:18.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.270 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.270 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.270 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928942+0000", 2024-09-14T06:01:18.270 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0037716809999999998 2024-09-14T06:01:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:45.928987+0000", 2024-09-14T06:01:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4338999999999997e-05 2024-09-14T06:01:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:46646 3.0 e56/24 3:01acbe3d:::rbd_data.1127f2f8ff9b.0000000000000015:head v 56'541, mlcod=55'538)", 2024-09-14T06:01:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 87.746129371999999, 2024-09-14T06:01:18.271 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0064775850000000001, 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461412+0000", 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.461415+0000", 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.666e-06 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463456+0000", 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00204177 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463488+0000", 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1503e-05 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.273 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.274 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.274 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463508+0000", 2024-09-14T06:01:18.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9788000000000001e-05 2024-09-14T06:01:18.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.274 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.274 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463697+0000", 2024-09-14T06:01:18.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018873499999999999 2024-09-14T06:01:18.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.274 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.274 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.463741+0000", 2024-09-14T06:01:18.274 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4333999999999999e-05 2024-09-14T06:01:18.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467845+0000", 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0041041430000000002 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:50.467890+0000", 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4645999999999999e-05 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:89402 3.0 e84/24 3:03c9b195:::rbd_data.11271f4525c9.00000000000001ae:head v 84'849, mlcod=83'847)", 2024-09-14T06:01:18.275 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 51.577228636000001, 2024-09-14T06:01:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0051764460000000003, 2024-09-14T06:01:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.276 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:18.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.277 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.277 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630313+0000", 2024-09-14T06:01:18.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8299999999999997e-07 2024-09-14T06:01:18.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.277 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.277 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630321+0000", 2024-09-14T06:01:18.277 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6070000000000002e-06 2024-09-14T06:01:18.277 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.277 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.277 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630349+0000", 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7696e-05 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630364+0000", 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4856e-05 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630507+0000", 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00014309899999999999 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.630573+0000", 2024-09-14T06:01:18.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6126999999999999e-05 2024-09-14T06:01:18.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.635358+0000", 2024-09-14T06:01:18.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0047853879999999998 2024-09-14T06:01:18.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.279 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.279 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.279 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:26.635489+0000", 2024-09-14T06:01:18.279 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00013108999999999999 2024-09-14T06:01:18.279 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.279 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.280 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.280 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:106809 3.9 e93/24 3:96c4c4a7:::rbd_data.1127189bfb31.000000000000000a:head v 93'304, mlcod=92'302)", 2024-09-14T06:01:18.280 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:18.280 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 42.153869577999998, 2024-09-14T06:01:18.280 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0092272799999999992, 2024-09-14T06:01:18.280 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.280 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.280 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.280 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.280 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053672+0000", 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.053673+0000", 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.522e-06 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056791+0000", 2024-09-14T06:01:18.281 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031181310000000001 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056814+0000", 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2473999999999999e-05 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056825+0000", 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.059e-05 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056898+0000", 2024-09-14T06:01:18.282 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.2992999999999997e-05 2024-09-14T06:01:18.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.283 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.283 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056918+0000", 2024-09-14T06:01:18.283 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0809999999999999e-05 2024-09-14T06:01:18.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.283 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.283 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.062810+0000", 2024-09-14T06:01:18.283 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0058916460000000004 2024-09-14T06:01:18.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.283 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.284 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.062899+0000", 2024-09-14T06:01:18.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9114000000000001e-05 2024-09-14T06:01:18.284 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.284 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.284 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.284 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:106810 3.9 e93/24 3:96c4c4a7:::rbd_data.1127189bfb31.000000000000000a:head v 93'306, mlcod=92'302)", 2024-09-14T06:01:18.284 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:18.284 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 42.150547422999999, 2024-09-14T06:01:18.284 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0060457269999999999, 2024-09-14T06:01:18.284 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.284 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056994+0000", 2024-09-14T06:01:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.056995+0000", 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8199999999999999e-07 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057001+0000", 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2060000000000004e-06 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057011+0000", 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8369999999999992e-06 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.057018+0000", 2024-09-14T06:01:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9e-06 2024-09-14T06:01:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.059980+0000", 2024-09-14T06:01:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029624500000000002 2024-09-14T06:01:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.060002+0000", 2024-09-14T06:01:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2299000000000001e-05 2024-09-14T06:01:18.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.288 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.288 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.063000+0000", 2024-09-14T06:01:18.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0029974170000000001 2024-09-14T06:01:18.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.288 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.288 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:36.063040+0000", 2024-09-14T06:01:18.288 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9836000000000003e-05 2024-09-14T06:01:18.288 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.288 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.288 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.288 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.289 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(client.4391.0:119911 3.0 e99/24 3:067b0149:::rbd_data.1127206dd91f.0000000000000002:head v 99'930, mlcod=97'928)", 2024-09-14T06:01:18.289 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:18.289 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 35.384801598999999, 2024-09-14T06:01:18.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049905519999999997, 2024-09-14T06:01:18.289 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.289 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.289 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.289 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.289 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.289 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:18.289 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.290 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822740+0000", 2024-09-14T06:01:18.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.290 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.822741+0000", 2024-09-14T06:01:18.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.054e-06 2024-09-14T06:01:18.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.290 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.290 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824085+0000", 2024-09-14T06:01:18.290 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.001343693 2024-09-14T06:01:18.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824114+0000", 2024-09-14T06:01:18.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9013000000000002e-05 2024-09-14T06:01:18.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824127+0000", 2024-09-14T06:01:18.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3869000000000001e-05 2024-09-14T06:01:18.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.291 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.291 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824222+0000", 2024-09-14T06:01:18.291 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4616000000000003e-05 2024-09-14T06:01:18.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.292 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.292 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.824247+0000", 2024-09-14T06:01:18.292 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5205999999999999e-05 2024-09-14T06:01:18.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.292 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.292 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.827664+0000", 2024-09-14T06:01:18.292 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0034165530000000001 2024-09-14T06:01:18.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.292 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.293 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.827730+0000", 2024-09-14T06:01:18.293 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6548e-05 2024-09-14T06:01:18.293 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.293 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.293 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.293 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_repop(osd.4.0:2631 3.9 e132/24 3:92eb55f0:::rbd_data.11279d23db97.0000000000000006:12 v 132'371, mlcod=129'368)", 2024-09-14T06:01:18.293 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:01:15.395110+0000", 2024-09-14T06:01:18.293 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 2.8124312460000001, 2024-09-14T06:01:18.293 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0055665690000000004, 2024-09-14T06:01:18.293 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.294 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.294 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:15.395110+0000", 2024-09-14T06:01:18.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.294 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:15.395110+0000", 2024-09-14T06:01:18.294 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.294 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.294 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:15.395111+0000", 2024-09-14T06:01:18.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5199999999999996e-07 2024-09-14T06:01:18.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:15.395121+0000", 2024-09-14T06:01:18.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0336999999999999e-05 2024-09-14T06:01:18.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.295 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.295 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.295 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:15.395457+0000", 2024-09-14T06:01:18.295 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00033536200000000002 2024-09-14T06:01:18.295 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.296 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.296 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:15.395486+0000", 2024-09-14T06:01:18.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9408999999999999e-05 2024-09-14T06:01:18.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.296 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.296 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:15.395613+0000", 2024-09-14T06:01:18.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000127269 2024-09-14T06:01:18.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.296 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.296 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:15.395661+0000", 2024-09-14T06:01:18.296 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7644e-05 2024-09-14T06:01:18.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.297 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:15.400621+0000", 2024-09-14T06:01:18.297 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0049597799999999996 2024-09-14T06:01:18.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.297 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.297 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.297 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:15.400677+0000", 2024-09-14T06:01:18.297 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6116000000000003e-05 2024-09-14T06:01:18.297 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.297 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.297 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.297 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.298 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.298 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:18.299 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:01:18.299 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:18.296+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:18.400 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:18.396+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2024-09-14T06:01:18.477 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:18.478 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:18.478 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:01:18.478 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:18.492 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:01:18.535 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:18.532+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:18.602 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:18.596+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:18.658 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:18.659 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:18.659 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:18.659 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:18.659 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:18.673 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:01:18.703 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:18.700+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:18.803 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:18.800+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:18.847 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:18.847 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:18.847 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:18.847 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:18.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.847 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54659 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 616448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.847 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.705018397999993, 2024-09-14T06:01:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092177035000000004, 2024-09-14T06:01:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54659 2024-09-14T06:01:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:18.849 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.849 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:18.849 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.849 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139718+0000", 2024-09-14T06:01:18.849 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9699999999999996e-07 2024-09-14T06:01:18.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139731+0000", 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2993000000000001e-05 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139738+0000", 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4610000000000002e-06 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139744+0000", 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6389999999999997e-06 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.850 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231570+0000", 2024-09-14T06:01:18.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091826216000000002 2024-09-14T06:01:18.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.851 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231662+0000", 2024-09-14T06:01:18.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2101000000000005e-05 2024-09-14T06:01:18.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.851 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231894+0000", 2024-09-14T06:01:18.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023212800000000001 2024-09-14T06:01:18.851 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.852 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.852 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54660 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 622592~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.852 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:18.852 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.704983064000004, 2024-09-14T06:01:18.852 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092366887999999994, 2024-09-14T06:01:18.852 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.852 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.852 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.852 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.853 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.853 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.853 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54660 2024-09-14T06:01:18.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.853 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.853 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.853 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:18.853 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.853 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.853 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.853 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:18.853 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.854 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.854 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:18.854 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T06:01:18.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.854 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.854 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139755+0000", 2024-09-14T06:01:18.854 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T06:01:18.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.854 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.854 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139762+0000", 2024-09-14T06:01:18.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6719999999999998e-06 2024-09-14T06:01:18.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139767+0000", 2024-09-14T06:01:18.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9819999999999999e-06 2024-09-14T06:01:18.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231917+0000", 2024-09-14T06:01:18.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092149872999999993 2024-09-14T06:01:18.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231969+0000", 2024-09-14T06:01:18.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2642000000000002e-05 2024-09-14T06:01:18.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232120+0000", 2024-09-14T06:01:18.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015011899999999999 2024-09-14T06:01:18.856 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.856 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.856 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.856 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54844 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 0~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.857 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:18.857 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.704961573000006, 2024-09-14T06:01:18.857 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092708507999999995, 2024-09-14T06:01:18.857 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.857 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.857 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.857 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.857 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.857 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.857 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54844 2024-09-14T06:01:18.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.857 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.857 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.858 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:18.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.858 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.858 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:18.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.858 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.858 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139775+0000", 2024-09-14T06:01:18.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3500000000000002e-07 2024-09-14T06:01:18.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.859 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.859 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139777+0000", 2024-09-14T06:01:18.859 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.979e-06 2024-09-14T06:01:18.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.859 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.859 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139787+0000", 2024-09-14T06:01:18.859 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0779e-05 2024-09-14T06:01:18.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.859 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.859 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139799+0000", 2024-09-14T06:01:18.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1719000000000001e-05 2024-09-14T06:01:18.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232151+0000", 2024-09-14T06:01:18.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092351767000000001 2024-09-14T06:01:18.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232217+0000", 2024-09-14T06:01:18.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6655000000000005e-05 2024-09-14T06:01:18.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.861 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232483+0000", 2024-09-14T06:01:18.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026517400000000002 2024-09-14T06:01:18.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.861 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.862 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.862 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54845 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 55296~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.862 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:18.862 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.704927901999994, 2024-09-14T06:01:18.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093127583999999999, 2024-09-14T06:01:18.863 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.863 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.863 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.863 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.864 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.864 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.864 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54845 2024-09-14T06:01:18.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.864 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.864 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:18.864 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.865 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:18.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.865 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:18.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4899999999999995e-07 2024-09-14T06:01:18.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.865 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139811+0000", 2024-09-14T06:01:18.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000001e-06 2024-09-14T06:01:18.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139821+0000", 2024-09-14T06:01:18.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0168e-05 2024-09-14T06:01:18.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139826+0000", 2024-09-14T06:01:18.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2780000000000001e-06 2024-09-14T06:01:18.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232556+0000", 2024-09-14T06:01:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092729729999999996 2024-09-14T06:01:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232652+0000", 2024-09-14T06:01:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680999999999994e-05 2024-09-14T06:01:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232935+0000", 2024-09-14T06:01:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000283758 2024-09-14T06:01:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.867 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.868 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.868 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54846 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.868 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:18.868 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.704901594999995, 2024-09-14T06:01:18.868 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093492079000000006, 2024-09-14T06:01:18.868 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.868 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.868 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.868 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.868 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.868 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.869 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54846 2024-09-14T06:01:18.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.869 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.869 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:18.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.869 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:18.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139835+0000", 2024-09-14T06:01:18.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T06:01:18.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139837+0000", 2024-09-14T06:01:18.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1059999999999998e-06 2024-09-14T06:01:18.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.871 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.871 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139845+0000", 2024-09-14T06:01:18.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4300000000000006e-06 2024-09-14T06:01:18.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.871 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.871 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139851+0000", 2024-09-14T06:01:18.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T06:01:18.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.871 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.871 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232987+0000", 2024-09-14T06:01:18.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093136073999999999 2024-09-14T06:01:18.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233075+0000", 2024-09-14T06:01:18.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7318999999999995e-05 2024-09-14T06:01:18.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233326+0000", 2024-09-14T06:01:18.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025159 2024-09-14T06:01:18.872 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.872 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.872 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.873 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54847 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 67584~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.873 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:18.873 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.704875878999999, 2024-09-14T06:01:18.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093777452999999997, 2024-09-14T06:01:18.873 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.873 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.873 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.873 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.874 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.874 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.874 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54847 2024-09-14T06:01:18.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.874 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.874 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.874 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:18.874 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.874 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.874 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T06:01:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139862+0000", 2024-09-14T06:01:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0200000000000001e-06 2024-09-14T06:01:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139870+0000", 2024-09-14T06:01:18.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0520000000000002e-06 2024-09-14T06:01:18.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139875+0000", 2024-09-14T06:01:18.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:01:18.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233389+0000", 2024-09-14T06:01:18.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093514054999999999 2024-09-14T06:01:18.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233443+0000", 2024-09-14T06:01:18.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3913999999999999e-05 2024-09-14T06:01:18.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233637+0000", 2024-09-14T06:01:18.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019392899999999999 2024-09-14T06:01:18.877 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.877 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.877 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.878 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54848 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 73728~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.878 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:18.878 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.704852783000007, 2024-09-14T06:01:18.878 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094064464, 2024-09-14T06:01:18.878 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.878 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.878 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.878 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.878 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.878 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.878 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54848 2024-09-14T06:01:18.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.878 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:18.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:18.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:18.880 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T06:01:18.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.880 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.880 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139885+0000", 2024-09-14T06:01:18.880 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9929999999999998e-06 2024-09-14T06:01:18.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.880 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.880 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139893+0000", 2024-09-14T06:01:18.880 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9759999999999995e-06 2024-09-14T06:01:18.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139898+0000", 2024-09-14T06:01:18.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6059999999999996e-06 2024-09-14T06:01:18.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233681+0000", 2024-09-14T06:01:18.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093782921000000005 2024-09-14T06:01:18.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233730+0000", 2024-09-14T06:01:18.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9410999999999998e-05 2024-09-14T06:01:18.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233947+0000", 2024-09-14T06:01:18.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021710300000000001 2024-09-14T06:01:18.882 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.882 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.882 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.882 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54849 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.882 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:18.882 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.704829326999999, 2024-09-14T06:01:18.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094499257000000003, 2024-09-14T06:01:18.883 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.883 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.883 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.883 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.883 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.883 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.883 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54849 2024-09-14T06:01:18.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.883 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.883 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:18.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:18.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139907+0000", 2024-09-14T06:01:18.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T06:01:18.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.885 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.885 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139909+0000", 2024-09-14T06:01:18.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T06:01:18.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.885 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.885 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139916+0000", 2024-09-14T06:01:18.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T06:01:18.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139921+0000", 2024-09-14T06:01:18.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:01:18.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234032+0000", 2024-09-14T06:01:18.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094111037999999994 2024-09-14T06:01:18.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234150+0000", 2024-09-14T06:01:18.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118408 2024-09-14T06:01:18.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234406+0000", 2024-09-14T06:01:18.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025540600000000001 2024-09-14T06:01:18.887 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.888 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.888 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.888 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.888 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54850 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 135168~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.888 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:18.888 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.704807618999993, 2024-09-14T06:01:18.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094814605999999996, 2024-09-14T06:01:18.888 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.888 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.888 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.888 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.888 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.889 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.889 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54850 2024-09-14T06:01:18.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.889 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.889 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.889 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:18.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.889 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.889 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:18.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139929+0000", 2024-09-14T06:01:18.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T06:01:18.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139931+0000", 2024-09-14T06:01:18.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.024e-06 2024-09-14T06:01:18.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139937+0000", 2024-09-14T06:01:18.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3770000000000001e-06 2024-09-14T06:01:18.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139942+0000", 2024-09-14T06:01:18.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0289999999999996e-06 2024-09-14T06:01:18.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234447+0000", 2024-09-14T06:01:18.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094505426000000003 2024-09-14T06:01:18.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234539+0000", 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1793999999999996e-05 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234743+0000", 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020354600000000001 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.892 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54851 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 141312~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.893 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:18.893 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.704785907000002, 2024-09-14T06:01:18.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095179749999999994, 2024-09-14T06:01:18.893 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.893 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.893 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.893 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.893 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.893 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54851 2024-09-14T06:01:18.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.893 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.893 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:18.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:18.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:18.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:01:18.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139952+0000", 2024-09-14T06:01:18.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0600000000000002e-06 2024-09-14T06:01:18.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139959+0000", 2024-09-14T06:01:18.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.584e-06 2024-09-14T06:01:18.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139964+0000", 2024-09-14T06:01:18.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8890000000000001e-06 2024-09-14T06:01:18.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234786+0000", 2024-09-14T06:01:18.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094822241000000002 2024-09-14T06:01:18.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234877+0000", 2024-09-14T06:01:18.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1158999999999999e-05 2024-09-14T06:01:18.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235130+0000", 2024-09-14T06:01:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025235999999999998 2024-09-14T06:01:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54852 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 147456~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.704764779000001, 2024-09-14T06:01:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095437742000000006, 2024-09-14T06:01:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.897 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.898 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.898 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.898 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.898 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.898 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54852 2024-09-14T06:01:18.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.898 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.898 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.898 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:18.898 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:18.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140125+0000", 2024-09-14T06:01:18.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154332 2024-09-14T06:01:18.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140130+0000", 2024-09-14T06:01:18.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.284e-06 2024-09-14T06:01:18.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140140+0000", 2024-09-14T06:01:18.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0789e-05 2024-09-14T06:01:18.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140147+0000", 2024-09-14T06:01:18.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9879999999999998e-06 2024-09-14T06:01:18.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235174+0000", 2024-09-14T06:01:18.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095026749999999993 2024-09-14T06:01:18.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235230+0000", 2024-09-14T06:01:18.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6224000000000002e-05 2024-09-14T06:01:18.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235409+0000", 2024-09-14T06:01:18.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017837500000000001 2024-09-14T06:01:18.901 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.901 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.901 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.902 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54853 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 202752~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.902 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:18.902 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.704575957000003, 2024-09-14T06:01:18.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095632919999999996, 2024-09-14T06:01:18.902 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.902 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.902 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.902 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.902 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.902 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.902 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54853 2024-09-14T06:01:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.903 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147748+0000", 2024-09-14T06:01:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075884910000000002 2024-09-14T06:01:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147798+0000", 2024-09-14T06:01:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0152999999999999e-05 2024-09-14T06:01:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147814+0000", 2024-09-14T06:01:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5866e-05 2024-09-14T06:01:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147831+0000", 2024-09-14T06:01:18.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6991999999999999e-05 2024-09-14T06:01:18.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235451+0000", 2024-09-14T06:01:18.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087620077000000005 2024-09-14T06:01:18.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235539+0000", 2024-09-14T06:01:18.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7800000000000006e-05 2024-09-14T06:01:18.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.906 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.906 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235793+0000", 2024-09-14T06:01:18.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025354099999999998 2024-09-14T06:01:18.906 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.906 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.906 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.906 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54870 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 503808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.906 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:18.906 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.696330410000002, 2024-09-14T06:01:18.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092420756000000007, 2024-09-14T06:01:18.907 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.907 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.907 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.907 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.907 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.907 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.907 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54870 2024-09-14T06:01:18.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.907 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:18.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:18.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148406+0000", 2024-09-14T06:01:18.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T06:01:18.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148409+0000", 2024-09-14T06:01:18.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T06:01:18.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148418+0000", 2024-09-14T06:01:18.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7329999999999998e-06 2024-09-14T06:01:18.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148425+0000", 2024-09-14T06:01:18.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2079999999999997e-06 2024-09-14T06:01:18.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240591+0000", 2024-09-14T06:01:18.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092166441000000002 2024-09-14T06:01:18.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240648+0000", 2024-09-14T06:01:18.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6733e-05 2024-09-14T06:01:18.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.911 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.911 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240826+0000", 2024-09-14T06:01:18.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017834700000000001 2024-09-14T06:01:18.911 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.911 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.912 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.912 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54871 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 509952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.912 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:18.912 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.696300449999995, 2024-09-14T06:01:18.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092702341999999993, 2024-09-14T06:01:18.912 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.912 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.912 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.913 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.913 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.913 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.913 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54871 2024-09-14T06:01:18.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.913 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:18.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:18.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148436+0000", 2024-09-14T06:01:18.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5499999999999998e-07 2024-09-14T06:01:18.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148439+0000", 2024-09-14T06:01:18.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8090000000000001e-06 2024-09-14T06:01:18.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148449+0000", 2024-09-14T06:01:18.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0115000000000001e-05 2024-09-14T06:01:18.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148466+0000", 2024-09-14T06:01:18.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6761000000000001e-05 2024-09-14T06:01:18.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240857+0000", 2024-09-14T06:01:18.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092391089999999995 2024-09-14T06:01:18.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240939+0000", 2024-09-14T06:01:18.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2387999999999998e-05 2024-09-14T06:01:18.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.916 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.916 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241138+0000", 2024-09-14T06:01:18.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000198624 2024-09-14T06:01:18.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.917 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.917 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.917 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54872 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 516096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:18.917 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:18.917 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 84.696259252000004, 2024-09-14T06:01:18.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093126020000000004, 2024-09-14T06:01:18.917 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.917 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.917 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:18.917 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.917 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.918 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.918 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54872 2024-09-14T06:01:18.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.918 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:18.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:18.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155484+0000", 2024-09-14T06:01:18.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070072429999999998 2024-09-14T06:01:18.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155490+0000", 2024-09-14T06:01:18.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6379999999999998e-06 2024-09-14T06:01:18.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155504+0000", 2024-09-14T06:01:18.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4065e-05 2024-09-14T06:01:18.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155513+0000", 2024-09-14T06:01:18.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6799999999999999e-06 2024-09-14T06:01:18.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241216+0000", 2024-09-14T06:01:18.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085702922000000001 2024-09-14T06:01:18.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241277+0000", 2024-09-14T06:01:18.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0980000000000002e-05 2024-09-14T06:01:18.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241602+0000", 2024-09-14T06:01:18.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032549199999999998 2024-09-14T06:01:18.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.922 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.922 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123238 3.7 3.c0662d67 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:18.922 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:18.922 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.429787581999999, 2024-09-14T06:01:18.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88300249500000005, 2024-09-14T06:01:18.922 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.923 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.923 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:01:18.923 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.923 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.923 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.923 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123238 2024-09-14T06:01:18.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.923 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:18.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:18.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414949+0000", 2024-09-14T06:01:18.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8899999999999998e-07 2024-09-14T06:01:18.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.924 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.924 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414953+0000", 2024-09-14T06:01:18.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1439999999999996e-06 2024-09-14T06:01:18.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414974+0000", 2024-09-14T06:01:18.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0630000000000001e-05 2024-09-14T06:01:18.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414982+0000", 2024-09-14T06:01:18.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9840000000000001e-06 2024-09-14T06:01:18.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415051+0000", 2024-09-14T06:01:18.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9787000000000001e-05 2024-09-14T06:01:18.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:18.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415062+0000", 2024-09-14T06:01:18.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0674e-05 2024-09-14T06:01:18.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297935+0000", 2024-09-14T06:01:18.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88287307400000004 2024-09-14T06:01:18.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297951+0000", 2024-09-14T06:01:18.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5413e-05 2024-09-14T06:01:18.927 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.927 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.927 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.927 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123240 3.15 3:a806c175:::rbd_data.112793b455a2.0000000000000005:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:18.927 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:18.928 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.429731867000001, 2024-09-14T06:01:18.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.950432851, 2024-09-14T06:01:18.928 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.928 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.928 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.928 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.928 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.928 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.928 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123240 2024-09-14T06:01:18.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.928 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:18.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:18.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:18.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3399999999999999e-07 2024-09-14T06:01:18.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415008+0000", 2024-09-14T06:01:18.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6090000000000001e-06 2024-09-14T06:01:18.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415017+0000", 2024-09-14T06:01:18.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0100000000000001e-06 2024-09-14T06:01:18.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415025+0000", 2024-09-14T06:01:18.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9109999999999993e-06 2024-09-14T06:01:18.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415114+0000", 2024-09-14T06:01:18.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9086999999999996e-05 2024-09-14T06:01:18.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:18.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415132+0000", 2024-09-14T06:01:18.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7405e-05 2024-09-14T06:01:18.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297130+0000", 2024-09-14T06:01:18.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88199837000000003 2024-09-14T06:01:18.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:18.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297152+0000", 2024-09-14T06:01:18.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2103000000000002e-05 2024-09-14T06:01:18.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361290+0000", 2024-09-14T06:01:18.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.064138091 2024-09-14T06:01:18.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.933 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.933 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361714+0000", 2024-09-14T06:01:18.933 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042403999999999999 2024-09-14T06:01:18.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.933 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361955+0000", 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000240981 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365095+0000", 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031403960000000002 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365192+0000", 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6976000000000001e-05 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.934 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365274+0000", 2024-09-14T06:01:18.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1293999999999998e-05 2024-09-14T06:01:18.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.935 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.935 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365437+0000", 2024-09-14T06:01:18.935 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016294399999999999 2024-09-14T06:01:18.935 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.935 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.935 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.935 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.935 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.935 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123244 3.7 3.d0cc8287 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.429686363999998, 2024-09-14T06:01:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88296528100000005, 2024-09-14T06:01:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:01:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123244 2024-09-14T06:01:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.936 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:18.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:18.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.937 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.937 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.937 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415050+0000", 2024-09-14T06:01:18.937 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1500000000000004e-07 2024-09-14T06:01:18.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415053+0000", 2024-09-14T06:01:18.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1219999999999999e-06 2024-09-14T06:01:18.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415065+0000", 2024-09-14T06:01:18.938 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1549000000000001e-05 2024-09-14T06:01:18.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.938 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.938 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.938 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415071+0000", 2024-09-14T06:01:18.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4359999999999999e-06 2024-09-14T06:01:18.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415133+0000", 2024-09-14T06:01:18.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2249999999999995e-05 2024-09-14T06:01:18.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.939 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:18.939 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415141+0000", 2024-09-14T06:01:18.939 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5480000000000004e-06 2024-09-14T06:01:18.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.939 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.298007+0000", 2024-09-14T06:01:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88286582199999997 2024-09-14T06:01:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.298015+0000", 2024-09-14T06:01:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8390000000000007e-06 2024-09-14T06:01:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.940 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123245 3.15 3:ae492430:::rbd_data.112793b455a2.000000000000000a:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:18.941 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:18.941 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.427618712000001, 2024-09-14T06:01:18.941 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9484952870000001, 2024-09-14T06:01:18.941 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.941 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.941 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.941 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.941 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.941 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.941 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123245 2024-09-14T06:01:18.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.942 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:18.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.942 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:18.942 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.942 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.942 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.942 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417118+0000", 2024-09-14T06:01:18.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0189999999999999e-06 2024-09-14T06:01:18.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417123+0000", 2024-09-14T06:01:18.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7380000000000002e-06 2024-09-14T06:01:18.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.943 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.943 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.943 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417137+0000", 2024-09-14T06:01:18.943 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4538999999999999e-05 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417146+0000", 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3669999999999997e-06 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417236+0000", 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9976999999999996e-05 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417249+0000", 2024-09-14T06:01:18.944 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3325e-05 2024-09-14T06:01:18.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297197+0000", 2024-09-14T06:01:18.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.87994787699999999 2024-09-14T06:01:18.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:18.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297209+0000", 2024-09-14T06:01:18.945 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2486e-05 2024-09-14T06:01:18.945 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.945 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.945 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.945 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363278+0000", 2024-09-14T06:01:18.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.066068257 2024-09-14T06:01:18.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363460+0000", 2024-09-14T06:01:18.946 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000182022 2024-09-14T06:01:18.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.946 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.946 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:18.946 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363641+0000", 2024-09-14T06:01:18.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018182199999999999 2024-09-14T06:01:18.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:18.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365170+0000", 2024-09-14T06:01:18.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00152838 2024-09-14T06:01:18.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.947 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:18.947 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365451+0000", 2024-09-14T06:01:18.947 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028076000000000002 2024-09-14T06:01:18.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365504+0000", 2024-09-14T06:01:18.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3334000000000001e-05 2024-09-14T06:01:18.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.948 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.948 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.948 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365612+0000", 2024-09-14T06:01:18.948 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108384 2024-09-14T06:01:18.948 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.949 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.949 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.949 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.949 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123248 3.15 3:a9835311:::rbd_data.112793b455a2.000000000000000d:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:18.949 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:18.949 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 19.426951488, 2024-09-14T06:01:18.949 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.948835844, 2024-09-14T06:01:18.949 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:18.949 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:18.949 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:18.950 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:18.950 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:18.950 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:18.950 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123248 2024-09-14T06:01:18.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.950 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:18.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:18.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:18.950 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.950 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.950 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:18.950 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:18.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:18.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:18.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417785+0000", 2024-09-14T06:01:18.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.054e-06 2024-09-14T06:01:18.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.951 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:18.951 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417790+0000", 2024-09-14T06:01:18.951 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.186e-06 2024-09-14T06:01:18.951 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.951 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:18.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417806+0000", 2024-09-14T06:01:18.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5430999999999998e-05 2024-09-14T06:01:18.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:18.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417816+0000", 2024-09-14T06:01:18.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7729999999999994e-06 2024-09-14T06:01:18.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.952 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.952 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.952 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417875+0000", 2024-09-14T06:01:18.952 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8950999999999999e-05 2024-09-14T06:01:18.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:18.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417884+0000", 2024-09-14T06:01:18.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4369999999999996e-06 2024-09-14T06:01:18.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297235+0000", 2024-09-14T06:01:18.953 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.87935095699999999 2024-09-14T06:01:18.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.953 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.953 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:18.953 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297241+0000", 2024-09-14T06:01:18.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2790000000000004e-06 2024-09-14T06:01:18.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:18.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364231+0000", 2024-09-14T06:01:18.956 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.066989736 2024-09-14T06:01:18.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.956 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.956 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:18.956 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364369+0000", 2024-09-14T06:01:18.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000137766 2024-09-14T06:01:18.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:18.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364563+0000", 2024-09-14T06:01:18.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019418500000000001 2024-09-14T06:01:18.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.957 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:18.957 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365625+0000", 2024-09-14T06:01:18.957 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0010621000000000001 2024-09-14T06:01:18.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.957 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:18.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366188+0000", 2024-09-14T06:01:18.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00056258499999999999 2024-09-14T06:01:18.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:18.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366318+0000", 2024-09-14T06:01:18.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012983299999999999 2024-09-14T06:01:18.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:18.958 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:18.958 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:18.958 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366620+0000", 2024-09-14T06:01:18.958 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030257100000000001 2024-09-14T06:01:18.959 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.959 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.959 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.959 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:18.959 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:18.959 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:18.960 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:01:18.961 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:18.960+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:19.062 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:19.060+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:19.092 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:19.092 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:19.092 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:19.092 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:19.107 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:01:19.163 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:19.160+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:19.225 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:19.225 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:19.225 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:19.226 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:19.226 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:19.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:01:19.282 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:19.280+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:19.365 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:19.360+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:19.417 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23550 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 606208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:01:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.46581078200001, 2024-09-14T06:01:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048793072999999999, 2024-09-14T06:01:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23550 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:01:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7800000000000002e-07 2024-09-14T06:01:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948677+0000", 2024-09-14T06:01:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1949999999999997e-06 2024-09-14T06:01:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948687+0000", 2024-09-14T06:01:19.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0849000000000001e-05 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948692+0000", 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8670000000000002e-06 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997290+0000", 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048597596999999999 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997367+0000", 2024-09-14T06:01:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7236000000000004e-05 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997462+0000", 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4951000000000006e-05 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23551 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 620544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.46577992500001, 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048938838999999998, 2024-09-14T06:01:19.422 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23551 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:01:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:01:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1e-07 2024-09-14T06:01:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948701+0000", 2024-09-14T06:01:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2950000000000001e-06 2024-09-14T06:01:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948705+0000", 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7929999999999999e-06 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948709+0000", 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997535+0000", 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048826181000000003 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997580+0000", 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5355000000000002e-05 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997639+0000", 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8479e-05 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:19.426 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.465764448, 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T06:01:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T06:01:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T06:01:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T06:01:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T06:01:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T06:01:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.430 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.465745173, 2024-09-14T06:01:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T06:01:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T06:01:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T06:01:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T06:01:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T06:01:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T06:01:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T06:01:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T06:01:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.465725597, 2024-09-14T06:01:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T06:01:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T06:01:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:19.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T06:01:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T06:01:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T06:01:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T06:01:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T06:01:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:01:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T06:01:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T06:01:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T06:01:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T06:01:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:19.439 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.46570613999999, 2024-09-14T06:01:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T06:01:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T06:01:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T06:01:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T06:01:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T06:01:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T06:01:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T06:01:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T06:01:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.443 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.465687089, 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T06:01:19.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T06:01:19.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T06:01:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T06:01:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T06:01:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T06:01:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T06:01:19.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T06:01:19.447 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.465667408, 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.448 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T06:01:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T06:01:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T06:01:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T06:01:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T06:01:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T06:01:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:01:19.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T06:01:19.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T06:01:19.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T06:01:19.452 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.452 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.452 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.452 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.452 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:19.452 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.465647457, 2024-09-14T06:01:19.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T06:01:19.453 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.453 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.453 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.453 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.453 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.453 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.453 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T06:01:19.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.453 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:19.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:19.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T06:01:19.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T06:01:19.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T06:01:19.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:01:19.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T06:01:19.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T06:01:19.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T06:01:19.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T06:01:19.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T06:01:19.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T06:01:19.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T06:01:19.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T06:01:19.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T06:01:19.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T06:01:19.457 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.457 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.457 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.457 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.457 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:19.457 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.465628145, 2024-09-14T06:01:19.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T06:01:19.457 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.458 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.458 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.458 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.458 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.458 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.458 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T06:01:19.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.458 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:19.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:19.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:19.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T06:01:19.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T06:01:19.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T06:01:19.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T06:01:19.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T06:01:19.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T06:01:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T06:01:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T06:01:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T06:01:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T06:01:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T06:01:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T06:01:19.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T06:01:19.462 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.462 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.462 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.462 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.462 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:19.462 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.46560838400001, 2024-09-14T06:01:19.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T06:01:19.462 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.462 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:19.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T06:01:19.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:01:19.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T06:01:19.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T06:01:19.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T06:01:19.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T06:01:19.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T06:01:19.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T06:01:19.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T06:01:19.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T06:01:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T06:01:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T06:01:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T06:01:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T06:01:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.46558746300001, 2024-09-14T06:01:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T06:01:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T06:01:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.467 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T06:01:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T06:01:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T06:01:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T06:01:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T06:01:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T06:01:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T06:01:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T06:01:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.464428129, 2024-09-14T06:01:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T06:01:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.471 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T06:01:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T06:01:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T06:01:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T06:01:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T06:01:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T06:01:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T06:01:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T06:01:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T06:01:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T06:01:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T06:01:19.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.475 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.464129347, 2024-09-14T06:01:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T06:01:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T06:01:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T06:01:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T06:01:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T06:01:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T06:01:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T06:01:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T06:01:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T06:01:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T06:01:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T06:01:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T06:01:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T06:01:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T06:01:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T06:01:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T06:01:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.46397860899999, 2024-09-14T06:01:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T06:01:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.480 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T06:01:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:19.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T06:01:19.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T06:01:19.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T06:01:19.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T06:01:19.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T06:01:19.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T06:01:19.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T06:01:19.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T06:01:19.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T06:01:19.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T06:01:19.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T06:01:19.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T06:01:19.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T06:01:19.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T06:01:19.484 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.484 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.484 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.485 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T06:01:19.485 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:19.485 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 107.838677046, 2024-09-14T06:01:19.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T06:01:19.485 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.485 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.485 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:19.485 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:19.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:19.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T06:01:19.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T06:01:19.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T06:01:19.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T06:01:19.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T06:01:19.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T06:01:19.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T06:01:19.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T06:01:19.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T06:01:19.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T06:01:19.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T06:01:19.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T06:01:19.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:19.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T06:01:19.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T06:01:19.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T06:01:19.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T06:01:19.489 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.489 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.489 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.489 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.490 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:19.490 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 107.315587107, 2024-09-14T06:01:19.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T06:01:19.490 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.490 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.490 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:19.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.490 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T06:01:19.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.490 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:19.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:19.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T06:01:19.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T06:01:19.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T06:01:19.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T06:01:19.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T06:01:19.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T06:01:19.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T06:01:19.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T06:01:19.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T06:01:19.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T06:01:19.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T06:01:19.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T06:01:19.495 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.495 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.495 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.495 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123243 3.f 3:f182c8b1:::rbd_data.112793b455a2.0000000000000008:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:19.495 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:19.495 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.999552645000001, 2024-09-14T06:01:19.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9453718680000001, 2024-09-14T06:01:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123243 2024-09-14T06:01:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414929+0000", 2024-09-14T06:01:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.761e-06 2024-09-14T06:01:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414935+0000", 2024-09-14T06:01:19.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1310000000000003e-06 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414953+0000", 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.806e-05 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414962+0000", 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8040000000000007e-06 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.415129+0000", 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016696699999999999 2024-09-14T06:01:19.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:19.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.415160+0000", 2024-09-14T06:01:19.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1361e-05 2024-09-14T06:01:19.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.306423+0000", 2024-09-14T06:01:19.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.89126284499999997 2024-09-14T06:01:19.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:19.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.306458+0000", 2024-09-14T06:01:19.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4864999999999999e-05 2024-09-14T06:01:19.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.356709+0000", 2024-09-14T06:01:19.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0502506730000001 2024-09-14T06:01:19.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357372+0000", 2024-09-14T06:01:19.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00066291500000000003 2024-09-14T06:01:19.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T06:01:19.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357702+0000", 2024-09-14T06:01:19.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00033040400000000002 2024-09-14T06:01:19.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:19.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359330+0000", 2024-09-14T06:01:19.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001628004 2024-09-14T06:01:19.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:19.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359899+0000", 2024-09-14T06:01:19.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00056937000000000003 2024-09-14T06:01:19.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:19.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360016+0000", 2024-09-14T06:01:19.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116688 2024-09-14T06:01:19.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360299+0000", 2024-09-14T06:01:19.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028301999999999998 2024-09-14T06:01:19.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.502 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123246 3.e 3:757f91a9:::rbd_data.112793b455a2.000000000000000b:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.997060045000001, 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.971537646, 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123246 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:19.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:19.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417422+0000", 2024-09-14T06:01:19.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3029999999999998e-06 2024-09-14T06:01:19.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417433+0000", 2024-09-14T06:01:19.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1333e-05 2024-09-14T06:01:19.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417496+0000", 2024-09-14T06:01:19.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2856999999999998e-05 2024-09-14T06:01:19.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417521+0000", 2024-09-14T06:01:19.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5041999999999998e-05 2024-09-14T06:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417631+0000", 2024-09-14T06:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010957 2024-09-14T06:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417641+0000", 2024-09-14T06:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0655999999999999e-05 2024-09-14T06:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301111+0000", 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.883469175 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301143+0000", 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1998000000000001e-05 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385119+0000", 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0839765729999999 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385594+0000", 2024-09-14T06:01:19.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000475014 2024-09-14T06:01:19.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:19.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385905+0000", 2024-09-14T06:01:19.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031112300000000001 2024-09-14T06:01:19.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:19.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388402+0000", 2024-09-14T06:01:19.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024969110000000001 2024-09-14T06:01:19.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:19.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388492+0000", 2024-09-14T06:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9740000000000005e-05 2024-09-14T06:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388646+0000", 2024-09-14T06:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153788 2024-09-14T06:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388957+0000", 2024-09-14T06:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000311563 2024-09-14T06:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.510 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123247 3.e 3:71933c91:::rbd_data.112793b455a2.000000000000000c:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:19.510 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:19.510 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.996881003999999, 2024-09-14T06:01:19.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9716223099999999, 2024-09-14T06:01:19.510 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.510 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.510 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:19.510 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.510 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.510 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.510 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123247 2024-09-14T06:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417601+0000", 2024-09-14T06:01:19.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:01:19.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417613+0000", 2024-09-14T06:01:19.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2041999999999999e-05 2024-09-14T06:01:19.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417636+0000", 2024-09-14T06:01:19.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3071999999999999e-05 2024-09-14T06:01:19.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417652+0000", 2024-09-14T06:01:19.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6512999999999999e-05 2024-09-14T06:01:19.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417722+0000", 2024-09-14T06:01:19.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0201000000000001e-05 2024-09-14T06:01:19.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:19.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417729+0000", 2024-09-14T06:01:19.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4420000000000003e-06 2024-09-14T06:01:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301770+0000", 2024-09-14T06:01:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88404090999999996 2024-09-14T06:01:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301798+0000", 2024-09-14T06:01:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8619000000000002e-05 2024-09-14T06:01:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387130+0000", 2024-09-14T06:01:19.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0853317760000001 2024-09-14T06:01:19.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387314+0000", 2024-09-14T06:01:19.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018428699999999999 2024-09-14T06:01:19.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:19.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387786+0000", 2024-09-14T06:01:19.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047110000000000001 2024-09-14T06:01:19.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:19.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388983+0000", 2024-09-14T06:01:19.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011978640000000001 2024-09-14T06:01:19.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:19.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389032+0000", 2024-09-14T06:01:19.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8349000000000001e-05 2024-09-14T06:01:19.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:19.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389082+0000", 2024-09-14T06:01:19.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0291999999999999e-05 2024-09-14T06:01:19.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389221+0000", 2024-09-14T06:01:19.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013898599999999999 2024-09-14T06:01:19.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.517 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.517 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.517 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:19.519 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:01:19.519 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:19.516+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:19.620 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:19.616+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:19.645 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:19.646 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:19.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:01:19.720 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:19.716+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:19.777 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:19.778 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:19.778 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:19.778 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:19.778 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:19.791 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:01:19.842 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:19.840+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:19.917 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:19.917 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:19.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:19.917 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:19.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.917 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:19.917 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:19.917 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.36721600200001, 2024-09-14T06:01:19.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:01:19.917 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.917 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.918 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:19.918 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.918 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.918 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.918 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:01:19.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.918 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:19.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:19.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:01:19.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:01:19.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:01:19.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:01:19.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:01:19.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:01:19.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:01:19.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:01:19.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:01:19.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:01:19.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:01:19.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:01:19.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:19.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:01:19.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:01:19.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:19.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:01:19.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:01:19.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:19.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:01:19.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:01:19.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:19.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:01:19.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:01:19.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:01:19.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:01:19.923 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.923 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.923 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.923 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:19.923 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:19.923 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 95.391819116999997, 2024-09-14T06:01:19.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:01:19.924 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.924 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.924 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.924 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.924 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.924 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.924 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:01:19.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.924 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:19.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:19.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:01:19.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:01:19.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 95.391780793999999, 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:01:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:01:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:01:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:01:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:01:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:01:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:01:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:01:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:01:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:01:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:01:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:01:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:01:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:01:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 95.391754101999993, 2024-09-14T06:01:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:01:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:01:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:01:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:01:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:01:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:01:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:01:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:01:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:01:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:01:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:01:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:01:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 95.391728236000006, 2024-09-14T06:01:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:01:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:01:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:01:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:01:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:01:19.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:01:19.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:01:19.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:01:19.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:01:19.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:01:19.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:01:19.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:01:19.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:01:19.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:01:19.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:01:19.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:01:19.941 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.941 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.941 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.941 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:19.941 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:19.941 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 95.390627867000006, 2024-09-14T06:01:19.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:01:19.941 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.942 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.942 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.942 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.942 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.942 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.942 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:01:19.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.942 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:19.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:01:19.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:01:19.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:01:19.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:01:19.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:01:19.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:01:19.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:01:19.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:01:19.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:01:19.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:01:19.945 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.945 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.945 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.946 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:19.946 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:19.946 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 95.390583887999995, 2024-09-14T06:01:19.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:01:19.946 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.946 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.946 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.946 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.946 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.946 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.946 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:01:19.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.946 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:19.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:19.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:01:19.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:01:19.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:01:19.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:01:19.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:01:19.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:01:19.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:01:19.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:01:19.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:01:19.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:01:19.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:01:19.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:01:19.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:01:19.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:01:19.950 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.950 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.950 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.950 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:19.950 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:19.950 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 95.389522127999996, 2024-09-14T06:01:19.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:01:19.950 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.950 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.951 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.951 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.951 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.951 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.951 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:01:19.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.951 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:19.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:01:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:01:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:01:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:01:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:01:19.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:01:19.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:01:19.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:01:19.954 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.954 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.954 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.954 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119203 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5881856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:19.955 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:19.955 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.848149098, 2024-09-14T06:01:19.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084813824999999995, 2024-09-14T06:01:19.955 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.955 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.955 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.955 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.955 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.955 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.955 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119203 2024-09-14T06:01:19.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.955 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:19.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:19.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065503+0000", 2024-09-14T06:01:19.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.054e-06 2024-09-14T06:01:19.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065509+0000", 2024-09-14T06:01:19.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9939999999999997e-06 2024-09-14T06:01:19.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065528+0000", 2024-09-14T06:01:19.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8736000000000002e-05 2024-09-14T06:01:19.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065540+0000", 2024-09-14T06:01:19.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2427e-05 2024-09-14T06:01:19.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.149851+0000", 2024-09-14T06:01:19.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084310806000000002 2024-09-14T06:01:19.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150073+0000", 2024-09-14T06:01:19.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022202999999999999 2024-09-14T06:01:19.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150316+0000", 2024-09-14T06:01:19.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000242778 2024-09-14T06:01:19.959 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.959 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.959 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.959 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119204 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5931008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:19.959 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:19.959 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.848093591000001, 2024-09-14T06:01:19.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085122164, 2024-09-14T06:01:19.959 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.960 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.960 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.960 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.960 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.960 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.960 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119204 2024-09-14T06:01:19.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.960 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:19.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:19.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065559+0000", 2024-09-14T06:01:19.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.068e-06 2024-09-14T06:01:19.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065564+0000", 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1089999999999997e-06 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065580+0000", 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6438000000000001e-05 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065592+0000", 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1739000000000001e-05 2024-09-14T06:01:19.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150396+0000", 2024-09-14T06:01:19.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084803859999999995 2024-09-14T06:01:19.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150524+0000", 2024-09-14T06:01:19.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012805600000000001 2024-09-14T06:01:19.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150680+0000", 2024-09-14T06:01:19.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015589400000000001 2024-09-14T06:01:19.964 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.964 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.964 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.964 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119205 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5980160~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:19.964 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:19.964 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.847997716000002, 2024-09-14T06:01:19.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085597655999999994, 2024-09-14T06:01:19.964 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.964 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.964 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.964 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119205 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065656+0000", 2024-09-14T06:01:19.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9829999999999999e-06 2024-09-14T06:01:19.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065661+0000", 2024-09-14T06:01:19.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9510000000000003e-06 2024-09-14T06:01:19.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065680+0000", 2024-09-14T06:01:19.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8947e-05 2024-09-14T06:01:19.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065694+0000", 2024-09-14T06:01:19.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3433e-05 2024-09-14T06:01:19.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150778+0000", 2024-09-14T06:01:19.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085083856999999999 2024-09-14T06:01:19.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151007+0000", 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022914499999999999 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151251+0000", 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024434000000000001 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119206 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6029312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.847936287000003, 2024-09-14T06:01:19.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086002258999999998, 2024-09-14T06:01:19.969 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.969 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.969 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.969 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119206 2024-09-14T06:01:19.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.969 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:19.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065716+0000", 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230000000000001e-06 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065722+0000", 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5219999999999998e-06 2024-09-14T06:01:19.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065739+0000", 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7122e-05 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065752+0000", 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2639e-05 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151384+0000", 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085632514000000007 2024-09-14T06:01:19.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151532+0000", 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000147761 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151717+0000", 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018537800000000001 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119207 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6078464~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:19.972 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:19.973 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.847882941999998, 2024-09-14T06:01:19.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086515080999999994, 2024-09-14T06:01:19.973 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.973 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.973 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.973 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.973 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.973 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.973 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119207 2024-09-14T06:01:19.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.973 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:19.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:19.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065770+0000", 2024-09-14T06:01:19.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5770000000000001e-06 2024-09-14T06:01:19.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065775+0000", 2024-09-14T06:01:19.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1930000000000001e-06 2024-09-14T06:01:19.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065791+0000", 2024-09-14T06:01:19.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6351e-05 2024-09-14T06:01:19.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065804+0000", 2024-09-14T06:01:19.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.259e-05 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151820+0000", 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086016398999999993 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152043+0000", 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022236200000000001 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152283+0000", 2024-09-14T06:01:19.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000240609 2024-09-14T06:01:19.977 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.977 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.977 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.977 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119208 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:19.977 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:19.977 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.847830444000003, 2024-09-14T06:01:19.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086932403000000005, 2024-09-14T06:01:19.977 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.977 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.977 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119208 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065822+0000", 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.032e-06 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065827+0000", 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5790000000000003e-06 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065843+0000", 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5801999999999999e-05 2024-09-14T06:01:19.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065856+0000", 2024-09-14T06:01:19.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2267e-05 2024-09-14T06:01:19.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152416+0000", 2024-09-14T06:01:19.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086560893999999999 2024-09-14T06:01:19.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152568+0000", 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151664 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152753+0000", 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018516499999999999 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119209 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6176768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.847778574000003, 2024-09-14T06:01:19.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087450828999999994, 2024-09-14T06:01:19.982 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.982 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.982 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.982 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119209 2024-09-14T06:01:19.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.982 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:19.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:19.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065874+0000", 2024-09-14T06:01:19.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.097e-06 2024-09-14T06:01:19.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065879+0000", 2024-09-14T06:01:19.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.254e-06 2024-09-14T06:01:19.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065895+0000", 2024-09-14T06:01:19.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6373000000000001e-05 2024-09-14T06:01:19.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065908+0000", 2024-09-14T06:01:19.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2656e-05 2024-09-14T06:01:19.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152854+0000", 2024-09-14T06:01:19.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086946078999999996 2024-09-14T06:01:19.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153080+0000", 2024-09-14T06:01:19.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022582200000000001 2024-09-14T06:01:19.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153324+0000", 2024-09-14T06:01:19.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024354800000000001 2024-09-14T06:01:19.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.986 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.986 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.986 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119210 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6225920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:19.986 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:19.986 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.847726647000002, 2024-09-14T06:01:19.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087773166, 2024-09-14T06:01:19.986 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.986 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.986 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.987 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119210 2024-09-14T06:01:19.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.987 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:19.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:19.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065926+0000", 2024-09-14T06:01:19.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3799999999999999e-06 2024-09-14T06:01:19.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065931+0000", 2024-09-14T06:01:19.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9629999999999997e-06 2024-09-14T06:01:19.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065950+0000", 2024-09-14T06:01:19.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9369999999999999e-05 2024-09-14T06:01:19.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065963+0000", 2024-09-14T06:01:19.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2164000000000001e-05 2024-09-14T06:01:19.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153404+0000", 2024-09-14T06:01:19.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087441840000000007 2024-09-14T06:01:19.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153537+0000", 2024-09-14T06:01:19.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013305500000000001 2024-09-14T06:01:19.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153698+0000", 2024-09-14T06:01:19.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016039400000000001 2024-09-14T06:01:19.990 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.990 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.990 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.991 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119211 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6275072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:19.991 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:19.991 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.847670880000003, 2024-09-14T06:01:19.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088244734000000005, 2024-09-14T06:01:19.991 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.991 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.991 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:19.991 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.991 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.991 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.991 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119211 2024-09-14T06:01:19.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.992 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:19.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:19.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065981+0000", 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.012e-06 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065987+0000", 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5450000000000003e-06 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.066003+0000", 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6198999999999999e-05 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.066016+0000", 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2595999999999999e-05 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153758+0000", 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087742610999999998 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153983+0000", 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000224336 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.154225+0000", 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024243499999999999 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123236 3.16 3:6f8987ed:::rbd_data.112793b455a2.0000000000000001:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 20.498830138999999, 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.973924129, 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:19.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123236 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:19.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:19.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414823+0000", 2024-09-14T06:01:19.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0930000000000001e-06 2024-09-14T06:01:19.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:19.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414830+0000", 2024-09-14T06:01:19.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-09-14T06:01:19.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:19.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414848+0000", 2024-09-14T06:01:19.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8029e-05 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414859+0000", 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0934000000000001e-05 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414952+0000", 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3140999999999995e-05 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414964+0000", 2024-09-14T06:01:19.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1802e-05 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297044+0000", 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88207986500000002 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297073+0000", 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9178000000000001e-05 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385889+0000", 2024-09-14T06:01:19.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0888154130000001 2024-09-14T06:01:20.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:20.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.386144+0000", 2024-09-14T06:01:20.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255064 2024-09-14T06:01:20.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:20.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.386344+0000", 2024-09-14T06:01:20.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020039100000000001 2024-09-14T06:01:20.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:20.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388411+0000", 2024-09-14T06:01:20.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020668029999999999 2024-09-14T06:01:20.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:20.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388490+0000", 2024-09-14T06:01:20.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9237e-05 2024-09-14T06:01:20.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:20.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388589+0000", 2024-09-14T06:01:20.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9254999999999998e-05 2024-09-14T06:01:20.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:20.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388745+0000", 2024-09-14T06:01:20.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015581899999999999 2024-09-14T06:01:20.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:20.002 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:20.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:20.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.002 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123238 3.7 3:e6b46603:::rbd_data.112793b455a2.0000000000000003:head [delete] snapc 19=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-14T06:01:20.002 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:20.002 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.621892384999999, 2024-09-14T06:01:20.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0714216679999999, 2024-09-14T06:01:20.002 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:20.002 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:20.003 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:20.003 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:20.003 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:20.003 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:20.003 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123238 2024-09-14T06:01:20.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.003 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:20.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:20.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:20.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:20.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:20.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:20.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:20.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:20.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291762+0000", 2024-09-14T06:01:20.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.467e-06 2024-09-14T06:01:20.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:20.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291777+0000", 2024-09-14T06:01:20.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4664999999999999e-05 2024-09-14T06:01:20.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:20.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291833+0000", 2024-09-14T06:01:20.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5498000000000003e-05 2024-09-14T06:01:20.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:20.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291861+0000", 2024-09-14T06:01:20.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8161999999999999e-05 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292150+0000", 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028918900000000003 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292171+0000", 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0936000000000001e-05 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297607+0000", 2024-09-14T06:01:20.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054358139999999998 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297630+0000", 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3209000000000001e-05 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357360+0000", 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0597304700000001 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357737+0000", 2024-09-14T06:01:20.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037695399999999998 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0,3", 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.358085+0000", 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034785099999999999 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361195+0000", 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003110163 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361362+0000", 2024-09-14T06:01:20.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167112 2024-09-14T06:01:20.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:20.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.362887+0000", 2024-09-14T06:01:20.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015243419999999999 2024-09-14T06:01:20.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:20.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.362987+0000", 2024-09-14T06:01:20.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100333 2024-09-14T06:01:20.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:20.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.363181+0000", 2024-09-14T06:01:20.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019350300000000001 2024-09-14T06:01:20.010 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:20.010 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:20.010 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:20.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.010 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123244 3.7 3:e141330b:::rbd_data.112793b455a2.0000000000000009:head [delete] snapc 19=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-14T06:01:20.010 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:20.010 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.621725806000001, 2024-09-14T06:01:20.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.072328908, 2024-09-14T06:01:20.010 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:20.010 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:20.010 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123244 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:20.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:20.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:20.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291927+0000", 2024-09-14T06:01:20.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5460000000000001e-06 2024-09-14T06:01:20.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:20.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291934+0000", 2024-09-14T06:01:20.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3599999999999998e-06 2024-09-14T06:01:20.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:20.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291956+0000", 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1469000000000001e-05 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291972+0000", 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5773e-05 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292362+0000", 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00038989100000000001 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-09-14T06:01:20.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292379+0000", 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7186000000000001e-05 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297840+0000", 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054614260000000001 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297860+0000", 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9782000000000001e-05 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:20.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359785+0000", 2024-09-14T06:01:20.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.061924665 2024-09-14T06:01:20.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:20.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360080+0000", 2024-09-14T06:01:20.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029538399999999999 2024-09-14T06:01:20.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0,3", 2024-09-14T06:01:20.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360382+0000", 2024-09-14T06:01:20.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030214 2024-09-14T06:01:20.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:20.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361612+0000", 2024-09-14T06:01:20.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001229808 2024-09-14T06:01:20.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:20.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.363256+0000", 2024-09-14T06:01:20.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001644162 2024-09-14T06:01:20.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:20.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364059+0000", 2024-09-14T06:01:20.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080328599999999995 2024-09-14T06:01:20.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:20.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364105+0000", 2024-09-14T06:01:20.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5695999999999998e-05 2024-09-14T06:01:20.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:20.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:20.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:20.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364254+0000", 2024-09-14T06:01:20.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014933399999999999 2024-09-14T06:01:20.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:20.017 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:20.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:20.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:20.017 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:20.018 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:20.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:01:20.019 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:20.016+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:20.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:01:20.120 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:20.116+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:20.188 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:20.188 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:20.188 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:20.188 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:20.202 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:01:20.221 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:20.216+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:20.277 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:20.277 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:20.294 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:20.320 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:20.320 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:20.321 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:20.316+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:20.339 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:20.359 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:20.359 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:20.380 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:20.380 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:20.388 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:20.389 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:20.402 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:20.402 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:20.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:01:20.439 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T06:01:20.446 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:20.444+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:20.523 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:20.520+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:20.527 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:20.528 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:20.542 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:01:20.630 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:20.628+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:20.703 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:20.703 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:20.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:01:20.762 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:20.760+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:20.825 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:20.824+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:20.885 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:20.886 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:20.900 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:01:20.946 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:20.944+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:21.022 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:21.022 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:21.026 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:21.020+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:21.036 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:01:21.127 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:21.124+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:21.169 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:21.169 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:21.184 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:01:21.228 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:21.224+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2024-09-14T06:01:21.312 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:21.313 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:21.329 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:21.324+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:21.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:01:21.430 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:21.424+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:21.465 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:21.465 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:21.481 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:01:21.531 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:21.528+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:21.596 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:21.596 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:21.609 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:01:21.655 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:21.652+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:21.729 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:21.730 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:21.732 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:21.728+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:21.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:01:21.835 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:21.832+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:21.912 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:21.912 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:21.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:01:21.934 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:21.928+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:22.035 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:22.032+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:22.096 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:22.096 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:22.110 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:01:22.135 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:22.132+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:22.223 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:22.223 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:22.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:01:22.237 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:22.232+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:22.338 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:22.332+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:22.364 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:22.364 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:22.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:01:22.421 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:01:22.438 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-14T06:01:22.439 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T06:01:22.439 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T06:01:22.439 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 0.000000 2024-09-14T06:01:22.439 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 0 2024-09-14T06:01:22.439 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:22.436+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:22.520 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:22.520 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:22.539 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:01:22.540 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:22.536+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:22.576 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:22.594 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:22.594 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:22.613 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:22.614 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:22.632 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:22.632 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:22.641 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:22.636+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:22.653 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:22.654 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:22.661 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:22.662 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:22.662 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:22.662 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:22.662 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:22.674 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:22.676 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:01:22.696 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:22.697 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:22.719 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:22.719 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:22.742 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:22.736+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:22.815 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:22.815 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:22.815 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:22.815 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:22.815 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.815 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54659 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 616448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.816 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:22.816 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.673411646000005, 2024-09-14T06:01:22.816 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092177035000000004, 2024-09-14T06:01:22.816 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.816 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.816 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.816 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.816 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.816 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.816 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54659 2024-09-14T06:01:22.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.816 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.817 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.817 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:22.817 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.817 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.817 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139717+0000", 2024-09-14T06:01:22.817 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.818 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.818 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139718+0000", 2024-09-14T06:01:22.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9699999999999996e-07 2024-09-14T06:01:22.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.818 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.818 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139731+0000", 2024-09-14T06:01:22.818 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2993000000000001e-05 2024-09-14T06:01:22.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.818 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.819 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.819 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139738+0000", 2024-09-14T06:01:22.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4610000000000002e-06 2024-09-14T06:01:22.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.819 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.819 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139744+0000", 2024-09-14T06:01:22.819 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6389999999999997e-06 2024-09-14T06:01:22.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.820 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.820 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231570+0000", 2024-09-14T06:01:22.820 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.091826216000000002 2024-09-14T06:01:22.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.820 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.820 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231662+0000", 2024-09-14T06:01:22.820 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2101000000000005e-05 2024-09-14T06:01:22.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.821 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.821 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231894+0000", 2024-09-14T06:01:22.821 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00023212800000000001 2024-09-14T06:01:22.821 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.821 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.821 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.821 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54660 3.1e 3:7d3ce0ab:::rbd_data.1127f2f8ff9b.0000000000000002:13 [read 622592~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.822 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:22.822 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.673376312000002, 2024-09-14T06:01:22.822 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092366887999999994, 2024-09-14T06:01:22.822 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.822 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.822 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.822 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.822 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.822 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.822 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54660 2024-09-14T06:01:22.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.822 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.822 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.823 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:22.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.823 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:22.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.823 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.823 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139753+0000", 2024-09-14T06:01:22.823 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0500000000000004e-07 2024-09-14T06:01:22.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.824 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139755+0000", 2024-09-14T06:01:22.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0949999999999998e-06 2024-09-14T06:01:22.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.824 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139762+0000", 2024-09-14T06:01:22.824 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6719999999999998e-06 2024-09-14T06:01:22.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.824 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.824 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139767+0000", 2024-09-14T06:01:22.825 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9819999999999999e-06 2024-09-14T06:01:22.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.825 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.825 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231917+0000", 2024-09-14T06:01:22.825 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092149872999999993 2024-09-14T06:01:22.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.825 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.826 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.231969+0000", 2024-09-14T06:01:22.826 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2642000000000002e-05 2024-09-14T06:01:22.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.826 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.826 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232120+0000", 2024-09-14T06:01:22.826 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00015011899999999999 2024-09-14T06:01:22.826 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.826 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.826 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.826 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54844 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 0~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.826 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:22.827 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.673354821000004, 2024-09-14T06:01:22.827 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092708507999999995, 2024-09-14T06:01:22.827 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.827 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.827 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.827 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.827 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.827 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.827 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54844 2024-09-14T06:01:22.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.827 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.827 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.828 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:22.828 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.828 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.829 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.829 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:22.829 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.829 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.829 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.829 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139775+0000", 2024-09-14T06:01:22.829 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3500000000000002e-07 2024-09-14T06:01:22.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.830 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.830 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139777+0000", 2024-09-14T06:01:22.830 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.979e-06 2024-09-14T06:01:22.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.830 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.830 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139787+0000", 2024-09-14T06:01:22.830 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0779e-05 2024-09-14T06:01:22.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.830 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.831 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139799+0000", 2024-09-14T06:01:22.831 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1719000000000001e-05 2024-09-14T06:01:22.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.831 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.831 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232151+0000", 2024-09-14T06:01:22.831 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092351767000000001 2024-09-14T06:01:22.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.832 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.832 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232217+0000", 2024-09-14T06:01:22.832 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6655000000000005e-05 2024-09-14T06:01:22.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.832 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.832 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.832 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232483+0000", 2024-09-14T06:01:22.832 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026517400000000002 2024-09-14T06:01:22.832 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.832 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.833 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.833 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54845 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 55296~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.833 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:22.833 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.673321150000007, 2024-09-14T06:01:22.833 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093127583999999999, 2024-09-14T06:01:22.833 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.833 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.833 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.833 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.834 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.834 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.834 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54845 2024-09-14T06:01:22.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.834 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.834 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.834 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.834 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:22.834 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.835 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.835 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.835 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:22.835 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.835 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.835 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.835 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:22.835 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4899999999999995e-07 2024-09-14T06:01:22.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.835 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.835 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.836 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139811+0000", 2024-09-14T06:01:22.836 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000001e-06 2024-09-14T06:01:22.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.836 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.836 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.836 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139821+0000", 2024-09-14T06:01:22.836 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0168e-05 2024-09-14T06:01:22.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.836 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.836 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.836 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139826+0000", 2024-09-14T06:01:22.836 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2780000000000001e-06 2024-09-14T06:01:22.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.837 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.837 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232556+0000", 2024-09-14T06:01:22.837 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092729729999999996 2024-09-14T06:01:22.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.837 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.837 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232652+0000", 2024-09-14T06:01:22.837 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680999999999994e-05 2024-09-14T06:01:22.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.838 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.838 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232935+0000", 2024-09-14T06:01:22.838 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000283758 2024-09-14T06:01:22.838 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.838 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.838 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.838 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.838 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54846 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.838 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:22.838 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.673294842999994, 2024-09-14T06:01:22.838 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093492079000000006, 2024-09-14T06:01:22.838 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.838 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.839 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.839 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.839 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.839 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.839 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54846 2024-09-14T06:01:22.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.839 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.839 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.839 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:22.839 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.839 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.840 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:22.840 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.840 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.840 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139835+0000", 2024-09-14T06:01:22.840 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T06:01:22.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.840 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.840 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139837+0000", 2024-09-14T06:01:22.840 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1059999999999998e-06 2024-09-14T06:01:22.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.841 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.841 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139845+0000", 2024-09-14T06:01:22.841 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4300000000000006e-06 2024-09-14T06:01:22.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.841 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.841 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139851+0000", 2024-09-14T06:01:22.841 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T06:01:22.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.842 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.842 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232987+0000", 2024-09-14T06:01:22.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093136073999999999 2024-09-14T06:01:22.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.842 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.842 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233075+0000", 2024-09-14T06:01:22.842 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7318999999999995e-05 2024-09-14T06:01:22.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.842 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.842 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.842 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233326+0000", 2024-09-14T06:01:22.843 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025159 2024-09-14T06:01:22.843 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.843 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.843 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.843 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.843 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54847 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 67584~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.843 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:22.843 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.673269126999998, 2024-09-14T06:01:22.843 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093777452999999997, 2024-09-14T06:01:22.843 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.843 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.843 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.843 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.844 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.844 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.844 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54847 2024-09-14T06:01:22.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.844 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.844 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.844 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:22.844 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.844 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.844 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:22.845 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.845 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.849 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:22.849 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T06:01:22.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.849 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.849 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139862+0000", 2024-09-14T06:01:22.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0200000000000001e-06 2024-09-14T06:01:22.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.850 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.850 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139870+0000", 2024-09-14T06:01:22.850 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0520000000000002e-06 2024-09-14T06:01:22.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.850 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139875+0000", 2024-09-14T06:01:22.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:01:22.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.851 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.851 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233389+0000", 2024-09-14T06:01:22.851 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093514054999999999 2024-09-14T06:01:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233443+0000", 2024-09-14T06:01:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3913999999999999e-05 2024-09-14T06:01:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233637+0000", 2024-09-14T06:01:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019392899999999999 2024-09-14T06:01:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.853 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54848 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 73728~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.853 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:22.853 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.673246031000005, 2024-09-14T06:01:22.853 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094064464, 2024-09-14T06:01:22.853 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.853 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.853 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.853 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.854 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.854 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54848 2024-09-14T06:01:22.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.854 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.854 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.854 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:22.854 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.854 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.854 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.854 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:22.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:22.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T06:01:22.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.855 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.855 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139885+0000", 2024-09-14T06:01:22.855 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9929999999999998e-06 2024-09-14T06:01:22.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139893+0000", 2024-09-14T06:01:22.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9759999999999995e-06 2024-09-14T06:01:22.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139898+0000", 2024-09-14T06:01:22.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6059999999999996e-06 2024-09-14T06:01:22.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.856 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.856 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233681+0000", 2024-09-14T06:01:22.856 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093782921000000005 2024-09-14T06:01:22.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.857 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.857 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233730+0000", 2024-09-14T06:01:22.857 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9410999999999998e-05 2024-09-14T06:01:22.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.857 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.857 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.857 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233947+0000", 2024-09-14T06:01:22.857 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021710300000000001 2024-09-14T06:01:22.857 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.857 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.857 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.858 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54849 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.858 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:22.858 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.673222574999997, 2024-09-14T06:01:22.858 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094499257000000003, 2024-09-14T06:01:22.858 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.858 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.858 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.858 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.858 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.858 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.858 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54849 2024-09-14T06:01:22.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.859 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.859 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.859 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:22.859 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.859 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.859 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:22.859 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139907+0000", 2024-09-14T06:01:22.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T06:01:22.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139909+0000", 2024-09-14T06:01:22.860 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T06:01:22.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.860 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.860 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139916+0000", 2024-09-14T06:01:22.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T06:01:22.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.861 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139921+0000", 2024-09-14T06:01:22.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:01:22.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.861 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.861 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234032+0000", 2024-09-14T06:01:22.861 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094111037999999994 2024-09-14T06:01:22.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.862 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.862 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234150+0000", 2024-09-14T06:01:22.862 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118408 2024-09-14T06:01:22.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.862 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.862 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.862 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234406+0000", 2024-09-14T06:01:22.862 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025540600000000001 2024-09-14T06:01:22.862 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.862 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.863 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.863 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54850 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 135168~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.863 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:22.863 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.673200867000006, 2024-09-14T06:01:22.863 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094814605999999996, 2024-09-14T06:01:22.863 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.863 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.863 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.863 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.863 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.863 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.864 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54850 2024-09-14T06:01:22.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.864 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.864 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:22.864 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.864 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:22.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.865 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139929+0000", 2024-09-14T06:01:22.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T06:01:22.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.865 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.865 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139931+0000", 2024-09-14T06:01:22.865 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.024e-06 2024-09-14T06:01:22.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139937+0000", 2024-09-14T06:01:22.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3770000000000001e-06 2024-09-14T06:01:22.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139942+0000", 2024-09-14T06:01:22.866 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0289999999999996e-06 2024-09-14T06:01:22.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.866 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.866 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234447+0000", 2024-09-14T06:01:22.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094505426000000003 2024-09-14T06:01:22.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234539+0000", 2024-09-14T06:01:22.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1793999999999996e-05 2024-09-14T06:01:22.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.867 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.867 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.867 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234743+0000", 2024-09-14T06:01:22.867 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020354600000000001 2024-09-14T06:01:22.867 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.867 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.867 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.868 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54851 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 141312~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.868 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:22.868 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.673179155, 2024-09-14T06:01:22.868 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095179749999999994, 2024-09-14T06:01:22.868 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.868 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.868 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.868 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.868 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.868 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.868 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54851 2024-09-14T06:01:22.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.869 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.869 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.869 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:22.869 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:22.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.870 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:22.870 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:01:22.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.870 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.871 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139952+0000", 2024-09-14T06:01:22.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0600000000000002e-06 2024-09-14T06:01:22.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.871 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.871 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139959+0000", 2024-09-14T06:01:22.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.584e-06 2024-09-14T06:01:22.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.871 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.871 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139964+0000", 2024-09-14T06:01:22.871 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8890000000000001e-06 2024-09-14T06:01:22.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234786+0000", 2024-09-14T06:01:22.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094822241000000002 2024-09-14T06:01:22.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.872 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234877+0000", 2024-09-14T06:01:22.872 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1158999999999999e-05 2024-09-14T06:01:22.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.872 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.872 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.873 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235130+0000", 2024-09-14T06:01:22.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025235999999999998 2024-09-14T06:01:22.873 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.873 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.873 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.873 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54852 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 147456~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.873 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:22.873 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.673158026999999, 2024-09-14T06:01:22.873 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095437742000000006, 2024-09-14T06:01:22.873 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.874 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.874 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.874 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.874 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.874 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.874 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54852 2024-09-14T06:01:22.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.874 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.874 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.874 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:22.874 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:22.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140125+0000", 2024-09-14T06:01:22.875 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154332 2024-09-14T06:01:22.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.875 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.875 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.875 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140130+0000", 2024-09-14T06:01:22.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.284e-06 2024-09-14T06:01:22.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140140+0000", 2024-09-14T06:01:22.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0789e-05 2024-09-14T06:01:22.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.876 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.876 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140147+0000", 2024-09-14T06:01:22.876 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9879999999999998e-06 2024-09-14T06:01:22.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235174+0000", 2024-09-14T06:01:22.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095026749999999993 2024-09-14T06:01:22.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.877 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235230+0000", 2024-09-14T06:01:22.877 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6224000000000002e-05 2024-09-14T06:01:22.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.877 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.878 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235409+0000", 2024-09-14T06:01:22.878 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017837500000000001 2024-09-14T06:01:22.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.878 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.878 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.878 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54853 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 202752~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.878 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:22.878 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.672969205000001, 2024-09-14T06:01:22.878 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095632919999999996, 2024-09-14T06:01:22.878 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.878 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.879 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.879 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.879 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.879 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.879 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54853 2024-09-14T06:01:22.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.879 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.879 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.879 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:22.879 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.879 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.880 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.880 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:22.880 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.880 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.880 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147748+0000", 2024-09-14T06:01:22.880 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075884910000000002 2024-09-14T06:01:22.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.880 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.880 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147798+0000", 2024-09-14T06:01:22.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0152999999999999e-05 2024-09-14T06:01:22.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147814+0000", 2024-09-14T06:01:22.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5866e-05 2024-09-14T06:01:22.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.881 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.881 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147831+0000", 2024-09-14T06:01:22.881 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6991999999999999e-05 2024-09-14T06:01:22.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235451+0000", 2024-09-14T06:01:22.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087620077000000005 2024-09-14T06:01:22.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235539+0000", 2024-09-14T06:01:22.882 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7800000000000006e-05 2024-09-14T06:01:22.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.882 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.882 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235793+0000", 2024-09-14T06:01:22.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025354099999999998 2024-09-14T06:01:22.883 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.883 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.883 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.883 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.883 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54870 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 503808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.883 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:22.883 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.664723658, 2024-09-14T06:01:22.883 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092420756000000007, 2024-09-14T06:01:22.883 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.883 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.883 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.883 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.884 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.884 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.884 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54870 2024-09-14T06:01:22.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.884 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:22.884 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.884 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.884 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.884 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.884 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:22.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.885 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.885 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148406+0000", 2024-09-14T06:01:22.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T06:01:22.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.885 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.885 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148409+0000", 2024-09-14T06:01:22.885 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T06:01:22.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.885 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148418+0000", 2024-09-14T06:01:22.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7329999999999998e-06 2024-09-14T06:01:22.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148425+0000", 2024-09-14T06:01:22.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2079999999999997e-06 2024-09-14T06:01:22.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.886 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.886 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.886 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240591+0000", 2024-09-14T06:01:22.886 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092166441000000002 2024-09-14T06:01:22.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240648+0000", 2024-09-14T06:01:22.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6733e-05 2024-09-14T06:01:22.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.887 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.887 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240826+0000", 2024-09-14T06:01:22.887 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017834700000000001 2024-09-14T06:01:22.887 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.887 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.887 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.887 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.888 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54871 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 509952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.888 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:22.888 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.664693697999994, 2024-09-14T06:01:22.888 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092702341999999993, 2024-09-14T06:01:22.888 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.888 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.888 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.888 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.888 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.888 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.888 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54871 2024-09-14T06:01:22.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.888 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.889 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.889 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:22.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.889 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.889 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:22.889 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.889 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148436+0000", 2024-09-14T06:01:22.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5499999999999998e-07 2024-09-14T06:01:22.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148439+0000", 2024-09-14T06:01:22.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8090000000000001e-06 2024-09-14T06:01:22.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.890 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.890 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148449+0000", 2024-09-14T06:01:22.890 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0115000000000001e-05 2024-09-14T06:01:22.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.890 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148466+0000", 2024-09-14T06:01:22.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6761000000000001e-05 2024-09-14T06:01:22.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240857+0000", 2024-09-14T06:01:22.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092391089999999995 2024-09-14T06:01:22.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.891 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.891 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.891 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240939+0000", 2024-09-14T06:01:22.891 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2387999999999998e-05 2024-09-14T06:01:22.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.892 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.892 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241138+0000", 2024-09-14T06:01:22.892 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000198624 2024-09-14T06:01:22.892 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.892 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.892 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.892 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.892 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.892 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54872 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 516096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:22.893 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:22.893 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 88.664652500000003, 2024-09-14T06:01:22.893 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093126020000000004, 2024-09-14T06:01:22.893 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.893 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:22.893 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.893 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.893 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.893 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54872 2024-09-14T06:01:22.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.893 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:22.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:22.894 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.894 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.894 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.894 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155484+0000", 2024-09-14T06:01:22.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070072429999999998 2024-09-14T06:01:22.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155490+0000", 2024-09-14T06:01:22.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6379999999999998e-06 2024-09-14T06:01:22.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.895 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.895 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.895 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155504+0000", 2024-09-14T06:01:22.895 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4065e-05 2024-09-14T06:01:22.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155513+0000", 2024-09-14T06:01:22.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6799999999999999e-06 2024-09-14T06:01:22.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241216+0000", 2024-09-14T06:01:22.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085702922000000001 2024-09-14T06:01:22.896 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.896 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.896 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.896 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241277+0000", 2024-09-14T06:01:22.896 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0980000000000002e-05 2024-09-14T06:01:22.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.897 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.897 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241602+0000", 2024-09-14T06:01:22.897 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032549199999999998 2024-09-14T06:01:22.897 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.897 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.897 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.897 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.897 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123238 3.7 3.c0662d67 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:22.897 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:22.897 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.398180830000001, 2024-09-14T06:01:22.898 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88300249500000005, 2024-09-14T06:01:22.898 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.898 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.898 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:01:22.898 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.898 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.898 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.898 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123238 2024-09-14T06:01:22.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.898 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.898 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.898 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.898 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:22.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:22.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.899 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414949+0000", 2024-09-14T06:01:22.899 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8899999999999998e-07 2024-09-14T06:01:22.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.899 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.899 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414953+0000", 2024-09-14T06:01:22.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1439999999999996e-06 2024-09-14T06:01:22.900 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.900 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.900 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.900 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414974+0000", 2024-09-14T06:01:22.900 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0630000000000001e-05 2024-09-14T06:01:22.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414982+0000", 2024-09-14T06:01:22.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9840000000000001e-06 2024-09-14T06:01:22.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.901 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.901 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415051+0000", 2024-09-14T06:01:22.901 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9787000000000001e-05 2024-09-14T06:01:22.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.901 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.902 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:22.902 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415062+0000", 2024-09-14T06:01:22.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0674e-05 2024-09-14T06:01:22.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.902 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.902 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297935+0000", 2024-09-14T06:01:22.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88287307400000004 2024-09-14T06:01:22.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.902 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.902 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.902 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297951+0000", 2024-09-14T06:01:22.902 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5413e-05 2024-09-14T06:01:22.903 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.903 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.903 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.903 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.903 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.903 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123240 3.15 3:a806c175:::rbd_data.112793b455a2.0000000000000005:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:22.903 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:22.903 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.398125114999999, 2024-09-14T06:01:22.903 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.950432851, 2024-09-14T06:01:22.903 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.903 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.903 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:22.904 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.904 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.904 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.904 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123240 2024-09-14T06:01:22.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.904 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.904 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:22.904 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.904 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.904 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:22.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:22.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3399999999999999e-07 2024-09-14T06:01:22.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.905 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.905 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415008+0000", 2024-09-14T06:01:22.905 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6090000000000001e-06 2024-09-14T06:01:22.905 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.905 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.906 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.906 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415017+0000", 2024-09-14T06:01:22.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0100000000000001e-06 2024-09-14T06:01:22.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.906 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.906 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415025+0000", 2024-09-14T06:01:22.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9109999999999993e-06 2024-09-14T06:01:22.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.906 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.906 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.906 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415114+0000", 2024-09-14T06:01:22.906 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9086999999999996e-05 2024-09-14T06:01:22.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:22.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415132+0000", 2024-09-14T06:01:22.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7405e-05 2024-09-14T06:01:22.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297130+0000", 2024-09-14T06:01:22.907 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88199837000000003 2024-09-14T06:01:22.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.907 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.907 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:22.907 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297152+0000", 2024-09-14T06:01:22.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2103000000000002e-05 2024-09-14T06:01:22.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361290+0000", 2024-09-14T06:01:22.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.064138091 2024-09-14T06:01:22.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.908 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.908 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361714+0000", 2024-09-14T06:01:22.908 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042403999999999999 2024-09-14T06:01:22.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.908 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:22.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361955+0000", 2024-09-14T06:01:22.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000240981 2024-09-14T06:01:22.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:22.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365095+0000", 2024-09-14T06:01:22.909 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031403960000000002 2024-09-14T06:01:22.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.909 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.909 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:22.909 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365192+0000", 2024-09-14T06:01:22.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6976000000000001e-05 2024-09-14T06:01:22.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:22.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365274+0000", 2024-09-14T06:01:22.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1293999999999998e-05 2024-09-14T06:01:22.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.910 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.910 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.910 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365437+0000", 2024-09-14T06:01:22.910 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016294399999999999 2024-09-14T06:01:22.910 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.910 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.910 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.911 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.911 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123244 3.7 3.d0cc8287 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:22.911 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:22.911 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.398079612, 2024-09-14T06:01:22.911 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88296528100000005, 2024-09-14T06:01:22.911 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.911 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.911 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:01:22.911 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.911 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.912 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.912 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123244 2024-09-14T06:01:22.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.912 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:22.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.912 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.912 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.912 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:22.912 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415050+0000", 2024-09-14T06:01:22.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1500000000000004e-07 2024-09-14T06:01:22.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.913 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.913 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415053+0000", 2024-09-14T06:01:22.913 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1219999999999999e-06 2024-09-14T06:01:22.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.913 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415065+0000", 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1549000000000001e-05 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415071+0000", 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4359999999999999e-06 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415133+0000", 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2249999999999995e-05 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.914 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415141+0000", 2024-09-14T06:01:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5480000000000004e-06 2024-09-14T06:01:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.298007+0000", 2024-09-14T06:01:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88286582199999997 2024-09-14T06:01:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.915 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.298015+0000", 2024-09-14T06:01:22.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8390000000000007e-06 2024-09-14T06:01:22.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.916 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.916 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.916 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.916 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123245 3.15 3:ae492430:::rbd_data.112793b455a2.000000000000000a:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:22.916 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:22.916 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.396011959999999, 2024-09-14T06:01:22.916 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9484952870000001, 2024-09-14T06:01:22.916 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.916 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.916 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:22.917 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.917 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.917 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.917 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123245 2024-09-14T06:01:22.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.917 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:22.917 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.917 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.917 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.917 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:22.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417118+0000", 2024-09-14T06:01:22.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0189999999999999e-06 2024-09-14T06:01:22.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.918 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.918 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417123+0000", 2024-09-14T06:01:22.918 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7380000000000002e-06 2024-09-14T06:01:22.918 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.918 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417137+0000", 2024-09-14T06:01:22.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4538999999999999e-05 2024-09-14T06:01:22.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417146+0000", 2024-09-14T06:01:22.919 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3669999999999997e-06 2024-09-14T06:01:22.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.919 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.919 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.919 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417236+0000", 2024-09-14T06:01:22.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9976999999999996e-05 2024-09-14T06:01:22.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:22.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417249+0000", 2024-09-14T06:01:22.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3325e-05 2024-09-14T06:01:22.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.920 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.920 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.920 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297197+0000", 2024-09-14T06:01:22.920 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.87994787699999999 2024-09-14T06:01:22.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:22.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297209+0000", 2024-09-14T06:01:22.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2486e-05 2024-09-14T06:01:22.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.921 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363278+0000", 2024-09-14T06:01:22.921 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.066068257 2024-09-14T06:01:22.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.921 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.921 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363460+0000", 2024-09-14T06:01:22.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000182022 2024-09-14T06:01:22.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:22.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363641+0000", 2024-09-14T06:01:22.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018182199999999999 2024-09-14T06:01:22.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.922 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.922 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:22.922 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365170+0000", 2024-09-14T06:01:22.922 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00152838 2024-09-14T06:01:22.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365451+0000", 2024-09-14T06:01:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028076000000000002 2024-09-14T06:01:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365504+0000", 2024-09-14T06:01:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3334000000000001e-05 2024-09-14T06:01:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.923 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365612+0000", 2024-09-14T06:01:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108384 2024-09-14T06:01:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123248 3.15 3:a9835311:::rbd_data.112793b455a2.000000000000000d:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 23.395344735999998, 2024-09-14T06:01:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.948835844, 2024-09-14T06:01:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:22.924 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123248 2024-09-14T06:01:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:22.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:22.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:22.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:22.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417785+0000", 2024-09-14T06:01:22.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.054e-06 2024-09-14T06:01:22.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.926 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.926 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:22.926 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417790+0000", 2024-09-14T06:01:22.926 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.186e-06 2024-09-14T06:01:22.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:22.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417806+0000", 2024-09-14T06:01:22.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5430999999999998e-05 2024-09-14T06:01:22.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.927 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.927 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:22.927 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417816+0000", 2024-09-14T06:01:22.927 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7729999999999994e-06 2024-09-14T06:01:22.927 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417875+0000", 2024-09-14T06:01:22.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8950999999999999e-05 2024-09-14T06:01:22.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.928 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:22.928 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417884+0000", 2024-09-14T06:01:22.928 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4369999999999996e-06 2024-09-14T06:01:22.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.928 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297235+0000", 2024-09-14T06:01:22.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.87935095699999999 2024-09-14T06:01:22.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:22.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297241+0000", 2024-09-14T06:01:22.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2790000000000004e-06 2024-09-14T06:01:22.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.929 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.929 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:22.929 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364231+0000", 2024-09-14T06:01:22.929 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.066989736 2024-09-14T06:01:22.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:22.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364369+0000", 2024-09-14T06:01:22.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000137766 2024-09-14T06:01:22.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.930 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:22.930 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364563+0000", 2024-09-14T06:01:22.930 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019418500000000001 2024-09-14T06:01:22.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.930 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:22.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365625+0000", 2024-09-14T06:01:22.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0010621000000000001 2024-09-14T06:01:22.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.931 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.931 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:22.931 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366188+0000", 2024-09-14T06:01:22.931 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00056258499999999999 2024-09-14T06:01:22.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:22.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366318+0000", 2024-09-14T06:01:22.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012983299999999999 2024-09-14T06:01:22.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:22.932 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:22.932 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:22.932 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366620+0000", 2024-09-14T06:01:22.932 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030257100000000001 2024-09-14T06:01:22.932 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.932 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.933 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.933 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:22.933 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:22.933 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:22.935 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:01:22.935 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:22.932+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:23.035 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:23.032+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:23.066 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:23.066 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:23.066 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:23.066 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:23.081 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:01:23.136 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:23.132+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:23.237 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:23.232+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:23.244 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:23.245 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:23.245 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:23.245 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:23.245 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:23.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:01:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.7 primary-affinity to 0 (802) 2024-09-14T06:01:23.340 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:23.336+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:23.343 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T06:01:23.439 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:23.436+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:23.449 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:23.449 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:23.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:23.450 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:23.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.450 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23550 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 606208~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.450 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:01:23.450 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.499045263, 2024-09-14T06:01:23.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048793072999999999, 2024-09-14T06:01:23.450 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.450 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.450 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.450 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.450 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.450 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.450 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23550 2024-09-14T06:01:23.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.451 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:01:23.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:01:23.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948669+0000", 2024-09-14T06:01:23.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7800000000000002e-07 2024-09-14T06:01:23.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948677+0000", 2024-09-14T06:01:23.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1949999999999997e-06 2024-09-14T06:01:23.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948687+0000", 2024-09-14T06:01:23.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0849000000000001e-05 2024-09-14T06:01:23.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948692+0000", 2024-09-14T06:01:23.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8670000000000002e-06 2024-09-14T06:01:23.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997290+0000", 2024-09-14T06:01:23.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048597596999999999 2024-09-14T06:01:23.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997367+0000", 2024-09-14T06:01:23.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7236000000000004e-05 2024-09-14T06:01:23.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997462+0000", 2024-09-14T06:01:23.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4951000000000006e-05 2024-09-14T06:01:23.454 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.454 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.454 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.454 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23551 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 620544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.455 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:01:23.455 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.499014406, 2024-09-14T06:01:23.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048938838999999998, 2024-09-14T06:01:23.455 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.455 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.455 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.455 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.455 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.455 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.455 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23551 2024-09-14T06:01:23.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.455 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:01:23.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:01:23.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948700+0000", 2024-09-14T06:01:23.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1e-07 2024-09-14T06:01:23.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948701+0000", 2024-09-14T06:01:23.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2950000000000001e-06 2024-09-14T06:01:23.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948705+0000", 2024-09-14T06:01:23.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7929999999999999e-06 2024-09-14T06:01:23.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948709+0000", 2024-09-14T06:01:23.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4259999999999999e-06 2024-09-14T06:01:23.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997535+0000", 2024-09-14T06:01:23.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048826181000000003 2024-09-14T06:01:23.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997580+0000", 2024-09-14T06:01:23.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5355000000000002e-05 2024-09-14T06:01:23.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997639+0000", 2024-09-14T06:01:23.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8479e-05 2024-09-14T06:01:23.462 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.462 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.462 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.498998929, 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.463 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:23.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:23.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T06:01:23.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T06:01:23.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T06:01:23.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T06:01:23.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T06:01:23.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T06:01:23.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T06:01:23.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T06:01:23.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T06:01:23.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T06:01:23.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T06:01:23.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T06:01:23.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T06:01:23.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T06:01:23.467 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.467 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.467 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.467 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.467 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:23.467 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.498979654, 2024-09-14T06:01:23.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T06:01:23.468 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.468 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.468 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.468 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.468 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.468 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.468 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T06:01:23.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.468 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:23.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:23.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:23.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T06:01:23.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T06:01:23.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T06:01:23.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T06:01:23.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T06:01:23.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T06:01:23.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T06:01:23.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T06:01:23.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T06:01:23.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T06:01:23.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T06:01:23.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T06:01:23.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T06:01:23.472 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.472 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.472 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.472 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.472 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:23.472 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.498960078, 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:23.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T06:01:23.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T06:01:23.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T06:01:23.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T06:01:23.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T06:01:23.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:01:23.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T06:01:23.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T06:01:23.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T06:01:23.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T06:01:23.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T06:01:23.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T06:01:23.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T06:01:23.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T06:01:23.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.477 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.477 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.477 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.477 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:23.477 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.498940621, 2024-09-14T06:01:23.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T06:01:23.477 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.477 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:23.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:23.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T06:01:23.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T06:01:23.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T06:01:23.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T06:01:23.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T06:01:23.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T06:01:23.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T06:01:23.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T06:01:23.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T06:01:23.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T06:01:23.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T06:01:23.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T06:01:23.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T06:01:23.482 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.482 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.482 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.482 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.482 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:23.482 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.49892156999999, 2024-09-14T06:01:23.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T06:01:23.482 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.482 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.482 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.483 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.483 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.483 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.483 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T06:01:23.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.483 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:23.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:23.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:23.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T06:01:23.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T06:01:23.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T06:01:23.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T06:01:23.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T06:01:23.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T06:01:23.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T06:01:23.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T06:01:23.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T06:01:23.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T06:01:23.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T06:01:23.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T06:01:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T06:01:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.498901889, 2024-09-14T06:01:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T06:01:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.487 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T06:01:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T06:01:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T06:01:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T06:01:23.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T06:01:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T06:01:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:01:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T06:01:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T06:01:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T06:01:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T06:01:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T06:01:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T06:01:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T06:01:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T06:01:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.491 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.498881938, 2024-09-14T06:01:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T06:01:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.492 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.493 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T06:01:23.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.493 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:23.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:23.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T06:01:23.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T06:01:23.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T06:01:23.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:01:23.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T06:01:23.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T06:01:23.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T06:01:23.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T06:01:23.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T06:01:23.497 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.497 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.497 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.497 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.497 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:23.497 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.498862626, 2024-09-14T06:01:23.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T06:01:23.498 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.498 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.498 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.498 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.498 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.498 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.498 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T06:01:23.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.498 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:23.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T06:01:23.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T06:01:23.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T06:01:23.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T06:01:23.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T06:01:23.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T06:01:23.501 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.501 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.501 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.502 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.502 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:23.502 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.498842865, 2024-09-14T06:01:23.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T06:01:23.502 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.502 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.502 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.502 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.503 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T06:01:23.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.503 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:23.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:23.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T06:01:23.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:01:23.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T06:01:23.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T06:01:23.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T06:01:23.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T06:01:23.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T06:01:23.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T06:01:23.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T06:01:23.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T06:01:23.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T06:01:23.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T06:01:23.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T06:01:23.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T06:01:23.506 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.506 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.506 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.507 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.507 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:23.507 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.498821944, 2024-09-14T06:01:23.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T06:01:23.507 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.507 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.507 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.507 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T06:01:23.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.508 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:23.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:23.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T06:01:23.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T06:01:23.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T06:01:23.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T06:01:23.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T06:01:23.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T06:01:23.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T06:01:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T06:01:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T06:01:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.49766261000001, 2024-09-14T06:01:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T06:01:23.512 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.512 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.512 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.512 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T06:01:23.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.512 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:23.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:23.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T06:01:23.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T06:01:23.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T06:01:23.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T06:01:23.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T06:01:23.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T06:01:23.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T06:01:23.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T06:01:23.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T06:01:23.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T06:01:23.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T06:01:23.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T06:01:23.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T06:01:23.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T06:01:23.516 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.516 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.516 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.516 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.516 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:23.516 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.497363828, 2024-09-14T06:01:23.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T06:01:23.517 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.517 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.517 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.517 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.517 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.517 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.517 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T06:01:23.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.517 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:23.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:23.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T06:01:23.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T06:01:23.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T06:01:23.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T06:01:23.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T06:01:23.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T06:01:23.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T06:01:23.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T06:01:23.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T06:01:23.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T06:01:23.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T06:01:23.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T06:01:23.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T06:01:23.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T06:01:23.521 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.521 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.521 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.521 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.521 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:23.522 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.49721309, 2024-09-14T06:01:23.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T06:01:23.522 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.522 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.522 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:23.522 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.522 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.522 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.522 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T06:01:23.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.522 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:23.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:23.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T06:01:23.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T06:01:23.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T06:01:23.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T06:01:23.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T06:01:23.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T06:01:23.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T06:01:23.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T06:01:23.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T06:01:23.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T06:01:23.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T06:01:23.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T06:01:23.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T06:01:23.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T06:01:23.526 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.526 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.526 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.526 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T06:01:23.526 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:23.526 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 111.87191152699999, 2024-09-14T06:01:23.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T06:01:23.527 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.527 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.527 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:23.527 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:23.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:23.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T06:01:23.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T06:01:23.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T06:01:23.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T06:01:23.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T06:01:23.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T06:01:23.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T06:01:23.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T06:01:23.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T06:01:23.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T06:01:23.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T06:01:23.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T06:01:23.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:23.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T06:01:23.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T06:01:23.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T06:01:23.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T06:01:23.531 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.531 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.531 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.532 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:23.532 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:23.532 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 111.34882158800001, 2024-09-14T06:01:23.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T06:01:23.532 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.532 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.532 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:23.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.532 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T06:01:23.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.533 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:23.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:23.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T06:01:23.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T06:01:23.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T06:01:23.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T06:01:23.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T06:01:23.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T06:01:23.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T06:01:23.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T06:01:23.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T06:01:23.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T06:01:23.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T06:01:23.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T06:01:23.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T06:01:23.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T06:01:23.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T06:01:23.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:23.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T06:01:23.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T06:01:23.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:23.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T06:01:23.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T06:01:23.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:23.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T06:01:23.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T06:01:23.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T06:01:23.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T06:01:23.538 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.538 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.538 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.538 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123243 3.f 3:f182c8b1:::rbd_data.112793b455a2.0000000000000008:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:23.538 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:23.538 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.032787125999999, 2024-09-14T06:01:23.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9453718680000001, 2024-09-14T06:01:23.539 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.539 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.539 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:23.539 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.539 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.539 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.539 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123243 2024-09-14T06:01:23.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.539 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:23.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:23.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414929+0000", 2024-09-14T06:01:23.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.761e-06 2024-09-14T06:01:23.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414935+0000", 2024-09-14T06:01:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1310000000000003e-06 2024-09-14T06:01:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414953+0000", 2024-09-14T06:01:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.806e-05 2024-09-14T06:01:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414962+0000", 2024-09-14T06:01:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8040000000000007e-06 2024-09-14T06:01:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.415129+0000", 2024-09-14T06:01:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016696699999999999 2024-09-14T06:01:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.415160+0000", 2024-09-14T06:01:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1361e-05 2024-09-14T06:01:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.306423+0000", 2024-09-14T06:01:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.89126284499999997 2024-09-14T06:01:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.306458+0000", 2024-09-14T06:01:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4864999999999999e-05 2024-09-14T06:01:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.356709+0000", 2024-09-14T06:01:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0502506730000001 2024-09-14T06:01:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357372+0000", 2024-09-14T06:01:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00066291500000000003 2024-09-14T06:01:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T06:01:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357702+0000", 2024-09-14T06:01:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00033040400000000002 2024-09-14T06:01:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359330+0000", 2024-09-14T06:01:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001628004 2024-09-14T06:01:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359899+0000", 2024-09-14T06:01:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00056937000000000003 2024-09-14T06:01:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360016+0000", 2024-09-14T06:01:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116688 2024-09-14T06:01:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360299+0000", 2024-09-14T06:01:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028301999999999998 2024-09-14T06:01:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123246 3.e 3:757f91a9:::rbd_data.112793b455a2.000000000000000b:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.030294525999999, 2024-09-14T06:01:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.971537646, 2024-09-14T06:01:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123246 2024-09-14T06:01:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417422+0000", 2024-09-14T06:01:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3029999999999998e-06 2024-09-14T06:01:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417433+0000", 2024-09-14T06:01:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1333e-05 2024-09-14T06:01:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417496+0000", 2024-09-14T06:01:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2856999999999998e-05 2024-09-14T06:01:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417521+0000", 2024-09-14T06:01:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5041999999999998e-05 2024-09-14T06:01:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417631+0000", 2024-09-14T06:01:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010957 2024-09-14T06:01:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417641+0000", 2024-09-14T06:01:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0655999999999999e-05 2024-09-14T06:01:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301111+0000", 2024-09-14T06:01:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.883469175 2024-09-14T06:01:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301143+0000", 2024-09-14T06:01:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1998000000000001e-05 2024-09-14T06:01:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385119+0000", 2024-09-14T06:01:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0839765729999999 2024-09-14T06:01:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385594+0000", 2024-09-14T06:01:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000475014 2024-09-14T06:01:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385905+0000", 2024-09-14T06:01:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031112300000000001 2024-09-14T06:01:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388402+0000", 2024-09-14T06:01:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024969110000000001 2024-09-14T06:01:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388492+0000", 2024-09-14T06:01:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9740000000000005e-05 2024-09-14T06:01:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388646+0000", 2024-09-14T06:01:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153788 2024-09-14T06:01:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388957+0000", 2024-09-14T06:01:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000311563 2024-09-14T06:01:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123247 3.e 3:71933c91:::rbd_data.112793b455a2.000000000000000c:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.030115485, 2024-09-14T06:01:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9716223099999999, 2024-09-14T06:01:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123247 2024-09-14T06:01:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417601+0000", 2024-09-14T06:01:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:01:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417613+0000", 2024-09-14T06:01:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2041999999999999e-05 2024-09-14T06:01:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417636+0000", 2024-09-14T06:01:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3071999999999999e-05 2024-09-14T06:01:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417652+0000", 2024-09-14T06:01:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6512999999999999e-05 2024-09-14T06:01:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417722+0000", 2024-09-14T06:01:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0201000000000001e-05 2024-09-14T06:01:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417729+0000", 2024-09-14T06:01:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4420000000000003e-06 2024-09-14T06:01:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301770+0000", 2024-09-14T06:01:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88404090999999996 2024-09-14T06:01:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301798+0000", 2024-09-14T06:01:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8619000000000002e-05 2024-09-14T06:01:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387130+0000", 2024-09-14T06:01:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0853317760000001 2024-09-14T06:01:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387314+0000", 2024-09-14T06:01:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018428699999999999 2024-09-14T06:01:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387786+0000", 2024-09-14T06:01:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047110000000000001 2024-09-14T06:01:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388983+0000", 2024-09-14T06:01:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011978640000000001 2024-09-14T06:01:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389032+0000", 2024-09-14T06:01:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8349000000000001e-05 2024-09-14T06:01:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389082+0000", 2024-09-14T06:01:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0291999999999999e-05 2024-09-14T06:01:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389221+0000", 2024-09-14T06:01:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013898599999999999 2024-09-14T06:01:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:23.562 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:23.563 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:01:23.564 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:23.560+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:23.664 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:23.660+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:23.733 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:23.734 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:23.734 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:23.734 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:23.747 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:01:23.794 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:23.792+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:23.866 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:23.864+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:23.874 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:23.875 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:23.875 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:23.889 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:01:23.968 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:23.964+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:24.057 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:24.057 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:24.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:24.057 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:24.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.058 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:24.058 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:24.058 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.507952148, 2024-09-14T06:01:24.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:01:24.058 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.058 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.058 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:24.058 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.058 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.058 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.058 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:01:24.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.059 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:24.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:24.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:01:24.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:01:24.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:01:24.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:01:24.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:01:24.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:01:24.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:01:24.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:01:24.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:01:24.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:01:24.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:01:24.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:01:24.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:24.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:01:24.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:01:24.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:24.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:01:24.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:01:24.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:24.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:01:24.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:01:24.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:24.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:01:24.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:01:24.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:01:24.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:01:24.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.064 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.064 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:24.064 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:24.064 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 99.532555263000006, 2024-09-14T06:01:24.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:01:24.064 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.064 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.065 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.065 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:01:24.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.065 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:24.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:24.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:01:24.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:01:24.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:01:24.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:01:24.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:01:24.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:01:24.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:01:24.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:01:24.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:01:24.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:01:24.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:01:24.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:01:24.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 99.532516939999994, 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.069 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.070 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.070 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.070 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:01:24.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.070 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:24.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:24.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:01:24.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:01:24.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:01:24.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:01:24.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:01:24.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:01:24.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:01:24.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:01:24.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:01:24.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:01:24.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:01:24.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:01:24.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:01:24.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:01:24.073 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.073 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.073 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.074 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:24.074 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:24.074 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 99.532490248000002, 2024-09-14T06:01:24.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:01:24.074 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.074 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.074 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.074 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.074 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.074 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.074 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:01:24.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.075 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:24.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:24.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:01:24.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:01:24.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:01:24.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:01:24.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:01:24.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:01:24.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:01:24.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:01:24.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:01:24.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:01:24.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:01:24.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:01:24.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:01:24.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:01:24.078 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.078 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.078 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.078 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:24.079 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:24.079 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 99.532464382000001, 2024-09-14T06:01:24.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:01:24.079 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.079 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.079 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.079 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:01:24.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.079 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:24.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:24.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:01:24.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:01:24.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:01:24.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:01:24.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:01:24.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:01:24.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:01:24.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:01:24.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:01:24.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:01:24.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:01:24.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:01:24.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:01:24.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:01:24.083 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.083 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.083 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.083 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:24.083 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:24.083 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 99.531364013000001, 2024-09-14T06:01:24.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:01:24.083 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.084 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.084 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.084 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.084 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.084 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.084 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:01:24.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.084 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:24.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:24.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:01:24.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:01:24.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:01:24.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:01:24.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:01:24.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:01:24.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:01:24.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:01:24.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:01:24.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:01:24.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:01:24.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:01:24.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:01:24.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:01:24.087 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.087 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.088 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:24.088 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:24.088 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 99.531320034000004, 2024-09-14T06:01:24.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:01:24.088 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.088 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.088 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.088 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.088 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.088 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.089 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:01:24.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.089 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:24.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:24.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:01:24.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:01:24.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:01:24.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:01:24.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:01:24.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:01:24.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:01:24.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:01:24.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:01:24.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:01:24.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:01:24.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:01:24.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:01:24.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:01:24.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.092 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.092 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:24.092 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:24.093 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 99.530258274000005, 2024-09-14T06:01:24.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:01:24.093 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.093 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.093 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.093 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:01:24.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.093 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:24.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:24.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:01:24.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:01:24.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:01:24.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:01:24.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:01:24.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:01:24.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:01:24.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:01:24.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:01:24.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:01:24.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:01:24.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:01:24.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:01:24.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:01:24.097 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.097 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.097 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.097 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119203 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5881856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:24.097 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:24.097 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.988885244000002, 2024-09-14T06:01:24.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084813824999999995, 2024-09-14T06:01:24.098 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.098 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.098 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.098 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119203 2024-09-14T06:01:24.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.098 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:24.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:24.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065503+0000", 2024-09-14T06:01:24.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.054e-06 2024-09-14T06:01:24.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065509+0000", 2024-09-14T06:01:24.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9939999999999997e-06 2024-09-14T06:01:24.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065528+0000", 2024-09-14T06:01:24.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8736000000000002e-05 2024-09-14T06:01:24.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065540+0000", 2024-09-14T06:01:24.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2427e-05 2024-09-14T06:01:24.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.149851+0000", 2024-09-14T06:01:24.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084310806000000002 2024-09-14T06:01:24.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150073+0000", 2024-09-14T06:01:24.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022202999999999999 2024-09-14T06:01:24.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150316+0000", 2024-09-14T06:01:24.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000242778 2024-09-14T06:01:24.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.102 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.102 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119204 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5931008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:24.102 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:24.102 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.988829737000003, 2024-09-14T06:01:24.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085122164, 2024-09-14T06:01:24.102 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.102 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.102 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.102 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.102 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.103 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119204 2024-09-14T06:01:24.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.103 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:24.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:24.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065559+0000", 2024-09-14T06:01:24.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.068e-06 2024-09-14T06:01:24.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065564+0000", 2024-09-14T06:01:24.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1089999999999997e-06 2024-09-14T06:01:24.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065580+0000", 2024-09-14T06:01:24.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6438000000000001e-05 2024-09-14T06:01:24.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065592+0000", 2024-09-14T06:01:24.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1739000000000001e-05 2024-09-14T06:01:24.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150396+0000", 2024-09-14T06:01:24.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084803859999999995 2024-09-14T06:01:24.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150524+0000", 2024-09-14T06:01:24.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012805600000000001 2024-09-14T06:01:24.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150680+0000", 2024-09-14T06:01:24.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015589400000000001 2024-09-14T06:01:24.106 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.106 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.106 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.106 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119205 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5980160~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:24.107 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:24.107 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.988733861999997, 2024-09-14T06:01:24.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085597655999999994, 2024-09-14T06:01:24.107 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.107 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.107 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.107 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.107 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.107 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.107 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119205 2024-09-14T06:01:24.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.107 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:24.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:24.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065656+0000", 2024-09-14T06:01:24.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9829999999999999e-06 2024-09-14T06:01:24.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065661+0000", 2024-09-14T06:01:24.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9510000000000003e-06 2024-09-14T06:01:24.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065680+0000", 2024-09-14T06:01:24.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8947e-05 2024-09-14T06:01:24.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065694+0000", 2024-09-14T06:01:24.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3433e-05 2024-09-14T06:01:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150778+0000", 2024-09-14T06:01:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085083856999999999 2024-09-14T06:01:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151007+0000", 2024-09-14T06:01:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022914499999999999 2024-09-14T06:01:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151251+0000", 2024-09-14T06:01:24.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024434000000000001 2024-09-14T06:01:24.111 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.111 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.111 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.111 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119206 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6029312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:24.111 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:24.111 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.988672432999998, 2024-09-14T06:01:24.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086002258999999998, 2024-09-14T06:01:24.111 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.111 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.111 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.112 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.112 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.112 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.112 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119206 2024-09-14T06:01:24.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.112 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:24.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065716+0000", 2024-09-14T06:01:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230000000000001e-06 2024-09-14T06:01:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065722+0000", 2024-09-14T06:01:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5219999999999998e-06 2024-09-14T06:01:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065739+0000", 2024-09-14T06:01:24.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7122e-05 2024-09-14T06:01:24.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065752+0000", 2024-09-14T06:01:24.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2639e-05 2024-09-14T06:01:24.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151384+0000", 2024-09-14T06:01:24.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085632514000000007 2024-09-14T06:01:24.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151532+0000", 2024-09-14T06:01:24.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000147761 2024-09-14T06:01:24.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151717+0000", 2024-09-14T06:01:24.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018537800000000001 2024-09-14T06:01:24.115 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.115 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.115 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.116 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119207 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6078464~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:24.116 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:24.116 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.988619088, 2024-09-14T06:01:24.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086515080999999994, 2024-09-14T06:01:24.116 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.116 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.116 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.116 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.116 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.116 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.116 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119207 2024-09-14T06:01:24.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.117 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:24.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:24.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065770+0000", 2024-09-14T06:01:24.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5770000000000001e-06 2024-09-14T06:01:24.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065775+0000", 2024-09-14T06:01:24.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1930000000000001e-06 2024-09-14T06:01:24.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065791+0000", 2024-09-14T06:01:24.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6351e-05 2024-09-14T06:01:24.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065804+0000", 2024-09-14T06:01:24.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.259e-05 2024-09-14T06:01:24.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151820+0000", 2024-09-14T06:01:24.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086016398999999993 2024-09-14T06:01:24.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152043+0000", 2024-09-14T06:01:24.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022236200000000001 2024-09-14T06:01:24.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152283+0000", 2024-09-14T06:01:24.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000240609 2024-09-14T06:01:24.120 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.120 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.120 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.120 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119208 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:24.120 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:24.120 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.988566589999998, 2024-09-14T06:01:24.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086932403000000005, 2024-09-14T06:01:24.121 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.121 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.121 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.121 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.121 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.121 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.121 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119208 2024-09-14T06:01:24.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.122 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:24.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:24.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065822+0000", 2024-09-14T06:01:24.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.032e-06 2024-09-14T06:01:24.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065827+0000", 2024-09-14T06:01:24.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5790000000000003e-06 2024-09-14T06:01:24.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065843+0000", 2024-09-14T06:01:24.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5801999999999999e-05 2024-09-14T06:01:24.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065856+0000", 2024-09-14T06:01:24.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2267e-05 2024-09-14T06:01:24.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152416+0000", 2024-09-14T06:01:24.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086560893999999999 2024-09-14T06:01:24.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152568+0000", 2024-09-14T06:01:24.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151664 2024-09-14T06:01:24.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152753+0000", 2024-09-14T06:01:24.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018516499999999999 2024-09-14T06:01:24.125 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.125 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.125 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.125 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119209 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6176768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:24.125 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:24.125 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.988514719999998, 2024-09-14T06:01:24.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087450828999999994, 2024-09-14T06:01:24.126 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.126 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.126 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.126 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.126 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.126 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.126 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119209 2024-09-14T06:01:24.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.126 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:24.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:24.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065874+0000", 2024-09-14T06:01:24.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.097e-06 2024-09-14T06:01:24.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065879+0000", 2024-09-14T06:01:24.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.254e-06 2024-09-14T06:01:24.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065895+0000", 2024-09-14T06:01:24.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6373000000000001e-05 2024-09-14T06:01:24.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065908+0000", 2024-09-14T06:01:24.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2656e-05 2024-09-14T06:01:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152854+0000", 2024-09-14T06:01:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086946078999999996 2024-09-14T06:01:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153080+0000", 2024-09-14T06:01:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022582200000000001 2024-09-14T06:01:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153324+0000", 2024-09-14T06:01:24.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024354800000000001 2024-09-14T06:01:24.130 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.130 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.130 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.130 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119210 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6225920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:24.130 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:24.130 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.988462792999997, 2024-09-14T06:01:24.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087773166, 2024-09-14T06:01:24.130 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.130 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.130 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.130 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.131 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.131 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.131 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119210 2024-09-14T06:01:24.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.131 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:24.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:24.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065926+0000", 2024-09-14T06:01:24.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3799999999999999e-06 2024-09-14T06:01:24.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065931+0000", 2024-09-14T06:01:24.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9629999999999997e-06 2024-09-14T06:01:24.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065950+0000", 2024-09-14T06:01:24.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9369999999999999e-05 2024-09-14T06:01:24.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065963+0000", 2024-09-14T06:01:24.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2164000000000001e-05 2024-09-14T06:01:24.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153404+0000", 2024-09-14T06:01:24.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087441840000000007 2024-09-14T06:01:24.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153537+0000", 2024-09-14T06:01:24.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013305500000000001 2024-09-14T06:01:24.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153698+0000", 2024-09-14T06:01:24.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016039400000000001 2024-09-14T06:01:24.134 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.134 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.134 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119211 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6275072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.988407025999997, 2024-09-14T06:01:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088244734000000005, 2024-09-14T06:01:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119211 2024-09-14T06:01:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.135 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:24.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:24.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065981+0000", 2024-09-14T06:01:24.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.012e-06 2024-09-14T06:01:24.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065987+0000", 2024-09-14T06:01:24.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5450000000000003e-06 2024-09-14T06:01:24.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.066003+0000", 2024-09-14T06:01:24.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6198999999999999e-05 2024-09-14T06:01:24.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.066016+0000", 2024-09-14T06:01:24.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2595999999999999e-05 2024-09-14T06:01:24.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153758+0000", 2024-09-14T06:01:24.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087742610999999998 2024-09-14T06:01:24.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153983+0000", 2024-09-14T06:01:24.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000224336 2024-09-14T06:01:24.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.154225+0000", 2024-09-14T06:01:24.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024243499999999999 2024-09-14T06:01:24.139 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.139 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.139 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.139 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123236 3.16 3:6f8987ed:::rbd_data.112793b455a2.0000000000000001:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:24.139 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:24.140 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.639566285000001, 2024-09-14T06:01:24.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.973924129, 2024-09-14T06:01:24.140 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.140 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.140 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:24.140 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.140 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.140 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.140 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123236 2024-09-14T06:01:24.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.140 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:24.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:24.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414823+0000", 2024-09-14T06:01:24.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0930000000000001e-06 2024-09-14T06:01:24.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414830+0000", 2024-09-14T06:01:24.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-09-14T06:01:24.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414848+0000", 2024-09-14T06:01:24.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8029e-05 2024-09-14T06:01:24.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414859+0000", 2024-09-14T06:01:24.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0934000000000001e-05 2024-09-14T06:01:24.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414952+0000", 2024-09-14T06:01:24.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3140999999999995e-05 2024-09-14T06:01:24.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:24.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414964+0000", 2024-09-14T06:01:24.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1802e-05 2024-09-14T06:01:24.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297044+0000", 2024-09-14T06:01:24.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88207986500000002 2024-09-14T06:01:24.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:24.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297073+0000", 2024-09-14T06:01:24.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9178000000000001e-05 2024-09-14T06:01:24.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385889+0000", 2024-09-14T06:01:24.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0888154130000001 2024-09-14T06:01:24.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.386144+0000", 2024-09-14T06:01:24.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255064 2024-09-14T06:01:24.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:24.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.386344+0000", 2024-09-14T06:01:24.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020039100000000001 2024-09-14T06:01:24.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:24.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388411+0000", 2024-09-14T06:01:24.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020668029999999999 2024-09-14T06:01:24.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:24.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388490+0000", 2024-09-14T06:01:24.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9237e-05 2024-09-14T06:01:24.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:24.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388589+0000", 2024-09-14T06:01:24.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9254999999999998e-05 2024-09-14T06:01:24.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388745+0000", 2024-09-14T06:01:24.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015581899999999999 2024-09-14T06:01:24.147 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.147 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.147 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.147 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123238 3.7 3:e6b46603:::rbd_data.112793b455a2.0000000000000003:head [delete] snapc 19=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-14T06:01:24.147 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:24.147 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.762628531000001, 2024-09-14T06:01:24.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0714216679999999, 2024-09-14T06:01:24.148 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.148 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.148 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:24.148 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.148 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.148 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.148 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123238 2024-09-14T06:01:24.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.148 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:24.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:24.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291762+0000", 2024-09-14T06:01:24.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.467e-06 2024-09-14T06:01:24.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291777+0000", 2024-09-14T06:01:24.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4664999999999999e-05 2024-09-14T06:01:24.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291833+0000", 2024-09-14T06:01:24.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5498000000000003e-05 2024-09-14T06:01:24.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291861+0000", 2024-09-14T06:01:24.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8161999999999999e-05 2024-09-14T06:01:24.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292150+0000", 2024-09-14T06:01:24.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028918900000000003 2024-09-14T06:01:24.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-14T06:01:24.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292171+0000", 2024-09-14T06:01:24.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0936000000000001e-05 2024-09-14T06:01:24.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297607+0000", 2024-09-14T06:01:24.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054358139999999998 2024-09-14T06:01:24.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:24.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297630+0000", 2024-09-14T06:01:24.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3209000000000001e-05 2024-09-14T06:01:24.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357360+0000", 2024-09-14T06:01:24.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0597304700000001 2024-09-14T06:01:24.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357737+0000", 2024-09-14T06:01:24.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037695399999999998 2024-09-14T06:01:24.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0,3", 2024-09-14T06:01:24.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.358085+0000", 2024-09-14T06:01:24.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034785099999999999 2024-09-14T06:01:24.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:24.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361195+0000", 2024-09-14T06:01:24.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003110163 2024-09-14T06:01:24.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361362+0000", 2024-09-14T06:01:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167112 2024-09-14T06:01:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.362887+0000", 2024-09-14T06:01:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015243419999999999 2024-09-14T06:01:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.362987+0000", 2024-09-14T06:01:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100333 2024-09-14T06:01:24.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.363181+0000", 2024-09-14T06:01:24.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019350300000000001 2024-09-14T06:01:24.155 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.155 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.155 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.155 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123244 3.7 3:e141330b:::rbd_data.112793b455a2.0000000000000009:head [delete] snapc 19=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-14T06:01:24.155 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:24.155 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.762461951999999, 2024-09-14T06:01:24.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.072328908, 2024-09-14T06:01:24.156 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.156 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.156 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:24.156 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.156 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.156 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.156 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123244 2024-09-14T06:01:24.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.156 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:24.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:24.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291927+0000", 2024-09-14T06:01:24.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5460000000000001e-06 2024-09-14T06:01:24.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291934+0000", 2024-09-14T06:01:24.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3599999999999998e-06 2024-09-14T06:01:24.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291956+0000", 2024-09-14T06:01:24.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1469000000000001e-05 2024-09-14T06:01:24.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291972+0000", 2024-09-14T06:01:24.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5773e-05 2024-09-14T06:01:24.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292362+0000", 2024-09-14T06:01:24.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00038989100000000001 2024-09-14T06:01:24.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-09-14T06:01:24.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292379+0000", 2024-09-14T06:01:24.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7186000000000001e-05 2024-09-14T06:01:24.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297840+0000", 2024-09-14T06:01:24.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054614260000000001 2024-09-14T06:01:24.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:24.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297860+0000", 2024-09-14T06:01:24.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9782000000000001e-05 2024-09-14T06:01:24.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359785+0000", 2024-09-14T06:01:24.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.061924665 2024-09-14T06:01:24.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360080+0000", 2024-09-14T06:01:24.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029538399999999999 2024-09-14T06:01:24.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0,3", 2024-09-14T06:01:24.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360382+0000", 2024-09-14T06:01:24.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030214 2024-09-14T06:01:24.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:24.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361612+0000", 2024-09-14T06:01:24.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001229808 2024-09-14T06:01:24.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:24.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.363256+0000", 2024-09-14T06:01:24.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001644162 2024-09-14T06:01:24.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:24.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364059+0000", 2024-09-14T06:01:24.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080328599999999995 2024-09-14T06:01:24.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:24.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364105+0000", 2024-09-14T06:01:24.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5695999999999998e-05 2024-09-14T06:01:24.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364254+0000", 2024-09-14T06:01:24.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014933399999999999 2024-09-14T06:01:24.163 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.163 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.163 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.163 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.163 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.163 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:24.165 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:01:24.165 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:24.164+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:24.265 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:24.260+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:24.311 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2024-09-14T06:01:24.355 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:24.355 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:24.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:01:24.383 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:24.380+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:24.467 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:24.464+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:24.490 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:24.491 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:24.491 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:24.491 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:24.491 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:24.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:01:24.568 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:24.564+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:24.669 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:24.668+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:24.676 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:24.676 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:24.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59148 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 419840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:01:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.405517845999995, 2024-09-14T06:01:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072974285999999999, 2024-09-14T06:01:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59148 2024-09-14T06:01:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:01:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:01:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268521+0000", 2024-09-14T06:01:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4199999999999995e-07 2024-09-14T06:01:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268524+0000", 2024-09-14T06:01:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.05e-06 2024-09-14T06:01:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268534+0000", 2024-09-14T06:01:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8719999999999997e-06 2024-09-14T06:01:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268541+0000", 2024-09-14T06:01:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5349999999999999e-06 2024-09-14T06:01:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341108+0000", 2024-09-14T06:01:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072566624999999996 2024-09-14T06:01:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341169+0000", 2024-09-14T06:01:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1251e-05 2024-09-14T06:01:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341494+0000", 2024-09-14T06:01:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325311 2024-09-14T06:01:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59149 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 436224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:01:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.405478622000004, 2024-09-14T06:01:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073405053999999997, 2024-09-14T06:01:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59149 2024-09-14T06:01:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:01:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:01:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268560+0000", 2024-09-14T06:01:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9999999999999997e-07 2024-09-14T06:01:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268563+0000", 2024-09-14T06:01:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.292e-06 2024-09-14T06:01:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268573+0000", 2024-09-14T06:01:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3260000000000002e-06 2024-09-14T06:01:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268581+0000", 2024-09-14T06:01:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1960000000000008e-06 2024-09-14T06:01:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341537+0000", 2024-09-14T06:01:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072955916999999995 2024-09-14T06:01:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341641+0000", 2024-09-14T06:01:24.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104341 2024-09-14T06:01:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341964+0000", 2024-09-14T06:01:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032328199999999999 2024-09-14T06:01:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59150 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 452608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.405445381999996, 2024-09-14T06:01:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073829748000000001, 2024-09-14T06:01:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59150 2024-09-14T06:01:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0399999999999995e-07 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268596+0000", 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9859999999999999e-06 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268606+0000", 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0088000000000001e-05 2024-09-14T06:01:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268614+0000", 2024-09-14T06:01:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T06:01:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341999+0000", 2024-09-14T06:01:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073385011999999999 2024-09-14T06:01:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342093+0000", 2024-09-14T06:01:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3793000000000001e-05 2024-09-14T06:01:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342422+0000", 2024-09-14T06:01:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000329129 2024-09-14T06:01:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59151 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:01:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.405413014000004, 2024-09-14T06:01:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074207289999999995, 2024-09-14T06:01:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59151 2024-09-14T06:01:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:01:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:01:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268626+0000", 2024-09-14T06:01:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T06:01:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268629+0000", 2024-09-14T06:01:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.038e-06 2024-09-14T06:01:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268638+0000", 2024-09-14T06:01:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8139999999999995e-06 2024-09-14T06:01:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268647+0000", 2024-09-14T06:01:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4889999999999995e-06 2024-09-14T06:01:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342457+0000", 2024-09-14T06:01:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073809890000000003 2024-09-14T06:01:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342545+0000", 2024-09-14T06:01:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8697999999999997e-05 2024-09-14T06:01:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342832+0000", 2024-09-14T06:01:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028681799999999999 2024-09-14T06:01:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59152 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.405380373, 2024-09-14T06:01:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074695176000000002, 2024-09-14T06:01:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59152 2024-09-14T06:01:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2900000000000003e-07 2024-09-14T06:01:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268661+0000", 2024-09-14T06:01:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0230000000000001e-06 2024-09-14T06:01:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268670+0000", 2024-09-14T06:01:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2129999999999997e-06 2024-09-14T06:01:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268679+0000", 2024-09-14T06:01:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-09-14T06:01:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342937+0000", 2024-09-14T06:01:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074258781999999995 2024-09-14T06:01:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343044+0000", 2024-09-14T06:01:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-09-14T06:01:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343353+0000", 2024-09-14T06:01:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030911099999999999 2024-09-14T06:01:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59153 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 501760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:01:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.405347602999996, 2024-09-14T06:01:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074997241000000006, 2024-09-14T06:01:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59153 2024-09-14T06:01:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:01:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:01:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268691+0000", 2024-09-14T06:01:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:01:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268693+0000", 2024-09-14T06:01:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3599999999999999e-06 2024-09-14T06:01:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268699+0000", 2024-09-14T06:01:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-09-14T06:01:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268704+0000", 2024-09-14T06:01:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5759999999999999e-06 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343398+0000", 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074694522999999999 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343450+0000", 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1350999999999997e-05 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343688+0000", 2024-09-14T06:01:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023806500000000001 2024-09-14T06:01:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59154 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 518144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:01:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.405328537000003, 2024-09-14T06:01:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075389938000000004, 2024-09-14T06:01:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59154 2024-09-14T06:01:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:01:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:01:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268710+0000", 2024-09-14T06:01:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8000000000000001e-07 2024-09-14T06:01:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268712+0000", 2024-09-14T06:01:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T06:01:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268717+0000", 2024-09-14T06:01:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8570000000000003e-06 2024-09-14T06:01:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268721+0000", 2024-09-14T06:01:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2039999999999999e-06 2024-09-14T06:01:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343721+0000", 2024-09-14T06:01:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074999748000000005 2024-09-14T06:01:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343784+0000", 2024-09-14T06:01:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3174000000000002e-05 2024-09-14T06:01:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.344099+0000", 2024-09-14T06:01:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000315299 2024-09-14T06:01:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59398 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 323584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:01:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.394364288999995, 2024-09-14T06:01:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073326565999999996, 2024-09-14T06:01:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59398 2024-09-14T06:01:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:01:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:01:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279675+0000", 2024-09-14T06:01:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-14T06:01:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279681+0000", 2024-09-14T06:01:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-09-14T06:01:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279702+0000", 2024-09-14T06:01:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1259000000000001e-05 2024-09-14T06:01:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279718+0000", 2024-09-14T06:01:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5475999999999999e-05 2024-09-14T06:01:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352360+0000", 2024-09-14T06:01:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.07264226 2024-09-14T06:01:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352447+0000", 2024-09-14T06:01:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7381999999999998e-05 2024-09-14T06:01:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353000+0000", 2024-09-14T06:01:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055309200000000004 2024-09-14T06:01:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59399 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:01:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.394299926000002, 2024-09-14T06:01:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073824446000000002, 2024-09-14T06:01:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59399 2024-09-14T06:01:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:01:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:01:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279739+0000", 2024-09-14T06:01:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T06:01:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279745+0000", 2024-09-14T06:01:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T06:01:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279767+0000", 2024-09-14T06:01:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639000000000001e-05 2024-09-14T06:01:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279781+0000", 2024-09-14T06:01:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4511999999999999e-05 2024-09-14T06:01:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353045+0000", 2024-09-14T06:01:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073263718000000005 2024-09-14T06:01:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353168+0000", 2024-09-14T06:01:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012314499999999999 2024-09-14T06:01:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353562+0000", 2024-09-14T06:01:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039435199999999999 2024-09-14T06:01:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59400 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.394236165999999, 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074271465999999994, 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59400 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:01:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:01:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279803+0000", 2024-09-14T06:01:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2100000000000001e-06 2024-09-14T06:01:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279819+0000", 2024-09-14T06:01:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6409000000000002e-05 2024-09-14T06:01:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279841+0000", 2024-09-14T06:01:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1878e-05 2024-09-14T06:01:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279856+0000", 2024-09-14T06:01:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4392999999999999e-05 2024-09-14T06:01:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353650+0000", 2024-09-14T06:01:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073794144000000006 2024-09-14T06:01:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353757+0000", 2024-09-14T06:01:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010687 2024-09-14T06:01:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354073+0000", 2024-09-14T06:01:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000316562 2024-09-14T06:01:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59401 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 372736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:01:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.394161341, 2024-09-14T06:01:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074643900999999999, 2024-09-14T06:01:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59401 2024-09-14T06:01:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:01:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:01:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279878+0000", 2024-09-14T06:01:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.31e-06 2024-09-14T06:01:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279883+0000", 2024-09-14T06:01:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3770000000000004e-06 2024-09-14T06:01:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279906+0000", 2024-09-14T06:01:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2398000000000001e-05 2024-09-14T06:01:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279920+0000", 2024-09-14T06:01:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.402e-05 2024-09-14T06:01:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354125+0000", 2024-09-14T06:01:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074205750000000001 2024-09-14T06:01:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354227+0000", 2024-09-14T06:01:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101612 2024-09-14T06:01:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354521+0000", 2024-09-14T06:01:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029343400000000002 2024-09-14T06:01:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59402 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 389120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:01:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.394099757999996, 2024-09-14T06:01:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075017027999999999, 2024-09-14T06:01:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59402 2024-09-14T06:01:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:01:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:01:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279939+0000", 2024-09-14T06:01:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2470000000000001e-06 2024-09-14T06:01:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279945+0000", 2024-09-14T06:01:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-09-14T06:01:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279966+0000", 2024-09-14T06:01:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1801999999999999e-05 2024-09-14T06:01:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279980+0000", 2024-09-14T06:01:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3589e-05 2024-09-14T06:01:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354569+0000", 2024-09-14T06:01:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074588707000000004 2024-09-14T06:01:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354671+0000", 2024-09-14T06:01:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102398 2024-09-14T06:01:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354955+0000", 2024-09-14T06:01:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028406500000000001 2024-09-14T06:01:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59403 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 405504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:01:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.394037971000003, 2024-09-14T06:01:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075434395000000001, 2024-09-14T06:01:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59403 2024-09-14T06:01:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:01:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:01:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280001+0000", 2024-09-14T06:01:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2669999999999999e-06 2024-09-14T06:01:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280008+0000", 2024-09-14T06:01:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5849999999999996e-06 2024-09-14T06:01:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280030+0000", 2024-09-14T06:01:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2293000000000002e-05 2024-09-14T06:01:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280044+0000", 2024-09-14T06:01:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3974999999999999e-05 2024-09-14T06:01:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355013+0000", 2024-09-14T06:01:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074969039000000001 2024-09-14T06:01:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355144+0000", 2024-09-14T06:01:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000131333 2024-09-14T06:01:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355434+0000", 2024-09-14T06:01:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028990299999999999 2024-09-14T06:01:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59404 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:01:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.393972852000005, 2024-09-14T06:01:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075696103000000001, 2024-09-14T06:01:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59404 2024-09-14T06:01:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:01:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:01:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280066+0000", 2024-09-14T06:01:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2640000000000001e-06 2024-09-14T06:01:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280072+0000", 2024-09-14T06:01:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129999999999997e-06 2024-09-14T06:01:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280094+0000", 2024-09-14T06:01:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2608000000000001e-05 2024-09-14T06:01:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280109+0000", 2024-09-14T06:01:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:01:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355479+0000", 2024-09-14T06:01:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075370699999999999 2024-09-14T06:01:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355554+0000", 2024-09-14T06:01:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4674999999999999e-05 2024-09-14T06:01:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355761+0000", 2024-09-14T06:01:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-14T06:01:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59405 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:01:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.393908941999996, 2024-09-14T06:01:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076008867999999993, 2024-09-14T06:01:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59405 2024-09-14T06:01:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:01:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:01:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280130+0000", 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2500000000000001e-06 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280136+0000", 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280158+0000", 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1795000000000001e-05 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280172+0000", 2024-09-14T06:01:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4303e-05 2024-09-14T06:01:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355797+0000", 2024-09-14T06:01:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075624835000000001 2024-09-14T06:01:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355866+0000", 2024-09-14T06:01:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9043999999999998e-05 2024-09-14T06:01:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356138+0000", 2024-09-14T06:01:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027207799999999998 2024-09-14T06:01:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59406 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:01:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.393844999999999, 2024-09-14T06:01:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076435642999999998, 2024-09-14T06:01:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59406 2024-09-14T06:01:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:01:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280194+0000", 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280200+0000", 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6359999999999999e-06 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280222+0000", 2024-09-14T06:01:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1628999999999999e-05 2024-09-14T06:01:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280236+0000", 2024-09-14T06:01:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4413000000000001e-05 2024-09-14T06:01:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356172+0000", 2024-09-14T06:01:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075936466999999994 2024-09-14T06:01:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356260+0000", 2024-09-14T06:01:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7437999999999999e-05 2024-09-14T06:01:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356629+0000", 2024-09-14T06:01:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036877600000000002 2024-09-14T06:01:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59407 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 471040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:01:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.393780766999996, 2024-09-14T06:01:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076820083999999997, 2024-09-14T06:01:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59407 2024-09-14T06:01:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:01:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:01:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280258+0000", 2024-09-14T06:01:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1370000000000001e-06 2024-09-14T06:01:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280264+0000", 2024-09-14T06:01:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6930000000000004e-06 2024-09-14T06:01:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280285+0000", 2024-09-14T06:01:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1455999999999999e-05 2024-09-14T06:01:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280300+0000", 2024-09-14T06:01:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4319e-05 2024-09-14T06:01:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356676+0000", 2024-09-14T06:01:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076376615999999994 2024-09-14T06:01:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356768+0000", 2024-09-14T06:01:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1234000000000001e-05 2024-09-14T06:01:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357077+0000", 2024-09-14T06:01:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030962900000000001 2024-09-14T06:01:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59408 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 487424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:01:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.393715767000003, 2024-09-14T06:01:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077185511999999998, 2024-09-14T06:01:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59408 2024-09-14T06:01:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:01:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:01:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280323+0000", 2024-09-14T06:01:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2860000000000001e-06 2024-09-14T06:01:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280329+0000", 2024-09-14T06:01:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.553e-06 2024-09-14T06:01:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280352+0000", 2024-09-14T06:01:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-14T06:01:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280366+0000", 2024-09-14T06:01:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-14T06:01:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357126+0000", 2024-09-14T06:01:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076760326000000004 2024-09-14T06:01:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357223+0000", 2024-09-14T06:01:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6490000000000006e-05 2024-09-14T06:01:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357508+0000", 2024-09-14T06:01:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028479900000000002 2024-09-14T06:01:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59409 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:01:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.393651536999997, 2024-09-14T06:01:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077536090000000002, 2024-09-14T06:01:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59409 2024-09-14T06:01:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:01:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:01:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280388+0000", 2024-09-14T06:01:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.096e-06 2024-09-14T06:01:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280393+0000", 2024-09-14T06:01:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T06:01:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280414+0000", 2024-09-14T06:01:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1175999999999999e-05 2024-09-14T06:01:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280427+0000", 2024-09-14T06:01:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3032e-05 2024-09-14T06:01:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357553+0000", 2024-09-14T06:01:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077125845999999998 2024-09-14T06:01:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357624+0000", 2024-09-14T06:01:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1062000000000005e-05 2024-09-14T06:01:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357923+0000", 2024-09-14T06:01:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029891199999999997 2024-09-14T06:01:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59410 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:01:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 89.393592225000006, 2024-09-14T06:01:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077854494999999996, 2024-09-14T06:01:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59410 2024-09-14T06:01:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:01:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:01:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280447+0000", 2024-09-14T06:01:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069999999999999e-06 2024-09-14T06:01:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280453+0000", 2024-09-14T06:01:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-06 2024-09-14T06:01:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280471+0000", 2024-09-14T06:01:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8295999999999999e-05 2024-09-14T06:01:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280484+0000", 2024-09-14T06:01:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2609000000000001e-05 2024-09-14T06:01:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357954+0000", 2024-09-14T06:01:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077470405000000006 2024-09-14T06:01:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358040+0000", 2024-09-14T06:01:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.551e-05 2024-09-14T06:01:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358300+0000", 2024-09-14T06:01:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026036800000000003 2024-09-14T06:01:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:24.771 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:24.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:01:24.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:01:24.773 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:24.768+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:24.873 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:24.868+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:24.900 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:24.900 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:24.900 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:24.900 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:24.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:01:24.930 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:24.930 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:24.947 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:24.947 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:24.964 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:24.964 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:24.981 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:24.981 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:25.000 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:25.006 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:25.004+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:25.020 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:25.020 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:25.039 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:25.039 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:25.058 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:25.075 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:25.072+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:25.083 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:25.083 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:25.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:01:25.175 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:25.172+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:25.265 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:25.265 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:25.276 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:25.272+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:25.279 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:01:25.377 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:25.372+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:25.421 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:25.421 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:25.437 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:01:25.486 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:25.484+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:25.574 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:25.574 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:25.578 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:25.576+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:25.590 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:01:25.680 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:25.676+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:25.760 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:25.761 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:25.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:01:25.781 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:25.776+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:25.882 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:25.880+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:25.902 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:25.902 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:25.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:01:25.982 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:25.980+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:26.037 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:26.037 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:26.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:01:26.095 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:26.092+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:26.185 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:26.180+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:26.221 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:26.221 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:26.237 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:01:26.323 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:26.320+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:26.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T06:01:26.387 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:26.384+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:26.422 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:26.422 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:26.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:01:26.487 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:26.484+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:26.570 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:26.570 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:26.584 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:01:26.631 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:26.628+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:26.688 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:26.684+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:26.750 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:26.750 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:26.764 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:01:26.789 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:26.784+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:26.890 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:26.884+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:26.936 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:26.936 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:26.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:01:26.995 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:26.992+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:27.077 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:01:27.123 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:27.120+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:27.123 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:27.123 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:27.138 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:01:27.192 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:27.188+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:27.239 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:27.239 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:27.257 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:27.257 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:27.274 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:27.274 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:27.291 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:27.292 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:27.293 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:27.288+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:27.306 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:27.306 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:27.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:27.307 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:27.307 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.307 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54844 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 0~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:27.307 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:27.307 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.164377328, 2024-09-14T06:01:27.307 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092708507999999995, 2024-09-14T06:01:27.307 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.307 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:27.307 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.307 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.307 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.307 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54844 2024-09-14T06:01:27.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.308 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.308 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.308 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:27.308 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.308 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.308 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139774+0000", 2024-09-14T06:01:27.308 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.308 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.308 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.309 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.309 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139775+0000", 2024-09-14T06:01:27.309 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3500000000000002e-07 2024-09-14T06:01:27.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.309 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.309 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139777+0000", 2024-09-14T06:01:27.309 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.979e-06 2024-09-14T06:01:27.309 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.309 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.309 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.309 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139787+0000", 2024-09-14T06:01:27.309 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0779e-05 2024-09-14T06:01:27.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.310 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139799+0000", 2024-09-14T06:01:27.310 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1719000000000001e-05 2024-09-14T06:01:27.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.310 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232151+0000", 2024-09-14T06:01:27.310 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092351767000000001 2024-09-14T06:01:27.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.310 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.310 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232217+0000", 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6655000000000005e-05 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232483+0000", 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00026517400000000002 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54845 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 55296~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:27.311 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.164343657000003, 2024-09-14T06:01:27.312 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093127583999999999, 2024-09-14T06:01:27.312 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.312 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.312 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:27.312 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.312 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.312 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.312 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54845 2024-09-14T06:01:27.312 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.312 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.312 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.312 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.312 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:27.312 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.313 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.313 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:27.313 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.313 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.313 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139808+0000", 2024-09-14T06:01:27.313 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4899999999999995e-07 2024-09-14T06:01:27.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.313 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.313 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139811+0000", 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4200000000000001e-06 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139821+0000", 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0168e-05 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139826+0000", 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2780000000000001e-06 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.314 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232556+0000", 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092729729999999996 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232652+0000", 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5680999999999994e-05 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232935+0000", 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000283758 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.316 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54846 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 61440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:27.316 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:27.316 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.164317350000005, 2024-09-14T06:01:27.316 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093492079000000006, 2024-09-14T06:01:27.316 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.316 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.316 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:27.316 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.316 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.316 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.316 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54846 2024-09-14T06:01:27.316 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.317 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:27.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.317 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.317 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.317 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.317 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139834+0000", 2024-09-14T06:01:27.317 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.318 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139835+0000", 2024-09-14T06:01:27.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2600000000000002e-07 2024-09-14T06:01:27.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.318 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139837+0000", 2024-09-14T06:01:27.318 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1059999999999998e-06 2024-09-14T06:01:27.318 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.318 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.318 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.318 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139845+0000", 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4300000000000006e-06 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139851+0000", 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0340000000000002e-06 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.232987+0000", 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093136073999999999 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.319 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233075+0000", 2024-09-14T06:01:27.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7318999999999995e-05 2024-09-14T06:01:27.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.320 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.320 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233326+0000", 2024-09-14T06:01:27.320 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025159 2024-09-14T06:01:27.320 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.320 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.320 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.320 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.320 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54847 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 67584~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:27.320 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:27.321 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.164291633999994, 2024-09-14T06:01:27.321 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093777452999999997, 2024-09-14T06:01:27.321 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.321 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:27.321 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.321 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.321 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.321 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54847 2024-09-14T06:01:27.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.321 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.321 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.321 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.321 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:27.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:27.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.322 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139860+0000", 2024-09-14T06:01:27.322 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5900000000000002e-07 2024-09-14T06:01:27.322 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.322 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.322 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139862+0000", 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0200000000000001e-06 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139870+0000", 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.0520000000000002e-06 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139875+0000", 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.323 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233389+0000", 2024-09-14T06:01:27.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093514054999999999 2024-09-14T06:01:27.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233443+0000", 2024-09-14T06:01:27.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3913999999999999e-05 2024-09-14T06:01:27.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.324 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.324 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.324 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233637+0000", 2024-09-14T06:01:27.324 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019392899999999999 2024-09-14T06:01:27.324 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.325 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.325 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.325 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54848 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 73728~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:27.325 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:27.325 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.164268538000002, 2024-09-14T06:01:27.325 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094064464, 2024-09-14T06:01:27.325 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.325 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:27.325 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.326 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.326 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.326 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54848 2024-09-14T06:01:27.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.326 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:27.326 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.326 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.326 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.326 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.326 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:27.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139883+0000", 2024-09-14T06:01:27.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5400000000000002e-07 2024-09-14T06:01:27.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.327 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.327 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139885+0000", 2024-09-14T06:01:27.327 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9929999999999998e-06 2024-09-14T06:01:27.327 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.327 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139893+0000", 2024-09-14T06:01:27.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9759999999999995e-06 2024-09-14T06:01:27.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139898+0000", 2024-09-14T06:01:27.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6059999999999996e-06 2024-09-14T06:01:27.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.328 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.328 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.328 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233681+0000", 2024-09-14T06:01:27.328 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093782921000000005 2024-09-14T06:01:27.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233730+0000", 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9410999999999998e-05 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.233947+0000", 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00021710300000000001 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.329 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54849 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 129024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:27.330 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:27.330 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.164245081999994, 2024-09-14T06:01:27.330 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094499257000000003, 2024-09-14T06:01:27.330 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.330 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.330 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:27.330 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.330 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.330 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.330 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54849 2024-09-14T06:01:27.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.330 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.330 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:27.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139906+0000", 2024-09-14T06:01:27.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.331 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.331 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.331 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139907+0000", 2024-09-14T06:01:27.331 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6899999999999998e-07 2024-09-14T06:01:27.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139909+0000", 2024-09-14T06:01:27.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.1660000000000001e-06 2024-09-14T06:01:27.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139916+0000", 2024-09-14T06:01:27.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7460000000000003e-06 2024-09-14T06:01:27.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.332 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.332 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.332 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139921+0000", 2024-09-14T06:01:27.332 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0239999999999997e-06 2024-09-14T06:01:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234032+0000", 2024-09-14T06:01:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094111037999999994 2024-09-14T06:01:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234150+0000", 2024-09-14T06:01:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000118408 2024-09-14T06:01:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.333 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234406+0000", 2024-09-14T06:01:27.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025540600000000001 2024-09-14T06:01:27.334 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.334 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.334 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.334 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.334 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.334 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54850 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 135168~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:27.334 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:27.334 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.164223374000002, 2024-09-14T06:01:27.334 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094814605999999996, 2024-09-14T06:01:27.334 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.334 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:27.335 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.335 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.335 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.335 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54850 2024-09-14T06:01:27.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.335 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.335 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.335 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:27.335 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.335 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.335 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.335 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.336 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139928+0000", 2024-09-14T06:01:27.336 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.336 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.336 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139929+0000", 2024-09-14T06:01:27.336 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0999999999999999e-07 2024-09-14T06:01:27.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.336 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.336 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.336 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139931+0000", 2024-09-14T06:01:27.336 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.024e-06 2024-09-14T06:01:27.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139937+0000", 2024-09-14T06:01:27.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3770000000000001e-06 2024-09-14T06:01:27.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139942+0000", 2024-09-14T06:01:27.337 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0289999999999996e-06 2024-09-14T06:01:27.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.337 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.337 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.337 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234447+0000", 2024-09-14T06:01:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094505426000000003 2024-09-14T06:01:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234539+0000", 2024-09-14T06:01:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1793999999999996e-05 2024-09-14T06:01:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234743+0000", 2024-09-14T06:01:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00020354600000000001 2024-09-14T06:01:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.338 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.339 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54851 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 141312~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:27.339 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:27.339 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.164201661999996, 2024-09-14T06:01:27.339 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095179749999999994, 2024-09-14T06:01:27.339 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.339 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.339 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:27.339 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.339 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.339 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.339 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54851 2024-09-14T06:01:27.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.340 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.340 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.340 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:27.340 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.340 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.340 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.340 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:27.340 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139950+0000", 2024-09-14T06:01:27.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:01:27.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.341 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.341 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139952+0000", 2024-09-14T06:01:27.341 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0600000000000002e-06 2024-09-14T06:01:27.341 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.341 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139959+0000", 2024-09-14T06:01:27.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.584e-06 2024-09-14T06:01:27.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139964+0000", 2024-09-14T06:01:27.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8890000000000001e-06 2024-09-14T06:01:27.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.342 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.342 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.342 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234786+0000", 2024-09-14T06:01:27.342 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.094822241000000002 2024-09-14T06:01:27.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.234877+0000", 2024-09-14T06:01:27.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1158999999999999e-05 2024-09-14T06:01:27.343 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.343 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.343 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.343 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235130+0000", 2024-09-14T06:01:27.343 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025235999999999998 2024-09-14T06:01:27.343 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.343 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.343 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.344 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.344 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54852 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 147456~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:27.344 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:27.344 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.164180533999996, 2024-09-14T06:01:27.344 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095437742000000006, 2024-09-14T06:01:27.344 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.344 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.344 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:27.344 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.344 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.344 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.344 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54852 2024-09-14T06:01:27.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.345 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:27.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.345 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.139971+0000", 2024-09-14T06:01:27.345 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.345 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.345 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140125+0000", 2024-09-14T06:01:27.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000154332 2024-09-14T06:01:27.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140130+0000", 2024-09-14T06:01:27.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.284e-06 2024-09-14T06:01:27.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.346 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.346 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.346 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140140+0000", 2024-09-14T06:01:27.346 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0789e-05 2024-09-14T06:01:27.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140147+0000", 2024-09-14T06:01:27.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9879999999999998e-06 2024-09-14T06:01:27.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.347 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.347 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235174+0000", 2024-09-14T06:01:27.347 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095026749999999993 2024-09-14T06:01:27.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.348 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235230+0000", 2024-09-14T06:01:27.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6224000000000002e-05 2024-09-14T06:01:27.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.348 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.348 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235409+0000", 2024-09-14T06:01:27.348 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017837500000000001 2024-09-14T06:01:27.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.348 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.348 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.348 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.348 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.349 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54853 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 202752~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:27.349 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:27.349 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.163991711999998, 2024-09-14T06:01:27.349 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.095632919999999996, 2024-09-14T06:01:27.349 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.349 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:27.349 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.349 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.349 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.349 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54853 2024-09-14T06:01:27.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.349 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:27.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.350 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.140160+0000", 2024-09-14T06:01:27.350 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.350 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.350 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.350 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147748+0000", 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0075884910000000002 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147798+0000", 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0152999999999999e-05 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147814+0000", 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5866e-05 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.351 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.147831+0000", 2024-09-14T06:01:27.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6991999999999999e-05 2024-09-14T06:01:27.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235451+0000", 2024-09-14T06:01:27.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.087620077000000005 2024-09-14T06:01:27.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.352 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.352 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235539+0000", 2024-09-14T06:01:27.352 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.7800000000000006e-05 2024-09-14T06:01:27.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.352 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.353 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.353 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.235793+0000", 2024-09-14T06:01:27.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00025354099999999998 2024-09-14T06:01:27.353 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.353 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.353 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.353 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.353 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.353 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54870 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 503808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:27.353 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:27.353 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.155746164999996, 2024-09-14T06:01:27.353 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092420756000000007, 2024-09-14T06:01:27.353 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.354 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.354 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:27.354 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.354 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.354 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.354 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54870 2024-09-14T06:01:27.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.354 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.354 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.354 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:27.354 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.354 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.354 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148405+0000", 2024-09-14T06:01:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148406+0000", 2024-09-14T06:01:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7199999999999999e-07 2024-09-14T06:01:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148409+0000", 2024-09-14T06:01:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7219999999999999e-06 2024-09-14T06:01:27.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148418+0000", 2024-09-14T06:01:27.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7329999999999998e-06 2024-09-14T06:01:27.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148425+0000", 2024-09-14T06:01:27.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2079999999999997e-06 2024-09-14T06:01:27.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.356 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.356 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.356 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240591+0000", 2024-09-14T06:01:27.356 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092166441000000002 2024-09-14T06:01:27.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240648+0000", 2024-09-14T06:01:27.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6733e-05 2024-09-14T06:01:27.357 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.357 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.357 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.357 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240826+0000", 2024-09-14T06:01:27.357 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00017834700000000001 2024-09-14T06:01:27.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.357 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54871 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 509952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.155716205000004, 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092702341999999993, 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54871 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.358 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:27.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148435+0000", 2024-09-14T06:01:27.359 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.359 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.359 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.359 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148436+0000", 2024-09-14T06:01:27.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5499999999999998e-07 2024-09-14T06:01:27.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148439+0000", 2024-09-14T06:01:27.360 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8090000000000001e-06 2024-09-14T06:01:27.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.360 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.360 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148449+0000", 2024-09-14T06:01:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0115000000000001e-05 2024-09-14T06:01:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148466+0000", 2024-09-14T06:01:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.6761000000000001e-05 2024-09-14T06:01:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240857+0000", 2024-09-14T06:01:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.092391089999999995 2024-09-14T06:01:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.240939+0000", 2024-09-14T06:01:27.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2387999999999998e-05 2024-09-14T06:01:27.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.362 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.362 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241138+0000", 2024-09-14T06:01:27.362 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000198624 2024-09-14T06:01:27.362 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.362 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.362 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.362 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.362 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.362 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:54872 3.1e 3:7cab8123:::rbd_data.1127f2f8ff9b.0000000000000001:13 [read 516096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:27.362 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 93.155675006999999, 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.093126020000000004, 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 54872 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:27.363 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.148476+0000", 2024-09-14T06:01:27.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.364 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155484+0000", 2024-09-14T06:01:27.364 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0070072429999999998 2024-09-14T06:01:27.364 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.364 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.364 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155490+0000", 2024-09-14T06:01:27.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6379999999999998e-06 2024-09-14T06:01:27.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155504+0000", 2024-09-14T06:01:27.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4065e-05 2024-09-14T06:01:27.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.365 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.365 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.365 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.155513+0000", 2024-09-14T06:01:27.365 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6799999999999999e-06 2024-09-14T06:01:27.365 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241216+0000", 2024-09-14T06:01:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.085702922000000001 2024-09-14T06:01:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241277+0000", 2024-09-14T06:01:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0980000000000002e-05 2024-09-14T06:01:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T05:59:54.241602+0000", 2024-09-14T06:01:27.366 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00032549199999999998 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123238 3.7 3.c0662d67 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.889203337000001, 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88300249500000005, 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.367 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123238 2024-09-14T06:01:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414948+0000", 2024-09-14T06:01:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.368 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414949+0000", 2024-09-14T06:01:27.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8899999999999998e-07 2024-09-14T06:01:27.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414953+0000", 2024-09-14T06:01:27.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1439999999999996e-06 2024-09-14T06:01:27.369 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.369 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.369 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.369 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414974+0000", 2024-09-14T06:01:27.369 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0630000000000001e-05 2024-09-14T06:01:27.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.414982+0000", 2024-09-14T06:01:27.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9840000000000001e-06 2024-09-14T06:01:27.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415051+0000", 2024-09-14T06:01:27.370 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9787000000000001e-05 2024-09-14T06:01:27.370 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.370 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.370 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:27.370 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415062+0000", 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0674e-05 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297935+0000", 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88287307400000004 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297951+0000", 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5413e-05 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.371 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.372 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123240 3.15 3:a806c175:::rbd_data.112793b455a2.0000000000000005:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:27.372 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:27.372 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.889147621999999, 2024-09-14T06:01:27.372 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.950432851, 2024-09-14T06:01:27.372 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.372 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.372 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:27.372 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.372 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.372 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.372 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123240 2024-09-14T06:01:27.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.372 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.372 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:27.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:27.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.373 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.373 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.373 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415004+0000", 2024-09-14T06:01:27.373 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.3399999999999999e-07 2024-09-14T06:01:27.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415008+0000", 2024-09-14T06:01:27.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6090000000000001e-06 2024-09-14T06:01:27.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415017+0000", 2024-09-14T06:01:27.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0100000000000001e-06 2024-09-14T06:01:27.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.374 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.374 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.374 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415025+0000", 2024-09-14T06:01:27.374 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.9109999999999993e-06 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415114+0000", 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9086999999999996e-05 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415132+0000", 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.7405e-05 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297130+0000", 2024-09-14T06:01:27.375 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88199837000000003 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297152+0000", 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2103000000000002e-05 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361290+0000", 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.064138091 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361714+0000", 2024-09-14T06:01:27.376 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00042403999999999999 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.361955+0000", 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000240981 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365095+0000", 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0031403960000000002 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365192+0000", 2024-09-14T06:01:27.377 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6976000000000001e-05 2024-09-14T06:01:27.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:27.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365274+0000", 2024-09-14T06:01:27.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1293999999999998e-05 2024-09-14T06:01:27.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.378 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.378 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.378 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365437+0000", 2024-09-14T06:01:27.378 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00016294399999999999 2024-09-14T06:01:27.378 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.378 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.378 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123244 3.7 3.d0cc8287 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.889102119, 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88296528100000005, 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "reached pg", 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123244 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.379 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:27.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415049+0000", 2024-09-14T06:01:27.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.380 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.380 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.380 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415050+0000", 2024-09-14T06:01:27.380 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1500000000000004e-07 2024-09-14T06:01:27.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415053+0000", 2024-09-14T06:01:27.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1219999999999999e-06 2024-09-14T06:01:27.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415065+0000", 2024-09-14T06:01:27.381 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1549000000000001e-05 2024-09-14T06:01:27.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.381 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.381 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415071+0000", 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.4359999999999999e-06 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415133+0000", 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2249999999999995e-05 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.415141+0000", 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.5480000000000004e-06 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.382 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.298007+0000", 2024-09-14T06:01:27.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88286582199999997 2024-09-14T06:01:27.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.383 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.383 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.298015+0000", 2024-09-14T06:01:27.383 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.8390000000000007e-06 2024-09-14T06:01:27.383 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.383 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.383 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.383 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.384 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123245 3.15 3:ae492430:::rbd_data.112793b455a2.000000000000000a:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:27.384 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:27.384 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.887034466999999, 2024-09-14T06:01:27.384 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.9484952870000001, 2024-09-14T06:01:27.384 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.384 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.384 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:27.384 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.384 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.384 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.384 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123245 2024-09-14T06:01:27.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.384 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:27.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417117+0000", 2024-09-14T06:01:27.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.385 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.385 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.385 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417118+0000", 2024-09-14T06:01:27.385 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0189999999999999e-06 2024-09-14T06:01:27.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417123+0000", 2024-09-14T06:01:27.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.7380000000000002e-06 2024-09-14T06:01:27.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.386 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417137+0000", 2024-09-14T06:01:27.386 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4538999999999999e-05 2024-09-14T06:01:27.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.386 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.386 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417146+0000", 2024-09-14T06:01:27.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3669999999999997e-06 2024-09-14T06:01:27.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417236+0000", 2024-09-14T06:01:27.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9976999999999996e-05 2024-09-14T06:01:27.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.387 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:27.387 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417249+0000", 2024-09-14T06:01:27.387 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.3325e-05 2024-09-14T06:01:27.387 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.387 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297197+0000", 2024-09-14T06:01:27.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.87994787699999999 2024-09-14T06:01:27.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:27.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297209+0000", 2024-09-14T06:01:27.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2486e-05 2024-09-14T06:01:27.388 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.388 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.388 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.388 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363278+0000", 2024-09-14T06:01:27.388 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.066068257 2024-09-14T06:01:27.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363460+0000", 2024-09-14T06:01:27.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000182022 2024-09-14T06:01:27.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.389 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:27.389 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.363641+0000", 2024-09-14T06:01:27.389 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00018182199999999999 2024-09-14T06:01:27.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.389 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:27.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365170+0000", 2024-09-14T06:01:27.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00152838 2024-09-14T06:01:27.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:27.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365451+0000", 2024-09-14T06:01:27.390 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00028076000000000002 2024-09-14T06:01:27.390 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.390 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.390 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:27.390 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365504+0000", 2024-09-14T06:01:27.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.3334000000000001e-05 2024-09-14T06:01:27.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.391 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.391 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365612+0000", 2024-09-14T06:01:27.391 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108384 2024-09-14T06:01:27.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.391 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.391 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.391 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:123248 3.15 3:a9835311:::rbd_data.112793b455a2.000000000000000d:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:27.391 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:27.391 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 27.886367242999999, 2024-09-14T06:01:27.392 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.948835844, 2024-09-14T06:01:27.392 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.392 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:27.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.392 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.392 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 123248 2024-09-14T06:01:27.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.392 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.392 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.392 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.392 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:27.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417784+0000", 2024-09-14T06:01:27.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.393 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417785+0000", 2024-09-14T06:01:27.393 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.054e-06 2024-09-14T06:01:27.393 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.393 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417790+0000", 2024-09-14T06:01:27.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.186e-06 2024-09-14T06:01:27.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417806+0000", 2024-09-14T06:01:27.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.5430999999999998e-05 2024-09-14T06:01:27.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.394 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.394 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.394 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417816+0000", 2024-09-14T06:01:27.394 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7729999999999994e-06 2024-09-14T06:01:27.394 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417875+0000", 2024-09-14T06:01:27.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8950999999999999e-05 2024-09-14T06:01:27.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:27.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:59.417884+0000", 2024-09-14T06:01:27.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4369999999999996e-06 2024-09-14T06:01:27.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.395 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.395 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.395 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297235+0000", 2024-09-14T06:01:27.395 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.87935095699999999 2024-09-14T06:01:27.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:27.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:00.297241+0000", 2024-09-14T06:01:27.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.2790000000000004e-06 2024-09-14T06:01:27.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.396 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364231+0000", 2024-09-14T06:01:27.396 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.066989736 2024-09-14T06:01:27.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.396 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.396 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364369+0000", 2024-09-14T06:01:27.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000137766 2024-09-14T06:01:27.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:27.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.364563+0000", 2024-09-14T06:01:27.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00019418500000000001 2024-09-14T06:01:27.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.397 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:27.397 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.365625+0000", 2024-09-14T06:01:27.397 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0010621000000000001 2024-09-14T06:01:27.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.397 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:27.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366188+0000", 2024-09-14T06:01:27.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00056258499999999999 2024-09-14T06:01:27.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:27.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366318+0000", 2024-09-14T06:01:27.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012983299999999999 2024-09-14T06:01:27.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.398 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.398 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:01.366620+0000", 2024-09-14T06:01:27.398 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00030257100000000001 2024-09-14T06:01:27.398 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.399 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.399 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.399 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.399 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.399 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:125594 3.15 3:a8a74c27:::rbd_data.1127d65075f9.0000000000000043:head [delete] snapc c=[] ondisk+write+known_if_redirected+supports_pool_eio e140)", 2024-09-14T06:01:27.399 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:01:23.439807+0000", 2024-09-14T06:01:27.399 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.864344392, 2024-09-14T06:01:27.399 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88614469600000001, 2024-09-14T06:01:27.399 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.399 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.399 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:27.399 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.399 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.400 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.400 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 125594 2024-09-14T06:01:27.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.400 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.439807+0000", 2024-09-14T06:01:27.400 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.400 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.400 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.439807+0000", 2024-09-14T06:01:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.439808+0000", 2024-09-14T06:01:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9999999999999998e-07 2024-09-14T06:01:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.439810+0000", 2024-09-14T06:01:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.6520000000000002e-06 2024-09-14T06:01:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.401 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.439821+0000", 2024-09-14T06:01:27.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0437e-05 2024-09-14T06:01:27.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.439827+0000", 2024-09-14T06:01:27.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5030000000000002e-06 2024-09-14T06:01:27.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.402 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.402 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.439894+0000", 2024-09-14T06:01:27.402 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6459999999999997e-05 2024-09-14T06:01:27.402 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.402 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:27.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.439906+0000", 2024-09-14T06:01:27.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.2125e-05 2024-09-14T06:01:27.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:24.315041+0000", 2024-09-14T06:01:27.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.875135361 2024-09-14T06:01:27.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.403 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.403 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.403 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:24.315225+0000", 2024-09-14T06:01:27.403 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0001841 2024-09-14T06:01:27.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T06:01:27.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:24.315342+0000", 2024-09-14T06:01:27.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011663399999999999 2024-09-14T06:01:27.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:27.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:24.317499+0000", 2024-09-14T06:01:27.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0021572800000000001 2024-09-14T06:01:27.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.404 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:27.404 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:24.325861+0000", 2024-09-14T06:01:27.404 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.008361594 2024-09-14T06:01:27.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:27.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:24.325915+0000", 2024-09-14T06:01:27.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4698999999999999e-05 2024-09-14T06:01:27.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.405 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.405 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.405 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:24.325952+0000", 2024-09-14T06:01:27.405 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.6350999999999998e-05 2024-09-14T06:01:27.405 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.405 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.405 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.405 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.406 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.406 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:125603 3.15 3:a8770d8a:::rbd_data.1127d65075f9.000000000000007d:head [delete] snapc c=[] ondisk+write+known_if_redirected+supports_pool_eio e140)", 2024-09-14T06:01:27.406 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:01:23.443927+0000", 2024-09-14T06:01:27.406 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 3.8602243789999999, 2024-09-14T06:01:27.406 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.88229107799999995, 2024-09-14T06:01:27.406 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:27.406 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:27.406 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:27.406 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:27.406 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:27.406 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.406 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 125603 2024-09-14T06:01:27.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.407 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:27.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:27.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.443927+0000", 2024-09-14T06:01:27.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:27.407 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.443927+0000", 2024-09-14T06:01:27.407 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:27.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.407 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.407 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:27.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.443928+0000", 2024-09-14T06:01:27.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.8100000000000001e-07 2024-09-14T06:01:27.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:27.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.443932+0000", 2024-09-14T06:01:27.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2019999999999997e-06 2024-09-14T06:01:27.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.408 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:27.408 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.443944+0000", 2024-09-14T06:01:27.408 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1799e-05 2024-09-14T06:01:27.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.408 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.443950+0000", 2024-09-14T06:01:27.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.7740000000000001e-06 2024-09-14T06:01:27.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.444006+0000", 2024-09-14T06:01:27.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6162000000000002e-05 2024-09-14T06:01:27.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.409 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.409 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for peered", 2024-09-14T06:01:27.409 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:23.444015+0000", 2024-09-14T06:01:27.409 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.081e-06 2024-09-14T06:01:27.409 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:24.316892+0000", 2024-09-14T06:01:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.87287667199999996 2024-09-14T06:01:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:24.316998+0000", 2024-09-14T06:01:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000106634 2024-09-14T06:01:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "waiting for subops from 7", 2024-09-14T06:01:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:24.317072+0000", 2024-09-14T06:01:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.3538e-05 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "op_commit", 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:24.319295+0000", 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.002222852 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:24.326042+0000", 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0067469870000000003 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "commit_sent", 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:24.326119+0000", 2024-09-14T06:01:27.411 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6914000000000003e-05 2024-09-14T06:01:27.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:27.412 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:27.412 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:27.412 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:01:24.326218+0000", 2024-09-14T06:01:27.412 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.9481999999999994e-05 2024-09-14T06:01:27.412 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.412 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.412 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.412 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:27.412 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:27.412 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:27.413 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:27.413 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:27.414 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:01:27.415 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:27.415 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:27.415 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2024-09-14T06:01:27.416 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:27.418 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:27.408+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:27.514 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:27.512+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:27.552 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:27.552 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:27.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:01:27.615 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:27.612+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:27.716 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:27.712+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:27.739 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:27.739 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:27.739 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:27.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:01:27.838 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:27.836+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:27.916 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:27.916 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:27.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:27.916 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:27.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.916 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:27.916 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:27.916 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 116.963712372, 2024-09-14T06:01:27.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T06:01:27.916 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.916 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.916 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:27.917 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.917 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.917 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.917 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T06:01:27.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.917 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:27.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T06:01:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T06:01:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T06:01:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T06:01:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T06:01:27.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T06:01:27.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T06:01:27.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T06:01:27.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T06:01:27.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T06:01:27.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T06:01:27.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T06:01:27.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T06:01:27.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T06:01:27.921 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.921 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.921 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.921 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:27.921 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:27.921 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 116.963693097, 2024-09-14T06:01:27.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T06:01:27.921 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.921 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.921 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:27.921 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.922 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.922 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.922 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T06:01:27.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.922 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:27.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:27.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:27.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T06:01:27.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T06:01:27.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T06:01:27.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T06:01:27.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T06:01:27.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T06:01:27.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T06:01:27.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T06:01:27.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T06:01:27.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T06:01:27.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T06:01:27.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T06:01:27.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T06:01:27.925 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.925 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.925 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.925 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:27.926 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:27.926 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 116.963673521, 2024-09-14T06:01:27.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T06:01:27.926 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.926 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.926 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:27.926 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.926 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.926 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.926 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T06:01:27.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.926 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:27.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:27.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T06:01:27.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T06:01:27.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T06:01:27.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T06:01:27.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T06:01:27.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:01:27.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T06:01:27.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T06:01:27.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T06:01:27.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T06:01:27.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T06:01:27.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T06:01:27.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T06:01:27.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T06:01:27.930 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.930 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.930 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.930 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 116.963654064, 2024-09-14T06:01:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T06:01:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T06:01:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T06:01:27.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T06:01:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T06:01:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T06:01:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T06:01:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T06:01:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T06:01:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T06:01:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T06:01:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T06:01:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T06:01:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T06:01:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T06:01:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 116.963635013, 2024-09-14T06:01:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T06:01:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.935 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T06:01:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T06:01:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T06:01:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T06:01:27.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T06:01:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T06:01:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T06:01:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T06:01:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T06:01:27.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T06:01:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T06:01:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T06:01:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T06:01:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T06:01:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 116.963615332, 2024-09-14T06:01:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T06:01:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T06:01:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.940 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T06:01:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T06:01:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T06:01:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T06:01:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T06:01:27.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:01:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T06:01:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T06:01:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T06:01:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T06:01:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T06:01:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T06:01:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T06:01:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T06:01:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:27.944 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 116.963595381, 2024-09-14T06:01:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T06:01:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T06:01:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T06:01:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T06:01:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T06:01:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:01:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T06:01:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T06:01:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T06:01:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T06:01:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T06:01:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T06:01:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T06:01:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T06:01:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T06:01:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T06:01:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 116.963576069, 2024-09-14T06:01:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T06:01:27.949 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T06:01:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T06:01:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T06:01:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T06:01:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T06:01:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T06:01:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T06:01:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T06:01:27.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T06:01:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T06:01:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T06:01:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T06:01:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T06:01:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.954 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:27.954 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:27.954 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 116.96355630799999, 2024-09-14T06:01:27.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T06:01:27.954 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.954 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.954 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:27.954 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.954 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.954 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.954 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T06:01:27.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.954 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:27.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:27.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T06:01:27.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:01:27.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T06:01:27.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T06:01:27.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T06:01:27.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T06:01:27.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T06:01:27.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T06:01:27.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T06:01:27.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T06:01:27.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T06:01:27.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T06:01:27.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T06:01:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T06:01:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 116.96353538699999, 2024-09-14T06:01:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T06:01:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.958 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.959 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:27.959 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.959 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.959 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.959 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T06:01:27.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.959 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:27.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:27.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T06:01:27.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T06:01:27.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T06:01:27.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T06:01:27.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T06:01:27.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T06:01:27.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T06:01:27.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T06:01:27.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T06:01:27.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T06:01:27.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T06:01:27.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T06:01:27.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T06:01:27.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T06:01:27.964 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.964 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.964 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.964 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:27.964 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:27.965 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 116.962376053, 2024-09-14T06:01:27.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T06:01:27.965 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.965 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.965 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:27.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.965 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T06:01:27.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.965 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:27.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:27.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T06:01:27.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T06:01:27.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T06:01:27.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T06:01:27.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T06:01:27.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T06:01:27.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T06:01:27.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T06:01:27.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T06:01:27.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T06:01:27.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T06:01:27.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T06:01:27.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T06:01:27.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T06:01:27.969 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.969 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.969 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.969 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:27.969 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:27.969 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 116.962077271, 2024-09-14T06:01:27.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T06:01:27.969 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.969 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.969 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:27.970 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.970 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.970 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.970 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T06:01:27.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.970 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:27.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:27.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T06:01:27.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T06:01:27.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T06:01:27.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T06:01:27.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T06:01:27.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T06:01:27.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T06:01:27.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T06:01:27.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T06:01:27.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T06:01:27.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T06:01:27.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T06:01:27.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T06:01:27.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T06:01:27.973 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.973 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.974 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.974 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:27.974 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:27.974 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 116.961926533, 2024-09-14T06:01:27.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T06:01:27.974 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.974 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.974 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:27.974 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.974 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.974 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.974 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T06:01:27.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.975 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:27.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:27.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T06:01:27.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T06:01:27.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T06:01:27.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T06:01:27.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T06:01:27.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T06:01:27.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T06:01:27.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T06:01:27.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T06:01:27.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T06:01:27.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T06:01:27.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T06:01:27.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T06:01:27.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T06:01:27.978 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.978 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.978 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.978 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T06:01:27.978 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:27.978 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 116.33662497, 2024-09-14T06:01:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T06:01:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:27.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T06:01:27.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T06:01:27.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T06:01:27.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T06:01:27.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T06:01:27.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T06:01:27.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T06:01:27.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T06:01:27.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T06:01:27.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T06:01:27.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T06:01:27.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T06:01:27.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:27.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T06:01:27.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T06:01:27.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T06:01:27.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T06:01:27.982 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.983 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.983 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.983 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:27.983 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:27.983 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 115.813535031, 2024-09-14T06:01:27.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T06:01:27.983 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.983 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.983 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:27.983 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.983 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.984 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.984 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T06:01:27.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.984 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:27.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:27.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T06:01:27.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T06:01:27.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T06:01:27.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T06:01:27.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T06:01:27.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T06:01:27.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T06:01:27.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T06:01:27.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T06:01:27.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T06:01:27.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T06:01:27.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T06:01:27.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T06:01:27.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T06:01:27.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T06:01:27.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:27.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T06:01:27.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T06:01:27.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:27.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T06:01:27.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T06:01:27.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:27.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T06:01:27.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T06:01:27.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T06:01:27.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T06:01:27.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.989 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.989 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123243 3.f 3:f182c8b1:::rbd_data.112793b455a2.0000000000000008:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:27.989 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:27.989 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.497500569, 2024-09-14T06:01:27.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9453718680000001, 2024-09-14T06:01:27.989 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.989 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.990 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:27.990 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.990 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.990 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.990 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123243 2024-09-14T06:01:27.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.990 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:27.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:27.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414929+0000", 2024-09-14T06:01:27.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.761e-06 2024-09-14T06:01:27.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:27.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414935+0000", 2024-09-14T06:01:27.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1310000000000003e-06 2024-09-14T06:01:27.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:27.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414953+0000", 2024-09-14T06:01:27.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.806e-05 2024-09-14T06:01:27.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:27.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414962+0000", 2024-09-14T06:01:27.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8040000000000007e-06 2024-09-14T06:01:27.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.415129+0000", 2024-09-14T06:01:27.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016696699999999999 2024-09-14T06:01:27.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:27.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.415160+0000", 2024-09-14T06:01:27.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1361e-05 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.306423+0000", 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.89126284499999997 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.306458+0000", 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4864999999999999e-05 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.356709+0000", 2024-09-14T06:01:27.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0502506730000001 2024-09-14T06:01:27.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:27.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357372+0000", 2024-09-14T06:01:27.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00066291500000000003 2024-09-14T06:01:27.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T06:01:27.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357702+0000", 2024-09-14T06:01:27.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00033040400000000002 2024-09-14T06:01:27.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:27.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359330+0000", 2024-09-14T06:01:27.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001628004 2024-09-14T06:01:27.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:27.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359899+0000", 2024-09-14T06:01:27.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00056937000000000003 2024-09-14T06:01:27.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:27.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360016+0000", 2024-09-14T06:01:27.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116688 2024-09-14T06:01:27.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:27.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360299+0000", 2024-09-14T06:01:27.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028301999999999998 2024-09-14T06:01:27.997 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.997 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:27.997 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:27.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.997 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123246 3.e 3:757f91a9:::rbd_data.112793b455a2.000000000000000b:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:27.997 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:27.998 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.495007969, 2024-09-14T06:01:27.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.971537646, 2024-09-14T06:01:27.998 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:27.998 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:27.998 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:27.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:27.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:27.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:27.998 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123246 2024-09-14T06:01:27.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.998 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:27.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:27.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:27.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:27.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:27.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:27.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:27.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:27.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:27.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417422+0000", 2024-09-14T06:01:27.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3029999999999998e-06 2024-09-14T06:01:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417433+0000", 2024-09-14T06:01:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1333e-05 2024-09-14T06:01:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417496+0000", 2024-09-14T06:01:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2856999999999998e-05 2024-09-14T06:01:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417521+0000", 2024-09-14T06:01:28.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5041999999999998e-05 2024-09-14T06:01:28.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417631+0000", 2024-09-14T06:01:28.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010957 2024-09-14T06:01:28.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:28.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417641+0000", 2024-09-14T06:01:28.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0655999999999999e-05 2024-09-14T06:01:28.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301111+0000", 2024-09-14T06:01:28.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.883469175 2024-09-14T06:01:28.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:28.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301143+0000", 2024-09-14T06:01:28.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1998000000000001e-05 2024-09-14T06:01:28.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385119+0000", 2024-09-14T06:01:28.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0839765729999999 2024-09-14T06:01:28.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385594+0000", 2024-09-14T06:01:28.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000475014 2024-09-14T06:01:28.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:28.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385905+0000", 2024-09-14T06:01:28.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031112300000000001 2024-09-14T06:01:28.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:28.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388402+0000", 2024-09-14T06:01:28.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024969110000000001 2024-09-14T06:01:28.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:28.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388492+0000", 2024-09-14T06:01:28.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9740000000000005e-05 2024-09-14T06:01:28.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:28.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388646+0000", 2024-09-14T06:01:28.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153788 2024-09-14T06:01:28.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388957+0000", 2024-09-14T06:01:28.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000311563 2024-09-14T06:01:28.005 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.005 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.005 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.005 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123247 3.e 3:71933c91:::rbd_data.112793b455a2.000000000000000c:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:28.005 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:28.005 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.494828928, 2024-09-14T06:01:28.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9716223099999999, 2024-09-14T06:01:28.005 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.006 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.006 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:28.006 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.006 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.006 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.006 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123247 2024-09-14T06:01:28.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.006 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:28.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:28.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417601+0000", 2024-09-14T06:01:28.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:01:28.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417613+0000", 2024-09-14T06:01:28.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2041999999999999e-05 2024-09-14T06:01:28.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417636+0000", 2024-09-14T06:01:28.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3071999999999999e-05 2024-09-14T06:01:28.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417652+0000", 2024-09-14T06:01:28.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6512999999999999e-05 2024-09-14T06:01:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417722+0000", 2024-09-14T06:01:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0201000000000001e-05 2024-09-14T06:01:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417729+0000", 2024-09-14T06:01:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4420000000000003e-06 2024-09-14T06:01:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301770+0000", 2024-09-14T06:01:28.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88404090999999996 2024-09-14T06:01:28.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:28.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301798+0000", 2024-09-14T06:01:28.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8619000000000002e-05 2024-09-14T06:01:28.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387130+0000", 2024-09-14T06:01:28.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0853317760000001 2024-09-14T06:01:28.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387314+0000", 2024-09-14T06:01:28.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018428699999999999 2024-09-14T06:01:28.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:28.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387786+0000", 2024-09-14T06:01:28.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047110000000000001 2024-09-14T06:01:28.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:28.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388983+0000", 2024-09-14T06:01:28.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011978640000000001 2024-09-14T06:01:28.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:28.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389032+0000", 2024-09-14T06:01:28.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8349000000000001e-05 2024-09-14T06:01:28.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:28.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389082+0000", 2024-09-14T06:01:28.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0291999999999999e-05 2024-09-14T06:01:28.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389221+0000", 2024-09-14T06:01:28.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013898599999999999 2024-09-14T06:01:28.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.013 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.013 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:125590 3.e 3:7269be12:::rbd_data.1127d65075f9.000000000000003f:head [delete] snapc c=[] ondisk+write+known_if_redirected+supports_pool_eio e140)", 2024-09-14T06:01:28.013 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:23.439474+0000", 2024-09-14T06:01:28.013 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4729538050000004, 2024-09-14T06:01:28.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88744142599999998, 2024-09-14T06:01:28.013 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.013 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.013 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:28.013 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 125590 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439474+0000", 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439474+0000", 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439475+0000", 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.195e-06 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439481+0000", 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7209999999999999e-06 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439499+0000", 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7819999999999999e-05 2024-09-14T06:01:28.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439508+0000", 2024-09-14T06:01:28.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9760000000000001e-06 2024-09-14T06:01:28.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439588+0000", 2024-09-14T06:01:28.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0024999999999994e-05 2024-09-14T06:01:28.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:28.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439599+0000", 2024-09-14T06:01:28.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1066e-05 2024-09-14T06:01:28.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.320613+0000", 2024-09-14T06:01:28.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88101414300000003 2024-09-14T06:01:28.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.320975+0000", 2024-09-14T06:01:28.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036199700000000002 2024-09-14T06:01:28.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 7", 2024-09-14T06:01:28.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.321284+0000", 2024-09-14T06:01:28.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030910200000000001 2024-09-14T06:01:28.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:28.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.325139+0000", 2024-09-14T06:01:28.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038546600000000002 2024-09-14T06:01:28.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:28.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.326794+0000", 2024-09-14T06:01:28.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016557970000000001 2024-09-14T06:01:28.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:28.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.326868+0000", 2024-09-14T06:01:28.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.381e-05 2024-09-14T06:01:28.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.326915+0000", 2024-09-14T06:01:28.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7114000000000003e-05 2024-09-14T06:01:28.020 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.020 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.020 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.020 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:125601 3.e 3:756a4815:::rbd_data.1127d65075f9.000000000000007b:head [delete] snapc c=[] ondisk+write+known_if_redirected+supports_pool_eio e140)", 2024-09-14T06:01:28.020 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:23.441355+0000", 2024-09-14T06:01:28.020 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4710724150000001, 2024-09-14T06:01:28.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88632629699999999, 2024-09-14T06:01:28.021 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.021 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.021 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:28.021 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.021 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.021 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.021 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 125601 2024-09-14T06:01:28.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.021 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441355+0000", 2024-09-14T06:01:28.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441355+0000", 2024-09-14T06:01:28.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441356+0000", 2024-09-14T06:01:28.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5600000000000004e-07 2024-09-14T06:01:28.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441366+0000", 2024-09-14T06:01:28.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6430000000000007e-06 2024-09-14T06:01:28.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441385+0000", 2024-09-14T06:01:28.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9188e-05 2024-09-14T06:01:28.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441395+0000", 2024-09-14T06:01:28.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8810000000000008e-06 2024-09-14T06:01:28.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441483+0000", 2024-09-14T06:01:28.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7807999999999997e-05 2024-09-14T06:01:28.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:28.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441498+0000", 2024-09-14T06:01:28.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5489e-05 2024-09-14T06:01:28.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.323574+0000", 2024-09-14T06:01:28.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88207560500000004 2024-09-14T06:01:28.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.323909+0000", 2024-09-14T06:01:28.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000335371 2024-09-14T06:01:28.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 7", 2024-09-14T06:01:28.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.324224+0000", 2024-09-14T06:01:28.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031446099999999998 2024-09-14T06:01:28.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:28.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.325701+0000", 2024-09-14T06:01:28.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001477648 2024-09-14T06:01:28.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:28.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.327487+0000", 2024-09-14T06:01:28.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001785909 2024-09-14T06:01:28.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:28.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.327576+0000", 2024-09-14T06:01:28.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9240000000000006e-05 2024-09-14T06:01:28.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.327682+0000", 2024-09-14T06:01:28.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105198 2024-09-14T06:01:28.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.027 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.027 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.027 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:28.029 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:01:28.029 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:28.024+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:28.129 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:28.124+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:28.198 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:28.199 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:28.199 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:28.199 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:28.215 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:01:28.230 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:28.224+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:28.331 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:28.328+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:28.368 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-14T06:01:28.368 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T06:01:28.369 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T06:01:28.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T06:01:28.383 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:28.383 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:28.383 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:28.383 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:28.383 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:28.400 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:01:28.432 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:28.428+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:28.532 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:28.528+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:28.575 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:28.575 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:28.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:28.575 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:28.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.576 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:28.576 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:28.576 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 117.0270419, 2024-09-14T06:01:28.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:01:28.576 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.576 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.576 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:28.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.576 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:01:28.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.576 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:28.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:28.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:01:28.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:01:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:01:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:01:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:01:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:01:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:01:28.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:01:28.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:01:28.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:01:28.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:01:28.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:01:28.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:28.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:01:28.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:01:28.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:28.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:01:28.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:01:28.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:28.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:01:28.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:01:28.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:28.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:01:28.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:01:28.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:01:28.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.05164501500001, 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.582 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.583 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:01:28.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.583 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:28.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:28.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:01:28.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:01:28.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:01:28.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:01:28.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:01:28.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:01:28.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:01:28.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:01:28.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.586 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.586 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:28.586 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:28.586 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.05160669199999, 2024-09-14T06:01:28.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:01:28.587 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.587 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.587 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.587 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:01:28.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.587 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:28.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:28.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:01:28.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:01:28.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:01:28.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:01:28.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:01:28.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:01:28.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:01:28.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:01:28.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:01:28.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:01:28.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:01:28.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:01:28.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:01:28.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:01:28.591 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.591 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.591 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.591 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:28.591 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:28.591 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.05158, 2024-09-14T06:01:28.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:01:28.591 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.591 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.591 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.592 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:01:28.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.592 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:28.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:28.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:01:28.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:01:28.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:01:28.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:01:28.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:01:28.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:01:28.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:01:28.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:01:28.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:01:28.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:01:28.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:01:28.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:01:28.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:01:28.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:01:28.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.595 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.596 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:28.596 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:28.596 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.051554134, 2024-09-14T06:01:28.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:01:28.596 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.596 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.596 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.596 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:01:28.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.597 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:28.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:28.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:01:28.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:01:28.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:01:28.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:01:28.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:01:28.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:01:28.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:01:28.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:01:28.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:01:28.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:01:28.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:01:28.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:01:28.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:01:28.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:01:28.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.600 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.600 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:28.601 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:28.601 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.050453765, 2024-09-14T06:01:28.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:01:28.601 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.601 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.601 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.601 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.601 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.601 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.601 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:01:28.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.601 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:01:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:01:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:01:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:01:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:01:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:01:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:01:28.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:01:28.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:01:28.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:01:28.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:01:28.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.050409786, 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.605 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.606 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:01:28.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.606 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:28.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:28.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:01:28.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:01:28.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:01:28.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:01:28.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:01:28.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 104.049348026, 2024-09-14T06:01:28.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:01:28.610 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.610 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.610 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.610 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.610 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.610 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.610 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:01:28.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.610 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:28.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:28.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:01:28.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:01:28.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:01:28.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:01:28.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:01:28.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:01:28.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:01:28.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:01:28.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:01:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:01:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:01:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:01:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:01:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:01:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119203 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5881856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.507974996000002, 2024-09-14T06:01:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084813824999999995, 2024-09-14T06:01:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119203 2024-09-14T06:01:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065503+0000", 2024-09-14T06:01:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.054e-06 2024-09-14T06:01:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065509+0000", 2024-09-14T06:01:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9939999999999997e-06 2024-09-14T06:01:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065528+0000", 2024-09-14T06:01:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8736000000000002e-05 2024-09-14T06:01:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065540+0000", 2024-09-14T06:01:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2427e-05 2024-09-14T06:01:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.149851+0000", 2024-09-14T06:01:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084310806000000002 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150073+0000", 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022202999999999999 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150316+0000", 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000242778 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119204 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5931008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.507919489000002, 2024-09-14T06:01:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085122164, 2024-09-14T06:01:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119204 2024-09-14T06:01:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065559+0000", 2024-09-14T06:01:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.068e-06 2024-09-14T06:01:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065564+0000", 2024-09-14T06:01:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1089999999999997e-06 2024-09-14T06:01:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065580+0000", 2024-09-14T06:01:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6438000000000001e-05 2024-09-14T06:01:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065592+0000", 2024-09-14T06:01:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1739000000000001e-05 2024-09-14T06:01:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150396+0000", 2024-09-14T06:01:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084803859999999995 2024-09-14T06:01:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150524+0000", 2024-09-14T06:01:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012805600000000001 2024-09-14T06:01:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150680+0000", 2024-09-14T06:01:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015589400000000001 2024-09-14T06:01:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119205 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5980160~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.507823614000003, 2024-09-14T06:01:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085597655999999994, 2024-09-14T06:01:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119205 2024-09-14T06:01:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065656+0000", 2024-09-14T06:01:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9829999999999999e-06 2024-09-14T06:01:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065661+0000", 2024-09-14T06:01:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9510000000000003e-06 2024-09-14T06:01:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065680+0000", 2024-09-14T06:01:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8947e-05 2024-09-14T06:01:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065694+0000", 2024-09-14T06:01:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3433e-05 2024-09-14T06:01:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150778+0000", 2024-09-14T06:01:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085083856999999999 2024-09-14T06:01:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151007+0000", 2024-09-14T06:01:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022914499999999999 2024-09-14T06:01:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151251+0000", 2024-09-14T06:01:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024434000000000001 2024-09-14T06:01:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119206 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6029312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.507762184999997, 2024-09-14T06:01:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086002258999999998, 2024-09-14T06:01:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119206 2024-09-14T06:01:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065716+0000", 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230000000000001e-06 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065722+0000", 2024-09-14T06:01:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5219999999999998e-06 2024-09-14T06:01:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065739+0000", 2024-09-14T06:01:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7122e-05 2024-09-14T06:01:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065752+0000", 2024-09-14T06:01:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2639e-05 2024-09-14T06:01:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151384+0000", 2024-09-14T06:01:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085632514000000007 2024-09-14T06:01:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151532+0000", 2024-09-14T06:01:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000147761 2024-09-14T06:01:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151717+0000", 2024-09-14T06:01:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018537800000000001 2024-09-14T06:01:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119207 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6078464~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.507708839999999, 2024-09-14T06:01:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086515080999999994, 2024-09-14T06:01:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119207 2024-09-14T06:01:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065770+0000", 2024-09-14T06:01:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5770000000000001e-06 2024-09-14T06:01:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065775+0000", 2024-09-14T06:01:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1930000000000001e-06 2024-09-14T06:01:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065791+0000", 2024-09-14T06:01:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6351e-05 2024-09-14T06:01:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065804+0000", 2024-09-14T06:01:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.259e-05 2024-09-14T06:01:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151820+0000", 2024-09-14T06:01:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086016398999999993 2024-09-14T06:01:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152043+0000", 2024-09-14T06:01:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022236200000000001 2024-09-14T06:01:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152283+0000", 2024-09-14T06:01:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000240609 2024-09-14T06:01:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119208 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.507656341999997, 2024-09-14T06:01:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086932403000000005, 2024-09-14T06:01:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119208 2024-09-14T06:01:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065822+0000", 2024-09-14T06:01:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.032e-06 2024-09-14T06:01:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065827+0000", 2024-09-14T06:01:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5790000000000003e-06 2024-09-14T06:01:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065843+0000", 2024-09-14T06:01:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5801999999999999e-05 2024-09-14T06:01:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065856+0000", 2024-09-14T06:01:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2267e-05 2024-09-14T06:01:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152416+0000", 2024-09-14T06:01:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086560893999999999 2024-09-14T06:01:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152568+0000", 2024-09-14T06:01:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151664 2024-09-14T06:01:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152753+0000", 2024-09-14T06:01:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018516499999999999 2024-09-14T06:01:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119209 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6176768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.507604471999997, 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087450828999999994, 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119209 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065874+0000", 2024-09-14T06:01:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.097e-06 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065879+0000", 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.254e-06 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065895+0000", 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6373000000000001e-05 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065908+0000", 2024-09-14T06:01:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2656e-05 2024-09-14T06:01:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152854+0000", 2024-09-14T06:01:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086946078999999996 2024-09-14T06:01:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153080+0000", 2024-09-14T06:01:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022582200000000001 2024-09-14T06:01:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153324+0000", 2024-09-14T06:01:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024354800000000001 2024-09-14T06:01:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119210 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6225920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.507552545000003, 2024-09-14T06:01:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087773166, 2024-09-14T06:01:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119210 2024-09-14T06:01:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065926+0000", 2024-09-14T06:01:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3799999999999999e-06 2024-09-14T06:01:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065931+0000", 2024-09-14T06:01:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9629999999999997e-06 2024-09-14T06:01:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065950+0000", 2024-09-14T06:01:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9369999999999999e-05 2024-09-14T06:01:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065963+0000", 2024-09-14T06:01:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2164000000000001e-05 2024-09-14T06:01:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153404+0000", 2024-09-14T06:01:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087441840000000007 2024-09-14T06:01:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153537+0000", 2024-09-14T06:01:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013305500000000001 2024-09-14T06:01:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153698+0000", 2024-09-14T06:01:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016039400000000001 2024-09-14T06:01:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119211 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6275072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.507496777999997, 2024-09-14T06:01:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088244734000000005, 2024-09-14T06:01:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119211 2024-09-14T06:01:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065981+0000", 2024-09-14T06:01:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.012e-06 2024-09-14T06:01:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065987+0000", 2024-09-14T06:01:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5450000000000003e-06 2024-09-14T06:01:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.066003+0000", 2024-09-14T06:01:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6198999999999999e-05 2024-09-14T06:01:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.066016+0000", 2024-09-14T06:01:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2595999999999999e-05 2024-09-14T06:01:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153758+0000", 2024-09-14T06:01:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087742610999999998 2024-09-14T06:01:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153983+0000", 2024-09-14T06:01:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000224336 2024-09-14T06:01:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.154225+0000", 2024-09-14T06:01:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024243499999999999 2024-09-14T06:01:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123236 3.16 3:6f8987ed:::rbd_data.112793b455a2.0000000000000001:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.158656037, 2024-09-14T06:01:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.973924129, 2024-09-14T06:01:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123236 2024-09-14T06:01:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414823+0000", 2024-09-14T06:01:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0930000000000001e-06 2024-09-14T06:01:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414830+0000", 2024-09-14T06:01:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-09-14T06:01:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414848+0000", 2024-09-14T06:01:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8029e-05 2024-09-14T06:01:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414859+0000", 2024-09-14T06:01:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0934000000000001e-05 2024-09-14T06:01:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414952+0000", 2024-09-14T06:01:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3140999999999995e-05 2024-09-14T06:01:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414964+0000", 2024-09-14T06:01:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1802e-05 2024-09-14T06:01:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297044+0000", 2024-09-14T06:01:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88207986500000002 2024-09-14T06:01:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297073+0000", 2024-09-14T06:01:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9178000000000001e-05 2024-09-14T06:01:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385889+0000", 2024-09-14T06:01:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0888154130000001 2024-09-14T06:01:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.386144+0000", 2024-09-14T06:01:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255064 2024-09-14T06:01:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.386344+0000", 2024-09-14T06:01:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020039100000000001 2024-09-14T06:01:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388411+0000", 2024-09-14T06:01:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020668029999999999 2024-09-14T06:01:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388490+0000", 2024-09-14T06:01:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9237e-05 2024-09-14T06:01:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388589+0000", 2024-09-14T06:01:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9254999999999998e-05 2024-09-14T06:01:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388745+0000", 2024-09-14T06:01:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015581899999999999 2024-09-14T06:01:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123238 3.7 3:e6b46603:::rbd_data.112793b455a2.0000000000000003:head [delete] snapc 19=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-14T06:01:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.281718283, 2024-09-14T06:01:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0714216679999999, 2024-09-14T06:01:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123238 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291762+0000", 2024-09-14T06:01:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.467e-06 2024-09-14T06:01:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291777+0000", 2024-09-14T06:01:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4664999999999999e-05 2024-09-14T06:01:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291833+0000", 2024-09-14T06:01:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5498000000000003e-05 2024-09-14T06:01:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291861+0000", 2024-09-14T06:01:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8161999999999999e-05 2024-09-14T06:01:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292150+0000", 2024-09-14T06:01:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028918900000000003 2024-09-14T06:01:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-14T06:01:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292171+0000", 2024-09-14T06:01:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0936000000000001e-05 2024-09-14T06:01:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297607+0000", 2024-09-14T06:01:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054358139999999998 2024-09-14T06:01:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297630+0000", 2024-09-14T06:01:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3209000000000001e-05 2024-09-14T06:01:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357360+0000", 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0597304700000001 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357737+0000", 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037695399999999998 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0,3", 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.358085+0000", 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034785099999999999 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361195+0000", 2024-09-14T06:01:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003110163 2024-09-14T06:01:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361362+0000", 2024-09-14T06:01:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167112 2024-09-14T06:01:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.362887+0000", 2024-09-14T06:01:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015243419999999999 2024-09-14T06:01:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.362987+0000", 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100333 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.363181+0000", 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019350300000000001 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123244 3.7 3:e141330b:::rbd_data.112793b455a2.0000000000000009:head [delete] snapc 19=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-14T06:01:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.281551704000002, 2024-09-14T06:01:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.072328908, 2024-09-14T06:01:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123244 2024-09-14T06:01:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291927+0000", 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5460000000000001e-06 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291934+0000", 2024-09-14T06:01:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3599999999999998e-06 2024-09-14T06:01:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291956+0000", 2024-09-14T06:01:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1469000000000001e-05 2024-09-14T06:01:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291972+0000", 2024-09-14T06:01:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5773e-05 2024-09-14T06:01:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292362+0000", 2024-09-14T06:01:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00038989100000000001 2024-09-14T06:01:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-09-14T06:01:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292379+0000", 2024-09-14T06:01:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7186000000000001e-05 2024-09-14T06:01:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297840+0000", 2024-09-14T06:01:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054614260000000001 2024-09-14T06:01:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297860+0000", 2024-09-14T06:01:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9782000000000001e-05 2024-09-14T06:01:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359785+0000", 2024-09-14T06:01:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.061924665 2024-09-14T06:01:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360080+0000", 2024-09-14T06:01:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029538399999999999 2024-09-14T06:01:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0,3", 2024-09-14T06:01:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360382+0000", 2024-09-14T06:01:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030214 2024-09-14T06:01:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361612+0000", 2024-09-14T06:01:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001229808 2024-09-14T06:01:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.363256+0000", 2024-09-14T06:01:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001644162 2024-09-14T06:01:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364059+0000", 2024-09-14T06:01:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080328599999999995 2024-09-14T06:01:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364105+0000", 2024-09-14T06:01:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5695999999999998e-05 2024-09-14T06:01:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364254+0000", 2024-09-14T06:01:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014933399999999999 2024-09-14T06:01:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:28.680 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:28.681 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:01:28.681 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:28.680+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:28.709 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:01:28.709 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:28.709 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 145, 2024-09-14T06:01:28.709 INFO:teuthology.orchestra.run.smithi006.stdout: "fsid": "8db933fa-392d-4966-864a-b73b8a91dd2d", 2024-09-14T06:01:28.709 INFO:teuthology.orchestra.run.smithi006.stdout: "created": "2024-09-14T05:58:34.536616+0000", 2024-09-14T06:01:28.709 INFO:teuthology.orchestra.run.smithi006.stdout: "modified": "2024-09-14T06:01:28.376924+0000", 2024-09-14T06:01:28.709 INFO:teuthology.orchestra.run.smithi006.stdout: "last_up_change": "2024-09-14T05:59:39.727882+0000", 2024-09-14T06:01:28.709 INFO:teuthology.orchestra.run.smithi006.stdout: "last_in_change": "2024-09-14T06:01:05.316677+0000", 2024-09-14T06:01:28.709 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T06:01:28.709 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_num": 5799936, 2024-09-14T06:01:28.709 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_set": [ 2024-09-14T06:01:28.710 INFO:teuthology.orchestra.run.smithi006.stdout: "pglog_hardlimit", 2024-09-14T06:01:28.710 INFO:teuthology.orchestra.run.smithi006.stdout: "purged_snapdirs", 2024-09-14T06:01:28.710 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_deletes", 2024-09-14T06:01:28.710 INFO:teuthology.orchestra.run.smithi006.stdout: "sortbitwise" 2024-09-14T06:01:28.710 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:28.710 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_version": 6, 2024-09-14T06:01:28.710 INFO:teuthology.orchestra.run.smithi006.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T06:01:28.710 INFO:teuthology.orchestra.run.smithi006.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T06:01:28.710 INFO:teuthology.orchestra.run.smithi006.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T06:01:28.710 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_snapshot": "", 2024-09-14T06:01:28.710 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_max": 3, 2024-09-14T06:01:28.710 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd": 8, 2024-09-14T06:01:28.710 INFO:teuthology.orchestra.run.smithi006.stdout: "require_min_compat_client": "luminous", 2024-09-14T06:01:28.711 INFO:teuthology.orchestra.run.smithi006.stdout: "min_compat_client": "luminous", 2024-09-14T06:01:28.711 INFO:teuthology.orchestra.run.smithi006.stdout: "require_osd_release": "squid", 2024-09-14T06:01:28.711 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_crimson": false, 2024-09-14T06:01:28.711 INFO:teuthology.orchestra.run.smithi006.stdout: "pools": [ 2024-09-14T06:01:28.711 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.711 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 1, 2024-09-14T06:01:28.711 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": ".mgr", 2024-09-14T06:01:28.711 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2024-09-14T05:58:47.505149+0000", 2024-09-14T06:01:28.711 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2024-09-14T06:01:28.711 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool", 2024-09-14T06:01:28.711 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2024-09-14T06:01:28.711 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2024-09-14T06:01:28.711 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2024-09-14T06:01:28.712 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2024-09-14T06:01:28.712 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2024-09-14T06:01:28.712 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2024-09-14T06:01:28.712 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T06:01:28.712 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T06:01:28.712 INFO:teuthology.orchestra.run.smithi006.stdout: "is_stretch_pool": false, 2024-09-14T06:01:28.712 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2024-09-14T06:01:28.712 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2024-09-14T06:01:28.712 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 1, 2024-09-14T06:01:28.712 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 1, 2024-09-14T06:01:28.712 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 1, 2024-09-14T06:01:28.712 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 1, 2024-09-14T06:01:28.712 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 1, 2024-09-14T06:01:28.712 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2024-09-14T06:01:28.713 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2024-09-14T06:01:28.713 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2024-09-14T06:01:28.713 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2024-09-14T06:01:28.713 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2024-09-14T06:01:28.713 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2024-09-14T06:01:28.713 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2024-09-14T06:01:28.713 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.713 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "18", 2024-09-14T06:01:28.713 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2024-09-14T06:01:28.713 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T06:01:28.713 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T06:01:28.713 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2024-09-14T06:01:28.713 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2024-09-14T06:01:28.714 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 0, 2024-09-14T06:01:28.714 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 0, 2024-09-14T06:01:28.714 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2024-09-14T06:01:28.714 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2024-09-14T06:01:28.714 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2024-09-14T06:01:28.714 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2024-09-14T06:01:28.714 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2024-09-14T06:01:28.714 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2024-09-14T06:01:28.714 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2024-09-14T06:01:28.714 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2024-09-14T06:01:28.714 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2024-09-14T06:01:28.714 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2024-09-14T06:01:28.714 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2024-09-14T06:01:28.714 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T06:01:28.715 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T06:01:28.715 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T06:01:28.715 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2024-09-14T06:01:28.715 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2024-09-14T06:01:28.715 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2024-09-14T06:01:28.715 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2024-09-14T06:01:28.715 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2024-09-14T06:01:28.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.715 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2024-09-14T06:01:28.715 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2024-09-14T06:01:28.715 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2024-09-14T06:01:28.715 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2024-09-14T06:01:28.715 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2024-09-14T06:01:28.716 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T06:01:28.716 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2024-09-14T06:01:28.716 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2024-09-14T06:01:28.716 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2024-09-14T06:01:28.716 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2024-09-14T06:01:28.716 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2024-09-14T06:01:28.716 INFO:teuthology.orchestra.run.smithi006.stdout: "options": { 2024-09-14T06:01:28.716 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_max": 32, 2024-09-14T06:01:28.716 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_min": 1 2024-09-14T06:01:28.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.716 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2024-09-14T06:01:28.716 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": {} 2024-09-14T06:01:28.716 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.716 INFO:teuthology.orchestra.run.smithi006.stdout: "read_balance": { 2024-09-14T06:01:28.717 INFO:teuthology.orchestra.run.smithi006.stdout: "score_type": "Fair distribution", 2024-09-14T06:01:28.717 INFO:teuthology.orchestra.run.smithi006.stdout: "score_acting": 6.059999942779541, 2024-09-14T06:01:28.717 INFO:teuthology.orchestra.run.smithi006.stdout: "score_stable": 6.059999942779541, 2024-09-14T06:01:28.717 INFO:teuthology.orchestra.run.smithi006.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T06:01:28.717 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_acting": 2, 2024-09-14T06:01:28.717 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_stable": 2, 2024-09-14T06:01:28.717 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity_weighted": 0.75, 2024-09-14T06:01:28.717 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity": 1, 2024-09-14T06:01:28.717 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity_weighted": 0.75 2024-09-14T06:01:28.717 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.718 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.718 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.718 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 2, 2024-09-14T06:01:28.718 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "rbd", 2024-09-14T06:01:28.718 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2024-09-14T05:58:52.779258+0000", 2024-09-14T06:01:28.718 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 8193, 2024-09-14T06:01:28.718 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T06:01:28.718 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2024-09-14T06:01:28.718 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2024-09-14T06:01:28.718 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2024-09-14T06:01:28.718 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2024-09-14T06:01:28.718 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2024-09-14T06:01:28.718 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2024-09-14T06:01:28.719 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T06:01:28.719 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T06:01:28.719 INFO:teuthology.orchestra.run.smithi006.stdout: "is_stretch_pool": false, 2024-09-14T06:01:28.719 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2024-09-14T06:01:28.719 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2024-09-14T06:01:28.719 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 8, 2024-09-14T06:01:28.719 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 8, 2024-09-14T06:01:28.719 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 8, 2024-09-14T06:01:28.719 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 8, 2024-09-14T06:01:28.719 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 8, 2024-09-14T06:01:28.719 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2024-09-14T06:01:28.719 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2024-09-14T06:01:28.719 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2024-09-14T06:01:28.719 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2024-09-14T06:01:28.720 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2024-09-14T06:01:28.720 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2024-09-14T06:01:28.720 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2024-09-14T06:01:28.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.720 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "22", 2024-09-14T06:01:28.720 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2024-09-14T06:01:28.720 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T06:01:28.720 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T06:01:28.720 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2024-09-14T06:01:28.720 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2024-09-14T06:01:28.720 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 2, 2024-09-14T06:01:28.720 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 22, 2024-09-14T06:01:28.720 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2024-09-14T06:01:28.720 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2024-09-14T06:01:28.721 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2024-09-14T06:01:28.721 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2024-09-14T06:01:28.721 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2024-09-14T06:01:28.721 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2024-09-14T06:01:28.721 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2024-09-14T06:01:28.721 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2024-09-14T06:01:28.721 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2024-09-14T06:01:28.721 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2024-09-14T06:01:28.721 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2024-09-14T06:01:28.721 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T06:01:28.721 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T06:01:28.721 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T06:01:28.722 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2024-09-14T06:01:28.722 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2024-09-14T06:01:28.722 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2024-09-14T06:01:28.722 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2024-09-14T06:01:28.722 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2024-09-14T06:01:28.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.722 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2024-09-14T06:01:28.722 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2024-09-14T06:01:28.723 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2024-09-14T06:01:28.723 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2024-09-14T06:01:28.723 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2024-09-14T06:01:28.723 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T06:01:28.723 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2024-09-14T06:01:28.723 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2024-09-14T06:01:28.723 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2024-09-14T06:01:28.723 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2024-09-14T06:01:28.723 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2024-09-14T06:01:28.723 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2024-09-14T06:01:28.723 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2024-09-14T06:01:28.723 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2024-09-14T06:01:28.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.724 INFO:teuthology.orchestra.run.smithi006.stdout: "read_balance": { 2024-09-14T06:01:28.724 INFO:teuthology.orchestra.run.smithi006.stdout: "score_type": "Fair distribution", 2024-09-14T06:01:28.724 INFO:teuthology.orchestra.run.smithi006.stdout: "score_acting": 2.25, 2024-09-14T06:01:28.724 INFO:teuthology.orchestra.run.smithi006.stdout: "score_stable": 2.25, 2024-09-14T06:01:28.724 INFO:teuthology.orchestra.run.smithi006.stdout: "optimal_score": 1.1699999570846558, 2024-09-14T06:01:28.724 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_acting": 2.630000114440918, 2024-09-14T06:01:28.724 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_stable": 2.630000114440918, 2024-09-14T06:01:28.724 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity_weighted": 0.75, 2024-09-14T06:01:28.724 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity": 1, 2024-09-14T06:01:28.724 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity_weighted": 0.75 2024-09-14T06:01:28.724 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.725 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.725 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2024-09-14T06:01:28.725 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": "pool_client.0", 2024-09-14T06:01:28.725 INFO:teuthology.orchestra.run.smithi006.stdout: "create_time": "2024-09-14T05:59:04.433909+0000", 2024-09-14T06:01:28.725 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 8193, 2024-09-14T06:01:28.725 INFO:teuthology.orchestra.run.smithi006.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T06:01:28.725 INFO:teuthology.orchestra.run.smithi006.stdout: "type": 1, 2024-09-14T06:01:28.725 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 2, 2024-09-14T06:01:28.725 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": 1, 2024-09-14T06:01:28.725 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_rule": 0, 2024-09-14T06:01:28.725 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_count": 0, 2024-09-14T06:01:28.726 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_target": 0, 2024-09-14T06:01:28.726 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T06:01:28.726 INFO:teuthology.orchestra.run.smithi006.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T06:01:28.726 INFO:teuthology.orchestra.run.smithi006.stdout: "is_stretch_pool": false, 2024-09-14T06:01:28.726 INFO:teuthology.orchestra.run.smithi006.stdout: "object_hash": 2, 2024-09-14T06:01:28.726 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscale_mode": "off", 2024-09-14T06:01:28.726 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": 32, 2024-09-14T06:01:28.726 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num": 32, 2024-09-14T06:01:28.726 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_placement_num_target": 32, 2024-09-14T06:01:28.726 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_target": 32, 2024-09-14T06:01:28.726 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num_pending": 32, 2024-09-14T06:01:28.726 INFO:teuthology.orchestra.run.smithi006.stdout: "last_pg_merge_meta": { 2024-09-14T06:01:28.726 INFO:teuthology.orchestra.run.smithi006.stdout: "source_pgid": "0.0", 2024-09-14T06:01:28.727 INFO:teuthology.orchestra.run.smithi006.stdout: "ready_epoch": 0, 2024-09-14T06:01:28.727 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_started": 0, 2024-09-14T06:01:28.727 INFO:teuthology.orchestra.run.smithi006.stdout: "last_epoch_clean": 0, 2024-09-14T06:01:28.727 INFO:teuthology.orchestra.run.smithi006.stdout: "source_version": "0'0", 2024-09-14T06:01:28.727 INFO:teuthology.orchestra.run.smithi006.stdout: "target_version": "0'0" 2024-09-14T06:01:28.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.727 INFO:teuthology.orchestra.run.smithi006.stdout: "last_change": "145", 2024-09-14T06:01:28.727 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend": "0", 2024-09-14T06:01:28.727 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T06:01:28.727 INFO:teuthology.orchestra.run.smithi006.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T06:01:28.727 INFO:teuthology.orchestra.run.smithi006.stdout: "auid": 0, 2024-09-14T06:01:28.727 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_mode": "selfmanaged", 2024-09-14T06:01:28.727 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_seq": 40, 2024-09-14T06:01:28.728 INFO:teuthology.orchestra.run.smithi006.stdout: "snap_epoch": 145, 2024-09-14T06:01:28.728 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_snaps": [], 2024-09-14T06:01:28.728 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps": "[]", 2024-09-14T06:01:28.728 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_bytes": 0, 2024-09-14T06:01:28.728 INFO:teuthology.orchestra.run.smithi006.stdout: "quota_max_objects": 0, 2024-09-14T06:01:28.728 INFO:teuthology.orchestra.run.smithi006.stdout: "tiers": [], 2024-09-14T06:01:28.728 INFO:teuthology.orchestra.run.smithi006.stdout: "tier_of": -1, 2024-09-14T06:01:28.728 INFO:teuthology.orchestra.run.smithi006.stdout: "read_tier": -1, 2024-09-14T06:01:28.728 INFO:teuthology.orchestra.run.smithi006.stdout: "write_tier": -1, 2024-09-14T06:01:28.728 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_mode": "none", 2024-09-14T06:01:28.728 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_bytes": 0, 2024-09-14T06:01:28.728 INFO:teuthology.orchestra.run.smithi006.stdout: "target_max_objects": 0, 2024-09-14T06:01:28.728 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T06:01:28.729 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T06:01:28.729 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T06:01:28.729 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_flush_age": 0, 2024-09-14T06:01:28.729 INFO:teuthology.orchestra.run.smithi006.stdout: "cache_min_evict_age": 0, 2024-09-14T06:01:28.729 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profile": "", 2024-09-14T06:01:28.729 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_params": { 2024-09-14T06:01:28.729 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "none" 2024-09-14T06:01:28.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.729 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_period": 0, 2024-09-14T06:01:28.729 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_count": 0, 2024-09-14T06:01:28.729 INFO:teuthology.orchestra.run.smithi006.stdout: "use_gmt_hitset": true, 2024-09-14T06:01:28.729 INFO:teuthology.orchestra.run.smithi006.stdout: "min_read_recency_for_promote": 0, 2024-09-14T06:01:28.729 INFO:teuthology.orchestra.run.smithi006.stdout: "min_write_recency_for_promote": 0, 2024-09-14T06:01:28.729 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T06:01:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "hit_set_search_last_n": 0, 2024-09-14T06:01:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "grade_table": [], 2024-09-14T06:01:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "stripe_width": 0, 2024-09-14T06:01:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "expected_num_objects": 0, 2024-09-14T06:01:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "fast_read": false, 2024-09-14T06:01:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "options": {}, 2024-09-14T06:01:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "application_metadata": { 2024-09-14T06:01:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd": {} 2024-09-14T06:01:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "read_balance": { 2024-09-14T06:01:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "score_type": "Fair distribution", 2024-09-14T06:01:28.730 INFO:teuthology.orchestra.run.smithi006.stdout: "score_acting": 1.5, 2024-09-14T06:01:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: "score_stable": 1.5, 2024-09-14T06:01:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: "optimal_score": 1.3300000429153442, 2024-09-14T06:01:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_acting": 2, 2024-09-14T06:01:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: "raw_score_stable": 2, 2024-09-14T06:01:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity_weighted": 0.75, 2024-09-14T06:01:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity": 1, 2024-09-14T06:01:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: "average_primary_affinity_weighted": 0.75 2024-09-14T06:01:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2024-09-14T06:01:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.731 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2024-09-14T06:01:28.732 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "9ef61ed5-359d-4de3-be54-41d3a66c393a", 2024-09-14T06:01:28.732 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:28.732 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:28.732 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:28.732 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:01:28.732 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 15, 2024-09-14T06:01:28.732 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 27, 2024-09-14T06:01:28.732 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 46, 2024-09-14T06:01:28.732 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 140, 2024-09-14T06:01:28.732 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 28, 2024-09-14T06:01:28.732 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:28.732 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:28.732 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.733 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6824", 2024-09-14T06:01:28.733 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:28.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.733 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6825", 2024-09-14T06:01:28.733 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:28.733 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.733 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.733 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:28.734 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.734 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.734 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6826", 2024-09-14T06:01:28.734 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:28.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.734 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.734 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.734 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6827", 2024-09-14T06:01:28.734 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:28.734 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.734 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.734 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:28.735 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.735 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.735 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6830", 2024-09-14T06:01:28.735 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:28.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.735 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.735 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6831", 2024-09-14T06:01:28.735 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:28.735 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.736 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.736 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:28.736 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.736 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6828", 2024-09-14T06:01:28.736 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:28.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.736 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6829", 2024-09-14T06:01:28.736 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 643732088 2024-09-14T06:01:28.737 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.737 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.737 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6825/643732088", 2024-09-14T06:01:28.737 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6827/643732088", 2024-09-14T06:01:28.737 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6831/643732088", 2024-09-14T06:01:28.737 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6829/643732088", 2024-09-14T06:01:28.737 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:28.737 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:28.737 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:28.737 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.737 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2024-09-14T06:01:28.738 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "f180c483-9b53-4808-b5ec-537bf956087d", 2024-09-14T06:01:28.738 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:28.738 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:28.738 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:28.738 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:01:28.738 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:01:28.738 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:01:28.738 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:01:28.738 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 140, 2024-09-14T06:01:28.738 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:01:28.738 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:28.738 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:28.738 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.739 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.739 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6812", 2024-09-14T06:01:28.739 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:28.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.739 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.739 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6815", 2024-09-14T06:01:28.739 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:28.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.739 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.739 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:28.739 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6818", 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6819", 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.741 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.741 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6822", 2024-09-14T06:01:28.741 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:28.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.741 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.741 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6823", 2024-09-14T06:01:28.741 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:28.741 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.741 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.741 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:28.742 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.742 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.742 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6820", 2024-09-14T06:01:28.742 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:28.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.742 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.742 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6821", 2024-09-14T06:01:28.742 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1278360579 2024-09-14T06:01:28.742 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.742 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.743 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6815/1278360579", 2024-09-14T06:01:28.743 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6819/1278360579", 2024-09-14T06:01:28.743 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6823/1278360579", 2024-09-14T06:01:28.743 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6821/1278360579", 2024-09-14T06:01:28.743 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:28.743 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:28.743 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:28.743 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.743 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2024-09-14T06:01:28.743 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "bc59bb00-b3b0-4483-a5b1-cc5907cf660a", 2024-09-14T06:01:28.743 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:28.744 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:28.744 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:28.744 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 0, 2024-09-14T06:01:28.744 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:01:28.744 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:01:28.744 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 15, 2024-09-14T06:01:28.744 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 124, 2024-09-14T06:01:28.744 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:01:28.744 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:28.744 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:28.744 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.744 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.745 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6808", 2024-09-14T06:01:28.745 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:28.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.745 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.745 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6809", 2024-09-14T06:01:28.745 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:28.745 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.745 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.745 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:28.745 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.745 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6810", 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6811", 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.746 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.747 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6816", 2024-09-14T06:01:28.747 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:28.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.747 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.747 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6817", 2024-09-14T06:01:28.747 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:28.747 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.747 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.747 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:28.747 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.747 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.748 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.748 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6813", 2024-09-14T06:01:28.748 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:28.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.748 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.748 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6814", 2024-09-14T06:01:28.748 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4171349592 2024-09-14T06:01:28.748 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.748 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.748 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6809/4171349592", 2024-09-14T06:01:28.748 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6811/4171349592", 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6817/4171349592", 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6814/4171349592", 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "7aa9fc3b-29c5-4e9a-a894-e2abfb586263", 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:01:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:01:28.750 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:01:28.750 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:01:28.750 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 140, 2024-09-14T06:01:28.750 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:01:28.750 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:28.750 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:28.750 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.750 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.750 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2024-09-14T06:01:28.750 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:28.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.751 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.751 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2024-09-14T06:01:28.751 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:28.751 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.751 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.751 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:28.751 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.751 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.751 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6802", 2024-09-14T06:01:28.751 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:28.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.751 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.752 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.752 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6803", 2024-09-14T06:01:28.752 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:28.752 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.752 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.752 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:28.752 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.752 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.752 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.752 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6806", 2024-09-14T06:01:28.752 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:28.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.753 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.753 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6807", 2024-09-14T06:01:28.753 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:28.753 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.753 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.753 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.753 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:28.753 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.754 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.754 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6804", 2024-09-14T06:01:28.754 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:28.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.754 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.754 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6805", 2024-09-14T06:01:28.755 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 3999210088 2024-09-14T06:01:28.755 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.755 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.755 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.6:6801/3999210088", 2024-09-14T06:01:28.755 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.6:6803/3999210088", 2024-09-14T06:01:28.755 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.6:6807/3999210088", 2024-09-14T06:01:28.755 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.6:6805/3999210088", 2024-09-14T06:01:28.755 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:28.755 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:28.756 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:28.756 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.756 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2024-09-14T06:01:28.756 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "a0665f54-f53d-4536-a322-4974c2f23aa1", 2024-09-14T06:01:28.756 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:28.756 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:28.756 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:28.756 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:01:28.756 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:01:28.756 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:01:28.756 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:01:28.757 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 140, 2024-09-14T06:01:28.757 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:01:28.757 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:28.757 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:28.757 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.757 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.757 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6824", 2024-09-14T06:01:28.757 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:28.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.757 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.757 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6825", 2024-09-14T06:01:28.757 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:28.758 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.758 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.758 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:28.758 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.758 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.758 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6826", 2024-09-14T06:01:28.758 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:28.758 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.758 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.758 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6827", 2024-09-14T06:01:28.758 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:28.759 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.759 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.759 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:28.759 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.759 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.759 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6830", 2024-09-14T06:01:28.759 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:28.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.759 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.759 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6831", 2024-09-14T06:01:28.759 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:28.760 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.760 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.760 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:28.760 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.760 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.760 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6828", 2024-09-14T06:01:28.760 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:28.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.760 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.760 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.760 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6829", 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 575863621 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6825/575863621", 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6827/575863621", 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6831/575863621", 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6829/575863621", 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.761 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2024-09-14T06:01:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "302ab31c-c228-44da-a0d2-58505ad571cf", 2024-09-14T06:01:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:01:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:01:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:01:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:01:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 140, 2024-09-14T06:01:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:01:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6808", 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6809", 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.763 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6810", 2024-09-14T06:01:28.764 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:28.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.764 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.764 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6811", 2024-09-14T06:01:28.764 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:28.764 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.764 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.764 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:28.764 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.764 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.764 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6814", 2024-09-14T06:01:28.765 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:28.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.765 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.765 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6815", 2024-09-14T06:01:28.765 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:28.765 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.765 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.765 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:28.765 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.765 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.766 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.766 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6812", 2024-09-14T06:01:28.766 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:28.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.766 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.766 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6813", 2024-09-14T06:01:28.766 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2498345645 2024-09-14T06:01:28.766 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.766 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.766 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6809/2498345645", 2024-09-14T06:01:28.766 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6811/2498345645", 2024-09-14T06:01:28.767 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6815/2498345645", 2024-09-14T06:01:28.767 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6813/2498345645", 2024-09-14T06:01:28.767 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:28.767 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:28.767 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:28.767 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.767 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2024-09-14T06:01:28.767 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "1adbca34-daef-4229-b25e-40dec6800f85", 2024-09-14T06:01:28.767 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:28.767 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:28.768 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:28.768 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 1, 2024-09-14T06:01:28.768 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:01:28.768 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:01:28.768 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:01:28.768 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 122, 2024-09-14T06:01:28.768 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:01:28.768 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:28.768 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:28.768 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.768 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.768 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6816", 2024-09-14T06:01:28.768 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:28.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.769 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.769 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6817", 2024-09-14T06:01:28.769 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:28.769 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.769 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.769 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:28.769 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.769 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.769 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6818", 2024-09-14T06:01:28.769 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:28.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.770 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.770 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6819", 2024-09-14T06:01:28.770 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:28.770 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.770 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.770 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:28.770 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.770 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.770 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6822", 2024-09-14T06:01:28.771 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:28.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.771 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.771 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6823", 2024-09-14T06:01:28.771 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:28.771 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.771 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.771 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:28.771 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.771 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.771 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.771 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6820", 2024-09-14T06:01:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6821", 2024-09-14T06:01:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 267756224 2024-09-14T06:01:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6817/267756224", 2024-09-14T06:01:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6819/267756224", 2024-09-14T06:01:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6823/267756224", 2024-09-14T06:01:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6821/267756224", 2024-09-14T06:01:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:28.773 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:28.773 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:28.773 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.773 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2024-09-14T06:01:28.773 INFO:teuthology.orchestra.run.smithi006.stdout: "uuid": "a75d9794-68bf-4e8c-bf75-448a7a783769", 2024-09-14T06:01:28.773 INFO:teuthology.orchestra.run.smithi006.stdout: "up": 1, 2024-09-14T06:01:28.773 INFO:teuthology.orchestra.run.smithi006.stdout: "in": 1, 2024-09-14T06:01:28.773 INFO:teuthology.orchestra.run.smithi006.stdout: "weight": 1, 2024-09-14T06:01:28.773 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_affinity": 0, 2024-09-14T06:01:28.773 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_begin": 0, 2024-09-14T06:01:28.773 INFO:teuthology.orchestra.run.smithi006.stdout: "last_clean_end": 0, 2024-09-14T06:01:28.773 INFO:teuthology.orchestra.run.smithi006.stdout: "up_from": 14, 2024-09-14T06:01:28.774 INFO:teuthology.orchestra.run.smithi006.stdout: "up_thru": 129, 2024-09-14T06:01:28.774 INFO:teuthology.orchestra.run.smithi006.stdout: "down_at": 0, 2024-09-14T06:01:28.774 INFO:teuthology.orchestra.run.smithi006.stdout: "lost_at": 0, 2024-09-14T06:01:28.774 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addrs": { 2024-09-14T06:01:28.774 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.774 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.774 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6800", 2024-09-14T06:01:28.774 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:28.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.774 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.774 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6801", 2024-09-14T06:01:28.774 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:28.775 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.775 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.775 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addrs": { 2024-09-14T06:01:28.775 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.775 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.775 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6802", 2024-09-14T06:01:28.775 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:28.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.776 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.776 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6803", 2024-09-14T06:01:28.776 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:28.776 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.776 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.777 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addrs": { 2024-09-14T06:01:28.777 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.777 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.777 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6806", 2024-09-14T06:01:28.777 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:28.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.777 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.777 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.777 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6807", 2024-09-14T06:01:28.777 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:28.777 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.778 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.778 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addrs": { 2024-09-14T06:01:28.778 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2024-09-14T06:01:28.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.778 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2024-09-14T06:01:28.778 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6804", 2024-09-14T06:01:28.778 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:28.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.778 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-09-14T06:01:28.778 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.154:6805", 2024-09-14T06:01:28.778 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4119173763 2024-09-14T06:01:28.778 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.779 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.779 INFO:teuthology.orchestra.run.smithi006.stdout: "public_addr": "172.21.15.154:6801/4119173763", 2024-09-14T06:01:28.779 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_addr": "172.21.15.154:6803/4119173763", 2024-09-14T06:01:28.779 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_back_addr": "172.21.15.154:6807/4119173763", 2024-09-14T06:01:28.779 INFO:teuthology.orchestra.run.smithi006.stdout: "heartbeat_front_addr": "172.21.15.154:6805/4119173763", 2024-09-14T06:01:28.779 INFO:teuthology.orchestra.run.smithi006.stdout: "state": [ 2024-09-14T06:01:28.779 INFO:teuthology.orchestra.run.smithi006.stdout: "exists", 2024-09-14T06:01:28.779 INFO:teuthology.orchestra.run.smithi006.stdout: "up" 2024-09-14T06:01:28.779 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.779 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.779 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:28.779 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_xinfo": [ 2024-09-14T06:01:28.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.780 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 0, 2024-09-14T06:01:28.780 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:28.780 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:28.780 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:28.780 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:28.780 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:28.780 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.791330+0000", 2024-09-14T06:01:28.780 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 28 2024-09-14T06:01:28.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.780 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 1, 2024-09-14T06:01:28.780 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:28.781 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:28.781 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:28.781 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:28.781 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:28.781 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.526550+0000", 2024-09-14T06:01:28.781 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:01:28.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.781 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.781 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 2, 2024-09-14T06:01:28.781 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.664242+0000", 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 3, 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:28.782 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.327736+0000", 2024-09-14T06:01:28.783 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:01:28.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.783 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 4, 2024-09-14T06:01:28.783 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:28.783 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:28.783 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:28.783 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:28.783 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:28.783 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.687393+0000", 2024-09-14T06:01:28.783 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:01:28.783 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.783 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 5, 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.314438+0000", 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 6, 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:28.784 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:28.785 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:28.785 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.487578+0000", 2024-09-14T06:01:28.785 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:01:28.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.785 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.785 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": 7, 2024-09-14T06:01:28.785 INFO:teuthology.orchestra.run.smithi006.stdout: "down_stamp": "0.000000", 2024-09-14T06:01:28.785 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_probability": 0, 2024-09-14T06:01:28.785 INFO:teuthology.orchestra.run.smithi006.stdout: "laggy_interval": 0, 2024-09-14T06:01:28.785 INFO:teuthology.orchestra.run.smithi006.stdout: "features": 4540719139924082687, 2024-09-14T06:01:28.785 INFO:teuthology.orchestra.run.smithi006.stdout: "old_weight": 0, 2024-09-14T06:01:28.785 INFO:teuthology.orchestra.run.smithi006.stdout: "last_purged_snaps_scrub": "2024-09-14T05:58:43.106833+0000", 2024-09-14T06:01:28.785 INFO:teuthology.orchestra.run.smithi006.stdout: "dead_epoch": 0 2024-09-14T06:01:28.786 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.786 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:28.786 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap": [ 2024-09-14T06:01:28.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.786 INFO:teuthology.orchestra.run.smithi006.stdout: "pgid": "1.0", 2024-09-14T06:01:28.786 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2024-09-14T06:01:28.786 INFO:teuthology.orchestra.run.smithi006.stdout: 4, 2024-09-14T06:01:28.786 INFO:teuthology.orchestra.run.smithi006.stdout: 1 2024-09-14T06:01:28.786 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.786 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.786 INFO:teuthology.orchestra.run.smithi006.stdout: "pgid": "3.7", 2024-09-14T06:01:28.786 INFO:teuthology.orchestra.run.smithi006.stdout: "osds": [ 2024-09-14T06:01:28.787 INFO:teuthology.orchestra.run.smithi006.stdout: 5, 2024-09-14T06:01:28.787 INFO:teuthology.orchestra.run.smithi006.stdout: 7 2024-09-14T06:01:28.787 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.787 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.787 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:28.787 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_items": [ 2024-09-14T06:01:28.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.787 INFO:teuthology.orchestra.run.smithi006.stdout: "pgid": "3.12", 2024-09-14T06:01:28.787 INFO:teuthology.orchestra.run.smithi006.stdout: "mappings": [ 2024-09-14T06:01:28.787 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.787 INFO:teuthology.orchestra.run.smithi006.stdout: "from": 7, 2024-09-14T06:01:28.787 INFO:teuthology.orchestra.run.smithi006.stdout: "to": 3 2024-09-14T06:01:28.787 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_upmap_primaries": [], 2024-09-14T06:01:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_temp": [], 2024-09-14T06:01:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "primary_temp": [], 2024-09-14T06:01:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklist": {}, 2024-09-14T06:01:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "range_blocklist": {}, 2024-09-14T06:01:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "erasure_code_profiles": { 2024-09-14T06:01:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "default": { 2024-09-14T06:01:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-failure-domain": "osd", 2024-09-14T06:01:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "k": "2", 2024-09-14T06:01:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "m": "1", 2024-09-14T06:01:28.788 INFO:teuthology.orchestra.run.smithi006.stdout: "plugin": "jerasure", 2024-09-14T06:01:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "technique": "reed_sol_van" 2024-09-14T06:01:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "removed_snaps_queue": [ 2024-09-14T06:01:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2024-09-14T06:01:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "snaps": [ 2024-09-14T06:01:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "begin": 8, 2024-09-14T06:01:28.789 INFO:teuthology.orchestra.run.smithi006.stdout: "length": 9 2024-09-14T06:01:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: "new_removed_snaps": [ 2024-09-14T06:01:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: "pool": 3, 2024-09-14T06:01:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: "snaps": [ 2024-09-14T06:01:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: "begin": 8, 2024-09-14T06:01:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: "length": 1 2024-09-14T06:01:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:28.790 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-09-14T06:01:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "new_purged_snaps": [], 2024-09-14T06:01:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_node_flags": {}, 2024-09-14T06:01:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "device_class_flags": {}, 2024-09-14T06:01:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode": { 2024-09-14T06:01:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_enabled": false, 2024-09-14T06:01:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_bucket_count": 0, 2024-09-14T06:01:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "degraded_stretch_mode": 0, 2024-09-14T06:01:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "recovering_stretch_mode": 0, 2024-09-14T06:01:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: "stretch_mode_bucket": 0 2024-09-14T06:01:28.791 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:28.791 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:28.794 INFO:tasks.thrashosds.thrasher:j is {'epoch': 145, 'fsid': '8db933fa-392d-4966-864a-b73b8a91dd2d', 'created': '2024-09-14T05:58:34.536616+0000', 'modified': '2024-09-14T06:01:28.376924+0000', 'last_up_change': '2024-09-14T05:59:39.727882+0000', 'last_in_change': '2024-09-14T06:01:05.316677+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T05:58:47.505149+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.75, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.75}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T05:58:52.779258+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1.1699999570846558, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.75, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.75}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-14T05:59:04.433909+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 40, 'snap_epoch': 145, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1.3300000429153442, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.75, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.75}}], 'osds': [{'osd': 0, 'uuid': '9ef61ed5-359d-4de3-be54-41d3a66c393a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 15, 'last_clean_end': 27, 'up_from': 46, 'up_thru': 140, 'down_at': 28, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6824', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6825', 'nonce': 643732088}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6826', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6827', 'nonce': 643732088}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6830', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6831', 'nonce': 643732088}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6828', 'nonce': 643732088}, {'type': 'v1', 'addr': '172.21.15.6:6829', 'nonce': 643732088}]}, 'public_addr': '172.21.15.6:6825/643732088', 'cluster_addr': '172.21.15.6:6827/643732088', 'heartbeat_back_addr': '172.21.15.6:6831/643732088', 'heartbeat_front_addr': '172.21.15.6:6829/643732088', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f180c483-9b53-4808-b5ec-537bf956087d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 140, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6812', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6815', 'nonce': 1278360579}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6818', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6819', 'nonce': 1278360579}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6822', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6823', 'nonce': 1278360579}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6820', 'nonce': 1278360579}, {'type': 'v1', 'addr': '172.21.15.6:6821', 'nonce': 1278360579}]}, 'public_addr': '172.21.15.6:6815/1278360579', 'cluster_addr': '172.21.15.6:6819/1278360579', 'heartbeat_back_addr': '172.21.15.6:6823/1278360579', 'heartbeat_front_addr': '172.21.15.6:6821/1278360579', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'bc59bb00-b3b0-4483-a5b1-cc5907cf660a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 124, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6808', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6809', 'nonce': 4171349592}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6810', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6811', 'nonce': 4171349592}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6816', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6817', 'nonce': 4171349592}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6813', 'nonce': 4171349592}, {'type': 'v1', 'addr': '172.21.15.6:6814', 'nonce': 4171349592}]}, 'public_addr': '172.21.15.6:6809/4171349592', 'cluster_addr': '172.21.15.6:6811/4171349592', 'heartbeat_back_addr': '172.21.15.6:6817/4171349592', 'heartbeat_front_addr': '172.21.15.6:6814/4171349592', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '7aa9fc3b-29c5-4e9a-a894-e2abfb586263', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 140, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6800', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6801', 'nonce': 3999210088}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6802', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6803', 'nonce': 3999210088}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6806', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6807', 'nonce': 3999210088}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6804', 'nonce': 3999210088}, {'type': 'v1', 'addr': '172.21.15.6:6805', 'nonce': 3999210088}]}, 'public_addr': '172.21.15.6:6801/3999210088', 'cluster_addr': '172.21.15.6:6803/3999210088', 'heartbeat_back_addr': '172.21.15.6:6807/3999210088', 'heartbeat_front_addr': '172.21.15.6:6805/3999210088', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'a0665f54-f53d-4536-a322-4974c2f23aa1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 140, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6824', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6825', 'nonce': 575863621}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6826', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6827', 'nonce': 575863621}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6830', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6831', 'nonce': 575863621}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6828', 'nonce': 575863621}, {'type': 'v1', 'addr': '172.21.15.154:6829', 'nonce': 575863621}]}, 'public_addr': '172.21.15.154:6825/575863621', 'cluster_addr': '172.21.15.154:6827/575863621', 'heartbeat_back_addr': '172.21.15.154:6831/575863621', 'heartbeat_front_addr': '172.21.15.154:6829/575863621', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '302ab31c-c228-44da-a0d2-58505ad571cf', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 140, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6808', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6809', 'nonce': 2498345645}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6810', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6811', 'nonce': 2498345645}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6814', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6815', 'nonce': 2498345645}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6812', 'nonce': 2498345645}, {'type': 'v1', 'addr': '172.21.15.154:6813', 'nonce': 2498345645}]}, 'public_addr': '172.21.15.154:6809/2498345645', 'cluster_addr': '172.21.15.154:6811/2498345645', 'heartbeat_back_addr': '172.21.15.154:6815/2498345645', 'heartbeat_front_addr': '172.21.15.154:6813/2498345645', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '1adbca34-daef-4229-b25e-40dec6800f85', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6816', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6817', 'nonce': 267756224}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6818', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6819', 'nonce': 267756224}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6822', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6823', 'nonce': 267756224}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6820', 'nonce': 267756224}, {'type': 'v1', 'addr': '172.21.15.154:6821', 'nonce': 267756224}]}, 'public_addr': '172.21.15.154:6817/267756224', 'cluster_addr': '172.21.15.154:6819/267756224', 'heartbeat_back_addr': '172.21.15.154:6823/267756224', 'heartbeat_front_addr': '172.21.15.154:6821/267756224', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a75d9794-68bf-4e8c-bf75-448a7a783769', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 129, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 4119173763}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 4119173763}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 4119173763}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 4119173763}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 4119173763}]}, 'public_addr': '172.21.15.154:6801/4119173763', 'cluster_addr': '172.21.15.154:6803/4119173763', 'heartbeat_back_addr': '172.21.15.154:6807/4119173763', 'heartbeat_front_addr': '172.21.15.154:6805/4119173763', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.791330+0000', 'dead_epoch': 28}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.526550+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.664242+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.327736+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.687393+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.314438+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.487578+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:58:43.106833+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '1.0', 'osds': [4, 1]}, {'pgid': '3.7', 'osds': [5, 7]}], 'pg_upmap_items': [{'pgid': '3.12', 'mappings': [{'from': 7, 'to': 3}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 8, 'length': 9}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 8, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T06:01:28.794 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.7 2024-09-14T06:01:28.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.7 2024-09-14T06:01:28.795 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:28.792+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:28.894 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:28.888+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:28.924 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:28.924 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:28.924 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:28.924 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:28.938 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:01:28.994 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:28.992+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:29.095 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:29.092+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:29.100 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:29.101 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:29.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:01:29.196 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:29.192+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:29.287 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:29.287 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:29.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:29.287 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:29.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.287 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59148 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 419840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.287 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:01:29.287 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.016055441999995, 2024-09-14T06:01:29.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072974285999999999, 2024-09-14T06:01:29.288 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.288 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.288 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.288 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.288 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.288 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.288 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59148 2024-09-14T06:01:29.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.288 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:01:29.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:01:29.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268521+0000", 2024-09-14T06:01:29.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4199999999999995e-07 2024-09-14T06:01:29.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268524+0000", 2024-09-14T06:01:29.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.05e-06 2024-09-14T06:01:29.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268534+0000", 2024-09-14T06:01:29.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8719999999999997e-06 2024-09-14T06:01:29.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268541+0000", 2024-09-14T06:01:29.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5349999999999999e-06 2024-09-14T06:01:29.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341108+0000", 2024-09-14T06:01:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072566624999999996 2024-09-14T06:01:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341169+0000", 2024-09-14T06:01:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1251e-05 2024-09-14T06:01:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341494+0000", 2024-09-14T06:01:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325311 2024-09-14T06:01:29.291 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59149 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 436224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:01:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.016016218000004, 2024-09-14T06:01:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073405053999999997, 2024-09-14T06:01:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.293 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.293 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59149 2024-09-14T06:01:29.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.293 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:01:29.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:01:29.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268560+0000", 2024-09-14T06:01:29.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9999999999999997e-07 2024-09-14T06:01:29.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268563+0000", 2024-09-14T06:01:29.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.292e-06 2024-09-14T06:01:29.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268573+0000", 2024-09-14T06:01:29.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3260000000000002e-06 2024-09-14T06:01:29.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268581+0000", 2024-09-14T06:01:29.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1960000000000008e-06 2024-09-14T06:01:29.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341537+0000", 2024-09-14T06:01:29.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072955916999999995 2024-09-14T06:01:29.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341641+0000", 2024-09-14T06:01:29.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104341 2024-09-14T06:01:29.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341964+0000", 2024-09-14T06:01:29.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032328199999999999 2024-09-14T06:01:29.296 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.296 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.296 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.296 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59150 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 452608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.297 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:29.297 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.015982977999997, 2024-09-14T06:01:29.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073829748000000001, 2024-09-14T06:01:29.297 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.297 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.297 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.297 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.297 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.297 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.297 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59150 2024-09-14T06:01:29.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.297 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0399999999999995e-07 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268596+0000", 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9859999999999999e-06 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268606+0000", 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0088000000000001e-05 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268614+0000", 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341999+0000", 2024-09-14T06:01:29.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073385011999999999 2024-09-14T06:01:29.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342093+0000", 2024-09-14T06:01:29.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3793000000000001e-05 2024-09-14T06:01:29.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342422+0000", 2024-09-14T06:01:29.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000329129 2024-09-14T06:01:29.300 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.301 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.301 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.301 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59151 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.301 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:01:29.301 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.015950610000004, 2024-09-14T06:01:29.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074207289999999995, 2024-09-14T06:01:29.301 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.301 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.301 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59151 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268626+0000", 2024-09-14T06:01:29.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T06:01:29.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268629+0000", 2024-09-14T06:01:29.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.038e-06 2024-09-14T06:01:29.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268638+0000", 2024-09-14T06:01:29.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8139999999999995e-06 2024-09-14T06:01:29.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268647+0000", 2024-09-14T06:01:29.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4889999999999995e-06 2024-09-14T06:01:29.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342457+0000", 2024-09-14T06:01:29.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073809890000000003 2024-09-14T06:01:29.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342545+0000", 2024-09-14T06:01:29.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8697999999999997e-05 2024-09-14T06:01:29.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342832+0000", 2024-09-14T06:01:29.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028681799999999999 2024-09-14T06:01:29.305 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.305 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.305 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.305 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59152 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.305 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:29.305 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.015917969, 2024-09-14T06:01:29.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074695176000000002, 2024-09-14T06:01:29.306 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.306 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.306 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.306 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.306 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.306 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.306 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59152 2024-09-14T06:01:29.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.306 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:29.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:29.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:29.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2900000000000003e-07 2024-09-14T06:01:29.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268661+0000", 2024-09-14T06:01:29.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0230000000000001e-06 2024-09-14T06:01:29.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268670+0000", 2024-09-14T06:01:29.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2129999999999997e-06 2024-09-14T06:01:29.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268679+0000", 2024-09-14T06:01:29.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-09-14T06:01:29.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342937+0000", 2024-09-14T06:01:29.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074258781999999995 2024-09-14T06:01:29.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343044+0000", 2024-09-14T06:01:29.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-09-14T06:01:29.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343353+0000", 2024-09-14T06:01:29.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030911099999999999 2024-09-14T06:01:29.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.310 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.310 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.310 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59153 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 501760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.310 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:01:29.310 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.015885198999996, 2024-09-14T06:01:29.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074997241000000006, 2024-09-14T06:01:29.310 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.310 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.310 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.311 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59153 2024-09-14T06:01:29.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.311 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:01:29.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:01:29.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268691+0000", 2024-09-14T06:01:29.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:01:29.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268693+0000", 2024-09-14T06:01:29.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3599999999999999e-06 2024-09-14T06:01:29.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268699+0000", 2024-09-14T06:01:29.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-09-14T06:01:29.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268704+0000", 2024-09-14T06:01:29.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5759999999999999e-06 2024-09-14T06:01:29.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343398+0000", 2024-09-14T06:01:29.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074694522999999999 2024-09-14T06:01:29.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343450+0000", 2024-09-14T06:01:29.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1350999999999997e-05 2024-09-14T06:01:29.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343688+0000", 2024-09-14T06:01:29.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023806500000000001 2024-09-14T06:01:29.314 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.314 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.314 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.314 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59154 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 518144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.314 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:01:29.314 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.015866133000003, 2024-09-14T06:01:29.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075389938000000004, 2024-09-14T06:01:29.315 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.315 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.315 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.315 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.315 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.315 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.315 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59154 2024-09-14T06:01:29.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.315 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:01:29.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:01:29.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268710+0000", 2024-09-14T06:01:29.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8000000000000001e-07 2024-09-14T06:01:29.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268712+0000", 2024-09-14T06:01:29.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T06:01:29.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268717+0000", 2024-09-14T06:01:29.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8570000000000003e-06 2024-09-14T06:01:29.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268721+0000", 2024-09-14T06:01:29.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2039999999999999e-06 2024-09-14T06:01:29.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343721+0000", 2024-09-14T06:01:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074999748000000005 2024-09-14T06:01:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343784+0000", 2024-09-14T06:01:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3174000000000002e-05 2024-09-14T06:01:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.344099+0000", 2024-09-14T06:01:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000315299 2024-09-14T06:01:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.318 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59398 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 323584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.004901884999995, 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073326565999999996, 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59398 2024-09-14T06:01:29.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:01:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:01:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279675+0000", 2024-09-14T06:01:29.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-14T06:01:29.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279681+0000", 2024-09-14T06:01:29.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-09-14T06:01:29.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279702+0000", 2024-09-14T06:01:29.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1259000000000001e-05 2024-09-14T06:01:29.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279718+0000", 2024-09-14T06:01:29.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5475999999999999e-05 2024-09-14T06:01:29.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352360+0000", 2024-09-14T06:01:29.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.07264226 2024-09-14T06:01:29.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352447+0000", 2024-09-14T06:01:29.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7381999999999998e-05 2024-09-14T06:01:29.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353000+0000", 2024-09-14T06:01:29.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055309200000000004 2024-09-14T06:01:29.323 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.323 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.323 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.323 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59399 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.323 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:01:29.323 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.004837522000003, 2024-09-14T06:01:29.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073824446000000002, 2024-09-14T06:01:29.323 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.323 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.324 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.324 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.324 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.324 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.324 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59399 2024-09-14T06:01:29.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.324 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:01:29.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:01:29.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279739+0000", 2024-09-14T06:01:29.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T06:01:29.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279745+0000", 2024-09-14T06:01:29.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T06:01:29.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279767+0000", 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639000000000001e-05 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279781+0000", 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4511999999999999e-05 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353045+0000", 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073263718000000005 2024-09-14T06:01:29.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353168+0000", 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012314499999999999 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353562+0000", 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039435199999999999 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.327 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59400 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.328 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:01:29.328 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.004773761999999, 2024-09-14T06:01:29.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074271465999999994, 2024-09-14T06:01:29.328 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.328 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.328 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.328 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.328 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.328 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.328 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59400 2024-09-14T06:01:29.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.328 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:01:29.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:01:29.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279803+0000", 2024-09-14T06:01:29.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2100000000000001e-06 2024-09-14T06:01:29.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279819+0000", 2024-09-14T06:01:29.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6409000000000002e-05 2024-09-14T06:01:29.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279841+0000", 2024-09-14T06:01:29.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1878e-05 2024-09-14T06:01:29.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279856+0000", 2024-09-14T06:01:29.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4392999999999999e-05 2024-09-14T06:01:29.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353650+0000", 2024-09-14T06:01:29.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073794144000000006 2024-09-14T06:01:29.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353757+0000", 2024-09-14T06:01:29.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010687 2024-09-14T06:01:29.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354073+0000", 2024-09-14T06:01:29.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000316562 2024-09-14T06:01:29.332 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.332 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.332 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.332 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59401 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 372736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.332 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:01:29.332 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.004698937000001, 2024-09-14T06:01:29.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074643900999999999, 2024-09-14T06:01:29.332 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.332 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.332 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59401 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:01:29.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279878+0000", 2024-09-14T06:01:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.31e-06 2024-09-14T06:01:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279883+0000", 2024-09-14T06:01:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3770000000000004e-06 2024-09-14T06:01:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279906+0000", 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2398000000000001e-05 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279920+0000", 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.402e-05 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354125+0000", 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074205750000000001 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354227+0000", 2024-09-14T06:01:29.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101612 2024-09-14T06:01:29.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354521+0000", 2024-09-14T06:01:29.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029343400000000002 2024-09-14T06:01:29.336 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.336 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.336 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.336 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59402 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 389120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.336 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.004637353999996, 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075017027999999999, 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59402 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:01:29.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279939+0000", 2024-09-14T06:01:29.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2470000000000001e-06 2024-09-14T06:01:29.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279945+0000", 2024-09-14T06:01:29.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-09-14T06:01:29.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279966+0000", 2024-09-14T06:01:29.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1801999999999999e-05 2024-09-14T06:01:29.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279980+0000", 2024-09-14T06:01:29.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3589e-05 2024-09-14T06:01:29.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354569+0000", 2024-09-14T06:01:29.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074588707000000004 2024-09-14T06:01:29.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354671+0000", 2024-09-14T06:01:29.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102398 2024-09-14T06:01:29.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354955+0000", 2024-09-14T06:01:29.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028406500000000001 2024-09-14T06:01:29.340 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.340 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.341 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.341 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59403 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 405504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.341 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:01:29.341 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.004575567000003, 2024-09-14T06:01:29.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075434395000000001, 2024-09-14T06:01:29.341 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.341 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.341 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.341 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.341 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59403 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280001+0000", 2024-09-14T06:01:29.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2669999999999999e-06 2024-09-14T06:01:29.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280008+0000", 2024-09-14T06:01:29.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5849999999999996e-06 2024-09-14T06:01:29.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280030+0000", 2024-09-14T06:01:29.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2293000000000002e-05 2024-09-14T06:01:29.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280044+0000", 2024-09-14T06:01:29.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3974999999999999e-05 2024-09-14T06:01:29.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355013+0000", 2024-09-14T06:01:29.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074969039000000001 2024-09-14T06:01:29.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355144+0000", 2024-09-14T06:01:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000131333 2024-09-14T06:01:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355434+0000", 2024-09-14T06:01:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028990299999999999 2024-09-14T06:01:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59404 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:01:29.345 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.004510448000005, 2024-09-14T06:01:29.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075696103000000001, 2024-09-14T06:01:29.346 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.346 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.346 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.346 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.346 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.346 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.346 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59404 2024-09-14T06:01:29.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.346 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:01:29.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:01:29.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280066+0000", 2024-09-14T06:01:29.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2640000000000001e-06 2024-09-14T06:01:29.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280072+0000", 2024-09-14T06:01:29.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129999999999997e-06 2024-09-14T06:01:29.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280094+0000", 2024-09-14T06:01:29.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2608000000000001e-05 2024-09-14T06:01:29.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280109+0000", 2024-09-14T06:01:29.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:01:29.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355479+0000", 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075370699999999999 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355554+0000", 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4674999999999999e-05 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355761+0000", 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-14T06:01:29.349 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59405 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:01:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.004446537999996, 2024-09-14T06:01:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076008867999999993, 2024-09-14T06:01:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.351 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59405 2024-09-14T06:01:29.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.351 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:01:29.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:01:29.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280130+0000", 2024-09-14T06:01:29.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2500000000000001e-06 2024-09-14T06:01:29.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280136+0000", 2024-09-14T06:01:29.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-09-14T06:01:29.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280158+0000", 2024-09-14T06:01:29.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1795000000000001e-05 2024-09-14T06:01:29.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280172+0000", 2024-09-14T06:01:29.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4303e-05 2024-09-14T06:01:29.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355797+0000", 2024-09-14T06:01:29.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075624835000000001 2024-09-14T06:01:29.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355866+0000", 2024-09-14T06:01:29.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9043999999999998e-05 2024-09-14T06:01:29.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356138+0000", 2024-09-14T06:01:29.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027207799999999998 2024-09-14T06:01:29.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.354 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.354 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59406 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.354 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:01:29.354 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.004382595999999, 2024-09-14T06:01:29.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076435642999999998, 2024-09-14T06:01:29.355 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.355 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.355 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.355 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59406 2024-09-14T06:01:29.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.355 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:01:29.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:01:29.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280194+0000", 2024-09-14T06:01:29.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-14T06:01:29.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280200+0000", 2024-09-14T06:01:29.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6359999999999999e-06 2024-09-14T06:01:29.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280222+0000", 2024-09-14T06:01:29.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1628999999999999e-05 2024-09-14T06:01:29.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280236+0000", 2024-09-14T06:01:29.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4413000000000001e-05 2024-09-14T06:01:29.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356172+0000", 2024-09-14T06:01:29.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075936466999999994 2024-09-14T06:01:29.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356260+0000", 2024-09-14T06:01:29.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7437999999999999e-05 2024-09-14T06:01:29.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356629+0000", 2024-09-14T06:01:29.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036877600000000002 2024-09-14T06:01:29.359 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.359 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.359 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.359 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59407 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 471040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.359 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:01:29.359 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.004318362999996, 2024-09-14T06:01:29.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076820083999999997, 2024-09-14T06:01:29.359 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.359 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.359 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.360 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.360 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.360 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59407 2024-09-14T06:01:29.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.360 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:01:29.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:01:29.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280258+0000", 2024-09-14T06:01:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1370000000000001e-06 2024-09-14T06:01:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280264+0000", 2024-09-14T06:01:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6930000000000004e-06 2024-09-14T06:01:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280285+0000", 2024-09-14T06:01:29.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1455999999999999e-05 2024-09-14T06:01:29.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280300+0000", 2024-09-14T06:01:29.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4319e-05 2024-09-14T06:01:29.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356676+0000", 2024-09-14T06:01:29.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076376615999999994 2024-09-14T06:01:29.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356768+0000", 2024-09-14T06:01:29.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1234000000000001e-05 2024-09-14T06:01:29.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357077+0000", 2024-09-14T06:01:29.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030962900000000001 2024-09-14T06:01:29.363 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.363 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.363 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.363 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59408 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 487424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.363 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:01:29.364 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.004253363000004, 2024-09-14T06:01:29.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077185511999999998, 2024-09-14T06:01:29.364 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.364 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.364 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.364 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.364 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.364 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.364 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59408 2024-09-14T06:01:29.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.364 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:01:29.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:01:29.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280323+0000", 2024-09-14T06:01:29.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2860000000000001e-06 2024-09-14T06:01:29.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280329+0000", 2024-09-14T06:01:29.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.553e-06 2024-09-14T06:01:29.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280352+0000", 2024-09-14T06:01:29.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-14T06:01:29.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280366+0000", 2024-09-14T06:01:29.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-14T06:01:29.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357126+0000", 2024-09-14T06:01:29.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076760326000000004 2024-09-14T06:01:29.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357223+0000", 2024-09-14T06:01:29.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6490000000000006e-05 2024-09-14T06:01:29.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357508+0000", 2024-09-14T06:01:29.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028479900000000002 2024-09-14T06:01:29.368 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.368 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.368 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.368 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59409 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.368 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:01:29.368 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.004189132999997, 2024-09-14T06:01:29.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077536090000000002, 2024-09-14T06:01:29.368 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.368 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.368 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.368 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.369 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.369 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.369 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59409 2024-09-14T06:01:29.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.369 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:01:29.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280388+0000", 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.096e-06 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280393+0000", 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280414+0000", 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1175999999999999e-05 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280427+0000", 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3032e-05 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357553+0000", 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077125845999999998 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357624+0000", 2024-09-14T06:01:29.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1062000000000005e-05 2024-09-14T06:01:29.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357923+0000", 2024-09-14T06:01:29.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029891199999999997 2024-09-14T06:01:29.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.372 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.372 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59410 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:29.372 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:01:29.372 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 94.004129821000006, 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077854494999999996, 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59410 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:29.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:01:29.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:29.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:29.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280447+0000", 2024-09-14T06:01:29.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069999999999999e-06 2024-09-14T06:01:29.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:29.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280453+0000", 2024-09-14T06:01:29.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-06 2024-09-14T06:01:29.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:29.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280471+0000", 2024-09-14T06:01:29.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8295999999999999e-05 2024-09-14T06:01:29.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:29.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280484+0000", 2024-09-14T06:01:29.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2609000000000001e-05 2024-09-14T06:01:29.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357954+0000", 2024-09-14T06:01:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077470405000000006 2024-09-14T06:01:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358040+0000", 2024-09-14T06:01:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.551e-05 2024-09-14T06:01:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358300+0000", 2024-09-14T06:01:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026036800000000003 2024-09-14T06:01:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.376 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.377 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.377 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:29.377 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:29.377 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:29.378 INFO:teuthology.orchestra.run.smithi006.stderr:clear 3.7 pg_upmap mapping 2024-09-14T06:01:29.379 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:01:29.379 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:29.372+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:29.418 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T06:01:29.418 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:01:29.478 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:29.476+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:29.510 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:29.511 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:29.511 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:29.511 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:29.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:01:29.589 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:29.589 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:29.614 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:29.612+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:29.618 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:29.634 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:29.635 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:29.651 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:29.651 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:29.671 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:29.671 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:29.681 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:29.676+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:29.691 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:29.691 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:29.698 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:29.698 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:29.698 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:29.699 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:29.699 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:29.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:01:29.713 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:29.713 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:29.731 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:29.731 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:29.791 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:29.788+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:29.875 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:29.875 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:29.883 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:29.880+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:29.889 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:01:29.984 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:29.980+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:30.019 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:30.019 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:30.034 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:01:30.085 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:30.080+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:30.162 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:30.177 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:01:30.185 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:30.180+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:30.286 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:30.280+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:30.296 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:30.296 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:30.310 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is set 2024-09-14T06:01:30.314 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:01:30.427 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:30.424+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:30.488 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:30.484+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:30.498 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:30.499 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:30.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:01:30.588 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:30.584+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:30.683 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:30.683 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:30.689 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:30.684+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:30.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:01:30.790 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:30.784+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:30.861 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:30.861 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:30.876 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:01:30.890 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:30.888+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:30.991 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:30.988+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:30.996 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:30.996 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:31.011 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:01:31.093 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:31.088+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:31.138 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:31.139 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:31.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:01:31.193 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:31.188+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:31.271 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:31.272 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:31.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:01:31.294 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:31.292+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:31.395 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:31.392+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:31.407 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:31.407 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:31.423 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:01:31.514 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:31.512+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:31.596 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:31.592+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:31.608 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:31.608 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:31.624 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:01:31.715 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:31.712+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:31.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:01:31.798 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:31.796+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:31.808 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:31.808 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:31.825 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:01:31.899 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:31.896+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:31.908 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:31.909 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:31.925 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:31.925 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:31.941 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:31.942 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:31.956 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:31.956 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:31.958 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:31.958 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:31.971 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:01:31.978 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:31.979 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:31.998 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:31.999 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:32.014 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:32.012+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:32.020 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:32.020 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:32.038 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:32.038 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:32.101 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:32.096+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:32.136 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:32.137 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:32.137 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:32.137 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:32.137 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:32.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:01:32.239 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:32.236+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:32.302 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:32.300+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:32.324 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:32.325 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:32.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:32.325 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:32.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.325 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23553 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.325 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:32.325 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 121.371124513, 2024-09-14T06:01:32.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049129969000000002, 2024-09-14T06:01:32.325 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.325 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.325 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.326 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23553 2024-09-14T06:01:32.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.326 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:32.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948715+0000", 2024-09-14T06:01:32.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948716+0000", 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8299999999999998e-07 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948718+0000", 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8080000000000001e-06 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948724+0000", 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0140000000000004e-06 2024-09-14T06:01:32.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948728+0000", 2024-09-14T06:01:32.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-09-14T06:01:32.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997675+0000", 2024-09-14T06:01:32.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048946785 2024-09-14T06:01:32.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997752+0000", 2024-09-14T06:01:32.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7114999999999996e-05 2024-09-14T06:01:32.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997845+0000", 2024-09-14T06:01:32.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3294000000000005e-05 2024-09-14T06:01:32.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.329 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.329 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23554 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 651264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.329 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 121.371105238, 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049263964, 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23554 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:32.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948735+0000", 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9900000000000001e-07 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948737+0000", 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.796e-06 2024-09-14T06:01:32.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948743+0000", 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8459999999999996e-06 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948747+0000", 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5970000000000002e-06 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997881+0000", 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049134204000000001 2024-09-14T06:01:32.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997937+0000", 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.997999+0000", 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1270000000000001e-05 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.333 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23560 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.334 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:32.334 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 121.371085662, 2024-09-14T06:01:32.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049438998999999997, 2024-09-14T06:01:32.334 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.334 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.334 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.334 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.334 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.334 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.334 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23560 2024-09-14T06:01:32.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.334 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:32.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948754+0000", 2024-09-14T06:01:32.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948755+0000", 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8799999999999998e-07 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948756+0000", 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9319999999999999e-06 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948762+0000", 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948767+0000", 2024-09-14T06:01:32.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8659999999999997e-06 2024-09-14T06:01:32.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998039+0000", 2024-09-14T06:01:32.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049271465 2024-09-14T06:01:32.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998117+0000", 2024-09-14T06:01:32.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8434000000000002e-05 2024-09-14T06:01:32.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998193+0000", 2024-09-14T06:01:32.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5958999999999996e-05 2024-09-14T06:01:32.338 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.338 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.338 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.338 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23562 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 735232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.338 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:32.338 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 121.37106620500001, 2024-09-14T06:01:32.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049550845000000003, 2024-09-14T06:01:32.339 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.339 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.339 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.339 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.339 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.339 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.339 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23562 2024-09-14T06:01:32.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.339 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:32.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:32.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948774+0000", 2024-09-14T06:01:32.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7599999999999998e-07 2024-09-14T06:01:32.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948776+0000", 2024-09-14T06:01:32.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8759999999999999e-06 2024-09-14T06:01:32.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948782+0000", 2024-09-14T06:01:32.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7459999999999997e-06 2024-09-14T06:01:32.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948786+0000", 2024-09-14T06:01:32.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-09-14T06:01:32.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998227+0000", 2024-09-14T06:01:32.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049440535000000001 2024-09-14T06:01:32.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998277+0000", 2024-09-14T06:01:32.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0114999999999997e-05 2024-09-14T06:01:32.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998324+0000", 2024-09-14T06:01:32.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7778999999999998e-05 2024-09-14T06:01:32.342 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23563 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 743424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 121.371047154, 2024-09-14T06:01:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049723690000000001, 2024-09-14T06:01:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23563 2024-09-14T06:01:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948793+0000", 2024-09-14T06:01:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7500000000000001e-07 2024-09-14T06:01:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948795+0000", 2024-09-14T06:01:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8199999999999999e-06 2024-09-14T06:01:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948801+0000", 2024-09-14T06:01:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-09-14T06:01:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948806+0000", 2024-09-14T06:01:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6650000000000002e-06 2024-09-14T06:01:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998368+0000", 2024-09-14T06:01:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049562096 2024-09-14T06:01:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998444+0000", 2024-09-14T06:01:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6076999999999997e-05 2024-09-14T06:01:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998516+0000", 2024-09-14T06:01:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2491999999999996e-05 2024-09-14T06:01:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23565 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 765952~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 121.371027473, 2024-09-14T06:01:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049853302000000002, 2024-09-14T06:01:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23565 2024-09-14T06:01:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948812+0000", 2024-09-14T06:01:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948813+0000", 2024-09-14T06:01:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4900000000000001e-07 2024-09-14T06:01:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948815+0000", 2024-09-14T06:01:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.872e-06 2024-09-14T06:01:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948821+0000", 2024-09-14T06:01:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9549999999999997e-06 2024-09-14T06:01:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948826+0000", 2024-09-14T06:01:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0839999999999999e-06 2024-09-14T06:01:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998553+0000", 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049727201999999998 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998605+0000", 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2043000000000003e-05 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998666+0000", 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0797000000000001e-05 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23566 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 774144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 121.371007522, 2024-09-14T06:01:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049950746999999997, 2024-09-14T06:01:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23566 2024-09-14T06:01:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948832+0000", 2024-09-14T06:01:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948833+0000", 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6100000000000002e-07 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948835+0000", 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948840+0000", 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9390000000000002e-06 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948845+0000", 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7650000000000001e-06 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998695+0000", 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049849705000000001 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998739+0000", 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4369999999999997e-05 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998783+0000", 2024-09-14T06:01:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.375e-05 2024-09-14T06:01:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23567 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 858112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 121.37098820999999, 2024-09-14T06:01:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050134255000000003, 2024-09-14T06:01:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23567 2024-09-14T06:01:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948852+0000", 2024-09-14T06:01:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3599999999999999e-07 2024-09-14T06:01:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948854+0000", 2024-09-14T06:01:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.832e-06 2024-09-14T06:01:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948860+0000", 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0499999999999997e-06 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948865+0000", 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0429999999999998e-06 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998823+0000", 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049957850999999998 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998909+0000", 2024-09-14T06:01:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6073000000000001e-05 2024-09-14T06:01:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.998986+0000", 2024-09-14T06:01:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6970000000000003e-05 2024-09-14T06:01:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23572 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 600064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 121.370968449, 2024-09-14T06:01:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050275772000000003, 2024-09-14T06:01:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23572 2024-09-14T06:01:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948871+0000", 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948872+0000", 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1600000000000002e-07 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948874+0000", 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7940000000000001e-06 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948881+0000", 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3479999999999998e-06 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948886+0000", 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7210000000000002e-06 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999023+0000", 2024-09-14T06:01:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050137462000000001 2024-09-14T06:01:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999085+0000", 2024-09-14T06:01:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1965999999999996e-05 2024-09-14T06:01:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999147+0000", 2024-09-14T06:01:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2064999999999996e-05 2024-09-14T06:01:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23573 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 608256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 121.370947528, 2024-09-14T06:01:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.050466900000000002, 2024-09-14T06:01:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23573 2024-09-14T06:01:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.948892+0000", 2024-09-14T06:01:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950004+0000", 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001111557 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950009+0000", 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3739999999999997e-06 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950018+0000", 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4670000000000004e-06 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950025+0000", 2024-09-14T06:01:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7069999999999992e-06 2024-09-14T06:01:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999188+0000", 2024-09-14T06:01:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049162401000000001 2024-09-14T06:01:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999265+0000", 2024-09-14T06:01:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7409000000000004e-05 2024-09-14T06:01:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999359+0000", 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3985000000000002e-05 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23574 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 121.36978819399999, 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049457229999999998, 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23574 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950052+0000", 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950307+0000", 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255367 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950312+0000", 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.344e-06 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950326+0000", 2024-09-14T06:01:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230999999999999e-05 2024-09-14T06:01:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950335+0000", 2024-09-14T06:01:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-09-14T06:01:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999392+0000", 2024-09-14T06:01:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049056623000000001 2024-09-14T06:01:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999443+0000", 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0807999999999999e-05 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999509+0000", 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6235000000000005e-05 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23575 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 121.36948941199999, 2024-09-14T06:01:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049294233999999999, 2024-09-14T06:01:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23575 2024-09-14T06:01:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950350+0000", 2024-09-14T06:01:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950466+0000", 2024-09-14T06:01:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011547700000000001 2024-09-14T06:01:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950470+0000", 2024-09-14T06:01:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0470000000000004e-06 2024-09-14T06:01:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950481+0000", 2024-09-14T06:01:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1292e-05 2024-09-14T06:01:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950488+0000", 2024-09-14T06:01:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2139999999999999e-06 2024-09-14T06:01:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999545+0000", 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049057001000000003 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999592+0000", 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6405e-05 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999645+0000", 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2797999999999998e-05 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.378 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23576 3.14 3:2a1e765a:::rbd_data.1127ff8b71e0.000000000000000d:b [read 653312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.378 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:32.378 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 121.36933867400001, 2024-09-14T06:01:32.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.049251719999999999, 2024-09-14T06:01:32.378 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.378 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.378 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.378 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.378 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.378 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.378 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23576 2024-09-14T06:01:32.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.379 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:32.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.950501+0000", 2024-09-14T06:01:32.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951329+0000", 2024-09-14T06:01:32.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082820099999999998 2024-09-14T06:01:32.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951334+0000", 2024-09-14T06:01:32.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.045e-06 2024-09-14T06:01:32.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951344+0000", 2024-09-14T06:01:32.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0059e-05 2024-09-14T06:01:32.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.951354+0000", 2024-09-14T06:01:32.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6320000000000003e-06 2024-09-14T06:01:32.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999673+0000", 2024-09-14T06:01:32.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.048319260000000003 2024-09-14T06:01:32.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999713+0000", 2024-09-14T06:01:32.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9477999999999997e-05 2024-09-14T06:01:32.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:30.999753+0000", 2024-09-14T06:01:32.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0045e-05 2024-09-14T06:01:32.382 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.382 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.382 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.382 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4391.0:23746 3.1d e41/24 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head v 41'44, mlcod=41'41)", 2024-09-14T06:01:32.382 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:32.382 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 120.744037111, 2024-09-14T06:01:32.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058238039999999998, 2024-09-14T06:01:32.382 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.383 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.383 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:32.383 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:32.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575803+0000", 2024-09-14T06:01:32.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.575806+0000", 2024-09-14T06:01:32.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2040000000000002e-06 2024-09-14T06:01:32.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593550+0000", 2024-09-14T06:01:32.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017744561999999998 2024-09-14T06:01:32.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593592+0000", 2024-09-14T06:01:32.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1984999999999999e-05 2024-09-14T06:01:32.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593612+0000", 2024-09-14T06:01:32.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9678e-05 2024-09-14T06:01:32.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593704+0000", 2024-09-14T06:01:32.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1805000000000006e-05 2024-09-14T06:01:32.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.593730+0000", 2024-09-14T06:01:32.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6350999999999999e-05 2024-09-14T06:01:32.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:32.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634000+0000", 2024-09-14T06:01:32.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040269801000000001 2024-09-14T06:01:32.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634041+0000", 2024-09-14T06:01:32.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0654000000000001e-05 2024-09-14T06:01:32.386 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.387 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.387 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.387 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:24289 3.9 3:925e0db5:::rbd_data.11276864ec6c.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.387 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:32.387 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 120.220947172, 2024-09-14T06:01:32.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121294952, 2024-09-14T06:01:32.387 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.387 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.387 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:32.387 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.387 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.387 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.388 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 24289 2024-09-14T06:01:32.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.388 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:32.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098893+0000", 2024-09-14T06:01:32.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.098897+0000", 2024-09-14T06:01:32.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-09-14T06:01:32.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128142+0000", 2024-09-14T06:01:32.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.029245673999999999 2024-09-14T06:01:32.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128194+0000", 2024-09-14T06:01:32.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1298000000000003e-05 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128239+0000", 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5048e-05 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128463+0000", 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022393099999999999 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.128728+0000", 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026488899999999998 2024-09-14T06:01:32.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 2", 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.150933+0000", 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022205753000000002 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.219966+0000", 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.069033053999999996 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220068+0000", 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010145900000000001 2024-09-14T06:01:32.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:32.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220130+0000", 2024-09-14T06:01:32.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2278000000000002e-05 2024-09-14T06:01:32.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:32.220188+0000", 2024-09-14T06:01:32.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7475000000000001e-05 2024-09-14T06:01:32.392 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.392 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.392 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123243 3.f 3:f182c8b1:::rbd_data.112793b455a2.0000000000000008:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.904912709999998, 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9453718680000001, 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123243 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:32.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414927+0000", 2024-09-14T06:01:32.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414929+0000", 2024-09-14T06:01:32.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.761e-06 2024-09-14T06:01:32.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414935+0000", 2024-09-14T06:01:32.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1310000000000003e-06 2024-09-14T06:01:32.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414953+0000", 2024-09-14T06:01:32.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.806e-05 2024-09-14T06:01:32.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414962+0000", 2024-09-14T06:01:32.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8040000000000007e-06 2024-09-14T06:01:32.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.415129+0000", 2024-09-14T06:01:32.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016696699999999999 2024-09-14T06:01:32.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:32.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.415160+0000", 2024-09-14T06:01:32.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1361e-05 2024-09-14T06:01:32.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.306423+0000", 2024-09-14T06:01:32.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.89126284499999997 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.306458+0000", 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4864999999999999e-05 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.356709+0000", 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0502506730000001 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357372+0000", 2024-09-14T06:01:32.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00066291500000000003 2024-09-14T06:01:32.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-09-14T06:01:32.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357702+0000", 2024-09-14T06:01:32.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00033040400000000002 2024-09-14T06:01:32.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:32.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359330+0000", 2024-09-14T06:01:32.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001628004 2024-09-14T06:01:32.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:32.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359899+0000", 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00056937000000000003 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360016+0000", 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116688 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360299+0000", 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028301999999999998 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.400 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123246 3.e 3:757f91a9:::rbd_data.112793b455a2.000000000000000b:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:32.400 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:32.400 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.902420110000001, 2024-09-14T06:01:32.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.971537646, 2024-09-14T06:01:32.400 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.400 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.400 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:32.400 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.400 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.400 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.400 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123246 2024-09-14T06:01:32.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.400 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:32.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417420+0000", 2024-09-14T06:01:32.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417422+0000", 2024-09-14T06:01:32.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3029999999999998e-06 2024-09-14T06:01:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417433+0000", 2024-09-14T06:01:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1333e-05 2024-09-14T06:01:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417496+0000", 2024-09-14T06:01:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2856999999999998e-05 2024-09-14T06:01:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417521+0000", 2024-09-14T06:01:32.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5041999999999998e-05 2024-09-14T06:01:32.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417631+0000", 2024-09-14T06:01:32.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010957 2024-09-14T06:01:32.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:32.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417641+0000", 2024-09-14T06:01:32.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0655999999999999e-05 2024-09-14T06:01:32.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301111+0000", 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.883469175 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301143+0000", 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1998000000000001e-05 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385119+0000", 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0839765729999999 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385594+0000", 2024-09-14T06:01:32.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000475014 2024-09-14T06:01:32.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:32.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385905+0000", 2024-09-14T06:01:32.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031112300000000001 2024-09-14T06:01:32.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:32.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388402+0000", 2024-09-14T06:01:32.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024969110000000001 2024-09-14T06:01:32.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:32.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388492+0000", 2024-09-14T06:01:32.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9740000000000005e-05 2024-09-14T06:01:32.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:32.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388646+0000", 2024-09-14T06:01:32.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153788 2024-09-14T06:01:32.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388957+0000", 2024-09-14T06:01:32.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000311563 2024-09-14T06:01:32.407 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.407 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.407 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.407 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123247 3.e 3:71933c91:::rbd_data.112793b455a2.000000000000000c:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:32.407 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:32.407 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.902241068999999, 2024-09-14T06:01:32.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9716223099999999, 2024-09-14T06:01:32.407 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.407 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.407 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:32.408 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.408 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.408 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.408 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123247 2024-09-14T06:01:32.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.408 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:32.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417599+0000", 2024-09-14T06:01:32.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417601+0000", 2024-09-14T06:01:32.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.857e-06 2024-09-14T06:01:32.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417613+0000", 2024-09-14T06:01:32.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2041999999999999e-05 2024-09-14T06:01:32.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417636+0000", 2024-09-14T06:01:32.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3071999999999999e-05 2024-09-14T06:01:32.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417652+0000", 2024-09-14T06:01:32.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6512999999999999e-05 2024-09-14T06:01:32.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417722+0000", 2024-09-14T06:01:32.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0201000000000001e-05 2024-09-14T06:01:32.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.417729+0000", 2024-09-14T06:01:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4420000000000003e-06 2024-09-14T06:01:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301770+0000", 2024-09-14T06:01:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88404090999999996 2024-09-14T06:01:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.301798+0000", 2024-09-14T06:01:32.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8619000000000002e-05 2024-09-14T06:01:32.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387130+0000", 2024-09-14T06:01:32.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0853317760000001 2024-09-14T06:01:32.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387314+0000", 2024-09-14T06:01:32.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018428699999999999 2024-09-14T06:01:32.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.387786+0000", 2024-09-14T06:01:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047110000000000001 2024-09-14T06:01:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388983+0000", 2024-09-14T06:01:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011978640000000001 2024-09-14T06:01:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389032+0000", 2024-09-14T06:01:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8349000000000001e-05 2024-09-14T06:01:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:32.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389082+0000", 2024-09-14T06:01:32.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0291999999999999e-05 2024-09-14T06:01:32.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.389221+0000", 2024-09-14T06:01:32.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013898599999999999 2024-09-14T06:01:32.414 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.414 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.414 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.414 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:125590 3.e 3:7269be12:::rbd_data.1127d65075f9.000000000000003f:head [delete] snapc c=[] ondisk+write+known_if_redirected+supports_pool_eio e140)", 2024-09-14T06:01:32.415 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:23.439474+0000", 2024-09-14T06:01:32.415 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8803659459999995, 2024-09-14T06:01:32.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88744142599999998, 2024-09-14T06:01:32.415 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.415 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.415 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:32.415 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.415 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.415 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.415 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 125590 2024-09-14T06:01:32.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.415 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439474+0000", 2024-09-14T06:01:32.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439474+0000", 2024-09-14T06:01:32.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439475+0000", 2024-09-14T06:01:32.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.195e-06 2024-09-14T06:01:32.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439481+0000", 2024-09-14T06:01:32.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7209999999999999e-06 2024-09-14T06:01:32.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439499+0000", 2024-09-14T06:01:32.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7819999999999999e-05 2024-09-14T06:01:32.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439508+0000", 2024-09-14T06:01:32.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9760000000000001e-06 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439588+0000", 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0024999999999994e-05 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.439599+0000", 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1066e-05 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.320613+0000", 2024-09-14T06:01:32.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88101414300000003 2024-09-14T06:01:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.320975+0000", 2024-09-14T06:01:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036199700000000002 2024-09-14T06:01:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 7", 2024-09-14T06:01:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.321284+0000", 2024-09-14T06:01:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030910200000000001 2024-09-14T06:01:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:32.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.325139+0000", 2024-09-14T06:01:32.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038546600000000002 2024-09-14T06:01:32.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:32.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.326794+0000", 2024-09-14T06:01:32.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016557970000000001 2024-09-14T06:01:32.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:32.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.326868+0000", 2024-09-14T06:01:32.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.381e-05 2024-09-14T06:01:32.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.326915+0000", 2024-09-14T06:01:32.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7114000000000003e-05 2024-09-14T06:01:32.421 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.421 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.421 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.421 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:125601 3.e 3:756a4815:::rbd_data.1127d65075f9.000000000000007b:head [delete] snapc c=[] ondisk+write+known_if_redirected+supports_pool_eio e140)", 2024-09-14T06:01:32.421 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:23.441355+0000", 2024-09-14T06:01:32.421 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.8784845560000001, 2024-09-14T06:01:32.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88632629699999999, 2024-09-14T06:01:32.421 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.421 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.421 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 125601 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441355+0000", 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441355+0000", 2024-09-14T06:01:32.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441356+0000", 2024-09-14T06:01:32.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5600000000000004e-07 2024-09-14T06:01:32.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441366+0000", 2024-09-14T06:01:32.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6430000000000007e-06 2024-09-14T06:01:32.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441385+0000", 2024-09-14T06:01:32.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9188e-05 2024-09-14T06:01:32.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441395+0000", 2024-09-14T06:01:32.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8810000000000008e-06 2024-09-14T06:01:32.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441483+0000", 2024-09-14T06:01:32.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7807999999999997e-05 2024-09-14T06:01:32.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:32.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:23.441498+0000", 2024-09-14T06:01:32.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5489e-05 2024-09-14T06:01:32.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.323574+0000", 2024-09-14T06:01:32.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88207560500000004 2024-09-14T06:01:32.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.323909+0000", 2024-09-14T06:01:32.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000335371 2024-09-14T06:01:32.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 7", 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.324224+0000", 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031446099999999998 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.325701+0000", 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001477648 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.327487+0000", 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001785909 2024-09-14T06:01:32.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:32.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.327576+0000", 2024-09-14T06:01:32.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9240000000000006e-05 2024-09-14T06:01:32.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:24.327682+0000", 2024-09-14T06:01:32.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105198 2024-09-14T06:01:32.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.427 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.428 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.428 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:32.428 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T06:01:32.429 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:01:32.430 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:32.424+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:32.530 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:32.524+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:32.603 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:32.603 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:32.603 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:32.603 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:32.617 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:01:32.658 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T06:01:32.656+0000 7f4f5013d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26549) UID: 0 2024-09-14T06:01:32.732 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:32.728+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:32.783 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:32.784 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:32.797 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:01:32.833 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:32.828+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:32.926 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:32.926 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:32.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:32.926 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:32.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.926 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:32.926 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:32.926 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 121.376415315, 2024-09-14T06:01:32.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:01:32.926 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.926 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.926 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:32.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:01:32.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:01:32.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:01:32.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:01:32.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:01:32.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:01:32.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:01:32.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:01:32.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:01:32.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:01:32.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:32.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:01:32.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:01:32.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:32.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:01:32.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:01:32.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:01:32.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:01:32.931 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.932 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.932 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.932 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:32.932 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:32.932 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.40101842999999, 2024-09-14T06:01:32.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:01:32.932 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.932 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.932 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.932 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.932 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.932 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.933 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:01:32.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.933 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:32.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:32.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:01:32.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:01:32.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:01:32.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:01:32.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:01:32.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:01:32.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:01:32.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:01:32.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:01:32.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:01:32.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:01:32.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:01:32.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:01:32.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:01:32.936 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.936 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.936 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.936 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:32.936 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:32.936 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.400980107, 2024-09-14T06:01:32.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:01:32.937 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.937 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.937 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.937 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.937 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.937 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.937 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:01:32.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.937 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:32.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:32.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:01:32.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:01:32.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:01:32.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:01:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:01:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:01:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:01:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:01:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:01:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:01:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:01:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:01:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:01:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:01:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.940 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.400953415, 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.941 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:32.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:32.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:01:32.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:01:32.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:01:32.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:01:32.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:01:32.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:01:32.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:01:32.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:01:32.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:01:32.945 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.945 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.945 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.945 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:32.945 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:32.945 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.400927549, 2024-09-14T06:01:32.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:01:32.945 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.945 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.945 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:32.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:01:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:01:32.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:01:32.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:01:32.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:01:32.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:01:32.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:01:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:01:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:01:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:01:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:32.949 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.39982718, 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:32.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:01:32.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:01:32.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:01:32.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:01:32.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:01:32.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:01:32.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:01:32.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:01:32.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:01:32.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:01:32.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:01:32.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:01:32.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:01:32.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:01:32.953 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.953 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.39978320100001, 2024-09-14T06:01:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:01:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.954 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:01:32.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.955 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:32.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:32.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:01:32.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:01:32.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:01:32.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:01:32.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:01:32.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:01:32.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:01:32.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:01:32.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:01:32.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:01:32.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:01:32.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:01:32.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:01:32.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:01:32.958 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.958 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.958 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.958 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:32.958 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:32.958 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 108.39872144100001, 2024-09-14T06:01:32.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:01:32.958 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:01:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:01:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:01:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:01:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:01:32.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:01:32.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:01:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:01:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:01:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:01:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119203 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5881856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.857348410999997, 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084813824999999995, 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119203 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065503+0000", 2024-09-14T06:01:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.054e-06 2024-09-14T06:01:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065509+0000", 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9939999999999997e-06 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065528+0000", 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8736000000000002e-05 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065540+0000", 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2427e-05 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.149851+0000", 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084310806000000002 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150073+0000", 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022202999999999999 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150316+0000", 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000242778 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.966 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119204 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5931008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.857292903999998, 2024-09-14T06:01:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085122164, 2024-09-14T06:01:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.967 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119204 2024-09-14T06:01:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065559+0000", 2024-09-14T06:01:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.068e-06 2024-09-14T06:01:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065564+0000", 2024-09-14T06:01:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1089999999999997e-06 2024-09-14T06:01:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065580+0000", 2024-09-14T06:01:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6438000000000001e-05 2024-09-14T06:01:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065592+0000", 2024-09-14T06:01:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1739000000000001e-05 2024-09-14T06:01:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150396+0000", 2024-09-14T06:01:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084803859999999995 2024-09-14T06:01:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150524+0000", 2024-09-14T06:01:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012805600000000001 2024-09-14T06:01:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150680+0000", 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015589400000000001 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119205 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5980160~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.857197028999998, 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085597655999999994, 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.971 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119205 2024-09-14T06:01:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065656+0000", 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9829999999999999e-06 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065661+0000", 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9510000000000003e-06 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065680+0000", 2024-09-14T06:01:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8947e-05 2024-09-14T06:01:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065694+0000", 2024-09-14T06:01:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3433e-05 2024-09-14T06:01:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150778+0000", 2024-09-14T06:01:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085083856999999999 2024-09-14T06:01:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151007+0000", 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022914499999999999 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151251+0000", 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024434000000000001 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119206 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6029312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:32.975 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.857135599999999, 2024-09-14T06:01:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086002258999999998, 2024-09-14T06:01:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119206 2024-09-14T06:01:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065716+0000", 2024-09-14T06:01:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230000000000001e-06 2024-09-14T06:01:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065722+0000", 2024-09-14T06:01:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5219999999999998e-06 2024-09-14T06:01:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065739+0000", 2024-09-14T06:01:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7122e-05 2024-09-14T06:01:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065752+0000", 2024-09-14T06:01:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2639e-05 2024-09-14T06:01:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151384+0000", 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085632514000000007 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151532+0000", 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000147761 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151717+0000", 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018537800000000001 2024-09-14T06:01:32.979 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119207 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6078464~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.857082255000002, 2024-09-14T06:01:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086515080999999994, 2024-09-14T06:01:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.980 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119207 2024-09-14T06:01:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065770+0000", 2024-09-14T06:01:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5770000000000001e-06 2024-09-14T06:01:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065775+0000", 2024-09-14T06:01:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1930000000000001e-06 2024-09-14T06:01:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065791+0000", 2024-09-14T06:01:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6351e-05 2024-09-14T06:01:32.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065804+0000", 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.259e-05 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151820+0000", 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086016398999999993 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152043+0000", 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022236200000000001 2024-09-14T06:01:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152283+0000", 2024-09-14T06:01:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000240609 2024-09-14T06:01:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119208 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.857029756999999, 2024-09-14T06:01:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086932403000000005, 2024-09-14T06:01:32.984 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119208 2024-09-14T06:01:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065822+0000", 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.032e-06 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065827+0000", 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5790000000000003e-06 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065843+0000", 2024-09-14T06:01:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5801999999999999e-05 2024-09-14T06:01:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065856+0000", 2024-09-14T06:01:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2267e-05 2024-09-14T06:01:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152416+0000", 2024-09-14T06:01:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086560893999999999 2024-09-14T06:01:32.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152568+0000", 2024-09-14T06:01:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151664 2024-09-14T06:01:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152753+0000", 2024-09-14T06:01:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018516499999999999 2024-09-14T06:01:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119209 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6176768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.856977886999999, 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087450828999999994, 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119209 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065874+0000", 2024-09-14T06:01:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.097e-06 2024-09-14T06:01:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065879+0000", 2024-09-14T06:01:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.254e-06 2024-09-14T06:01:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065895+0000", 2024-09-14T06:01:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6373000000000001e-05 2024-09-14T06:01:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065908+0000", 2024-09-14T06:01:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2656e-05 2024-09-14T06:01:32.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152854+0000", 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086946078999999996 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153080+0000", 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022582200000000001 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153324+0000", 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024354800000000001 2024-09-14T06:01:32.992 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119210 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6225920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.856925959999998, 2024-09-14T06:01:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087773166, 2024-09-14T06:01:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.993 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119210 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065926+0000", 2024-09-14T06:01:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3799999999999999e-06 2024-09-14T06:01:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065931+0000", 2024-09-14T06:01:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9629999999999997e-06 2024-09-14T06:01:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065950+0000", 2024-09-14T06:01:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9369999999999999e-05 2024-09-14T06:01:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065963+0000", 2024-09-14T06:01:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2164000000000001e-05 2024-09-14T06:01:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153404+0000", 2024-09-14T06:01:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087441840000000007 2024-09-14T06:01:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153537+0000", 2024-09-14T06:01:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013305500000000001 2024-09-14T06:01:32.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153698+0000", 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016039400000000001 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119211 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6275072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.856870192999999, 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088244734000000005, 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:32.997 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119211 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:32.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065981+0000", 2024-09-14T06:01:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.012e-06 2024-09-14T06:01:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065987+0000", 2024-09-14T06:01:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5450000000000003e-06 2024-09-14T06:01:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.066003+0000", 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6198999999999999e-05 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.066016+0000", 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2595999999999999e-05 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153758+0000", 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087742610999999998 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153983+0000", 2024-09-14T06:01:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000224336 2024-09-14T06:01:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.154225+0000", 2024-09-14T06:01:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024243499999999999 2024-09-14T06:01:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123236 3.16 3:6f8987ed:::rbd_data.112793b455a2.0000000000000001:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:33.001 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.508029452000002, 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.973924129, 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123236 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:33.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414823+0000", 2024-09-14T06:01:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0930000000000001e-06 2024-09-14T06:01:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414830+0000", 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414848+0000", 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8029e-05 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414859+0000", 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0934000000000001e-05 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414952+0000", 2024-09-14T06:01:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3140999999999995e-05 2024-09-14T06:01:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414964+0000", 2024-09-14T06:01:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1802e-05 2024-09-14T06:01:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297044+0000", 2024-09-14T06:01:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88207986500000002 2024-09-14T06:01:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297073+0000", 2024-09-14T06:01:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9178000000000001e-05 2024-09-14T06:01:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385889+0000", 2024-09-14T06:01:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0888154130000001 2024-09-14T06:01:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.386144+0000", 2024-09-14T06:01:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255064 2024-09-14T06:01:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.386344+0000", 2024-09-14T06:01:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020039100000000001 2024-09-14T06:01:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388411+0000", 2024-09-14T06:01:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020668029999999999 2024-09-14T06:01:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388490+0000", 2024-09-14T06:01:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9237e-05 2024-09-14T06:01:33.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388589+0000", 2024-09-14T06:01:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9254999999999998e-05 2024-09-14T06:01:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388745+0000", 2024-09-14T06:01:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015581899999999999 2024-09-14T06:01:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123238 3.7 3:e6b46603:::rbd_data.112793b455a2.0000000000000003:head [delete] snapc 19=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-14T06:01:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.631091697999999, 2024-09-14T06:01:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0714216679999999, 2024-09-14T06:01:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.009 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123238 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291762+0000", 2024-09-14T06:01:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.467e-06 2024-09-14T06:01:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291777+0000", 2024-09-14T06:01:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4664999999999999e-05 2024-09-14T06:01:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291833+0000", 2024-09-14T06:01:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5498000000000003e-05 2024-09-14T06:01:33.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291861+0000", 2024-09-14T06:01:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8161999999999999e-05 2024-09-14T06:01:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292150+0000", 2024-09-14T06:01:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028918900000000003 2024-09-14T06:01:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-14T06:01:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292171+0000", 2024-09-14T06:01:33.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0936000000000001e-05 2024-09-14T06:01:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297607+0000", 2024-09-14T06:01:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054358139999999998 2024-09-14T06:01:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297630+0000", 2024-09-14T06:01:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3209000000000001e-05 2024-09-14T06:01:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357360+0000", 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0597304700000001 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357737+0000", 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037695399999999998 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0,3", 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.358085+0000", 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034785099999999999 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:33.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361195+0000", 2024-09-14T06:01:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003110163 2024-09-14T06:01:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361362+0000", 2024-09-14T06:01:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167112 2024-09-14T06:01:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.362887+0000", 2024-09-14T06:01:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015243419999999999 2024-09-14T06:01:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.362987+0000", 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100333 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.363181+0000", 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019350300000000001 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123244 3.7 3:e141330b:::rbd_data.112793b455a2.0000000000000009:head [delete] snapc 19=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-14T06:01:33.016 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.630925118999997, 2024-09-14T06:01:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.072328908, 2024-09-14T06:01:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123244 2024-09-14T06:01:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291927+0000", 2024-09-14T06:01:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5460000000000001e-06 2024-09-14T06:01:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291934+0000", 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3599999999999998e-06 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291956+0000", 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1469000000000001e-05 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291972+0000", 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5773e-05 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292362+0000", 2024-09-14T06:01:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00038989100000000001 2024-09-14T06:01:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-09-14T06:01:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292379+0000", 2024-09-14T06:01:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7186000000000001e-05 2024-09-14T06:01:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297840+0000", 2024-09-14T06:01:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054614260000000001 2024-09-14T06:01:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297860+0000", 2024-09-14T06:01:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9782000000000001e-05 2024-09-14T06:01:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359785+0000", 2024-09-14T06:01:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.061924665 2024-09-14T06:01:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360080+0000", 2024-09-14T06:01:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029538399999999999 2024-09-14T06:01:33.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0,3", 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360382+0000", 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030214 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361612+0000", 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001229808 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.363256+0000", 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001644162 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364059+0000", 2024-09-14T06:01:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080328599999999995 2024-09-14T06:01:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364105+0000", 2024-09-14T06:01:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5695999999999998e-05 2024-09-14T06:01:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364254+0000", 2024-09-14T06:01:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014933399999999999 2024-09-14T06:01:33.023 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.024 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.024 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:33.025 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:01:33.026 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:33.024+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:33.126 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:33.124+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:33.193 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:33.193 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:33.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:01:33.254 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:33.252+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is set 2024-09-14T06:01:33.328 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:33.324+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:33.330 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:33.330 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:33.330 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:33.330 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:33.330 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:33.348 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:01:33.429 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:33.424+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:33.515 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:33.515 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:33.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:33.516 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:33.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.516 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59148 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 419840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.516 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:01:33.516 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.244509946999997, 2024-09-14T06:01:33.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072974285999999999, 2024-09-14T06:01:33.516 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.516 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.516 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.517 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59148 2024-09-14T06:01:33.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.517 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:01:33.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:01:33.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268521+0000", 2024-09-14T06:01:33.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4199999999999995e-07 2024-09-14T06:01:33.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268524+0000", 2024-09-14T06:01:33.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.05e-06 2024-09-14T06:01:33.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268534+0000", 2024-09-14T06:01:33.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8719999999999997e-06 2024-09-14T06:01:33.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268541+0000", 2024-09-14T06:01:33.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5349999999999999e-06 2024-09-14T06:01:33.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341108+0000", 2024-09-14T06:01:33.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072566624999999996 2024-09-14T06:01:33.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341169+0000", 2024-09-14T06:01:33.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1251e-05 2024-09-14T06:01:33.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341494+0000", 2024-09-14T06:01:33.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325311 2024-09-14T06:01:33.520 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.520 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59149 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 436224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:01:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.244470723000006, 2024-09-14T06:01:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073405053999999997, 2024-09-14T06:01:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.521 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59149 2024-09-14T06:01:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:01:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:01:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268560+0000", 2024-09-14T06:01:33.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9999999999999997e-07 2024-09-14T06:01:33.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268563+0000", 2024-09-14T06:01:33.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.292e-06 2024-09-14T06:01:33.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268573+0000", 2024-09-14T06:01:33.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3260000000000002e-06 2024-09-14T06:01:33.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268581+0000", 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1960000000000008e-06 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341537+0000", 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072955916999999995 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341641+0000", 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104341 2024-09-14T06:01:33.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341964+0000", 2024-09-14T06:01:33.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032328199999999999 2024-09-14T06:01:33.525 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.525 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.525 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.525 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59150 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 452608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.525 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:33.525 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.244437482999999, 2024-09-14T06:01:33.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073829748000000001, 2024-09-14T06:01:33.525 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59150 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0399999999999995e-07 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268596+0000", 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9859999999999999e-06 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268606+0000", 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0088000000000001e-05 2024-09-14T06:01:33.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268614+0000", 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341999+0000", 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073385011999999999 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342093+0000", 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3793000000000001e-05 2024-09-14T06:01:33.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342422+0000", 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000329129 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59151 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.244405115000006, 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074207289999999995, 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.529 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59151 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:01:33.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268626+0000", 2024-09-14T06:01:33.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T06:01:33.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268629+0000", 2024-09-14T06:01:33.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.038e-06 2024-09-14T06:01:33.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268638+0000", 2024-09-14T06:01:33.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8139999999999995e-06 2024-09-14T06:01:33.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268647+0000", 2024-09-14T06:01:33.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4889999999999995e-06 2024-09-14T06:01:33.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342457+0000", 2024-09-14T06:01:33.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073809890000000003 2024-09-14T06:01:33.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342545+0000", 2024-09-14T06:01:33.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8697999999999997e-05 2024-09-14T06:01:33.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342832+0000", 2024-09-14T06:01:33.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028681799999999999 2024-09-14T06:01:33.533 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59152 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.244372474000002, 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074695176000000002, 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.534 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59152 2024-09-14T06:01:33.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.535 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:33.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:33.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2900000000000003e-07 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268661+0000", 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0230000000000001e-06 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268670+0000", 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2129999999999997e-06 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268679+0000", 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342937+0000", 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074258781999999995 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343044+0000", 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343353+0000", 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030911099999999999 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59153 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 501760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.244339703999998, 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074997241000000006, 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.538 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.539 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.539 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59153 2024-09-14T06:01:33.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.539 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:01:33.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:01:33.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268691+0000", 2024-09-14T06:01:33.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:01:33.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268693+0000", 2024-09-14T06:01:33.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3599999999999999e-06 2024-09-14T06:01:33.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268699+0000", 2024-09-14T06:01:33.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-09-14T06:01:33.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268704+0000", 2024-09-14T06:01:33.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5759999999999999e-06 2024-09-14T06:01:33.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343398+0000", 2024-09-14T06:01:33.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074694522999999999 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343450+0000", 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1350999999999997e-05 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343688+0000", 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023806500000000001 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.543 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59154 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 518144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.543 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:01:33.543 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.244320638000005, 2024-09-14T06:01:33.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075389938000000004, 2024-09-14T06:01:33.543 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.543 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.543 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.543 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.543 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.543 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.543 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59154 2024-09-14T06:01:33.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.543 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:01:33.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:01:33.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268710+0000", 2024-09-14T06:01:33.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8000000000000001e-07 2024-09-14T06:01:33.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268712+0000", 2024-09-14T06:01:33.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T06:01:33.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268717+0000", 2024-09-14T06:01:33.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8570000000000003e-06 2024-09-14T06:01:33.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268721+0000", 2024-09-14T06:01:33.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2039999999999999e-06 2024-09-14T06:01:33.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343721+0000", 2024-09-14T06:01:33.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074999748000000005 2024-09-14T06:01:33.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343784+0000", 2024-09-14T06:01:33.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3174000000000002e-05 2024-09-14T06:01:33.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.344099+0000", 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000315299 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59398 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 323584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.233356389999997, 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073326565999999996, 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.547 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59398 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:01:33.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279675+0000", 2024-09-14T06:01:33.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-14T06:01:33.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279681+0000", 2024-09-14T06:01:33.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-09-14T06:01:33.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279702+0000", 2024-09-14T06:01:33.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1259000000000001e-05 2024-09-14T06:01:33.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279718+0000", 2024-09-14T06:01:33.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5475999999999999e-05 2024-09-14T06:01:33.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352360+0000", 2024-09-14T06:01:33.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.07264226 2024-09-14T06:01:33.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352447+0000", 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7381999999999998e-05 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353000+0000", 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055309200000000004 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.551 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59399 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.552 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:01:33.552 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.233292027000005, 2024-09-14T06:01:33.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073824446000000002, 2024-09-14T06:01:33.552 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.552 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.552 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.552 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.552 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.552 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.552 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59399 2024-09-14T06:01:33.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.552 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:01:33.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:01:33.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279739+0000", 2024-09-14T06:01:33.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T06:01:33.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279745+0000", 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279767+0000", 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639000000000001e-05 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279781+0000", 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4511999999999999e-05 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353045+0000", 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073263718000000005 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353168+0000", 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012314499999999999 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353562+0000", 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039435199999999999 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.555 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.556 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.556 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59400 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.556 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:01:33.556 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.233228267000001, 2024-09-14T06:01:33.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074271465999999994, 2024-09-14T06:01:33.556 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.556 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.556 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.556 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.556 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.556 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.556 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59400 2024-09-14T06:01:33.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.557 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:01:33.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:01:33.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279803+0000", 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2100000000000001e-06 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279819+0000", 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6409000000000002e-05 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279841+0000", 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1878e-05 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279856+0000", 2024-09-14T06:01:33.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4392999999999999e-05 2024-09-14T06:01:33.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353650+0000", 2024-09-14T06:01:33.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073794144000000006 2024-09-14T06:01:33.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353757+0000", 2024-09-14T06:01:33.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010687 2024-09-14T06:01:33.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354073+0000", 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000316562 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59401 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 372736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.233153442000003, 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074643900999999999, 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.560 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59401 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279878+0000", 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.31e-06 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279883+0000", 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3770000000000004e-06 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279906+0000", 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2398000000000001e-05 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279920+0000", 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.402e-05 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354125+0000", 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074205750000000001 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354227+0000", 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101612 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354521+0000", 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029343400000000002 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59402 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 389120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.233091858999998, 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075017027999999999, 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59402 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279939+0000", 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2470000000000001e-06 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279945+0000", 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279966+0000", 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1801999999999999e-05 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279980+0000", 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3589e-05 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354569+0000", 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074588707000000004 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354671+0000", 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102398 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354955+0000", 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028406500000000001 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59403 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 405504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.233030072000005, 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075434395000000001, 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.568 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.569 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.569 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.569 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59403 2024-09-14T06:01:33.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.569 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:01:33.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280001+0000", 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2669999999999999e-06 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280008+0000", 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5849999999999996e-06 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280030+0000", 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2293000000000002e-05 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280044+0000", 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3974999999999999e-05 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355013+0000", 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074969039000000001 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355144+0000", 2024-09-14T06:01:33.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000131333 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355434+0000", 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028990299999999999 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59404 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.232964953000007, 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075696103000000001, 2024-09-14T06:01:33.572 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.573 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.573 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.573 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.573 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.573 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.573 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59404 2024-09-14T06:01:33.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.573 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:01:33.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280066+0000", 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2640000000000001e-06 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280072+0000", 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129999999999997e-06 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280094+0000", 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2608000000000001e-05 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280109+0000", 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355479+0000", 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075370699999999999 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355554+0000", 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4674999999999999e-05 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355761+0000", 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59405 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.576 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.232901042999998, 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076008867999999993, 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59405 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:01:33.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280130+0000", 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2500000000000001e-06 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280136+0000", 2024-09-14T06:01:33.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280158+0000", 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1795000000000001e-05 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280172+0000", 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4303e-05 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355797+0000", 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075624835000000001 2024-09-14T06:01:33.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355866+0000", 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9043999999999998e-05 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356138+0000", 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027207799999999998 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.580 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59406 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.232837101000001, 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076435642999999998, 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59406 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:01:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:01:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280194+0000", 2024-09-14T06:01:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-14T06:01:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280200+0000", 2024-09-14T06:01:33.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6359999999999999e-06 2024-09-14T06:01:33.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280222+0000", 2024-09-14T06:01:33.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1628999999999999e-05 2024-09-14T06:01:33.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280236+0000", 2024-09-14T06:01:33.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4413000000000001e-05 2024-09-14T06:01:33.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356172+0000", 2024-09-14T06:01:33.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075936466999999994 2024-09-14T06:01:33.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356260+0000", 2024-09-14T06:01:33.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7437999999999999e-05 2024-09-14T06:01:33.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356629+0000", 2024-09-14T06:01:33.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036877600000000002 2024-09-14T06:01:33.584 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59407 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 471040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:01:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.232772867999998, 2024-09-14T06:01:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076820083999999997, 2024-09-14T06:01:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.585 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.586 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59407 2024-09-14T06:01:33.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.586 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:01:33.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:01:33.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280258+0000", 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1370000000000001e-06 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280264+0000", 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6930000000000004e-06 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280285+0000", 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1455999999999999e-05 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280300+0000", 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4319e-05 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356676+0000", 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076376615999999994 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356768+0000", 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1234000000000001e-05 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357077+0000", 2024-09-14T06:01:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030962900000000001 2024-09-14T06:01:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59408 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 487424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:01:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.232707868000006, 2024-09-14T06:01:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077185511999999998, 2024-09-14T06:01:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.590 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.590 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.590 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.590 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.590 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59408 2024-09-14T06:01:33.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.590 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:01:33.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:01:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280323+0000", 2024-09-14T06:01:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2860000000000001e-06 2024-09-14T06:01:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280329+0000", 2024-09-14T06:01:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.553e-06 2024-09-14T06:01:33.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280352+0000", 2024-09-14T06:01:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-14T06:01:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280366+0000", 2024-09-14T06:01:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-14T06:01:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357126+0000", 2024-09-14T06:01:33.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076760326000000004 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357223+0000", 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6490000000000006e-05 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357508+0000", 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028479900000000002 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.593 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59409 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.232643637999999, 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077536090000000002, 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59409 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280388+0000", 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.096e-06 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280393+0000", 2024-09-14T06:01:33.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T06:01:33.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280414+0000", 2024-09-14T06:01:33.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1175999999999999e-05 2024-09-14T06:01:33.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280427+0000", 2024-09-14T06:01:33.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3032e-05 2024-09-14T06:01:33.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357553+0000", 2024-09-14T06:01:33.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077125845999999998 2024-09-14T06:01:33.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357624+0000", 2024-09-14T06:01:33.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1062000000000005e-05 2024-09-14T06:01:33.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357923+0000", 2024-09-14T06:01:33.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029891199999999997 2024-09-14T06:01:33.597 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59410 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 98.232584325999994, 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077854494999999996, 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:33.598 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59410 2024-09-14T06:01:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:01:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:01:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280447+0000", 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069999999999999e-06 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280453+0000", 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-06 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280471+0000", 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8295999999999999e-05 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:33.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280484+0000", 2024-09-14T06:01:33.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2609000000000001e-05 2024-09-14T06:01:33.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:33.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357954+0000", 2024-09-14T06:01:33.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077470405000000006 2024-09-14T06:01:33.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:33.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358040+0000", 2024-09-14T06:01:33.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.551e-05 2024-09-14T06:01:33.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:33.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:33.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:33.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358300+0000", 2024-09-14T06:01:33.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026036800000000003 2024-09-14T06:01:33.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.602 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:33.602 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:33.602 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:33.603 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:01:33.604 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:33.600+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:33.704 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:33.704+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:33.772 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:33.772 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:33.772 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:33.772 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:33.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:01:33.834 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:33.832+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:33.906 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:33.900+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:33.909 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:33.910 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:33.910 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:33.910 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:33.910 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:33.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:01:34.007 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:34.004+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:34.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T06:01:34.092 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114753 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1564672~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:01:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.732405587999999, 2024-09-14T06:01:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111972162, 2024-09-14T06:01:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114753 2024-09-14T06:01:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:01:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:01:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:01:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6599999999999996e-07 2024-09-14T06:01:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357678+0000", 2024-09-14T06:01:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.807e-06 2024-09-14T06:01:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357683+0000", 2024-09-14T06:01:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.933e-06 2024-09-14T06:01:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357687+0000", 2024-09-14T06:01:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8469999999999998e-06 2024-09-14T06:01:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468941+0000", 2024-09-14T06:01:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111254009 2024-09-14T06:01:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469159+0000", 2024-09-14T06:01:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021768800000000001 2024-09-14T06:01:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469648+0000", 2024-09-14T06:01:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048931199999999999 2024-09-14T06:01:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114754 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1671168~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:01:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.732365915000003, 2024-09-14T06:01:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.112607016, 2024-09-14T06:01:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114754 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357716+0000", 2024-09-14T06:01:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-14T06:01:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357718+0000", 2024-09-14T06:01:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5910000000000001e-06 2024-09-14T06:01:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357725+0000", 2024-09-14T06:01:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9399999999999996e-06 2024-09-14T06:01:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357729+0000", 2024-09-14T06:01:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0439999999999997e-06 2024-09-14T06:01:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469752+0000", 2024-09-14T06:01:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11202385400000001 2024-09-14T06:01:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469889+0000", 2024-09-14T06:01:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136704 2024-09-14T06:01:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470322+0000", 2024-09-14T06:01:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000433337 2024-09-14T06:01:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114771 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 98304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:01:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.732324808000001, 2024-09-14T06:01:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11267808, 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114771 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:01:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:01:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.37e-07 2024-09-14T06:01:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357759+0000", 2024-09-14T06:01:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5650000000000001e-06 2024-09-14T06:01:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357764+0000", 2024-09-14T06:01:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T06:01:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357768+0000", 2024-09-14T06:01:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9580000000000001e-06 2024-09-14T06:01:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469739+0000", 2024-09-14T06:01:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111971591 2024-09-14T06:01:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469951+0000", 2024-09-14T06:01:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021185999999999999 2024-09-14T06:01:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470435+0000", 2024-09-14T06:01:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048335499999999998 2024-09-14T06:01:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114772 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:01:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.732284591999999, 2024-09-14T06:01:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11329244500000001, 2024-09-14T06:01:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114772 2024-09-14T06:01:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:01:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:01:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:01:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3099999999999998e-07 2024-09-14T06:01:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357799+0000", 2024-09-14T06:01:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0770000000000002e-06 2024-09-14T06:01:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357805+0000", 2024-09-14T06:01:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3329999999999996e-06 2024-09-14T06:01:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357816+0000", 2024-09-14T06:01:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0869999999999999e-05 2024-09-14T06:01:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470507+0000", 2024-09-14T06:01:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.112691635 2024-09-14T06:01:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470648+0000", 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014075000000000001 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471089+0000", 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000441249 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114773 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 311296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:01:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.732239045999997, 2024-09-14T06:01:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114111303, 2024-09-14T06:01:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114773 2024-09-14T06:01:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:01:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:01:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357843+0000", 2024-09-14T06:01:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4499999999999997e-07 2024-09-14T06:01:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357844+0000", 2024-09-14T06:01:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.612e-06 2024-09-14T06:01:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357851+0000", 2024-09-14T06:01:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7900000000000002e-06 2024-09-14T06:01:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357855+0000", 2024-09-14T06:01:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9310000000000001e-06 2024-09-14T06:01:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471187+0000", 2024-09-14T06:01:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.113332222 2024-09-14T06:01:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471425+0000", 2024-09-14T06:01:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000237412 2024-09-14T06:01:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471954+0000", 2024-09-14T06:01:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00052879100000000003 2024-09-14T06:01:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114774 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 417792~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:01:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.732198019999998, 2024-09-14T06:01:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114690902, 2024-09-14T06:01:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114774 2024-09-14T06:01:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:01:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:01:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357884+0000", 2024-09-14T06:01:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.37e-07 2024-09-14T06:01:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357886+0000", 2024-09-14T06:01:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7010000000000001e-06 2024-09-14T06:01:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357891+0000", 2024-09-14T06:01:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T06:01:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357896+0000", 2024-09-14T06:01:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5999999999999997e-06 2024-09-14T06:01:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472030+0000", 2024-09-14T06:01:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11413328 2024-09-14T06:01:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472157+0000", 2024-09-14T06:01:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012693900000000001 2024-09-14T06:01:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472574+0000", 2024-09-14T06:01:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041773100000000002 2024-09-14T06:01:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114775 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 524288~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:01:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.732158351999999, 2024-09-14T06:01:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.115518357, 2024-09-14T06:01:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114775 2024-09-14T06:01:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:01:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:01:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357924+0000", 2024-09-14T06:01:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3799999999999997e-07 2024-09-14T06:01:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357928+0000", 2024-09-14T06:01:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7700000000000001e-06 2024-09-14T06:01:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357934+0000", 2024-09-14T06:01:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6420000000000004e-06 2024-09-14T06:01:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357938+0000", 2024-09-14T06:01:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1899999999999997e-06 2024-09-14T06:01:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472667+0000", 2024-09-14T06:01:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114728409 2024-09-14T06:01:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472901+0000", 2024-09-14T06:01:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023484100000000001 2024-09-14T06:01:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473441+0000", 2024-09-14T06:01:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053996700000000003 2024-09-14T06:01:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114776 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 630784~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:01:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.732118456000002, 2024-09-14T06:01:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11610183, 2024-09-14T06:01:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114776 2024-09-14T06:01:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:01:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:01:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357964+0000", 2024-09-14T06:01:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7700000000000004e-07 2024-09-14T06:01:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357965+0000", 2024-09-14T06:01:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.761e-06 2024-09-14T06:01:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357970+0000", 2024-09-14T06:01:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1429999999999997e-06 2024-09-14T06:01:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357974+0000", 2024-09-14T06:01:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8879999999999999e-06 2024-09-14T06:01:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473514+0000", 2024-09-14T06:01:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11554007500000001 2024-09-14T06:01:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473641+0000", 2024-09-14T06:01:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000127088 2024-09-14T06:01:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474065+0000", 2024-09-14T06:01:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00042329800000000001 2024-09-14T06:01:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114777 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 737280~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:01:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.732079280999997, 2024-09-14T06:01:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11697975200000001, 2024-09-14T06:01:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114777 2024-09-14T06:01:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:01:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:01:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358003+0000", 2024-09-14T06:01:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-14T06:01:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358004+0000", 2024-09-14T06:01:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6950000000000001e-06 2024-09-14T06:01:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358010+0000", 2024-09-14T06:01:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2410000000000003e-06 2024-09-14T06:01:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358014+0000", 2024-09-14T06:01:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9380000000000002e-06 2024-09-14T06:01:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474156+0000", 2024-09-14T06:01:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.116142597 2024-09-14T06:01:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474386+0000", 2024-09-14T06:01:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023008999999999999 2024-09-14T06:01:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474982+0000", 2024-09-14T06:01:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059564500000000001 2024-09-14T06:01:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114778 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 843776~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:01:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.732038938000002, 2024-09-14T06:01:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11749908100000001, 2024-09-14T06:01:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114778 2024-09-14T06:01:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:01:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:01:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358043+0000", 2024-09-14T06:01:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3399999999999999e-07 2024-09-14T06:01:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358045+0000", 2024-09-14T06:01:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8789999999999999e-06 2024-09-14T06:01:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358052+0000", 2024-09-14T06:01:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.951e-06 2024-09-14T06:01:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358056+0000", 2024-09-14T06:01:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.121e-06 2024-09-14T06:01:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475018+0000", 2024-09-14T06:01:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11696224199999999 2024-09-14T06:01:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475141+0000", 2024-09-14T06:01:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012285099999999999 2024-09-14T06:01:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475542+0000", 2024-09-14T06:01:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00040050300000000002 2024-09-14T06:01:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114779 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 950272~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:01:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.731996338999998, 2024-09-14T06:01:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.118289098, 2024-09-14T06:01:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114779 2024-09-14T06:01:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:01:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:01:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358086+0000", 2024-09-14T06:01:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5300000000000004e-07 2024-09-14T06:01:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358087+0000", 2024-09-14T06:01:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.623e-06 2024-09-14T06:01:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358093+0000", 2024-09-14T06:01:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9510000000000003e-06 2024-09-14T06:01:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358097+0000", 2024-09-14T06:01:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1819999999999999e-06 2024-09-14T06:01:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475637+0000", 2024-09-14T06:01:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11753928600000001 2024-09-14T06:01:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475862+0000", 2024-09-14T06:01:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225336 2024-09-14T06:01:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476374+0000", 2024-09-14T06:01:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000512167 2024-09-14T06:01:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114780 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1056768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:01:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.731955315, 2024-09-14T06:01:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.119083513, 2024-09-14T06:01:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114780 2024-09-14T06:01:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:01:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:01:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358127+0000", 2024-09-14T06:01:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.44e-07 2024-09-14T06:01:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358128+0000", 2024-09-14T06:01:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.714e-06 2024-09-14T06:01:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358135+0000", 2024-09-14T06:01:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-09-14T06:01:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358140+0000", 2024-09-14T06:01:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1969999999999998e-06 2024-09-14T06:01:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476456+0000", 2024-09-14T06:01:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.118316717 2024-09-14T06:01:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476674+0000", 2024-09-14T06:01:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021775200000000001 2024-09-14T06:01:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477210+0000", 2024-09-14T06:01:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053548400000000003 2024-09-14T06:01:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114781 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1163264~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:01:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.731910194000001, 2024-09-14T06:01:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11988966700000001, 2024-09-14T06:01:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114781 2024-09-14T06:01:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:01:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:01:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358172+0000", 2024-09-14T06:01:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.44e-07 2024-09-14T06:01:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358174+0000", 2024-09-14T06:01:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9920000000000002e-06 2024-09-14T06:01:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358179+0000", 2024-09-14T06:01:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.288e-06 2024-09-14T06:01:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358183+0000", 2024-09-14T06:01:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0489999999999997e-06 2024-09-14T06:01:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477294+0000", 2024-09-14T06:01:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11911132000000001 2024-09-14T06:01:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477516+0000", 2024-09-14T06:01:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022208500000000001 2024-09-14T06:01:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478061+0000", 2024-09-14T06:01:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00054438900000000005 2024-09-14T06:01:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114782 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1269760~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:01:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.731891627000003, 2024-09-14T06:01:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.120723238, 2024-09-14T06:01:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114782 2024-09-14T06:01:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:01:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:01:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:01:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4099999999999999e-07 2024-09-14T06:01:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358192+0000", 2024-09-14T06:01:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.559e-06 2024-09-14T06:01:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358197+0000", 2024-09-14T06:01:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6789999999999996e-06 2024-09-14T06:01:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358202+0000", 2024-09-14T06:01:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4779999999999999e-06 2024-09-14T06:01:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478140+0000", 2024-09-14T06:01:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11993833600000001 2024-09-14T06:01:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478358+0000", 2024-09-14T06:01:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021785700000000001 2024-09-14T06:01:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478913+0000", 2024-09-14T06:01:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055478799999999996 2024-09-14T06:01:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114783 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1376256~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:01:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.731873282000002, 2024-09-14T06:01:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121464831, 2024-09-14T06:01:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114783 2024-09-14T06:01:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:01:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:01:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:01:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4499999999999998e-07 2024-09-14T06:01:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358210+0000", 2024-09-14T06:01:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5880000000000001e-06 2024-09-14T06:01:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358214+0000", 2024-09-14T06:01:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3850000000000004e-06 2024-09-14T06:01:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358218+0000", 2024-09-14T06:01:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7799999999999998e-06 2024-09-14T06:01:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479024+0000", 2024-09-14T06:01:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.120805364 2024-09-14T06:01:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479177+0000", 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153642 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479673+0000", 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049572699999999995 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114784 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1482752~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:01:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.731858623999997, 2024-09-14T06:01:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.122316759, 2024-09-14T06:01:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114784 2024-09-14T06:01:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:01:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:01:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:01:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2399999999999999e-07 2024-09-14T06:01:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358225+0000", 2024-09-14T06:01:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5570000000000001e-06 2024-09-14T06:01:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358229+0000", 2024-09-14T06:01:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5589999999999999e-06 2024-09-14T06:01:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358233+0000", 2024-09-14T06:01:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7270000000000001e-06 2024-09-14T06:01:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479769+0000", 2024-09-14T06:01:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12153594299999999 2024-09-14T06:01:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480000+0000", 2024-09-14T06:01:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000230967 2024-09-14T06:01:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480540+0000", 2024-09-14T06:01:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053968199999999999 2024-09-14T06:01:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114785 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1589248~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:01:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.731842432999997, 2024-09-14T06:01:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123154237, 2024-09-14T06:01:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114785 2024-09-14T06:01:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:01:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:01:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:01:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3799999999999998e-07 2024-09-14T06:01:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358241+0000", 2024-09-14T06:01:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.457e-06 2024-09-14T06:01:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358245+0000", 2024-09-14T06:01:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.42e-06 2024-09-14T06:01:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358249+0000", 2024-09-14T06:01:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7740000000000002e-06 2024-09-14T06:01:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480626+0000", 2024-09-14T06:01:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12237743600000001 2024-09-14T06:01:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480844+0000", 2024-09-14T06:01:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021792299999999999 2024-09-14T06:01:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481393+0000", 2024-09-14T06:01:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000548889 2024-09-14T06:01:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114786 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1695744~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:01:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.731827729000003, 2024-09-14T06:01:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123995568, 2024-09-14T06:01:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114786 2024-09-14T06:01:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:01:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:01:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:01:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.27e-07 2024-09-14T06:01:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358256+0000", 2024-09-14T06:01:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5460000000000001e-06 2024-09-14T06:01:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358260+0000", 2024-09-14T06:01:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3819999999999997e-06 2024-09-14T06:01:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358264+0000", 2024-09-14T06:01:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7469999999999999e-06 2024-09-14T06:01:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481473+0000", 2024-09-14T06:01:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123209244 2024-09-14T06:01:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481686+0000", 2024-09-14T06:01:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000212957 2024-09-14T06:01:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482249+0000", 2024-09-14T06:01:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00056336500000000002 2024-09-14T06:01:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114867 3.15 3:aea12e8e:::rbd_data.1127cb09e343.000000000000000b:head [stat,truncate 737280] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:01:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.731813144, 2024-09-14T06:01:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12722582099999999, 2024-09-14T06:01:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114867 2024-09-14T06:01:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:01:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:01:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358269+0000", 2024-09-14T06:01:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4799999999999999e-07 2024-09-14T06:01:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358274+0000", 2024-09-14T06:01:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.237e-06 2024-09-14T06:01:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358279+0000", 2024-09-14T06:01:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7990000000000001e-06 2024-09-14T06:01:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358284+0000", 2024-09-14T06:01:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1900000000000003e-06 2024-09-14T06:01:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482355+0000", 2024-09-14T06:01:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.124070718 2024-09-14T06:01:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482496+0000", 2024-09-14T06:01:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014162699999999999 2024-09-14T06:01:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 3", 2024-09-14T06:01:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482722+0000", 2024-09-14T06:01:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225622 2024-09-14T06:01:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.484427+0000", 2024-09-14T06:01:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001704929 2024-09-14T06:01:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485332+0000", 2024-09-14T06:01:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00090576600000000001 2024-09-14T06:01:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485429+0000", 2024-09-14T06:01:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6540999999999996e-05 2024-09-14T06:01:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485494+0000", 2024-09-14T06:01:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5043999999999996e-05 2024-09-14T06:01:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123535 3.f 3.fbaab0af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-14T06:01:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:05.349325+0000", 2024-09-14T06:01:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.740756129000001, 2024-09-14T06:01:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.983705842, 2024-09-14T06:01:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T06:01:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123535 2024-09-14T06:01:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349325+0000", 2024-09-14T06:01:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349325+0000", 2024-09-14T06:01:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349329+0000", 2024-09-14T06:01:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5999999999999998e-06 2024-09-14T06:01:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349345+0000", 2024-09-14T06:01:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6195999999999999e-05 2024-09-14T06:01:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349385+0000", 2024-09-14T06:01:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0172000000000001e-05 2024-09-14T06:01:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349408+0000", 2024-09-14T06:01:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3224999999999999e-05 2024-09-14T06:01:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349631+0000", 2024-09-14T06:01:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022237400000000001 2024-09-14T06:01:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349658+0000", 2024-09-14T06:01:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7559000000000002e-05 2024-09-14T06:01:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:06.333011+0000", 2024-09-14T06:01:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.98335301100000005 2024-09-14T06:01:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:06.333031+0000", 2024-09-14T06:01:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9704999999999999e-05 2024-09-14T06:01:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:34.193 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:34.194 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:01:34.195 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:34.188+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:34.219 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:34.236 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:34.255 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:34.255 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:34.272 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:34.272 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:34.293 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:34.293 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:34.294 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:34.288+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:34.323 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:34.323 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:34.326 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:34.327 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:34.345 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:01:34.353 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:34.353 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:34.377 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:34.380 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [1, 2, 3, 4, 5, 6, 7, 0] 2024-09-14T06:01:34.381 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T06:01:34.381 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T06:01:34.381 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 1.000000 2024-09-14T06:01:34.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-14T06:01:34.399 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:34.396+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:34.487 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:34.487 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:34.496 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:34.492+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:34.504 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:01:34.597 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:34.592+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:34.662 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:34.662 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:34.675 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T06:01:34.698 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:34.696+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:34.799 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:34.796+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:34.844 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:34.845 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:34.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T06:01:34.900 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:34.896+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:35.001 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:34.996+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:35.020 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:35.020 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:35.034 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T06:01:35.102 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:35.096+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:35.155 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:35.155 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:35.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T06:01:35.211 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:35.208+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:35.304 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:35.300+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:35.333 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:35.333 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:35.345 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-14T06:01:35.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T06:01:35.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T06:01:35.419 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:35.416+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:35.476 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:35.476 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:35.495 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T06:01:35.505 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:35.500+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:35.606 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:35.604+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:35.649 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:35.649 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:35.662 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T06:01:35.707 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T06:01:35.704+0000 7f2a287e9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26547) UID: 0 2024-09-14T06:01:35.774 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:35.775 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:35.787 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T06:01:35.808 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:35.804+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:35.908 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:35.909 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:35.909 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T06:01:35.904+0000 7f8817e46640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26545) UID: 0 2024-09-14T06:01:35.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T06:01:36.010 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:36.008+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:36.049 INFO:teuthology.orchestra.run.smithi006.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:36.049 INFO:teuthology.orchestra.run.smithi006.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:36.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T06:01:36.111 INFO:tasks.ceph.osd.0.smithi006.stderr:2024-09-14T06:01:36.108+0000 7f8a7a852640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 35242) UID: 0 2024-09-14T06:01:36.195 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:36.195 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:36.209 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T06:01:36.212 INFO:tasks.ceph.osd.1.smithi006.stderr:2024-09-14T06:01:36.208+0000 7f2db18e0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26387) UID: 0 2024-09-14T06:01:36.314 INFO:tasks.ceph.osd.3.smithi006.stderr:2024-09-14T06:01:36.308+0000 7f1b83a7e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26391) UID: 0 2024-09-14T06:01:36.332 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:36.332 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:36.349 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T06:01:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2024-09-14T06:01:36.400 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T06:01:36.414 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T06:01:36.412+0000 7ff7a2280640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26543) UID: 0 2024-09-14T06:01:36.482 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:36.483 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:36.494 INFO:teuthology.orchestra.run.smithi006.stdout:All operations completed A-OK! 2024-09-14T06:01:36.498 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T06:01:36.515 INFO:tasks.ceph.osd.2.smithi006.stderr:2024-09-14T06:01:36.512+0000 7fcea17b9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26389) UID: 0 2024-09-14T06:01:36.553 DEBUG:teuthology.parallel:result is None 2024-09-14T06:01:36.554 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-14T06:01:36.563 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-14T06:01:36.570 INFO:tasks.thrashosds:joining thrashosds 2024-09-14T06:01:36.591 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0: {} 2024-09-14T06:01:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T06:01:36.607 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1: {} 2024-09-14T06:01:36.608 INFO:teuthology.orchestra.run.smithi006.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T06:01:36.624 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2: {} 2024-09-14T06:01:36.624 INFO:teuthology.orchestra.run.smithi006.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T06:01:36.640 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3: {} 2024-09-14T06:01:36.641 INFO:teuthology.orchestra.run.smithi006.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T06:01:36.661 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4: {} 2024-09-14T06:01:36.661 INFO:teuthology.orchestra.run.smithi006.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T06:01:36.668 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-09-14T06:01:36.668 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T06:01:36.681 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5: {} 2024-09-14T06:01:36.681 INFO:teuthology.orchestra.run.smithi006.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T06:01:36.683 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T06:01:36.699 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6: {} 2024-09-14T06:01:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-14T06:01:36.719 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7: {} 2024-09-14T06:01:36.719 INFO:teuthology.orchestra.run.smithi006.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-14T06:01:36.805 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:36.805 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:36.805 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:36.805 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:36.805 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:36.819 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T06:01:36.941 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:36.941 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:36.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:36.941 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:36.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.941 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:23746 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-14T06:01:36.941 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:36.941 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 125.391401797, 2024-09-14T06:01:36.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087864796999999994, 2024-09-14T06:01:36.942 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:36.942 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:36.942 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:36.942 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:36.942 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:36.942 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:36.942 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 23746 2024-09-14T06:01:36.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.942 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:36.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:36.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:36.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546435+0000", 2024-09-14T06:01:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.546439+0000", 2024-09-14T06:01:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1119999999999998e-06 2024-09-14T06:01:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:36.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572390+0000", 2024-09-14T06:01:36.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.025951095 2024-09-14T06:01:36.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:36.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572426+0000", 2024-09-14T06:01:36.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5796000000000001e-05 2024-09-14T06:01:36.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:36.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572444+0000", 2024-09-14T06:01:36.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8162e-05 2024-09-14T06:01:36.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:36.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572623+0000", 2024-09-14T06:01:36.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017874500000000001 2024-09-14T06:01:36.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:36.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.572865+0000", 2024-09-14T06:01:36.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024220099999999999 2024-09-14T06:01:36.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 4", 2024-09-14T06:01:36.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.574358+0000", 2024-09-14T06:01:36.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014928299999999999 2024-09-14T06:01:36.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:36.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.633410+0000", 2024-09-14T06:01:36.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.059051900999999997 2024-09-14T06:01:36.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:36.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634202+0000", 2024-09-14T06:01:36.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00079233299999999999 2024-09-14T06:01:36.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:36.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634251+0000", 2024-09-14T06:01:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8353000000000003e-05 2024-09-14T06:01:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:31.634300+0000", 2024-09-14T06:01:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9268999999999999e-05 2024-09-14T06:01:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38854 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 8814592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.41600491200001, 2024-09-14T06:01:36.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084872174999999994, 2024-09-14T06:01:36.948 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:36.948 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:36.948 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:36.948 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:36.948 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:36.948 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:36.948 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38854 2024-09-14T06:01:36.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.948 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:36.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:36.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521832+0000", 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521833+0000", 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.08e-06 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:36.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521838+0000", 2024-09-14T06:01:36.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-09-14T06:01:36.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:36.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521849+0000", 2024-09-14T06:01:36.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.111e-05 2024-09-14T06:01:36.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:36.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521856+0000", 2024-09-14T06:01:36.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8800000000000002e-06 2024-09-14T06:01:36.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:36.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606525+0000", 2024-09-14T06:01:36.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084669174999999999 2024-09-14T06:01:36.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:36.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606619+0000", 2024-09-14T06:01:36.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3301999999999995e-05 2024-09-14T06:01:36.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:36.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606704+0000", 2024-09-14T06:01:36.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5765000000000003e-05 2024-09-14T06:01:36.951 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.952 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:36.952 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.952 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38856 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10207232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:36.952 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:36.952 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.41596658900001, 2024-09-14T06:01:36.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085120091999999994, 2024-09-14T06:01:36.952 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:36.953 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:36.953 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:36.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:36.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:36.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:36.953 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38856 2024-09-14T06:01:36.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.953 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:36.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:36.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:36.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521870+0000", 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521872+0000", 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0279999999999999e-06 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521874+0000", 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000001e-06 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521882+0000", 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1000000000000004e-06 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521889+0000", 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.365e-06 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606768+0000", 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084879582999999995 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:36.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606904+0000", 2024-09-14T06:01:36.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013538100000000001 2024-09-14T06:01:36.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:36.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.606991+0000", 2024-09-14T06:01:36.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6837999999999998e-05 2024-09-14T06:01:36.956 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.956 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:36.956 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.956 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38857 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10027008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:36.957 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:36.957 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.415939897, 2024-09-14T06:01:36.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085301175000000007, 2024-09-14T06:01:36.957 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:36.957 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:36.957 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:36.957 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:36.957 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:36.957 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:36.957 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38857 2024-09-14T06:01:36.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.957 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:36.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:36.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:36.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:36.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521897+0000", 2024-09-14T06:01:36.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:36.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521898+0000", 2024-09-14T06:01:36.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1399999999999997e-07 2024-09-14T06:01:36.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:36.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521900+0000", 2024-09-14T06:01:36.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6860000000000002e-06 2024-09-14T06:01:36.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:36.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521908+0000", 2024-09-14T06:01:36.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7680000000000008e-06 2024-09-14T06:01:36.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:36.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521915+0000", 2024-09-14T06:01:36.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4080000000000003e-06 2024-09-14T06:01:36.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:36.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607039+0000", 2024-09-14T06:01:36.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085124151999999995 2024-09-14T06:01:36.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:36.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607123+0000", 2024-09-14T06:01:36.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4537999999999996e-05 2024-09-14T06:01:36.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:36.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607198+0000", 2024-09-14T06:01:36.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5009e-05 2024-09-14T06:01:36.961 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.961 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:36.961 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.961 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38859 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 10584064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:36.961 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:36.961 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.415914031, 2024-09-14T06:01:36.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085571000999999994, 2024-09-14T06:01:36.961 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:36.961 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:36.961 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38859 2024-09-14T06:01:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:36.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.521923+0000", 2024-09-14T06:01:36.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:36.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522954+0000", 2024-09-14T06:01:36.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010313029999999999 2024-09-14T06:01:36.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:36.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522961+0000", 2024-09-14T06:01:36.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-09-14T06:01:36.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:36.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522976+0000", 2024-09-14T06:01:36.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5642e-05 2024-09-14T06:01:36.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:36.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.522986+0000", 2024-09-14T06:01:36.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1759999999999999e-06 2024-09-14T06:01:36.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:36.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607261+0000", 2024-09-14T06:01:36.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084275348 2024-09-14T06:01:36.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:36.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607380+0000", 2024-09-14T06:01:36.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118653 2024-09-14T06:01:36.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:36.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607494+0000", 2024-09-14T06:01:36.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114474 2024-09-14T06:01:36.965 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.965 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:36.965 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.966 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38862 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 0~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:36.966 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:36.966 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.414813662, 2024-09-14T06:01:36.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084709014999999999, 2024-09-14T06:01:36.966 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:36.966 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:36.966 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:36.966 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:36.966 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:36.966 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:36.966 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38862 2024-09-14T06:01:36.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.966 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:36.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:36.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:36.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523023+0000", 2024-09-14T06:01:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523024+0000", 2024-09-14T06:01:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3099999999999997e-07 2024-09-14T06:01:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523028+0000", 2024-09-14T06:01:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-09-14T06:01:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:36.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523038+0000", 2024-09-14T06:01:36.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-09-14T06:01:36.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:36.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523045+0000", 2024-09-14T06:01:36.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1080000000000004e-06 2024-09-14T06:01:36.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:36.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607539+0000", 2024-09-14T06:01:36.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084493876999999995 2024-09-14T06:01:36.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:36.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607622+0000", 2024-09-14T06:01:36.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3169000000000003e-05 2024-09-14T06:01:36.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:36.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607732+0000", 2024-09-14T06:01:36.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011058800000000001 2024-09-14T06:01:36.971 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.971 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:36.971 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38863 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.414769683, 2024-09-14T06:01:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084999976000000005, 2024-09-14T06:01:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38863 2024-09-14T06:01:36.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.973 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:36.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:36.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:36.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:36.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523067+0000", 2024-09-14T06:01:36.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:36.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523896+0000", 2024-09-14T06:01:36.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00082849900000000001 2024-09-14T06:01:36.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:36.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523907+0000", 2024-09-14T06:01:36.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1171e-05 2024-09-14T06:01:36.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:36.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523932+0000", 2024-09-14T06:01:36.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4735e-05 2024-09-14T06:01:36.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:36.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.523991+0000", 2024-09-14T06:01:36.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9332e-05 2024-09-14T06:01:36.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:36.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607764+0000", 2024-09-14T06:01:36.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083772948 2024-09-14T06:01:36.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:36.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.607892+0000", 2024-09-14T06:01:36.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012837499999999999 2024-09-14T06:01:36.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:36.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608067+0000", 2024-09-14T06:01:36.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174916 2024-09-14T06:01:36.976 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.976 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:36.976 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.976 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:38867 3.1d 3:be55fb6a:::rbd_data.11276864ec6c.0000000000000001:d [read 278528~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-14T06:01:36.976 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:36.976 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 112.413707923, 2024-09-14T06:01:36.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084718887000000007, 2024-09-14T06:01:36.977 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:36.977 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:36.977 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:36.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:36.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:36.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:36.977 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 38867 2024-09-14T06:01:36.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.977 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:36.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:36.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:36.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:36.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524129+0000", 2024-09-14T06:01:36.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:36.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524479+0000", 2024-09-14T06:01:36.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035010299999999999 2024-09-14T06:01:36.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:36.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524488+0000", 2024-09-14T06:01:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-09-14T06:01:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524503+0000", 2024-09-14T06:01:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5173e-05 2024-09-14T06:01:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.524513+0000", 2024-09-14T06:01:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0542e-05 2024-09-14T06:01:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:36.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608456+0000", 2024-09-14T06:01:36.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083942724999999996 2024-09-14T06:01:36.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:36.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608638+0000", 2024-09-14T06:01:36.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018189899999999999 2024-09-14T06:01:36.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:44.608848+0000", 2024-09-14T06:01:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021014499999999999 2024-09-14T06:01:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119203 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5881856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 54.872334893000001, 2024-09-14T06:01:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084813824999999995, 2024-09-14T06:01:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:36.982 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:36.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:36.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:36.982 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:36.982 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119203 2024-09-14T06:01:36.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.982 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:36.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:36.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:36.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065502+0000", 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065503+0000", 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.054e-06 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065509+0000", 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9939999999999997e-06 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:36.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065528+0000", 2024-09-14T06:01:36.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8736000000000002e-05 2024-09-14T06:01:36.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:36.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065540+0000", 2024-09-14T06:01:36.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2427e-05 2024-09-14T06:01:36.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:36.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.149851+0000", 2024-09-14T06:01:36.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084310806000000002 2024-09-14T06:01:36.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:36.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150073+0000", 2024-09-14T06:01:36.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022202999999999999 2024-09-14T06:01:36.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:36.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150316+0000", 2024-09-14T06:01:36.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000242778 2024-09-14T06:01:36.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.985 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:36.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.986 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119204 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5931008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:36.986 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:36.986 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 54.872279386000002, 2024-09-14T06:01:36.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085122164, 2024-09-14T06:01:36.986 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:36.986 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:36.986 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:36.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:36.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:36.986 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:36.986 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119204 2024-09-14T06:01:36.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065558+0000", 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065559+0000", 2024-09-14T06:01:36.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.068e-06 2024-09-14T06:01:36.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:36.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065564+0000", 2024-09-14T06:01:36.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1089999999999997e-06 2024-09-14T06:01:36.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:36.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065580+0000", 2024-09-14T06:01:36.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6438000000000001e-05 2024-09-14T06:01:36.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:36.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065592+0000", 2024-09-14T06:01:36.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1739000000000001e-05 2024-09-14T06:01:36.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:36.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150396+0000", 2024-09-14T06:01:36.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.084803859999999995 2024-09-14T06:01:36.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:36.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150524+0000", 2024-09-14T06:01:36.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012805600000000001 2024-09-14T06:01:36.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150680+0000", 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015589400000000001 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119205 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 5980160~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 54.872183511000003, 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085597655999999994, 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:36.990 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119205 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065654+0000", 2024-09-14T06:01:36.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:36.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065656+0000", 2024-09-14T06:01:36.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9829999999999999e-06 2024-09-14T06:01:36.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:36.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065661+0000", 2024-09-14T06:01:36.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9510000000000003e-06 2024-09-14T06:01:36.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:36.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065680+0000", 2024-09-14T06:01:36.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8947e-05 2024-09-14T06:01:36.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:36.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065694+0000", 2024-09-14T06:01:36.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3433e-05 2024-09-14T06:01:36.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:36.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.150778+0000", 2024-09-14T06:01:36.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085083856999999999 2024-09-14T06:01:36.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151007+0000", 2024-09-14T06:01:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022914499999999999 2024-09-14T06:01:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151251+0000", 2024-09-14T06:01:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024434000000000001 2024-09-14T06:01:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119206 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6029312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:36.995 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 54.872122081999997, 2024-09-14T06:01:36.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086002258999999998, 2024-09-14T06:01:36.995 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:36.995 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:36.995 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:36.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:36.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:36.995 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:36.995 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119206 2024-09-14T06:01:36.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.996 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:36.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:36.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:36.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:36.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065715+0000", 2024-09-14T06:01:36.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:36.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:36.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065716+0000", 2024-09-14T06:01:36.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3230000000000001e-06 2024-09-14T06:01:36.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:36.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065722+0000", 2024-09-14T06:01:36.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5219999999999998e-06 2024-09-14T06:01:36.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:36.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065739+0000", 2024-09-14T06:01:36.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7122e-05 2024-09-14T06:01:36.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065752+0000", 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2639e-05 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151384+0000", 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.085632514000000007 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151532+0000", 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000147761 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:36.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151717+0000", 2024-09-14T06:01:36.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018537800000000001 2024-09-14T06:01:36.999 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.999 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:36.999 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:36.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:36.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:36.999 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119207 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6078464~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:36.999 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:36.999 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 54.872068736999999, 2024-09-14T06:01:36.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086515080999999994, 2024-09-14T06:01:36.999 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:36.999 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:36.999 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.000 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.000 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.000 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.000 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119207 2024-09-14T06:01:37.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.000 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:37.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065768+0000", 2024-09-14T06:01:37.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065770+0000", 2024-09-14T06:01:37.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5770000000000001e-06 2024-09-14T06:01:37.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065775+0000", 2024-09-14T06:01:37.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1930000000000001e-06 2024-09-14T06:01:37.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065791+0000", 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6351e-05 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065804+0000", 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.259e-05 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.151820+0000", 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086016398999999993 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152043+0000", 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022236200000000001 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152283+0000", 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000240609 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119208 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:37.003 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:37.004 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 54.872016238999997, 2024-09-14T06:01:37.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086932403000000005, 2024-09-14T06:01:37.004 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.004 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.004 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.004 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.004 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.004 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.004 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119208 2024-09-14T06:01:37.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.004 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:37.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065821+0000", 2024-09-14T06:01:37.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065822+0000", 2024-09-14T06:01:37.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.032e-06 2024-09-14T06:01:37.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065827+0000", 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5790000000000003e-06 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065843+0000", 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5801999999999999e-05 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065856+0000", 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2267e-05 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152416+0000", 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086560893999999999 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152568+0000", 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151664 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152753+0000", 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018516499999999999 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.008 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119209 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6176768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:37.008 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:37.008 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 54.871964368999997, 2024-09-14T06:01:37.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087450828999999994, 2024-09-14T06:01:37.008 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.008 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.008 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.008 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.008 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.008 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.008 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119209 2024-09-14T06:01:37.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.009 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:37.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065873+0000", 2024-09-14T06:01:37.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065874+0000", 2024-09-14T06:01:37.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.097e-06 2024-09-14T06:01:37.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065879+0000", 2024-09-14T06:01:37.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.254e-06 2024-09-14T06:01:37.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065895+0000", 2024-09-14T06:01:37.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6373000000000001e-05 2024-09-14T06:01:37.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065908+0000", 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2656e-05 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.152854+0000", 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.086946078999999996 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153080+0000", 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022582200000000001 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153324+0000", 2024-09-14T06:01:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024354800000000001 2024-09-14T06:01:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119210 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6225920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 54.871912442000003, 2024-09-14T06:01:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087773166, 2024-09-14T06:01:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.012 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.013 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.013 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.013 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.013 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119210 2024-09-14T06:01:37.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.013 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:37.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065925+0000", 2024-09-14T06:01:37.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065926+0000", 2024-09-14T06:01:37.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3799999999999999e-06 2024-09-14T06:01:37.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065931+0000", 2024-09-14T06:01:37.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9629999999999997e-06 2024-09-14T06:01:37.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065950+0000", 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9369999999999999e-05 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065963+0000", 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2164000000000001e-05 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153404+0000", 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087441840000000007 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153537+0000", 2024-09-14T06:01:37.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013305500000000001 2024-09-14T06:01:37.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153698+0000", 2024-09-14T06:01:37.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016039400000000001 2024-09-14T06:01:37.016 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.016 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.016 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.016 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:119211 3.1c 3:3f59e151:::rbd_data.1127325deb36.0000000000000006:28 [read 6275072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:37.017 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:37.017 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 54.871856674999997, 2024-09-14T06:01:37.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088244734000000005, 2024-09-14T06:01:37.017 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.017 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.017 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.017 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 119211 2024-09-14T06:01:37.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.017 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:37.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065980+0000", 2024-09-14T06:01:37.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065981+0000", 2024-09-14T06:01:37.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.012e-06 2024-09-14T06:01:37.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.065987+0000", 2024-09-14T06:01:37.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5450000000000003e-06 2024-09-14T06:01:37.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.066003+0000", 2024-09-14T06:01:37.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6198999999999999e-05 2024-09-14T06:01:37.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.066016+0000", 2024-09-14T06:01:37.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2595999999999999e-05 2024-09-14T06:01:37.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153758+0000", 2024-09-14T06:01:37.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087742610999999998 2024-09-14T06:01:37.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.153983+0000", 2024-09-14T06:01:37.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000224336 2024-09-14T06:01:37.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:42.154225+0000", 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024243499999999999 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123236 3.16 3:6f8987ed:::rbd_data.112793b455a2.0000000000000001:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 37.523015934, 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.973924129, 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.021 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123236 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414821+0000", 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414823+0000", 2024-09-14T06:01:37.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0930000000000001e-06 2024-09-14T06:01:37.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414830+0000", 2024-09-14T06:01:37.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414848+0000", 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8029e-05 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414859+0000", 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0934000000000001e-05 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414952+0000", 2024-09-14T06:01:37.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3140999999999995e-05 2024-09-14T06:01:37.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:37.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:59.414964+0000", 2024-09-14T06:01:37.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1802e-05 2024-09-14T06:01:37.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297044+0000", 2024-09-14T06:01:37.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.88207986500000002 2024-09-14T06:01:37.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:37.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297073+0000", 2024-09-14T06:01:37.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9178000000000001e-05 2024-09-14T06:01:37.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.385889+0000", 2024-09-14T06:01:37.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0888154130000001 2024-09-14T06:01:37.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.386144+0000", 2024-09-14T06:01:37.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000255064 2024-09-14T06:01:37.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 1", 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.386344+0000", 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020039100000000001 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388411+0000", 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020668029999999999 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388490+0000", 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9237e-05 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388589+0000", 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9254999999999998e-05 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.388745+0000", 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015581899999999999 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123238 3.7 3:e6b46603:::rbd_data.112793b455a2.0000000000000003:head [delete] snapc 19=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:37.028 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.646078180000003, 2024-09-14T06:01:37.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0714216679999999, 2024-09-14T06:01:37.029 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.029 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.029 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:37.029 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.029 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.029 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.029 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123238 2024-09-14T06:01:37.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.029 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:37.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291759+0000", 2024-09-14T06:01:37.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291762+0000", 2024-09-14T06:01:37.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.467e-06 2024-09-14T06:01:37.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291777+0000", 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4664999999999999e-05 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291833+0000", 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5498000000000003e-05 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291861+0000", 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8161999999999999e-05 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292150+0000", 2024-09-14T06:01:37.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028918900000000003 2024-09-14T06:01:37.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-09-14T06:01:37.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292171+0000", 2024-09-14T06:01:37.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0936000000000001e-05 2024-09-14T06:01:37.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297607+0000", 2024-09-14T06:01:37.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054358139999999998 2024-09-14T06:01:37.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:37.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297630+0000", 2024-09-14T06:01:37.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3209000000000001e-05 2024-09-14T06:01:37.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357360+0000", 2024-09-14T06:01:37.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0597304700000001 2024-09-14T06:01:37.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.357737+0000", 2024-09-14T06:01:37.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037695399999999998 2024-09-14T06:01:37.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0,3", 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.358085+0000", 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034785099999999999 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361195+0000", 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003110163 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361362+0000", 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167112 2024-09-14T06:01:37.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.362887+0000", 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015243419999999999 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.362987+0000", 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100333 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.363181+0000", 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019350300000000001 2024-09-14T06:01:37.035 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.036 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.036 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.036 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123244 3.7 3:e141330b:::rbd_data.112793b455a2.0000000000000009:head [delete] snapc 19=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-14T06:01:37.036 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:37.036 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.645911601000002, 2024-09-14T06:01:37.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.072328908, 2024-09-14T06:01:37.036 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.036 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.036 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:37.036 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.036 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.037 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.037 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123244 2024-09-14T06:01:37.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.037 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:37.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291925+0000", 2024-09-14T06:01:37.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291927+0000", 2024-09-14T06:01:37.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5460000000000001e-06 2024-09-14T06:01:37.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291934+0000", 2024-09-14T06:01:37.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3599999999999998e-06 2024-09-14T06:01:37.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291956+0000", 2024-09-14T06:01:37.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1469000000000001e-05 2024-09-14T06:01:37.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.291972+0000", 2024-09-14T06:01:37.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5773e-05 2024-09-14T06:01:37.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292362+0000", 2024-09-14T06:01:37.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00038989100000000001 2024-09-14T06:01:37.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-09-14T06:01:37.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.292379+0000", 2024-09-14T06:01:37.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7186000000000001e-05 2024-09-14T06:01:37.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297840+0000", 2024-09-14T06:01:37.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054614260000000001 2024-09-14T06:01:37.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:37.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:00.297860+0000", 2024-09-14T06:01:37.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9782000000000001e-05 2024-09-14T06:01:37.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.359785+0000", 2024-09-14T06:01:37.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.061924665 2024-09-14T06:01:37.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360080+0000", 2024-09-14T06:01:37.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029538399999999999 2024-09-14T06:01:37.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0,3", 2024-09-14T06:01:37.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.360382+0000", 2024-09-14T06:01:37.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030214 2024-09-14T06:01:37.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:37.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.361612+0000", 2024-09-14T06:01:37.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001229808 2024-09-14T06:01:37.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:37.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.363256+0000", 2024-09-14T06:01:37.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001644162 2024-09-14T06:01:37.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:37.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364059+0000", 2024-09-14T06:01:37.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080328599999999995 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364105+0000", 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5695999999999998e-05 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:01.364254+0000", 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014933399999999999 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.043 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.044 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:37.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-14T06:01:37.173 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:37.176 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:37.176 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:37.176 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:37.187 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-14T06:01:37.312 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:37.312 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:37.312 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:37.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-14T06:01:37.454 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59148 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 419840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:01:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.183020993, 2024-09-14T06:01:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072974285999999999, 2024-09-14T06:01:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59148 2024-09-14T06:01:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:01:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268520+0000", 2024-09-14T06:01:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268521+0000", 2024-09-14T06:01:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4199999999999995e-07 2024-09-14T06:01:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268524+0000", 2024-09-14T06:01:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.05e-06 2024-09-14T06:01:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268534+0000", 2024-09-14T06:01:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8719999999999997e-06 2024-09-14T06:01:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268541+0000", 2024-09-14T06:01:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5349999999999999e-06 2024-09-14T06:01:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341108+0000", 2024-09-14T06:01:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072566624999999996 2024-09-14T06:01:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341169+0000", 2024-09-14T06:01:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1251e-05 2024-09-14T06:01:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341494+0000", 2024-09-14T06:01:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000325311 2024-09-14T06:01:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59149 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 436224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:01:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.18298176899999, 2024-09-14T06:01:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073405053999999997, 2024-09-14T06:01:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59149 2024-09-14T06:01:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:01:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268559+0000", 2024-09-14T06:01:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268560+0000", 2024-09-14T06:01:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9999999999999997e-07 2024-09-14T06:01:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268563+0000", 2024-09-14T06:01:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.292e-06 2024-09-14T06:01:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268573+0000", 2024-09-14T06:01:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3260000000000002e-06 2024-09-14T06:01:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268581+0000", 2024-09-14T06:01:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1960000000000008e-06 2024-09-14T06:01:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341537+0000", 2024-09-14T06:01:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.072955916999999995 2024-09-14T06:01:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341641+0000", 2024-09-14T06:01:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104341 2024-09-14T06:01:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341964+0000", 2024-09-14T06:01:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032328199999999999 2024-09-14T06:01:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59150 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 452608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.182948529, 2024-09-14T06:01:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073829748000000001, 2024-09-14T06:01:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59150 2024-09-14T06:01:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268593+0000", 2024-09-14T06:01:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0399999999999995e-07 2024-09-14T06:01:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268596+0000", 2024-09-14T06:01:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9859999999999999e-06 2024-09-14T06:01:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268606+0000", 2024-09-14T06:01:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0088000000000001e-05 2024-09-14T06:01:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268614+0000", 2024-09-14T06:01:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0360000000000006e-06 2024-09-14T06:01:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.341999+0000", 2024-09-14T06:01:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073385011999999999 2024-09-14T06:01:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342093+0000", 2024-09-14T06:01:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3793000000000001e-05 2024-09-14T06:01:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342422+0000", 2024-09-14T06:01:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000329129 2024-09-14T06:01:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59151 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:01:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.18291616099999, 2024-09-14T06:01:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074207289999999995, 2024-09-14T06:01:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59151 2024-09-14T06:01:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:01:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268625+0000", 2024-09-14T06:01:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268626+0000", 2024-09-14T06:01:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4300000000000003e-07 2024-09-14T06:01:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268629+0000", 2024-09-14T06:01:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.038e-06 2024-09-14T06:01:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268638+0000", 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8139999999999995e-06 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268647+0000", 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4889999999999995e-06 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342457+0000", 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073809890000000003 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342545+0000", 2024-09-14T06:01:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8697999999999997e-05 2024-09-14T06:01:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342832+0000", 2024-09-14T06:01:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028681799999999999 2024-09-14T06:01:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59152 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.18288352, 2024-09-14T06:01:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074695176000000002, 2024-09-14T06:01:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59152 2024-09-14T06:01:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268658+0000", 2024-09-14T06:01:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2900000000000003e-07 2024-09-14T06:01:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268661+0000", 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0230000000000001e-06 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268670+0000", 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2129999999999997e-06 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268679+0000", 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-09-14T06:01:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.342937+0000", 2024-09-14T06:01:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074258781999999995 2024-09-14T06:01:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343044+0000", 2024-09-14T06:01:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-09-14T06:01:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343353+0000", 2024-09-14T06:01:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030911099999999999 2024-09-14T06:01:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59153 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 501760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:01:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.18285075, 2024-09-14T06:01:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074997241000000006, 2024-09-14T06:01:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59153 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268690+0000", 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268691+0000", 2024-09-14T06:01:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0800000000000005e-07 2024-09-14T06:01:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268693+0000", 2024-09-14T06:01:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3599999999999999e-06 2024-09-14T06:01:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268699+0000", 2024-09-14T06:01:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-09-14T06:01:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268704+0000", 2024-09-14T06:01:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5759999999999999e-06 2024-09-14T06:01:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343398+0000", 2024-09-14T06:01:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074694522999999999 2024-09-14T06:01:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343450+0000", 2024-09-14T06:01:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1350999999999997e-05 2024-09-14T06:01:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343688+0000", 2024-09-14T06:01:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023806500000000001 2024-09-14T06:01:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59154 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 518144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:01:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.18283168400001, 2024-09-14T06:01:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075389938000000004, 2024-09-14T06:01:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59154 2024-09-14T06:01:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:01:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268709+0000", 2024-09-14T06:01:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268710+0000", 2024-09-14T06:01:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8000000000000001e-07 2024-09-14T06:01:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268712+0000", 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2759999999999999e-06 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268717+0000", 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8570000000000003e-06 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.268721+0000", 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2039999999999999e-06 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343721+0000", 2024-09-14T06:01:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074999748000000005 2024-09-14T06:01:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.343784+0000", 2024-09-14T06:01:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3174000000000002e-05 2024-09-14T06:01:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.344099+0000", 2024-09-14T06:01:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000315299 2024-09-14T06:01:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59398 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 323584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:01:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.171867436, 2024-09-14T06:01:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073326565999999996, 2024-09-14T06:01:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59398 2024-09-14T06:01:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:01:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279674+0000", 2024-09-14T06:01:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279675+0000", 2024-09-14T06:01:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.297e-06 2024-09-14T06:01:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279681+0000", 2024-09-14T06:01:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-09-14T06:01:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279702+0000", 2024-09-14T06:01:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1259000000000001e-05 2024-09-14T06:01:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279718+0000", 2024-09-14T06:01:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5475999999999999e-05 2024-09-14T06:01:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352360+0000", 2024-09-14T06:01:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.07264226 2024-09-14T06:01:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.352447+0000", 2024-09-14T06:01:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7381999999999998e-05 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353000+0000", 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055309200000000004 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59399 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.17180307300001, 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073824446000000002, 2024-09-14T06:01:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59399 2024-09-14T06:01:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:01:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279738+0000", 2024-09-14T06:01:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279739+0000", 2024-09-14T06:01:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3069999999999999e-06 2024-09-14T06:01:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279745+0000", 2024-09-14T06:01:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7729999999999996e-06 2024-09-14T06:01:37.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279767+0000", 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1639000000000001e-05 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279781+0000", 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4511999999999999e-05 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353045+0000", 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073263718000000005 2024-09-14T06:01:37.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353168+0000", 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012314499999999999 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353562+0000", 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039435199999999999 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59400 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:01:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.171739313, 2024-09-14T06:01:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074271465999999994, 2024-09-14T06:01:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59400 2024-09-14T06:01:37.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:01:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279802+0000", 2024-09-14T06:01:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279803+0000", 2024-09-14T06:01:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2100000000000001e-06 2024-09-14T06:01:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279819+0000", 2024-09-14T06:01:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6409000000000002e-05 2024-09-14T06:01:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279841+0000", 2024-09-14T06:01:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1878e-05 2024-09-14T06:01:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279856+0000", 2024-09-14T06:01:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4392999999999999e-05 2024-09-14T06:01:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353650+0000", 2024-09-14T06:01:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.073794144000000006 2024-09-14T06:01:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.353757+0000", 2024-09-14T06:01:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010687 2024-09-14T06:01:37.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354073+0000", 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000316562 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59401 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 372736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.171664488, 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074643900999999999, 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.499 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59401 2024-09-14T06:01:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:01:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279877+0000", 2024-09-14T06:01:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279878+0000", 2024-09-14T06:01:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.31e-06 2024-09-14T06:01:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279883+0000", 2024-09-14T06:01:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3770000000000004e-06 2024-09-14T06:01:37.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279906+0000", 2024-09-14T06:01:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2398000000000001e-05 2024-09-14T06:01:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279920+0000", 2024-09-14T06:01:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.402e-05 2024-09-14T06:01:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354125+0000", 2024-09-14T06:01:37.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074205750000000001 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354227+0000", 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101612 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354521+0000", 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029343400000000002 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.504 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59402 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 389120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.504 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:01:37.504 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.171602905, 2024-09-14T06:01:37.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075017027999999999, 2024-09-14T06:01:37.504 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.504 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.504 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.504 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.504 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.504 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.504 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59402 2024-09-14T06:01:37.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.504 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:01:37.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279938+0000", 2024-09-14T06:01:37.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279939+0000", 2024-09-14T06:01:37.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2470000000000001e-06 2024-09-14T06:01:37.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279945+0000", 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279966+0000", 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1801999999999999e-05 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.279980+0000", 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3589e-05 2024-09-14T06:01:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354569+0000", 2024-09-14T06:01:37.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074588707000000004 2024-09-14T06:01:37.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354671+0000", 2024-09-14T06:01:37.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102398 2024-09-14T06:01:37.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.354955+0000", 2024-09-14T06:01:37.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028406500000000001 2024-09-14T06:01:37.508 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.508 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.508 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.508 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59403 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 405504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.508 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:01:37.508 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.17154111799999, 2024-09-14T06:01:37.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075434395000000001, 2024-09-14T06:01:37.508 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.508 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.508 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.508 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.508 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59403 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280000+0000", 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280001+0000", 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2669999999999999e-06 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280008+0000", 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5849999999999996e-06 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280030+0000", 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2293000000000002e-05 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280044+0000", 2024-09-14T06:01:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3974999999999999e-05 2024-09-14T06:01:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355013+0000", 2024-09-14T06:01:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074969039000000001 2024-09-14T06:01:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355144+0000", 2024-09-14T06:01:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000131333 2024-09-14T06:01:37.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355434+0000", 2024-09-14T06:01:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028990299999999999 2024-09-14T06:01:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59404 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 421888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:01:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.17147599899999, 2024-09-14T06:01:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075696103000000001, 2024-09-14T06:01:37.512 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59404 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280065+0000", 2024-09-14T06:01:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280066+0000", 2024-09-14T06:01:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2640000000000001e-06 2024-09-14T06:01:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280072+0000", 2024-09-14T06:01:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129999999999997e-06 2024-09-14T06:01:37.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280094+0000", 2024-09-14T06:01:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2608000000000001e-05 2024-09-14T06:01:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280109+0000", 2024-09-14T06:01:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4341999999999999e-05 2024-09-14T06:01:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355479+0000", 2024-09-14T06:01:37.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075370699999999999 2024-09-14T06:01:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355554+0000", 2024-09-14T06:01:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4674999999999999e-05 2024-09-14T06:01:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355761+0000", 2024-09-14T06:01:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710100000000001 2024-09-14T06:01:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.516 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.517 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59405 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 438272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.517 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:01:37.517 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.171412089, 2024-09-14T06:01:37.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076008867999999993, 2024-09-14T06:01:37.517 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.517 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.517 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.517 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.517 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.517 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.517 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59405 2024-09-14T06:01:37.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280129+0000", 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280130+0000", 2024-09-14T06:01:37.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2500000000000001e-06 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280136+0000", 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280158+0000", 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1795000000000001e-05 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280172+0000", 2024-09-14T06:01:37.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4303e-05 2024-09-14T06:01:37.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355797+0000", 2024-09-14T06:01:37.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075624835000000001 2024-09-14T06:01:37.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.355866+0000", 2024-09-14T06:01:37.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9043999999999998e-05 2024-09-14T06:01:37.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356138+0000", 2024-09-14T06:01:37.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027207799999999998 2024-09-14T06:01:37.521 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.521 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.521 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.521 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59406 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.521 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:01:37.521 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.171348147, 2024-09-14T06:01:37.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076435642999999998, 2024-09-14T06:01:37.521 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.521 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.521 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.521 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.522 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.522 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.522 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59406 2024-09-14T06:01:37.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.522 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:01:37.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280193+0000", 2024-09-14T06:01:37.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280194+0000", 2024-09-14T06:01:37.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2839999999999999e-06 2024-09-14T06:01:37.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280200+0000", 2024-09-14T06:01:37.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6359999999999999e-06 2024-09-14T06:01:37.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280222+0000", 2024-09-14T06:01:37.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1628999999999999e-05 2024-09-14T06:01:37.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280236+0000", 2024-09-14T06:01:37.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4413000000000001e-05 2024-09-14T06:01:37.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356172+0000", 2024-09-14T06:01:37.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.075936466999999994 2024-09-14T06:01:37.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356260+0000", 2024-09-14T06:01:37.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7437999999999999e-05 2024-09-14T06:01:37.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356629+0000", 2024-09-14T06:01:37.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036877600000000002 2024-09-14T06:01:37.525 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.526 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.526 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.526 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59407 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 471040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.526 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:01:37.526 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.171283914, 2024-09-14T06:01:37.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076820083999999997, 2024-09-14T06:01:37.526 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.526 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.526 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.526 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.526 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.527 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.527 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59407 2024-09-14T06:01:37.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.527 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:01:37.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280257+0000", 2024-09-14T06:01:37.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280258+0000", 2024-09-14T06:01:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1370000000000001e-06 2024-09-14T06:01:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280264+0000", 2024-09-14T06:01:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6930000000000004e-06 2024-09-14T06:01:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280285+0000", 2024-09-14T06:01:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1455999999999999e-05 2024-09-14T06:01:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280300+0000", 2024-09-14T06:01:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4319e-05 2024-09-14T06:01:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356676+0000", 2024-09-14T06:01:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076376615999999994 2024-09-14T06:01:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.356768+0000", 2024-09-14T06:01:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1234000000000001e-05 2024-09-14T06:01:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357077+0000", 2024-09-14T06:01:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00030962900000000001 2024-09-14T06:01:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.530 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59408 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 487424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:01:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.17121891399999, 2024-09-14T06:01:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077185511999999998, 2024-09-14T06:01:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59408 2024-09-14T06:01:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280322+0000", 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280323+0000", 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2860000000000001e-06 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280329+0000", 2024-09-14T06:01:37.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.553e-06 2024-09-14T06:01:37.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280352+0000", 2024-09-14T06:01:37.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2779e-05 2024-09-14T06:01:37.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280366+0000", 2024-09-14T06:01:37.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4279e-05 2024-09-14T06:01:37.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357126+0000", 2024-09-14T06:01:37.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.076760326000000004 2024-09-14T06:01:37.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357223+0000", 2024-09-14T06:01:37.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6490000000000006e-05 2024-09-14T06:01:37.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357508+0000", 2024-09-14T06:01:37.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028479900000000002 2024-09-14T06:01:37.534 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59409 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 503808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.171154684, 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077536090000000002, 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.535 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59409 2024-09-14T06:01:37.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.536 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:01:37.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280386+0000", 2024-09-14T06:01:37.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280388+0000", 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.096e-06 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280393+0000", 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9660000000000004e-06 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280414+0000", 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1175999999999999e-05 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280427+0000", 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3032e-05 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357553+0000", 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077125845999999998 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357624+0000", 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1062000000000005e-05 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357923+0000", 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029891199999999997 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:59410 3.10 3:09483614:::rbd_data.1127e0283608.0000000000000007:14 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 102.171095372, 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077854494999999996, 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.539 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.540 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.540 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.540 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59410 2024-09-14T06:01:37.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.540 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:01:37.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280446+0000", 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280447+0000", 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1069999999999999e-06 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280453+0000", 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1999999999999999e-06 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280471+0000", 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8295999999999999e-05 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.280484+0000", 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2609000000000001e-05 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.357954+0000", 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.077470405000000006 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358040+0000", 2024-09-14T06:01:37.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.551e-05 2024-09-14T06:01:37.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T05:59:55.358300+0000", 2024-09-14T06:01:37.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026036800000000003 2024-09-14T06:01:37.543 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.543 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.543 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.543 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.543 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.543 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:37.544 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-14T06:01:37.670 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:37.670 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:37.670 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-09-14T06:01:37.670 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:37.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-14T06:01:37.804 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:37.804 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-09-14T06:01:37.804 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-09-14T06:01:37.804 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-09-14T06:01:37.804 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:37.819 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-14T06:01:37.942 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-14T06:01:37.942 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-09-14T06:01:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-09-14T06:01:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-09-14T06:01:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114753 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1564672~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:01:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.583437238000002, 2024-09-14T06:01:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111972162, 2024-09-14T06:01:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.943 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114753 2024-09-14T06:01:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:01:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:01:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357676+0000", 2024-09-14T06:01:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6599999999999996e-07 2024-09-14T06:01:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357678+0000", 2024-09-14T06:01:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.807e-06 2024-09-14T06:01:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357683+0000", 2024-09-14T06:01:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.933e-06 2024-09-14T06:01:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357687+0000", 2024-09-14T06:01:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8469999999999998e-06 2024-09-14T06:01:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.468941+0000", 2024-09-14T06:01:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111254009 2024-09-14T06:01:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469159+0000", 2024-09-14T06:01:37.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021768800000000001 2024-09-14T06:01:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469648+0000", 2024-09-14T06:01:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048931199999999999 2024-09-14T06:01:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114754 3.d 3:b2a9f650:::rbd_data.1127189bfb31.0000000000000000:26 [read 1671168~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:01:37.947 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.583397564999999, 2024-09-14T06:01:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.112607016, 2024-09-14T06:01:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114754 2024-09-14T06:01:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:01:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357715+0000", 2024-09-14T06:01:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357716+0000", 2024-09-14T06:01:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-14T06:01:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357718+0000", 2024-09-14T06:01:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5910000000000001e-06 2024-09-14T06:01:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357725+0000", 2024-09-14T06:01:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9399999999999996e-06 2024-09-14T06:01:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357729+0000", 2024-09-14T06:01:37.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0439999999999997e-06 2024-09-14T06:01:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469752+0000", 2024-09-14T06:01:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11202385400000001 2024-09-14T06:01:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469889+0000", 2024-09-14T06:01:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136704 2024-09-14T06:01:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470322+0000", 2024-09-14T06:01:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000433337 2024-09-14T06:01:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114771 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 98304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:01:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.583356457999997, 2024-09-14T06:01:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11267808, 2024-09-14T06:01:37.952 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114771 2024-09-14T06:01:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:01:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:01:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357757+0000", 2024-09-14T06:01:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.37e-07 2024-09-14T06:01:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357759+0000", 2024-09-14T06:01:37.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5650000000000001e-06 2024-09-14T06:01:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357764+0000", 2024-09-14T06:01:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T06:01:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357768+0000", 2024-09-14T06:01:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9580000000000001e-06 2024-09-14T06:01:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469739+0000", 2024-09-14T06:01:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.111971591 2024-09-14T06:01:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.469951+0000", 2024-09-14T06:01:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021185999999999999 2024-09-14T06:01:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470435+0000", 2024-09-14T06:01:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048335499999999998 2024-09-14T06:01:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114772 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 204800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:01:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.583316242000002, 2024-09-14T06:01:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11329244500000001, 2024-09-14T06:01:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.957 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114772 2024-09-14T06:01:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:01:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:01:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357797+0000", 2024-09-14T06:01:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3099999999999998e-07 2024-09-14T06:01:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357799+0000", 2024-09-14T06:01:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0770000000000002e-06 2024-09-14T06:01:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357805+0000", 2024-09-14T06:01:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3329999999999996e-06 2024-09-14T06:01:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357816+0000", 2024-09-14T06:01:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0869999999999999e-05 2024-09-14T06:01:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470507+0000", 2024-09-14T06:01:37.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.112691635 2024-09-14T06:01:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.470648+0000", 2024-09-14T06:01:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014075000000000001 2024-09-14T06:01:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471089+0000", 2024-09-14T06:01:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000441249 2024-09-14T06:01:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114773 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 311296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:01:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.583270696, 2024-09-14T06:01:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114111303, 2024-09-14T06:01:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114773 2024-09-14T06:01:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.962 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:01:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357842+0000", 2024-09-14T06:01:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357843+0000", 2024-09-14T06:01:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4499999999999997e-07 2024-09-14T06:01:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357844+0000", 2024-09-14T06:01:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.612e-06 2024-09-14T06:01:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357851+0000", 2024-09-14T06:01:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7900000000000002e-06 2024-09-14T06:01:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357855+0000", 2024-09-14T06:01:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9310000000000001e-06 2024-09-14T06:01:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471187+0000", 2024-09-14T06:01:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.113332222 2024-09-14T06:01:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471425+0000", 2024-09-14T06:01:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000237412 2024-09-14T06:01:37.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.471954+0000", 2024-09-14T06:01:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00052879100000000003 2024-09-14T06:01:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114774 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 417792~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:01:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.583229670000001, 2024-09-14T06:01:37.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114690902, 2024-09-14T06:01:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114774 2024-09-14T06:01:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:01:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357883+0000", 2024-09-14T06:01:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357884+0000", 2024-09-14T06:01:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.37e-07 2024-09-14T06:01:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357886+0000", 2024-09-14T06:01:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7010000000000001e-06 2024-09-14T06:01:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357891+0000", 2024-09-14T06:01:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1139999999999997e-06 2024-09-14T06:01:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357896+0000", 2024-09-14T06:01:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5999999999999997e-06 2024-09-14T06:01:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472030+0000", 2024-09-14T06:01:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11413328 2024-09-14T06:01:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472157+0000", 2024-09-14T06:01:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012693900000000001 2024-09-14T06:01:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472574+0000", 2024-09-14T06:01:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041773100000000002 2024-09-14T06:01:37.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114775 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 524288~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.583190002000002, 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.115518357, 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.971 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114775 2024-09-14T06:01:37.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.972 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:01:37.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357923+0000", 2024-09-14T06:01:37.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357924+0000", 2024-09-14T06:01:37.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3799999999999997e-07 2024-09-14T06:01:37.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357928+0000", 2024-09-14T06:01:37.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7700000000000001e-06 2024-09-14T06:01:37.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357934+0000", 2024-09-14T06:01:37.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6420000000000004e-06 2024-09-14T06:01:37.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357938+0000", 2024-09-14T06:01:37.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1899999999999997e-06 2024-09-14T06:01:37.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472667+0000", 2024-09-14T06:01:37.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.114728409 2024-09-14T06:01:37.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.472901+0000", 2024-09-14T06:01:37.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023484100000000001 2024-09-14T06:01:37.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473441+0000", 2024-09-14T06:01:37.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053996700000000003 2024-09-14T06:01:37.975 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.975 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.975 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.976 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114776 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 630784~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:37.976 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:01:37.976 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.583150105999998, 2024-09-14T06:01:37.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11610183, 2024-09-14T06:01:37.976 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.976 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.976 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.976 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114776 2024-09-14T06:01:37.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.976 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:01:37.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357963+0000", 2024-09-14T06:01:37.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357964+0000", 2024-09-14T06:01:37.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7700000000000004e-07 2024-09-14T06:01:37.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357965+0000", 2024-09-14T06:01:37.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.761e-06 2024-09-14T06:01:37.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357970+0000", 2024-09-14T06:01:37.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1429999999999997e-06 2024-09-14T06:01:37.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.357974+0000", 2024-09-14T06:01:37.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8879999999999999e-06 2024-09-14T06:01:37.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473514+0000", 2024-09-14T06:01:37.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11554007500000001 2024-09-14T06:01:37.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.473641+0000", 2024-09-14T06:01:37.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000127088 2024-09-14T06:01:37.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474065+0000", 2024-09-14T06:01:37.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00042329800000000001 2024-09-14T06:01:37.980 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.980 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.980 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.980 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114777 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 737280~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:37.980 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:01:37.980 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.583110931, 2024-09-14T06:01:37.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11697975200000001, 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114777 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358002+0000", 2024-09-14T06:01:37.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358003+0000", 2024-09-14T06:01:37.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4600000000000005e-07 2024-09-14T06:01:37.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358004+0000", 2024-09-14T06:01:37.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6950000000000001e-06 2024-09-14T06:01:37.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358010+0000", 2024-09-14T06:01:37.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2410000000000003e-06 2024-09-14T06:01:37.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358014+0000", 2024-09-14T06:01:37.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9380000000000002e-06 2024-09-14T06:01:37.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474156+0000", 2024-09-14T06:01:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.116142597 2024-09-14T06:01:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474386+0000", 2024-09-14T06:01:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023008999999999999 2024-09-14T06:01:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.474982+0000", 2024-09-14T06:01:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059564500000000001 2024-09-14T06:01:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.984 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114778 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 843776~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:01:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.583070587999998, 2024-09-14T06:01:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11749908100000001, 2024-09-14T06:01:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114778 2024-09-14T06:01:37.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.986 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:01:37.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358042+0000", 2024-09-14T06:01:37.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358043+0000", 2024-09-14T06:01:37.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3399999999999999e-07 2024-09-14T06:01:37.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358045+0000", 2024-09-14T06:01:37.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8789999999999999e-06 2024-09-14T06:01:37.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358052+0000", 2024-09-14T06:01:37.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.951e-06 2024-09-14T06:01:37.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358056+0000", 2024-09-14T06:01:37.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.121e-06 2024-09-14T06:01:37.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475018+0000", 2024-09-14T06:01:37.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11696224199999999 2024-09-14T06:01:37.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475141+0000", 2024-09-14T06:01:37.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012285099999999999 2024-09-14T06:01:37.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475542+0000", 2024-09-14T06:01:37.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00040050300000000002 2024-09-14T06:01:37.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.989 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.990 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114779 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 950272~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:37.990 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:01:37.990 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.583027989000001, 2024-09-14T06:01:37.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.118289098, 2024-09-14T06:01:37.990 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.990 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.990 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.990 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.990 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.990 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.994 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114779 2024-09-14T06:01:37.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.994 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:01:37.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358085+0000", 2024-09-14T06:01:37.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358086+0000", 2024-09-14T06:01:37.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5300000000000004e-07 2024-09-14T06:01:37.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:37.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358087+0000", 2024-09-14T06:01:37.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.623e-06 2024-09-14T06:01:37.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:37.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358093+0000", 2024-09-14T06:01:37.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9510000000000003e-06 2024-09-14T06:01:37.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:37.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358097+0000", 2024-09-14T06:01:37.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1819999999999999e-06 2024-09-14T06:01:37.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:37.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475637+0000", 2024-09-14T06:01:37.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11753928600000001 2024-09-14T06:01:37.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.475862+0000", 2024-09-14T06:01:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225336 2024-09-14T06:01:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476374+0000", 2024-09-14T06:01:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000512167 2024-09-14T06:01:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114780 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1056768~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:37.998 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:01:37.998 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.582986965000003, 2024-09-14T06:01:37.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.119083513, 2024-09-14T06:01:37.998 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:37.998 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:37.998 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:37.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:37.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:37.998 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:37.998 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114780 2024-09-14T06:01:37.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.998 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:37.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:37.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:01:37.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:37.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358126+0000", 2024-09-14T06:01:37.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:37.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:37.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:37.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358127+0000", 2024-09-14T06:01:37.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.44e-07 2024-09-14T06:01:37.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:37.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:38.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358128+0000", 2024-09-14T06:01:38.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.714e-06 2024-09-14T06:01:38.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:38.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358135+0000", 2024-09-14T06:01:38.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-09-14T06:01:38.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358140+0000", 2024-09-14T06:01:38.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1969999999999998e-06 2024-09-14T06:01:38.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:38.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476456+0000", 2024-09-14T06:01:38.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.118316717 2024-09-14T06:01:38.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:38.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.476674+0000", 2024-09-14T06:01:38.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021775200000000001 2024-09-14T06:01:38.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:38.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477210+0000", 2024-09-14T06:01:38.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053548400000000003 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114781 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1163264~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.582941843999997, 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11988966700000001, 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:38.002 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114781 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358171+0000", 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:38.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358172+0000", 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.44e-07 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358174+0000", 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9920000000000002e-06 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358179+0000", 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.288e-06 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358183+0000", 2024-09-14T06:01:38.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0489999999999997e-06 2024-09-14T06:01:38.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:38.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477294+0000", 2024-09-14T06:01:38.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11911132000000001 2024-09-14T06:01:38.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:38.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.477516+0000", 2024-09-14T06:01:38.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022208500000000001 2024-09-14T06:01:38.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478061+0000", 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00054438900000000005 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114782 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1269760~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.582923276999999, 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.120723238, 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:38.006 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:38.007 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.007 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114782 2024-09-14T06:01:38.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.007 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:38.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:38.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:01:38.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:38.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:01:38.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:38.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358190+0000", 2024-09-14T06:01:38.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4099999999999999e-07 2024-09-14T06:01:38.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:38.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358192+0000", 2024-09-14T06:01:38.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.559e-06 2024-09-14T06:01:38.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:38.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358197+0000", 2024-09-14T06:01:38.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6789999999999996e-06 2024-09-14T06:01:38.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358202+0000", 2024-09-14T06:01:38.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4779999999999999e-06 2024-09-14T06:01:38.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:38.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478140+0000", 2024-09-14T06:01:38.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.11993833600000001 2024-09-14T06:01:38.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:38.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478358+0000", 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021785700000000001 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.478913+0000", 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055478799999999996 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114783 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1376256~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.582904931999998, 2024-09-14T06:01:38.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.121464831, 2024-09-14T06:01:38.011 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:38.011 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:38.011 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:38.011 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:38.011 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:38.011 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.011 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114783 2024-09-14T06:01:38.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.011 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:38.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:38.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:01:38.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:38.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:01:38.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:38.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358208+0000", 2024-09-14T06:01:38.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4499999999999998e-07 2024-09-14T06:01:38.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:38.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358210+0000", 2024-09-14T06:01:38.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5880000000000001e-06 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358214+0000", 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3850000000000004e-06 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358218+0000", 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7799999999999998e-06 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479024+0000", 2024-09-14T06:01:38.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.120805364 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479177+0000", 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153642 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479673+0000", 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049572699999999995 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.015 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114784 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1482752~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:38.015 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:01:38.015 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.582890274, 2024-09-14T06:01:38.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.122316759, 2024-09-14T06:01:38.015 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:38.015 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:38.015 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:38.015 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:38.015 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:38.015 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.015 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114784 2024-09-14T06:01:38.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.015 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:38.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358223+0000", 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2399999999999999e-07 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:38.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358225+0000", 2024-09-14T06:01:38.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5570000000000001e-06 2024-09-14T06:01:38.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:38.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358229+0000", 2024-09-14T06:01:38.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5589999999999999e-06 2024-09-14T06:01:38.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358233+0000", 2024-09-14T06:01:38.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7270000000000001e-06 2024-09-14T06:01:38.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:38.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.479769+0000", 2024-09-14T06:01:38.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12153594299999999 2024-09-14T06:01:38.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:38.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480000+0000", 2024-09-14T06:01:38.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000230967 2024-09-14T06:01:38.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:38.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480540+0000", 2024-09-14T06:01:38.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00053968199999999999 2024-09-14T06:01:38.019 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.019 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:38.019 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.019 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114785 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1589248~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:38.019 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:01:38.019 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.582874083, 2024-09-14T06:01:38.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123154237, 2024-09-14T06:01:38.019 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:38.019 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:38.019 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:38.019 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:38.019 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:38.020 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.020 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114785 2024-09-14T06:01:38.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.020 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:38.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:38.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:01:38.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:38.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:01:38.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358239+0000", 2024-09-14T06:01:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3799999999999998e-07 2024-09-14T06:01:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358241+0000", 2024-09-14T06:01:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.457e-06 2024-09-14T06:01:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:38.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358245+0000", 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.42e-06 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358249+0000", 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7740000000000002e-06 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480626+0000", 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12237743600000001 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:38.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.480844+0000", 2024-09-14T06:01:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021792299999999999 2024-09-14T06:01:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481393+0000", 2024-09-14T06:01:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000548889 2024-09-14T06:01:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114786 3.15 3:ab99a443:::rbd_data.1127189bfb31.0000000000000002:26 [read 1695744~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:01:38.023 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.582859378999999, 2024-09-14T06:01:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123995568, 2024-09-14T06:01:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-09-14T06:01:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114786 2024-09-14T06:01:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:38.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:01:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:01:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358254+0000", 2024-09-14T06:01:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.27e-07 2024-09-14T06:01:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358256+0000", 2024-09-14T06:01:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5460000000000001e-06 2024-09-14T06:01:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358260+0000", 2024-09-14T06:01:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3819999999999997e-06 2024-09-14T06:01:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358264+0000", 2024-09-14T06:01:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7469999999999999e-06 2024-09-14T06:01:38.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481473+0000", 2024-09-14T06:01:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123209244 2024-09-14T06:01:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.481686+0000", 2024-09-14T06:01:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000212957 2024-09-14T06:01:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482249+0000", 2024-09-14T06:01:38.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00056336500000000002 2024-09-14T06:01:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:114867 3.15 3:aea12e8e:::rbd_data.1127cb09e343.000000000000000b:head [stat,truncate 737280] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e93)", 2024-09-14T06:01:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:01:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.582844794000003, 2024-09-14T06:01:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12722582099999999, 2024-09-14T06:01:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T06:01:38.028 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 114867 2024-09-14T06:01:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:01:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:38.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358268+0000", 2024-09-14T06:01:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358269+0000", 2024-09-14T06:01:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4799999999999999e-07 2024-09-14T06:01:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358274+0000", 2024-09-14T06:01:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.237e-06 2024-09-14T06:01:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358279+0000", 2024-09-14T06:01:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7990000000000001e-06 2024-09-14T06:01:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.358284+0000", 2024-09-14T06:01:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1900000000000003e-06 2024-09-14T06:01:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482355+0000", 2024-09-14T06:01:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.124070718 2024-09-14T06:01:38.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-09-14T06:01:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482496+0000", 2024-09-14T06:01:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014162699999999999 2024-09-14T06:01:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 3", 2024-09-14T06:01:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.482722+0000", 2024-09-14T06:01:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000225622 2024-09-14T06:01:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-09-14T06:01:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.484427+0000", 2024-09-14T06:01:38.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001704929 2024-09-14T06:01:38.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-09-14T06:01:38.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485332+0000", 2024-09-14T06:01:38.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00090576600000000001 2024-09-14T06:01:38.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-09-14T06:01:38.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485429+0000", 2024-09-14T06:01:38.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6540999999999996e-05 2024-09-14T06:01:38.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:00:37.485494+0000", 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5043999999999996e-05 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4391.0:123535 3.f 3.fbaab0af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-09-14T06:01:05.349325+0000", 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.591787779000001, 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.983705842, 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: "continuous": false, 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-09-14T06:01:38.034 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4391", 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 123535 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349325+0000", 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349325+0000", 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-09-14T06:01:38.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-09-14T06:01:38.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349329+0000", 2024-09-14T06:01:38.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5999999999999998e-06 2024-09-14T06:01:38.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-09-14T06:01:38.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349345+0000", 2024-09-14T06:01:38.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6195999999999999e-05 2024-09-14T06:01:38.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-09-14T06:01:38.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349385+0000", 2024-09-14T06:01:38.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0172000000000001e-05 2024-09-14T06:01:38.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349408+0000", 2024-09-14T06:01:38.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3224999999999999e-05 2024-09-14T06:01:38.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:38.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349631+0000", 2024-09-14T06:01:38.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022237400000000001 2024-09-14T06:01:38.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for peered", 2024-09-14T06:01:38.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:05.349658+0000", 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7559000000000002e-05 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:06.333011+0000", 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.98335301100000005 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-09-14T06:01:06.333031+0000", 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9704999999999999e-05 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.038 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-14T06:01:38.039 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-14T06:01:38.039 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-14T06:01:38.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T06:01:38.175 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:38.176 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:38.176 INFO:teuthology.orchestra.run.smithi006.stdout: "num_ops": 0 2024-09-14T06:01:38.176 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:38.190 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T06:01:38.319 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:38.319 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [], 2024-09-14T06:01:38.319 INFO:teuthology.orchestra.run.smithi006.stdout: "complaint_time": 30, 2024-09-14T06:01:38.319 INFO:teuthology.orchestra.run.smithi006.stdout: "num_blocked_ops": 0 2024-09-14T06:01:38.319 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:38.334 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T06:01:38.388 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T06:01:38.467 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:01:38.467 INFO:teuthology.orchestra.run.smithi006.stdout: "size": 20, 2024-09-14T06:01:38.467 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 600, 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: "ops": [ 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119850 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 3571712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.714772529999998, 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050424731, 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119850 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.468 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751244+0000", 2024-09-14T06:01:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6100000000000001e-07 2024-09-14T06:01:38.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751247+0000", 2024-09-14T06:01:38.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5059999999999998e-06 2024-09-14T06:01:38.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751255+0000", 2024-09-14T06:01:38.470 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3080000000000008e-06 2024-09-14T06:01:38.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.470 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.470 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.470 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751262+0000", 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.1060000000000002e-06 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801559+0000", 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050297043 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801614+0000", 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5028999999999998e-05 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.471 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801668+0000", 2024-09-14T06:01:38.472 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4178000000000002e-05 2024-09-14T06:01:38.472 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.472 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.472 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.472 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.472 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.472 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119851 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 3620864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.472 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:01:38.472 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.714743873000003, 2024-09-14T06:01:38.472 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050528479000000001, 2024-09-14T06:01:38.472 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.472 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.472 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119851 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.751272+0000", 2024-09-14T06:01:38.473 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752502+0000", 2024-09-14T06:01:38.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0012294529999999999 2024-09-14T06:01:38.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752508+0000", 2024-09-14T06:01:38.474 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.8780000000000003e-06 2024-09-14T06:01:38.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.474 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.474 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.474 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752522+0000", 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4405e-05 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.752532+0000", 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.6739999999999992e-06 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801702+0000", 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.049169996000000001 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.475 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801744+0000", 2024-09-14T06:01:38.476 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2789e-05 2024-09-14T06:01:38.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.476 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.476 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.476 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.801801+0000", 2024-09-14T06:01:38.476 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6283999999999998e-05 2024-09-14T06:01:38.476 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.476 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.476 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.476 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.476 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119877 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4898816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.476 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:38.476 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.710014438999998, 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050416282999999999, 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119877 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756002+0000", 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6300000000000005e-07 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756005+0000", 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7350000000000001e-06 2024-09-14T06:01:38.478 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756012+0000", 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8990000000000004e-06 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756017+0000", 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.023e-06 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806256+0000", 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050239355999999999 2024-09-14T06:01:38.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806331+0000", 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4800000000000002e-05 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806418+0000", 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.6907e-05 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.480 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119878 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4947968~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.481 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:01:38.481 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.709989593000003, 2024-09-14T06:01:38.481 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050582539000000003, 2024-09-14T06:01:38.481 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.481 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.481 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.481 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.481 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.481 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.481 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119878 2024-09-14T06:01:38.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.481 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.481 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.481 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756026+0000", 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756027+0000", 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.1399999999999997e-07 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.482 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756029+0000", 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.3420000000000002e-06 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756036+0000", 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9550000000000003e-06 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756041+0000", 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2669999999999997e-06 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.483 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806448+0000", 2024-09-14T06:01:38.484 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050407037000000002 2024-09-14T06:01:38.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.484 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.484 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.484 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806526+0000", 2024-09-14T06:01:38.484 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.7119000000000005e-05 2024-09-14T06:01:38.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.484 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.484 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.484 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806609+0000", 2024-09-14T06:01:38.484 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.3405000000000005e-05 2024-09-14T06:01:38.484 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.484 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.484 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.485 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.485 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119879 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 4997120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.485 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:38.485 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.709967112999998, 2024-09-14T06:01:38.485 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.05075727, 2024-09-14T06:01:38.485 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.485 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.485 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.485 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.485 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.485 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.485 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119879 2024-09-14T06:01:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.486 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.487 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756049+0000", 2024-09-14T06:01:38.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.9400000000000001e-07 2024-09-14T06:01:38.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.487 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.487 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.487 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756058+0000", 2024-09-14T06:01:38.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5199999999999997e-06 2024-09-14T06:01:38.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.487 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.487 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.487 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756065+0000", 2024-09-14T06:01:38.487 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.9800000000000001e-06 2024-09-14T06:01:38.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756070+0000", 2024-09-14T06:01:38.488 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.2360000000000004e-06 2024-09-14T06:01:38.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806639+0000", 2024-09-14T06:01:38.488 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050568702 2024-09-14T06:01:38.488 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.488 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.488 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.488 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806714+0000", 2024-09-14T06:01:38.488 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4825000000000003e-05 2024-09-14T06:01:38.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.489 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.489 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806806+0000", 2024-09-14T06:01:38.489 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2613000000000003e-05 2024-09-14T06:01:38.489 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.489 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.489 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.489 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.489 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119880 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5046272~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.489 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:38.489 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.709912414000001, 2024-09-14T06:01:38.489 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050918568999999997, 2024-09-14T06:01:38.490 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.490 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.490 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.490 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.490 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.490 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.490 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119880 2024-09-14T06:01:38.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.490 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.490 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.490 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:38.490 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.491 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:38.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.491 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756104+0000", 2024-09-14T06:01:38.491 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.5700000000000002e-07 2024-09-14T06:01:38.491 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.491 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.491 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.492 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756107+0000", 2024-09-14T06:01:38.492 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.8159999999999998e-06 2024-09-14T06:01:38.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.492 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.492 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756116+0000", 2024-09-14T06:01:38.492 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4980000000000006e-06 2024-09-14T06:01:38.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.492 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.492 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756122+0000", 2024-09-14T06:01:38.492 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.8809999999999998e-06 2024-09-14T06:01:38.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.492 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.493 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.493 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806841+0000", 2024-09-14T06:01:38.493 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050718907000000001 2024-09-14T06:01:38.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.493 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.493 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.806927+0000", 2024-09-14T06:01:38.493 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5908999999999994e-05 2024-09-14T06:01:38.493 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.493 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.493 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.493 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807022+0000", 2024-09-14T06:01:38.493 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.4901000000000005e-05 2024-09-14T06:01:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119881 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5095424~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:01:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.709881791000001, 2024-09-14T06:01:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051097946999999998, 2024-09-14T06:01:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.494 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.495 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.495 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119881 2024-09-14T06:01:38.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.495 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.495 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.495 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:01:38.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.495 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.495 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.495 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756134+0000", 2024-09-14T06:01:38.495 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756135+0000", 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.51e-07 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756137+0000", 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2230000000000001e-06 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756145+0000", 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.6629999999999993e-06 2024-09-14T06:01:38.496 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.497 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.497 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756150+0000", 2024-09-14T06:01:38.497 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9150000000000004e-06 2024-09-14T06:01:38.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.497 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.497 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807054+0000", 2024-09-14T06:01:38.497 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050904855999999998 2024-09-14T06:01:38.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.497 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.497 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.497 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807137+0000", 2024-09-14T06:01:38.497 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.2248000000000003e-05 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807232+0000", 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5490999999999998e-05 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119882 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5144576~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.709857915000001, 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051297745999999998, 2024-09-14T06:01:38.498 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119882 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.499 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756158+0000", 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756159+0000", 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.4299999999999998e-07 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756161+0000", 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4959999999999999e-06 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.500 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756170+0000", 2024-09-14T06:01:38.501 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1779999999999992e-06 2024-09-14T06:01:38.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.501 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.501 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756176+0000", 2024-09-14T06:01:38.501 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.0090000000000004e-06 2024-09-14T06:01:38.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.501 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.501 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807264+0000", 2024-09-14T06:01:38.501 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051087948000000001 2024-09-14T06:01:38.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.501 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.502 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.502 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807353+0000", 2024-09-14T06:01:38.502 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.8919999999999996e-05 2024-09-14T06:01:38.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.502 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.502 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807456+0000", 2024-09-14T06:01:38.502 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010275199999999999 2024-09-14T06:01:38.502 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.502 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.502 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.502 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.502 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119883 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5193728~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.709831061999999, 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051484553000000002, 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119883 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:38.503 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756185+0000", 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.8699999999999995e-07 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756188+0000", 2024-09-14T06:01:38.504 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.4820000000000001e-06 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756195+0000", 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.545e-06 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756200+0000", 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.045e-06 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807487+0000", 2024-09-14T06:01:38.505 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051287228999999997 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807572+0000", 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5303999999999995e-05 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807670+0000", 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.7460999999999994e-05 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.506 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119884 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5242880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.709790572999999, 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051672403999999998, 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119884 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:01:38.507 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756225+0000", 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756226+0000", 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7899999999999998e-07 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756229+0000", 2024-09-14T06:01:38.508 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.9919999999999999e-06 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756237+0000", 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1280000000000008e-06 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756244+0000", 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7519999999999999e-06 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807726+0000", 2024-09-14T06:01:38.509 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051482344999999999 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807808+0000", 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.1845e-05 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807898+0000", 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9662999999999999e-05 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119885 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5292032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.709762167999997, 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051858125999999997, 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119885 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.511 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:01:38.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.512 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.756254+0000", 2024-09-14T06:01:38.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.512 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759822+0000", 2024-09-14T06:01:38.512 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.0035676610000000002 2024-09-14T06:01:38.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.512 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759831+0000", 2024-09-14T06:01:38.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2329999999999995e-06 2024-09-14T06:01:38.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.513 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759842+0000", 2024-09-14T06:01:38.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0954999999999999e-05 2024-09-14T06:01:38.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.513 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.513 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.759851+0000", 2024-09-14T06:01:38.513 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1770000000000004e-06 2024-09-14T06:01:38.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.807942+0000", 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.048091438 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.808027+0000", 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.4227999999999994e-05 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.808112+0000", 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.5433999999999996e-05 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.514 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.515 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119897 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5881856~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.515 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:01:38.515 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.705957660999999, 2024-09-14T06:01:38.515 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050603113999999998, 2024-09-14T06:01:38.515 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.515 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.515 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.515 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.515 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.515 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.515 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119897 2024-09-14T06:01:38.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760058+0000", 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760059+0000", 2024-09-14T06:01:38.516 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0800000000000001e-07 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760060+0000", 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4050000000000001e-06 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760063+0000", 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2320000000000001e-06 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760066+0000", 2024-09-14T06:01:38.517 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.74e-06 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810454+0000", 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050388355000000003 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810550+0000", 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.5441999999999999e-05 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810662+0000", 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00011173199999999999 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.518 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119898 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5931008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.705946322000003, 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050800631999999998, 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119898 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.519 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.520 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.520 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:38.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.520 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.520 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:38.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.520 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.520 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760070+0000", 2024-09-14T06:01:38.520 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0900000000000001e-07 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760071+0000", 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.0899999999999999e-06 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760074+0000", 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.1470000000000001e-06 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760077+0000", 2024-09-14T06:01:38.521 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.0170000000000001e-06 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810704+0000", 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050626811000000001 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810779+0000", 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 7.4762e-05 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810870+0000", 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1595999999999995e-05 2024-09-14T06:01:38.522 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119899 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 5980160~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.705935308000001, 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051034903, 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.523 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119899 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.524 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760081+0000", 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.34e-07 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760082+0000", 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.4190000000000001e-06 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760086+0000", 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.2629999999999999e-06 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760088+0000", 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5150000000000001e-06 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.810919+0000", 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.050831111999999998 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811011+0000", 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1339000000000001e-05 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.526 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811116+0000", 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000105021 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119900 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6029312~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.705924402999997, 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051299599000000001, 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.527 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.528 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.528 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119900 2024-09-14T06:01:38.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.528 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:38.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.528 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.528 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:38.528 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.529 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.529 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760092+0000", 2024-09-14T06:01:38.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.5699999999999999e-07 2024-09-14T06:01:38.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.529 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.529 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760093+0000", 2024-09-14T06:01:38.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 1.1689999999999999e-06 2024-09-14T06:01:38.529 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.529 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.529 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.529 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760096+0000", 2024-09-14T06:01:38.529 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 3.315e-06 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760101+0000", 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.6920000000000001e-06 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811162+0000", 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051061341000000003 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811271+0000", 2024-09-14T06:01:38.530 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010851799999999999 2024-09-14T06:01:38.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.531 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.531 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811391+0000", 2024-09-14T06:01:38.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000120307 2024-09-14T06:01:38.531 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.531 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.531 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.531 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119901 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6078464~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.531 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:01:38.531 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.705882883000001, 2024-09-14T06:01:38.531 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051519772999999998, 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119901 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760133+0000", 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760134+0000", 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.92e-07 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760138+0000", 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.3869999999999997e-06 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.533 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760145+0000", 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.878e-06 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760151+0000", 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.4399999999999996e-06 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811452+0000", 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051301872999999998 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.534 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811545+0000", 2024-09-14T06:01:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.2472000000000005e-05 2024-09-14T06:01:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811653+0000", 2024-09-14T06:01:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000108031 2024-09-14T06:01:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119902 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6127616~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.705855497999998, 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051737544000000003, 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119902 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:38.536 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:38.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760161+0000", 2024-09-14T06:01:38.537 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.0600000000000001e-07 2024-09-14T06:01:38.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.537 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.537 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.537 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760163+0000", 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2850000000000001e-06 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760170+0000", 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.6030000000000001e-06 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760176+0000", 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6540000000000004e-06 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.538 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811704+0000", 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051528303999999997 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811794+0000", 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0142000000000005e-05 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811898+0000", 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010415 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.539 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.540 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119903 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6176768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.540 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:01:38.540 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.705825834999999, 2024-09-14T06:01:38.540 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051958747999999999, 2024-09-14T06:01:38.540 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.540 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.540 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.540 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.540 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.540 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.540 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119903 2024-09-14T06:01:38.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.540 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760190+0000", 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760191+0000", 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.6400000000000002e-07 2024-09-14T06:01:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760194+0000", 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.7920000000000001e-06 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760203+0000", 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0669999999999998e-06 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760208+0000", 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.5929999999999996e-06 2024-09-14T06:01:38.542 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.811955+0000", 2024-09-14T06:01:38.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051746357 2024-09-14T06:01:38.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812046+0000", 2024-09-14T06:01:38.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.1824999999999996e-05 2024-09-14T06:01:38.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.543 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.543 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.543 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812149+0000", 2024-09-14T06:01:38.543 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00010255 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119904 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6225920~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.705798647999998, 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052164159000000002, 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.544 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.545 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119904 2024-09-14T06:01:38.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.545 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:01:38.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.545 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.545 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.545 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760217+0000", 2024-09-14T06:01:38.545 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760218+0000", 2024-09-14T06:01:38.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.2899999999999999e-07 2024-09-14T06:01:38.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760220+0000", 2024-09-14T06:01:38.546 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.2879999999999999e-06 2024-09-14T06:01:38.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.546 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.546 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.546 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760226+0000", 2024-09-14T06:01:38.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.1870000000000002e-06 2024-09-14T06:01:38.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760231+0000", 2024-09-14T06:01:38.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 5.0950000000000003e-06 2024-09-14T06:01:38.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.547 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.547 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812192+0000", 2024-09-14T06:01:38.547 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.051960587000000003 2024-09-14T06:01:38.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.547 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.548 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.548 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812281+0000", 2024-09-14T06:01:38.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 8.9225e-05 2024-09-14T06:01:38.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.548 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.548 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812382+0000", 2024-09-14T06:01:38.548 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.000100348 2024-09-14T06:01:38.548 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.548 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.548 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.548 INFO:teuthology.orchestra.run.smithi006.stdout: "description": "osd_op(client.4391.0:119905 3.1 3:81bf0221:::rbd_data.1127325deb36.0000000000000000:28 [read 6275072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e98)", 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: "initiated_at": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: "age": 55.705776608999997, 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052394334000000001, 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: "continuous": false, 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: "type_data": { 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: "flag_point": "started", 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: "client_info": { 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: "client": "client.4391", 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: "client_addr": "172.21.15.6:0/3384963630", 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: "tid": 119905 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: "events": [ 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "initiated", 2024-09-14T06:01:38.549 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "header_read", 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760239+0000", 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "throttled", 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760240+0000", 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.5699999999999998e-07 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "all_read", 2024-09-14T06:01:38.550 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760242+0000", 2024-09-14T06:01:38.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 2.0959999999999999e-06 2024-09-14T06:01:38.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "dispatched", 2024-09-14T06:01:38.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760249+0000", 2024-09-14T06:01:38.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 6.7399999999999998e-06 2024-09-14T06:01:38.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "queued_for_pg", 2024-09-14T06:01:38.551 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.760254+0000", 2024-09-14T06:01:38.551 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 4.9089999999999999e-06 2024-09-14T06:01:38.551 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.551 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "reached_pg", 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812419+0000", 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.052165481 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "started", 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812510+0000", 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 9.0525000000000005e-05 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: { 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: "event": "done", 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: "time": "2024-09-14T06:00:42.812634+0000", 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: "duration": 0.00012412600000000001 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.552 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.553 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-09-14T06:01:38.553 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-09-14T06:01:38.553 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:01:39.303 INFO:teuthology.orchestra.run.smithi006.stderr:noscrub is unset 2024-09-14T06:01:39.331 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T06:01:40.371 INFO:teuthology.orchestra.run.smithi006.stderr:nodeep-scrub is unset 2024-09-14T06:01:40.374 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-14T06:01:40.515 INFO:teuthology.orchestra.run.smithi006.stdout:mon.a: {} 2024-09-14T06:01:40.516 INFO:teuthology.orchestra.run.smithi006.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T06:01:40.529 INFO:teuthology.orchestra.run.smithi006.stdout:mon.b: {} 2024-09-14T06:01:40.529 INFO:teuthology.orchestra.run.smithi006.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T06:01:40.538 INFO:teuthology.orchestra.run.smithi006.stdout:mon.c: {} 2024-09-14T06:01:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T06:01:40.555 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T06:01:41.381 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T06:01:41.409 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-14T06:01:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-14T06:01:42.421 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T06:01:43.403 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T06:01:43.434 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-14T06:01:44.313 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-14T06:01:44.341 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-14T06:01:45.428 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.3 to 1 (10000) 2024-09-14T06:01:45.455 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-14T06:01:46.437 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-14T06:01:46.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T06:01:47.447 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T06:01:47.474 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-14T06:01:48.464 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-14T06:01:48.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T06:01:49.459 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T06:01:49.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-14T06:01:50.486 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-14T06:01:50.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-14T06:01:51.482 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.6 to 1 (10000) 2024-09-14T06:01:51.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-14T06:01:51.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-09-14T06:01:51.840+0000 7fc949ed5640 0 --2- 172.21.15.6:0/947476015 >> [v2:172.21.15.6:3301/0,v1:172.21.15.6:6790/0] conn(0x7fc9440b2940 0x7fc94413e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T06:01:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-14T06:01:52.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-14T06:01:53.511 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.7 to 1 (10000) 2024-09-14T06:01:53.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-14T06:01:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-14T06:01:54.552 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T06:01:55.526 INFO:teuthology.orchestra.run.smithi006.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T06:01:55.553 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-14T06:01:56.556 INFO:teuthology.orchestra.run.smithi006.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-14T06:01:56.587 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-14T06:01:56.587 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-14T06:01:56.587 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-14T06:01:56.587 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-14T06:01:56.587 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T06:01:56.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T06:01:56.908 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:01:56.908 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":171,"fsid":"8db933fa-392d-4966-864a-b73b8a91dd2d","created":"2024-09-14T05:58:34.536616+0000","modified":"2024-09-14T06:01:56.545689+0000","last_up_change":"2024-09-14T05:59:39.727882+0000","last_in_change":"2024-09-14T06:01:05.316677+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T05:58:47.505149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T05:58:52.779258+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-14T05:59:04.433909+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":40,"snap_epoch":153,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ef61ed5-359d-4de3-be54-41d3a66c393a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":27,"up_from":46,"up_thru":140,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":643732088},{"type":"v1","addr":"172.21.15.6:6825","nonce":643732088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":643732088},{"type":"v1","addr":"172.21.15.6:6827","nonce":643732088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":643732088},{"type":"v1","addr":"172.21.15.6:6831","nonce":643732088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":643732088},{"type":"v1","addr":"172.21.15.6:6829","nonce":643732088}]},"public_addr":"172.21.15.6:6825/643732088","cluster_addr":"172.21.15.6:6827/643732088","heartbeat_back_addr":"172.21.15.6:6831/643732088","heartbeat_front_addr":"172.21.15.6:6829/643732088","state":["exists","up"]},{"osd":1,"uuid":"f180c483-9b53-4808-b5ec-537bf956087d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6815","nonce":1278360579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6819","nonce":1278360579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6823","nonce":1278360579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6821","nonce":1278360579}]},"public_addr":"172.21.15.6:6815/1278360579","cluster_addr":"172.21.15.6:6819/1278360579","heartbeat_back_addr":"172.21.15.6:6823/1278360579","heartbeat_front_addr":"172.21.15.6:6821/1278360579","state":["exists","up"]},{"osd":2,"uuid":"bc59bb00-b3b0-4483-a5b1-cc5907cf660a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6809","nonce":4171349592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6811","nonce":4171349592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6817","nonce":4171349592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6814","nonce":4171349592}]},"public_addr":"172.21.15.6:6809/4171349592","cluster_addr":"172.21.15.6:6811/4171349592","heartbeat_back_addr":"172.21.15.6:6817/4171349592","heartbeat_front_addr":"172.21.15.6:6814/4171349592","state":["exists","up"]},{"osd":3,"uuid":"7aa9fc3b-29c5-4e9a-a894-e2abfb586263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6801","nonce":3999210088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6803","nonce":3999210088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6807","nonce":3999210088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6805","nonce":3999210088}]},"public_addr":"172.21.15.6:6801/3999210088","cluster_addr":"172.21.15.6:6803/3999210088","heartbeat_back_addr":"172.21.15.6:6807/3999210088","heartbeat_front_addr":"172.21.15.6:6805/3999210088","state":["exists","up"]},{"osd":4,"uuid":"a0665f54-f53d-4536-a322-4974c2f23aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6825","nonce":575863621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6827","nonce":575863621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6831","nonce":575863621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6829","nonce":575863621}]},"public_addr":"172.21.15.154:6825/575863621","cluster_addr":"172.21.15.154:6827/575863621","heartbeat_back_addr":"172.21.15.154:6831/575863621","heartbeat_front_addr":"172.21.15.154:6829/575863621","state":["exists","up"]},{"osd":5,"uuid":"302ab31c-c228-44da-a0d2-58505ad571cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6809","nonce":2498345645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6811","nonce":2498345645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6815","nonce":2498345645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6813","nonce":2498345645}]},"public_addr":"172.21.15.154:6809/2498345645","cluster_addr":"172.21.15.154:6811/2498345645","heartbeat_back_addr":"172.21.15.154:6815/2498345645","heartbeat_front_addr":"172.21.15.154:6813/2498345645","state":["exists","up"]},{"osd":6,"uuid":"1adbca34-daef-4229-b25e-40dec6800f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6817","nonce":267756224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6819","nonce":267756224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6823","nonce":267756224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6821","nonce":267756224}]},"public_addr":"172.21.15.154:6817/267756224","cluster_addr":"172.21.15.154:6819/267756224","heartbeat_back_addr":"172.21.15.154:6823/267756224","heartbeat_front_addr":"172.21.15.154:6821/267756224","state":["exists","up"]},{"osd":7,"uuid":"a75d9794-68bf-4e8c-bf75-448a7a783769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6801","nonce":4119173763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6803","nonce":4119173763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6807","nonce":4119173763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6805","nonce":4119173763}]},"public_addr":"172.21.15.154:6801/4119173763","cluster_addr":"172.21.15.154:6803/4119173763","heartbeat_back_addr":"172.21.15.154:6807/4119173763","heartbeat_front_addr":"172.21.15.154:6805/4119173763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.791330+0000","dead_epoch":28},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.526550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.664242+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.327736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.687393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.487578+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.106833+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"1.0","osds":[4,1]}],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T06:01:56.928 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T06:01:56.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T06:01:57.236 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:01:57.236 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":171,"fsid":"8db933fa-392d-4966-864a-b73b8a91dd2d","created":"2024-09-14T05:58:34.536616+0000","modified":"2024-09-14T06:01:56.545689+0000","last_up_change":"2024-09-14T05:59:39.727882+0000","last_in_change":"2024-09-14T06:01:05.316677+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T05:58:47.505149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T05:58:52.779258+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-14T05:59:04.433909+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":40,"snap_epoch":153,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ef61ed5-359d-4de3-be54-41d3a66c393a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":27,"up_from":46,"up_thru":140,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":643732088},{"type":"v1","addr":"172.21.15.6:6825","nonce":643732088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":643732088},{"type":"v1","addr":"172.21.15.6:6827","nonce":643732088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":643732088},{"type":"v1","addr":"172.21.15.6:6831","nonce":643732088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":643732088},{"type":"v1","addr":"172.21.15.6:6829","nonce":643732088}]},"public_addr":"172.21.15.6:6825/643732088","cluster_addr":"172.21.15.6:6827/643732088","heartbeat_back_addr":"172.21.15.6:6831/643732088","heartbeat_front_addr":"172.21.15.6:6829/643732088","state":["exists","up"]},{"osd":1,"uuid":"f180c483-9b53-4808-b5ec-537bf956087d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6815","nonce":1278360579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6819","nonce":1278360579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6823","nonce":1278360579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6821","nonce":1278360579}]},"public_addr":"172.21.15.6:6815/1278360579","cluster_addr":"172.21.15.6:6819/1278360579","heartbeat_back_addr":"172.21.15.6:6823/1278360579","heartbeat_front_addr":"172.21.15.6:6821/1278360579","state":["exists","up"]},{"osd":2,"uuid":"bc59bb00-b3b0-4483-a5b1-cc5907cf660a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6809","nonce":4171349592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6811","nonce":4171349592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6817","nonce":4171349592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6814","nonce":4171349592}]},"public_addr":"172.21.15.6:6809/4171349592","cluster_addr":"172.21.15.6:6811/4171349592","heartbeat_back_addr":"172.21.15.6:6817/4171349592","heartbeat_front_addr":"172.21.15.6:6814/4171349592","state":["exists","up"]},{"osd":3,"uuid":"7aa9fc3b-29c5-4e9a-a894-e2abfb586263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6801","nonce":3999210088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6803","nonce":3999210088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6807","nonce":3999210088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6805","nonce":3999210088}]},"public_addr":"172.21.15.6:6801/3999210088","cluster_addr":"172.21.15.6:6803/3999210088","heartbeat_back_addr":"172.21.15.6:6807/3999210088","heartbeat_front_addr":"172.21.15.6:6805/3999210088","state":["exists","up"]},{"osd":4,"uuid":"a0665f54-f53d-4536-a322-4974c2f23aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6825","nonce":575863621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6827","nonce":575863621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6831","nonce":575863621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6829","nonce":575863621}]},"public_addr":"172.21.15.154:6825/575863621","cluster_addr":"172.21.15.154:6827/575863621","heartbeat_back_addr":"172.21.15.154:6831/575863621","heartbeat_front_addr":"172.21.15.154:6829/575863621","state":["exists","up"]},{"osd":5,"uuid":"302ab31c-c228-44da-a0d2-58505ad571cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6809","nonce":2498345645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6811","nonce":2498345645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6815","nonce":2498345645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6813","nonce":2498345645}]},"public_addr":"172.21.15.154:6809/2498345645","cluster_addr":"172.21.15.154:6811/2498345645","heartbeat_back_addr":"172.21.15.154:6815/2498345645","heartbeat_front_addr":"172.21.15.154:6813/2498345645","state":["exists","up"]},{"osd":6,"uuid":"1adbca34-daef-4229-b25e-40dec6800f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6817","nonce":267756224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6819","nonce":267756224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6823","nonce":267756224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6821","nonce":267756224}]},"public_addr":"172.21.15.154:6817/267756224","cluster_addr":"172.21.15.154:6819/267756224","heartbeat_back_addr":"172.21.15.154:6823/267756224","heartbeat_front_addr":"172.21.15.154:6821/267756224","state":["exists","up"]},{"osd":7,"uuid":"a75d9794-68bf-4e8c-bf75-448a7a783769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6801","nonce":4119173763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6803","nonce":4119173763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6807","nonce":4119173763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6805","nonce":4119173763}]},"public_addr":"172.21.15.154:6801/4119173763","cluster_addr":"172.21.15.154:6803/4119173763","heartbeat_back_addr":"172.21.15.154:6807/4119173763","heartbeat_front_addr":"172.21.15.154:6805/4119173763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.791330+0000","dead_epoch":28},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.526550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.664242+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.327736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.687393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.487578+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.106833+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"1.0","osds":[4,1]}],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T06:01:57.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T06:01:57.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T06:01:57.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T06:01:57.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T06:01:57.259 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T06:01:57.259 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T06:01:57.259 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T06:01:57.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T06:01:57.524 INFO:teuthology.orchestra.run.smithi006.stdout:60129542186 2024-09-14T06:01:57.525 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T06:01:57.525 INFO:teuthology.orchestra.run.smithi006.stdout:60129542186 2024-09-14T06:01:57.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T06:01:57.528 INFO:teuthology.orchestra.run.smithi006.stdout:60129542185 2024-09-14T06:01:57.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T06:01:57.531 INFO:teuthology.orchestra.run.smithi006.stdout:60129542188 2024-09-14T06:01:57.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T06:01:57.535 INFO:teuthology.orchestra.run.smithi006.stdout:64424509481 2024-09-14T06:01:57.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T06:01:57.536 INFO:teuthology.orchestra.run.smithi006.stdout:197568495645 2024-09-14T06:01:57.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T06:01:57.541 INFO:teuthology.orchestra.run.smithi006.stdout:60129542187 2024-09-14T06:01:57.541 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T06:01:57.542 INFO:teuthology.orchestra.run.smithi006.stdout:60129542187 2024-09-14T06:01:57.543 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T06:01:58.058 INFO:teuthology.orchestra.run.smithi006.stdout:60129542188 2024-09-14T06:01:58.063 INFO:teuthology.orchestra.run.smithi006.stdout:60129542186 2024-09-14T06:01:58.080 INFO:teuthology.orchestra.run.smithi006.stdout:60129542185 2024-09-14T06:01:58.081 INFO:teuthology.orchestra.run.smithi006.stdout:60129542186 2024-09-14T06:01:58.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542188 got 60129542188 for osd.6 2024-09-14T06:01:58.082 DEBUG:teuthology.parallel:result is None 2024-09-14T06:01:58.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542186 got 60129542186 for osd.5 2024-09-14T06:01:58.095 DEBUG:teuthology.parallel:result is None 2024-09-14T06:01:58.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542186 got 60129542186 for osd.3 2024-09-14T06:01:58.103 DEBUG:teuthology.parallel:result is None 2024-09-14T06:01:58.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542185 got 60129542185 for osd.1 2024-09-14T06:01:58.109 DEBUG:teuthology.parallel:result is None 2024-09-14T06:01:58.115 INFO:teuthology.orchestra.run.smithi006.stdout:64424509481 2024-09-14T06:01:58.132 INFO:teuthology.orchestra.run.smithi006.stdout:60129542187 2024-09-14T06:01:58.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509481 got 64424509481 for osd.2 2024-09-14T06:01:58.133 DEBUG:teuthology.parallel:result is None 2024-09-14T06:01:58.146 INFO:teuthology.orchestra.run.smithi006.stdout:197568495645 2024-09-14T06:01:58.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542187 got 60129542187 for osd.7 2024-09-14T06:01:58.149 DEBUG:teuthology.parallel:result is None 2024-09-14T06:01:58.162 INFO:teuthology.orchestra.run.smithi006.stdout:60129542187 2024-09-14T06:01:58.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 197568495645 got 197568495645 for osd.0 2024-09-14T06:01:58.163 DEBUG:teuthology.parallel:result is None 2024-09-14T06:01:58.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542187 got 60129542187 for osd.4 2024-09-14T06:01:58.179 DEBUG:teuthology.parallel:result is None 2024-09-14T06:01:58.180 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T06:01:58.180 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T06:01:58.508 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:01:58.509 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T06:01:58.524 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2024-09-14T06:01:57.515277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1002,"num_object_clones":0,"num_object_copies":2004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1002,"num_whiteouts":994,"num_read":167009,"num_read_kb":827958,"num_write":24826,"num_write_kb":447534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3515,"num_bytes_recovered":62799885,"num_keys_recovered":216,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21379,"ondisk_log_size":21379,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":409268,"kb_used_data":17208,"kb_used_omap":15,"kb_used_meta":391856,"kb_avail":754565452,"statfs":{"total":773094113280,"available":772675022848,"internally_reserved":0,"allocated":17620992,"data_stored":9041508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":401261340},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.011938"},"pg_stats":[{"pgid":"3.1f","version":"153'822","reported_seq":3050,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555490+0000","last_change":"2024-09-14T06:01:36.363763+0000","last_active":"2024-09-14T06:01:56.555490+0000","last_peered":"2024-09-14T06:01:56.555490+0000","last_clean":"2024-09-14T06:01:56.555490+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T06:01:56.555490+0000","last_undegraded":"2024-09-14T06:01:56.555490+0000","last_fullsized":"2024-09-14T06:01:56.555490+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:20.876081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019644789999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":4722,"num_read_kb":14974,"num_write":989,"num_write_kb":5443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"153'621","reported_seq":3371,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555733+0000","last_change":"2024-09-14T06:01:36.375502+0000","last_active":"2024-09-14T06:01:56.555733+0000","last_peered":"2024-09-14T06:01:56.555733+0000","last_clean":"2024-09-14T06:01:56.555733+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T06:01:56.555733+0000","last_undegraded":"2024-09-14T06:01:56.555733+0000","last_fullsized":"2024-09-14T06:01:56.555733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:17.635647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029969670000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":3552,"num_read_kb":12323,"num_write":744,"num_write_kb":12372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"152'406","reported_seq":6313,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678437+0000","last_change":"2024-09-14T06:01:36.368174+0000","last_active":"2024-09-14T06:01:56.678437+0000","last_peered":"2024-09-14T06:01:56.678437+0000","last_clean":"2024-09-14T06:01:56.678437+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T06:01:56.678437+0000","last_undegraded":"2024-09-14T06:01:56.678437+0000","last_fullsized":"2024-09-14T06:01:56.678437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:07.173657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084545099999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5603,"num_read_kb":35883,"num_write":395,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"153'594","reported_seq":4983,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678413+0000","last_change":"2024-09-14T06:01:36.368633+0000","last_active":"2024-09-14T06:01:56.678413+0000","last_peered":"2024-09-14T06:01:56.678413+0000","last_clean":"2024-09-14T06:01:56.678413+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T06:01:56.678413+0000","last_undegraded":"2024-09-14T06:01:56.678413+0000","last_fullsized":"2024-09-14T06:01:56.678413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:06.972032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012650980000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":5037,"num_read_kb":20692,"num_write":657,"num_write_kb":8689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"152'603","reported_seq":1906,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554864+0000","last_change":"2024-09-14T06:01:36.361688+0000","last_active":"2024-09-14T06:01:56.554864+0000","last_peered":"2024-09-14T06:01:56.554864+0000","last_clean":"2024-09-14T06:01:56.554864+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T06:01:56.554864+0000","last_undegraded":"2024-09-14T06:01:56.554864+0000","last_fullsized":"2024-09-14T06:01:56.554864+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:07.283206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184701,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":2669,"num_read_kb":6421,"num_write":624,"num_write_kb":6293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"152'990","reported_seq":6236,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552171+0000","last_change":"2024-09-14T06:01:36.362503+0000","last_active":"2024-09-14T06:01:56.552171+0000","last_peered":"2024-09-14T06:01:56.552171+0000","last_clean":"2024-09-14T06:01:56.552171+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T06:01:56.552171+0000","last_undegraded":"2024-09-14T06:01:56.552171+0000","last_fullsized":"2024-09-14T06:01:56.552171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":990,"log_dups_size":0,"ondisk_log_size":990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:22.103314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001987094,"stat_sum":{"num_bytes":19,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":36,"num_read":8467,"num_read_kb":44656,"num_write":1302,"num_write_kb":19849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"151'534","reported_seq":3329,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861755+0000","last_change":"2024-09-14T06:01:36.458706+0000","last_active":"2024-09-14T06:01:56.861755+0000","last_peered":"2024-09-14T06:01:56.861755+0000","last_clean":"2024-09-14T06:01:56.861755+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T06:01:56.861755+0000","last_undegraded":"2024-09-14T06:01:56.861755+0000","last_fullsized":"2024-09-14T06:01:56.861755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:08.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096831599999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3556,"num_read_kb":21733,"num_write":601,"num_write_kb":16615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"152'559","reported_seq":6311,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554241+0000","last_change":"2024-09-14T06:01:36.372778+0000","last_active":"2024-09-14T06:01:56.554241+0000","last_peered":"2024-09-14T06:01:56.554241+0000","last_clean":"2024-09-14T06:01:56.554241+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T06:01:56.554241+0000","last_undegraded":"2024-09-14T06:01:56.554241+0000","last_fullsized":"2024-09-14T06:01:56.554241+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:44:55.242255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001233916,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7305,"num_read_kb":51490,"num_write":523,"num_write_kb":14203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"152'456","reported_seq":3550,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555163+0000","last_change":"2024-09-14T06:01:36.364273+0000","last_active":"2024-09-14T06:01:56.555163+0000","last_peered":"2024-09-14T06:01:56.555163+0000","last_clean":"2024-09-14T06:01:56.555163+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T06:01:56.555163+0000","last_undegraded":"2024-09-14T06:01:56.555163+0000","last_fullsized":"2024-09-14T06:01:56.555163+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:20.309640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002476359,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":3799,"num_read_kb":21473,"num_write":380,"num_write_kb":6982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"152'1485","reported_seq":4435,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678284+0000","last_change":"2024-09-14T06:01:36.368055+0000","last_active":"2024-09-14T06:01:56.678284+0000","last_peered":"2024-09-14T06:01:56.678284+0000","last_clean":"2024-09-14T06:01:56.678284+0000","last_became_active":"2024-09-14T06:01:12.307740+0000","last_became_peered":"2024-09-14T06:01:12.307740+0000","last_unstale":"2024-09-14T06:01:56.678284+0000","last_undegraded":"2024-09-14T06:01:56.678284+0000","last_fullsized":"2024-09-14T06:01:56.678284+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1485,"log_dups_size":0,"ondisk_log_size":1485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:19.124319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073476100000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":8264,"num_read_kb":22572,"num_write":2472,"num_write_kb":21400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":246,"num_bytes_recovered":5782955,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"149'796","reported_seq":6739,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861730+0000","last_change":"2024-09-14T06:01:55.536577+0000","last_active":"2024-09-14T06:01:56.861730+0000","last_peered":"2024-09-14T06:01:56.861730+0000","last_clean":"2024-09-14T06:01:56.861730+0000","last_became_active":"2024-09-14T06:01:55.530587+0000","last_became_peered":"2024-09-14T06:01:55.530587+0000","last_unstale":"2024-09-14T06:01:56.861730+0000","last_undegraded":"2024-09-14T06:01:56.861730+0000","last_fullsized":"2024-09-14T06:01:56.861730+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:42.496860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040508719999999996,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":7663,"num_read_kb":54856,"num_write":859,"num_write_kb":20153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":314,"num_bytes_recovered":5293699,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"152'646","reported_seq":5880,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552323+0000","last_change":"2024-09-14T06:01:36.361814+0000","last_active":"2024-09-14T06:01:56.552323+0000","last_peered":"2024-09-14T06:01:56.552323+0000","last_clean":"2024-09-14T06:01:56.552323+0000","last_became_active":"2024-09-14T06:01:12.309550+0000","last_became_peered":"2024-09-14T06:01:12.309550+0000","last_unstale":"2024-09-14T06:01:56.552323+0000","last_undegraded":"2024-09-14T06:01:56.552323+0000","last_fullsized":"2024-09-14T06:01:56.552323+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:42:18.135474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017425800000000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5717,"num_read_kb":30636,"num_write":834,"num_write_kb":16055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":1542204,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":331,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861515+0000","last_change":"2024-09-14T06:01:06.338467+0000","last_active":"2024-09-14T06:01:56.861515+0000","last_peered":"2024-09-14T06:01:56.861515+0000","last_clean":"2024-09-14T06:01:56.861515+0000","last_became_active":"2024-09-14T06:01:06.337939+0000","last_became_peered":"2024-09-14T06:01:06.337939+0000","last_unstale":"2024-09-14T06:01:56.861515+0000","last_undegraded":"2024-09-14T06:01:56.861515+0000","last_fullsized":"2024-09-14T06:01:56.861515+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:06.843302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"153'1130","reported_seq":5446,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555239+0000","last_change":"2024-09-14T06:01:36.363074+0000","last_active":"2024-09-14T06:01:56.555239+0000","last_peered":"2024-09-14T06:01:56.555239+0000","last_clean":"2024-09-14T06:01:56.555239+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T06:01:56.555239+0000","last_undegraded":"2024-09-14T06:01:56.555239+0000","last_fullsized":"2024-09-14T06:01:56.555239+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1130,"log_dups_size":0,"ondisk_log_size":1130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:49.879137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001486961,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":8368,"num_read_kb":25403,"num_write":1459,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":318,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862037+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T06:01:56.862037+0000","last_peered":"2024-09-14T06:01:56.862037+0000","last_clean":"2024-09-14T06:01:56.862037+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T06:01:56.862037+0000","last_undegraded":"2024-09-14T06:01:56.862037+0000","last_fullsized":"2024-09-14T06:01:56.862037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"153'440","reported_seq":4857,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555900+0000","last_change":"2024-09-14T06:01:36.374743+0000","last_active":"2024-09-14T06:01:56.555900+0000","last_peered":"2024-09-14T06:01:56.555900+0000","last_clean":"2024-09-14T06:01:56.555900+0000","last_became_active":"2024-09-14T06:01:33.331374+0000","last_became_peered":"2024-09-14T06:01:33.331374+0000","last_unstale":"2024-09-14T06:01:56.555900+0000","last_undegraded":"2024-09-14T06:01:56.555900+0000","last_fullsized":"2024-09-14T06:01:56.555900+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:50.843210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022251139999999998,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3987,"num_read_kb":32301,"num_write":424,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":530,"num_bytes_recovered":12849230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862069+0000","last_change":"2024-09-14T06:01:55.529470+0000","last_active":"2024-09-14T06:01:56.862069+0000","last_peered":"2024-09-14T06:01:56.862069+0000","last_clean":"2024-09-14T06:01:56.862069+0000","last_became_active":"2024-09-14T06:01:55.528696+0000","last_became_peered":"2024-09-14T06:01:55.528696+0000","last_unstale":"2024-09-14T06:01:56.862069+0000","last_undegraded":"2024-09-14T06:01:56.862069+0000","last_fullsized":"2024-09-14T06:01:56.862069+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:01.366086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"151'420","reported_seq":4284,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861879+0000","last_change":"2024-09-14T06:01:36.459282+0000","last_active":"2024-09-14T06:01:56.861879+0000","last_peered":"2024-09-14T06:01:56.861879+0000","last_clean":"2024-09-14T06:01:56.861879+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T06:01:56.861879+0000","last_undegraded":"2024-09-14T06:01:56.861879+0000","last_fullsized":"2024-09-14T06:01:56.861879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:44:57.795683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010338089999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3782,"num_read_kb":24853,"num_write":451,"num_write_kb":9884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":327,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861588+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T06:01:56.861588+0000","last_peered":"2024-09-14T06:01:56.861588+0000","last_clean":"2024-09-14T06:01:56.861588+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T06:01:56.861588+0000","last_undegraded":"2024-09-14T06:01:56.861588+0000","last_fullsized":"2024-09-14T06:01:56.861588+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"153'528","reported_seq":4377,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678700+0000","last_change":"2024-09-14T06:01:36.369952+0000","last_active":"2024-09-14T06:01:56.678700+0000","last_peered":"2024-09-14T06:01:56.678700+0000","last_clean":"2024-09-14T06:01:56.678700+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T06:01:56.678700+0000","last_undegraded":"2024-09-14T06:01:56.678700+0000","last_fullsized":"2024-09-14T06:01:56.678700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:09.812466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002246255,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5158,"num_read_kb":19798,"num_write":493,"num_write_kb":8565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"153'688","reported_seq":3684,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552235+0000","last_change":"2024-09-14T06:01:36.363528+0000","last_active":"2024-09-14T06:01:56.552235+0000","last_peered":"2024-09-14T06:01:56.552235+0000","last_clean":"2024-09-14T06:01:56.552235+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T06:01:56.552235+0000","last_undegraded":"2024-09-14T06:01:56.552235+0000","last_fullsized":"2024-09-14T06:01:56.552235+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:39.780208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022285579999999998,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":33,"num_read":4014,"num_read_kb":39469,"num_write":650,"num_write_kb":15966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":320,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678167+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T06:01:56.678167+0000","last_peered":"2024-09-14T06:01:56.678167+0000","last_clean":"2024-09-14T06:01:56.678167+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T06:01:56.678167+0000","last_undegraded":"2024-09-14T06:01:56.678167+0000","last_fullsized":"2024-09-14T06:01:56.678167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"152'1013","reported_seq":3096,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861679+0000","last_change":"2024-09-14T06:01:36.458728+0000","last_active":"2024-09-14T06:01:56.861679+0000","last_peered":"2024-09-14T06:01:56.861679+0000","last_clean":"2024-09-14T06:01:56.861679+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T06:01:56.861679+0000","last_undegraded":"2024-09-14T06:01:56.861679+0000","last_fullsized":"2024-09-14T06:01:56.861679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:41.340635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095053200000000003,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":40,"num_read":4900,"num_read_kb":20186,"num_write":1454,"num_write_kb":18376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.815822+0000","last_change":"2024-09-14T06:01:45.441200+0000","last_active":"2024-09-14T06:01:56.815822+0000","last_peered":"2024-09-14T06:01:56.815822+0000","last_clean":"2024-09-14T06:01:56.815822+0000","last_became_active":"2024-09-14T06:01:45.440693+0000","last_became_peered":"2024-09-14T06:01:45.440693+0000","last_unstale":"2024-09-14T06:01:56.815822+0000","last_undegraded":"2024-09-14T06:01:56.815822+0000","last_fullsized":"2024-09-14T06:01:56.815822+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:32.396856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"152'508","reported_seq":2906,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554433+0000","last_change":"2024-09-14T06:01:36.362228+0000","last_active":"2024-09-14T06:01:56.554433+0000","last_peered":"2024-09-14T06:01:56.554433+0000","last_clean":"2024-09-14T06:01:56.554433+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T06:01:56.554433+0000","last_undegraded":"2024-09-14T06:01:56.554433+0000","last_fullsized":"2024-09-14T06:01:56.554433+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:18.683159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015877090000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":2965,"num_read_kb":24090,"num_write":468,"num_write_kb":10967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861636+0000","last_change":"2024-09-14T06:01:55.699782+0000","last_active":"2024-09-14T06:01:56.861636+0000","last_peered":"2024-09-14T06:01:56.861636+0000","last_clean":"2024-09-14T06:01:56.861636+0000","last_became_active":"2024-09-14T06:01:55.699203+0000","last_became_peered":"2024-09-14T06:01:55.699203+0000","last_unstale":"2024-09-14T06:01:56.861636+0000","last_undegraded":"2024-09-14T06:01:56.861636+0000","last_fullsized":"2024-09-14T06:01:56.861636+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:58.473556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"152'361","reported_seq":2600,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555006+0000","last_change":"2024-09-14T06:01:36.373997+0000","last_active":"2024-09-14T06:01:56.555006+0000","last_peered":"2024-09-14T06:01:56.555006+0000","last_clean":"2024-09-14T06:01:56.555006+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T06:01:56.555006+0000","last_undegraded":"2024-09-14T06:01:56.555006+0000","last_fullsized":"2024-09-14T06:01:56.555006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:15.490820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002155353,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":1854,"num_read_kb":21999,"num_write":376,"num_write_kb":9648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":319,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678186+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T06:01:56.678186+0000","last_peered":"2024-09-14T06:01:56.678186+0000","last_clean":"2024-09-14T06:01:56.678186+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T06:01:56.678186+0000","last_undegraded":"2024-09-14T06:01:56.678186+0000","last_fullsized":"2024-09-14T06:01:56.678186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":150,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.551873+0000","last_change":"2024-09-14T06:00:48.871361+0000","last_active":"2024-09-14T06:01:56.551873+0000","last_peered":"2024-09-14T06:01:56.551873+0000","last_clean":"2024-09-14T06:01:56.551873+0000","last_became_active":"2024-09-14T06:00:48.845773+0000","last_became_peered":"2024-09-14T06:00:48.845773+0000","last_unstale":"2024-09-14T06:01:56.551873+0000","last_undegraded":"2024-09-14T06:01:56.551873+0000","last_fullsized":"2024-09-14T06:01:56.551873+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:59.588543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"153'737","reported_seq":2435,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554555+0000","last_change":"2024-09-14T06:01:36.372809+0000","last_active":"2024-09-14T06:01:56.554555+0000","last_peered":"2024-09-14T06:01:56.554555+0000","last_clean":"2024-09-14T06:01:56.554555+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T06:01:56.554555+0000","last_undegraded":"2024-09-14T06:01:56.554555+0000","last_fullsized":"2024-09-14T06:01:56.554555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:01.500172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938190000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3347,"num_read_kb":6654,"num_write":929,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"152'385","reported_seq":4935,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552090+0000","last_change":"2024-09-14T06:01:36.361089+0000","last_active":"2024-09-14T06:01:56.552090+0000","last_peered":"2024-09-14T06:01:56.552090+0000","last_clean":"2024-09-14T06:01:56.552090+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T06:01:56.552090+0000","last_undegraded":"2024-09-14T06:01:56.552090+0000","last_fullsized":"2024-09-14T06:01:56.552090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:03.218382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010238700000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":4613,"num_read_kb":34486,"num_write":364,"num_write_kb":27482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"152'680","reported_seq":2729,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861366+0000","last_change":"2024-09-14T06:01:36.375532+0000","last_active":"2024-09-14T06:01:56.861366+0000","last_peered":"2024-09-14T06:01:56.861366+0000","last_clean":"2024-09-14T06:01:56.861366+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T06:01:56.861366+0000","last_undegraded":"2024-09-14T06:01:56.861366+0000","last_fullsized":"2024-09-14T06:01:56.861366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:22.830670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069170899999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":3310,"num_read_kb":12425,"num_write":762,"num_write_kb":6088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"152'901","reported_seq":3870,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555315+0000","last_change":"2024-09-14T06:01:36.374044+0000","last_active":"2024-09-14T06:01:56.555315+0000","last_peered":"2024-09-14T06:01:56.555315+0000","last_clean":"2024-09-14T06:01:56.555315+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T06:01:56.555315+0000","last_undegraded":"2024-09-14T06:01:56.555315+0000","last_fullsized":"2024-09-14T06:01:56.555315+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:38:00.359541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022223719999999998,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":5877,"num_read_kb":27140,"num_write":1302,"num_write_kb":14124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"146'608","reported_seq":5313,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678299+0000","last_change":"2024-09-14T06:01:36.369367+0000","last_active":"2024-09-14T06:01:56.678299+0000","last_peered":"2024-09-14T06:01:56.678299+0000","last_clean":"2024-09-14T06:01:56.678299+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T06:01:56.678299+0000","last_undegraded":"2024-09-14T06:01:56.678299+0000","last_fullsized":"2024-09-14T06:01:56.678299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:15.699674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019468420000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":6117,"num_read_kb":23676,"num_write":517,"num_write_kb":12874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"151'418","reported_seq":3762,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862048+0000","last_change":"2024-09-14T06:01:55.542135+0000","last_active":"2024-09-14T06:01:56.862048+0000","last_peered":"2024-09-14T06:01:56.862048+0000","last_clean":"2024-09-14T06:01:56.862048+0000","last_became_active":"2024-09-14T06:01:55.537648+0000","last_became_peered":"2024-09-14T06:01:55.537648+0000","last_unstale":"2024-09-14T06:01:56.862048+0000","last_undegraded":"2024-09-14T06:01:56.862048+0000","last_fullsized":"2024-09-14T06:01:56.862048+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:37.382850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084296140000000002,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3697,"num_read_kb":21745,"num_write":409,"num_write_kb":13473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":2150148,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"152'627","reported_seq":4969,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862208+0000","last_change":"2024-09-14T06:01:55.538704+0000","last_active":"2024-09-14T06:01:56.862208+0000","last_peered":"2024-09-14T06:01:56.862208+0000","last_clean":"2024-09-14T06:01:56.862208+0000","last_became_active":"2024-09-14T06:01:55.529576+0000","last_became_peered":"2024-09-14T06:01:55.529576+0000","last_unstale":"2024-09-14T06:01:56.862208+0000","last_undegraded":"2024-09-14T06:01:56.862208+0000","last_fullsized":"2024-09-14T06:01:56.862208+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:02.794742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036759169999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5969,"num_read_kb":24775,"num_write":580,"num_write_kb":11404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":302,"num_bytes_recovered":1794796,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"152'634","reported_seq":6685,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862358+0000","last_change":"2024-09-14T06:01:55.540392+0000","last_active":"2024-09-14T06:01:56.862358+0000","last_peered":"2024-09-14T06:01:56.862358+0000","last_clean":"2024-09-14T06:01:56.862358+0000","last_became_active":"2024-09-14T06:01:55.534489+0000","last_became_peered":"2024-09-14T06:01:55.534489+0000","last_unstale":"2024-09-14T06:01:56.862358+0000","last_undegraded":"2024-09-14T06:01:56.862358+0000","last_fullsized":"2024-09-14T06:01:56.862358+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:46.714182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035801489999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":7304,"num_read_kb":14772,"num_write":688,"num_write_kb":6369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":2812424,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"152'955","reported_seq":4468,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861364+0000","last_change":"2024-09-14T06:01:36.375463+0000","last_active":"2024-09-14T06:01:56.861364+0000","last_peered":"2024-09-14T06:01:56.861364+0000","last_clean":"2024-09-14T06:01:56.861364+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T06:01:56.861364+0000","last_undegraded":"2024-09-14T06:01:56.861364+0000","last_fullsized":"2024-09-14T06:01:56.861364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:28.705551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063032799999999999,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":6689,"num_read_kb":19376,"num_write":1207,"num_write_kb":11822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"152'562","reported_seq":6675,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861701+0000","last_change":"2024-09-14T06:01:55.534889+0000","last_active":"2024-09-14T06:01:56.861701+0000","last_peered":"2024-09-14T06:01:56.861701+0000","last_clean":"2024-09-14T06:01:56.861701+0000","last_became_active":"2024-09-14T06:01:55.529694+0000","last_became_peered":"2024-09-14T06:01:55.529694+0000","last_unstale":"2024-09-14T06:01:56.861701+0000","last_undegraded":"2024-09-14T06:01:56.861701+0000","last_fullsized":"2024-09-14T06:01:56.861701+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:32:41.094646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007656754,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":6277,"num_read_kb":34183,"num_write":630,"num_write_kb":31053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":284,"num_bytes_recovered":12777008,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"151'731","reported_seq":6960,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554765+0000","last_change":"2024-09-14T06:01:36.362365+0000","last_active":"2024-09-14T06:01:56.554765+0000","last_peered":"2024-09-14T06:01:56.554765+0000","last_clean":"2024-09-14T06:01:56.554765+0000","last_became_active":"2024-09-14T06:01:21.321381+0000","last_became_peered":"2024-09-14T06:01:21.321381+0000","last_unstale":"2024-09-14T06:01:56.554765+0000","last_undegraded":"2024-09-14T06:01:56.554765+0000","last_fullsized":"2024-09-14T06:01:56.554765+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:07.305705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017037930000000001,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":6816,"num_read_kb":29154,"num_write":729,"num_write_kb":10847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":500,"num_bytes_recovered":4175332,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"152'466","reported_seq":6578,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861786+0000","last_change":"2024-09-14T06:01:55.536790+0000","last_active":"2024-09-14T06:01:56.861786+0000","last_peered":"2024-09-14T06:01:56.861786+0000","last_clean":"2024-09-14T06:01:56.861786+0000","last_became_active":"2024-09-14T06:01:55.529674+0000","last_became_peered":"2024-09-14T06:01:55.529674+0000","last_unstale":"2024-09-14T06:01:56.861786+0000","last_undegraded":"2024-09-14T06:01:56.861786+0000","last_fullsized":"2024-09-14T06:01:56.861786+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:07:14.178795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026632919999999998,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":5545,"num_read_kb":33709,"num_write":451,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":300,"num_bytes_recovered":8189194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":998,"num_object_clones":0,"num_object_copies":1996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":998,"num_whiteouts":994,"num_read":166943,"num_read_kb":827903,"num_write":24723,"num_write_kb":445904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3513,"num_bytes_recovered":62209517,"num_keys_recovered":216,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21304,"ondisk_log_size":21304,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41520,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330320,"statfs":{"total":96636764160,"available":96594247680,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495645,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56360,"kb_used_data":2004,"kb_used_omap":4,"kb_used_meta":54331,"kb_avail":94315480,"statfs":{"total":96636764160,"available":96579051520,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":55635632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51240,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320600,"statfs":{"total":96636764160,"available":96584294400,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41516,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330324,"statfs":{"total":96636764160,"available":96594251776,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55404,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316436,"statfs":{"total":96636764160,"available":96580030464,"internally_reserved":0,"allocated":2056192,"data_stored":982606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47668,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324172,"statfs":{"total":96636764160,"available":96587952128,"internally_reserved":0,"allocated":2650112,"data_stored":1572974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59564,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312276,"statfs":{"total":96636764160,"available":96575770624,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55996,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315844,"statfs":{"total":96636764160,"available":96579424256,"internally_reserved":0,"allocated":2654208,"data_stored":1572993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T06:01:58.526 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T06:01:58.827 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:01:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T06:01:58.844 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2024-09-14T06:01:57.515277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1002,"num_object_clones":0,"num_object_copies":2004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1002,"num_whiteouts":994,"num_read":167009,"num_read_kb":827958,"num_write":24826,"num_write_kb":447534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3515,"num_bytes_recovered":62799885,"num_keys_recovered":216,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21379,"ondisk_log_size":21379,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":409268,"kb_used_data":17208,"kb_used_omap":15,"kb_used_meta":391856,"kb_avail":754565452,"statfs":{"total":773094113280,"available":772675022848,"internally_reserved":0,"allocated":17620992,"data_stored":9041508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":401261340},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.011938"},"pg_stats":[{"pgid":"3.1f","version":"153'822","reported_seq":3050,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555490+0000","last_change":"2024-09-14T06:01:36.363763+0000","last_active":"2024-09-14T06:01:56.555490+0000","last_peered":"2024-09-14T06:01:56.555490+0000","last_clean":"2024-09-14T06:01:56.555490+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T06:01:56.555490+0000","last_undegraded":"2024-09-14T06:01:56.555490+0000","last_fullsized":"2024-09-14T06:01:56.555490+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:20.876081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019644789999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":4722,"num_read_kb":14974,"num_write":989,"num_write_kb":5443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"153'621","reported_seq":3371,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555733+0000","last_change":"2024-09-14T06:01:36.375502+0000","last_active":"2024-09-14T06:01:56.555733+0000","last_peered":"2024-09-14T06:01:56.555733+0000","last_clean":"2024-09-14T06:01:56.555733+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T06:01:56.555733+0000","last_undegraded":"2024-09-14T06:01:56.555733+0000","last_fullsized":"2024-09-14T06:01:56.555733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:17.635647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029969670000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":3552,"num_read_kb":12323,"num_write":744,"num_write_kb":12372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"152'406","reported_seq":6313,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678437+0000","last_change":"2024-09-14T06:01:36.368174+0000","last_active":"2024-09-14T06:01:56.678437+0000","last_peered":"2024-09-14T06:01:56.678437+0000","last_clean":"2024-09-14T06:01:56.678437+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T06:01:56.678437+0000","last_undegraded":"2024-09-14T06:01:56.678437+0000","last_fullsized":"2024-09-14T06:01:56.678437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:07.173657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084545099999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5603,"num_read_kb":35883,"num_write":395,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"153'594","reported_seq":4983,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678413+0000","last_change":"2024-09-14T06:01:36.368633+0000","last_active":"2024-09-14T06:01:56.678413+0000","last_peered":"2024-09-14T06:01:56.678413+0000","last_clean":"2024-09-14T06:01:56.678413+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T06:01:56.678413+0000","last_undegraded":"2024-09-14T06:01:56.678413+0000","last_fullsized":"2024-09-14T06:01:56.678413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:06.972032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012650980000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":5037,"num_read_kb":20692,"num_write":657,"num_write_kb":8689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"152'603","reported_seq":1906,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554864+0000","last_change":"2024-09-14T06:01:36.361688+0000","last_active":"2024-09-14T06:01:56.554864+0000","last_peered":"2024-09-14T06:01:56.554864+0000","last_clean":"2024-09-14T06:01:56.554864+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T06:01:56.554864+0000","last_undegraded":"2024-09-14T06:01:56.554864+0000","last_fullsized":"2024-09-14T06:01:56.554864+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:07.283206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184701,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":2669,"num_read_kb":6421,"num_write":624,"num_write_kb":6293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"152'990","reported_seq":6236,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552171+0000","last_change":"2024-09-14T06:01:36.362503+0000","last_active":"2024-09-14T06:01:56.552171+0000","last_peered":"2024-09-14T06:01:56.552171+0000","last_clean":"2024-09-14T06:01:56.552171+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T06:01:56.552171+0000","last_undegraded":"2024-09-14T06:01:56.552171+0000","last_fullsized":"2024-09-14T06:01:56.552171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":990,"log_dups_size":0,"ondisk_log_size":990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:22.103314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001987094,"stat_sum":{"num_bytes":19,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":36,"num_read":8467,"num_read_kb":44656,"num_write":1302,"num_write_kb":19849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"151'534","reported_seq":3329,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861755+0000","last_change":"2024-09-14T06:01:36.458706+0000","last_active":"2024-09-14T06:01:56.861755+0000","last_peered":"2024-09-14T06:01:56.861755+0000","last_clean":"2024-09-14T06:01:56.861755+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T06:01:56.861755+0000","last_undegraded":"2024-09-14T06:01:56.861755+0000","last_fullsized":"2024-09-14T06:01:56.861755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:08.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096831599999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3556,"num_read_kb":21733,"num_write":601,"num_write_kb":16615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"152'559","reported_seq":6311,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554241+0000","last_change":"2024-09-14T06:01:36.372778+0000","last_active":"2024-09-14T06:01:56.554241+0000","last_peered":"2024-09-14T06:01:56.554241+0000","last_clean":"2024-09-14T06:01:56.554241+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T06:01:56.554241+0000","last_undegraded":"2024-09-14T06:01:56.554241+0000","last_fullsized":"2024-09-14T06:01:56.554241+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:44:55.242255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001233916,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7305,"num_read_kb":51490,"num_write":523,"num_write_kb":14203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"152'456","reported_seq":3550,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555163+0000","last_change":"2024-09-14T06:01:36.364273+0000","last_active":"2024-09-14T06:01:56.555163+0000","last_peered":"2024-09-14T06:01:56.555163+0000","last_clean":"2024-09-14T06:01:56.555163+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T06:01:56.555163+0000","last_undegraded":"2024-09-14T06:01:56.555163+0000","last_fullsized":"2024-09-14T06:01:56.555163+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:20.309640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002476359,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":3799,"num_read_kb":21473,"num_write":380,"num_write_kb":6982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"152'1485","reported_seq":4435,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678284+0000","last_change":"2024-09-14T06:01:36.368055+0000","last_active":"2024-09-14T06:01:56.678284+0000","last_peered":"2024-09-14T06:01:56.678284+0000","last_clean":"2024-09-14T06:01:56.678284+0000","last_became_active":"2024-09-14T06:01:12.307740+0000","last_became_peered":"2024-09-14T06:01:12.307740+0000","last_unstale":"2024-09-14T06:01:56.678284+0000","last_undegraded":"2024-09-14T06:01:56.678284+0000","last_fullsized":"2024-09-14T06:01:56.678284+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1485,"log_dups_size":0,"ondisk_log_size":1485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:19.124319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073476100000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":8264,"num_read_kb":22572,"num_write":2472,"num_write_kb":21400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":246,"num_bytes_recovered":5782955,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"149'796","reported_seq":6739,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861730+0000","last_change":"2024-09-14T06:01:55.536577+0000","last_active":"2024-09-14T06:01:56.861730+0000","last_peered":"2024-09-14T06:01:56.861730+0000","last_clean":"2024-09-14T06:01:56.861730+0000","last_became_active":"2024-09-14T06:01:55.530587+0000","last_became_peered":"2024-09-14T06:01:55.530587+0000","last_unstale":"2024-09-14T06:01:56.861730+0000","last_undegraded":"2024-09-14T06:01:56.861730+0000","last_fullsized":"2024-09-14T06:01:56.861730+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:42.496860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040508719999999996,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":7663,"num_read_kb":54856,"num_write":859,"num_write_kb":20153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":314,"num_bytes_recovered":5293699,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"152'646","reported_seq":5880,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552323+0000","last_change":"2024-09-14T06:01:36.361814+0000","last_active":"2024-09-14T06:01:56.552323+0000","last_peered":"2024-09-14T06:01:56.552323+0000","last_clean":"2024-09-14T06:01:56.552323+0000","last_became_active":"2024-09-14T06:01:12.309550+0000","last_became_peered":"2024-09-14T06:01:12.309550+0000","last_unstale":"2024-09-14T06:01:56.552323+0000","last_undegraded":"2024-09-14T06:01:56.552323+0000","last_fullsized":"2024-09-14T06:01:56.552323+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:42:18.135474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017425800000000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5717,"num_read_kb":30636,"num_write":834,"num_write_kb":16055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":1542204,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":331,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861515+0000","last_change":"2024-09-14T06:01:06.338467+0000","last_active":"2024-09-14T06:01:56.861515+0000","last_peered":"2024-09-14T06:01:56.861515+0000","last_clean":"2024-09-14T06:01:56.861515+0000","last_became_active":"2024-09-14T06:01:06.337939+0000","last_became_peered":"2024-09-14T06:01:06.337939+0000","last_unstale":"2024-09-14T06:01:56.861515+0000","last_undegraded":"2024-09-14T06:01:56.861515+0000","last_fullsized":"2024-09-14T06:01:56.861515+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:06.843302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"153'1130","reported_seq":5446,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555239+0000","last_change":"2024-09-14T06:01:36.363074+0000","last_active":"2024-09-14T06:01:56.555239+0000","last_peered":"2024-09-14T06:01:56.555239+0000","last_clean":"2024-09-14T06:01:56.555239+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T06:01:56.555239+0000","last_undegraded":"2024-09-14T06:01:56.555239+0000","last_fullsized":"2024-09-14T06:01:56.555239+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1130,"log_dups_size":0,"ondisk_log_size":1130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:49.879137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001486961,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":8368,"num_read_kb":25403,"num_write":1459,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":318,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862037+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T06:01:56.862037+0000","last_peered":"2024-09-14T06:01:56.862037+0000","last_clean":"2024-09-14T06:01:56.862037+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T06:01:56.862037+0000","last_undegraded":"2024-09-14T06:01:56.862037+0000","last_fullsized":"2024-09-14T06:01:56.862037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"153'440","reported_seq":4857,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555900+0000","last_change":"2024-09-14T06:01:36.374743+0000","last_active":"2024-09-14T06:01:56.555900+0000","last_peered":"2024-09-14T06:01:56.555900+0000","last_clean":"2024-09-14T06:01:56.555900+0000","last_became_active":"2024-09-14T06:01:33.331374+0000","last_became_peered":"2024-09-14T06:01:33.331374+0000","last_unstale":"2024-09-14T06:01:56.555900+0000","last_undegraded":"2024-09-14T06:01:56.555900+0000","last_fullsized":"2024-09-14T06:01:56.555900+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:50.843210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022251139999999998,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3987,"num_read_kb":32301,"num_write":424,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":530,"num_bytes_recovered":12849230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862069+0000","last_change":"2024-09-14T06:01:55.529470+0000","last_active":"2024-09-14T06:01:56.862069+0000","last_peered":"2024-09-14T06:01:56.862069+0000","last_clean":"2024-09-14T06:01:56.862069+0000","last_became_active":"2024-09-14T06:01:55.528696+0000","last_became_peered":"2024-09-14T06:01:55.528696+0000","last_unstale":"2024-09-14T06:01:56.862069+0000","last_undegraded":"2024-09-14T06:01:56.862069+0000","last_fullsized":"2024-09-14T06:01:56.862069+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:01.366086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"151'420","reported_seq":4284,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861879+0000","last_change":"2024-09-14T06:01:36.459282+0000","last_active":"2024-09-14T06:01:56.861879+0000","last_peered":"2024-09-14T06:01:56.861879+0000","last_clean":"2024-09-14T06:01:56.861879+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T06:01:56.861879+0000","last_undegraded":"2024-09-14T06:01:56.861879+0000","last_fullsized":"2024-09-14T06:01:56.861879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:44:57.795683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010338089999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3782,"num_read_kb":24853,"num_write":451,"num_write_kb":9884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":327,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861588+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T06:01:56.861588+0000","last_peered":"2024-09-14T06:01:56.861588+0000","last_clean":"2024-09-14T06:01:56.861588+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T06:01:56.861588+0000","last_undegraded":"2024-09-14T06:01:56.861588+0000","last_fullsized":"2024-09-14T06:01:56.861588+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"153'528","reported_seq":4377,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678700+0000","last_change":"2024-09-14T06:01:36.369952+0000","last_active":"2024-09-14T06:01:56.678700+0000","last_peered":"2024-09-14T06:01:56.678700+0000","last_clean":"2024-09-14T06:01:56.678700+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T06:01:56.678700+0000","last_undegraded":"2024-09-14T06:01:56.678700+0000","last_fullsized":"2024-09-14T06:01:56.678700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:09.812466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002246255,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5158,"num_read_kb":19798,"num_write":493,"num_write_kb":8565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"153'688","reported_seq":3684,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552235+0000","last_change":"2024-09-14T06:01:36.363528+0000","last_active":"2024-09-14T06:01:56.552235+0000","last_peered":"2024-09-14T06:01:56.552235+0000","last_clean":"2024-09-14T06:01:56.552235+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T06:01:56.552235+0000","last_undegraded":"2024-09-14T06:01:56.552235+0000","last_fullsized":"2024-09-14T06:01:56.552235+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:39.780208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022285579999999998,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":33,"num_read":4014,"num_read_kb":39469,"num_write":650,"num_write_kb":15966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":320,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678167+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T06:01:56.678167+0000","last_peered":"2024-09-14T06:01:56.678167+0000","last_clean":"2024-09-14T06:01:56.678167+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T06:01:56.678167+0000","last_undegraded":"2024-09-14T06:01:56.678167+0000","last_fullsized":"2024-09-14T06:01:56.678167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"152'1013","reported_seq":3096,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861679+0000","last_change":"2024-09-14T06:01:36.458728+0000","last_active":"2024-09-14T06:01:56.861679+0000","last_peered":"2024-09-14T06:01:56.861679+0000","last_clean":"2024-09-14T06:01:56.861679+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T06:01:56.861679+0000","last_undegraded":"2024-09-14T06:01:56.861679+0000","last_fullsized":"2024-09-14T06:01:56.861679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:41.340635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095053200000000003,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":40,"num_read":4900,"num_read_kb":20186,"num_write":1454,"num_write_kb":18376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.815822+0000","last_change":"2024-09-14T06:01:45.441200+0000","last_active":"2024-09-14T06:01:56.815822+0000","last_peered":"2024-09-14T06:01:56.815822+0000","last_clean":"2024-09-14T06:01:56.815822+0000","last_became_active":"2024-09-14T06:01:45.440693+0000","last_became_peered":"2024-09-14T06:01:45.440693+0000","last_unstale":"2024-09-14T06:01:56.815822+0000","last_undegraded":"2024-09-14T06:01:56.815822+0000","last_fullsized":"2024-09-14T06:01:56.815822+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:32.396856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"152'508","reported_seq":2906,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554433+0000","last_change":"2024-09-14T06:01:36.362228+0000","last_active":"2024-09-14T06:01:56.554433+0000","last_peered":"2024-09-14T06:01:56.554433+0000","last_clean":"2024-09-14T06:01:56.554433+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T06:01:56.554433+0000","last_undegraded":"2024-09-14T06:01:56.554433+0000","last_fullsized":"2024-09-14T06:01:56.554433+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:18.683159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015877090000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":2965,"num_read_kb":24090,"num_write":468,"num_write_kb":10967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861636+0000","last_change":"2024-09-14T06:01:55.699782+0000","last_active":"2024-09-14T06:01:56.861636+0000","last_peered":"2024-09-14T06:01:56.861636+0000","last_clean":"2024-09-14T06:01:56.861636+0000","last_became_active":"2024-09-14T06:01:55.699203+0000","last_became_peered":"2024-09-14T06:01:55.699203+0000","last_unstale":"2024-09-14T06:01:56.861636+0000","last_undegraded":"2024-09-14T06:01:56.861636+0000","last_fullsized":"2024-09-14T06:01:56.861636+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:58.473556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"152'361","reported_seq":2600,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555006+0000","last_change":"2024-09-14T06:01:36.373997+0000","last_active":"2024-09-14T06:01:56.555006+0000","last_peered":"2024-09-14T06:01:56.555006+0000","last_clean":"2024-09-14T06:01:56.555006+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T06:01:56.555006+0000","last_undegraded":"2024-09-14T06:01:56.555006+0000","last_fullsized":"2024-09-14T06:01:56.555006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:15.490820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002155353,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":1854,"num_read_kb":21999,"num_write":376,"num_write_kb":9648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":319,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678186+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T06:01:56.678186+0000","last_peered":"2024-09-14T06:01:56.678186+0000","last_clean":"2024-09-14T06:01:56.678186+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T06:01:56.678186+0000","last_undegraded":"2024-09-14T06:01:56.678186+0000","last_fullsized":"2024-09-14T06:01:56.678186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":150,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.551873+0000","last_change":"2024-09-14T06:00:48.871361+0000","last_active":"2024-09-14T06:01:56.551873+0000","last_peered":"2024-09-14T06:01:56.551873+0000","last_clean":"2024-09-14T06:01:56.551873+0000","last_became_active":"2024-09-14T06:00:48.845773+0000","last_became_peered":"2024-09-14T06:00:48.845773+0000","last_unstale":"2024-09-14T06:01:56.551873+0000","last_undegraded":"2024-09-14T06:01:56.551873+0000","last_fullsized":"2024-09-14T06:01:56.551873+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:59.588543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"153'737","reported_seq":2435,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554555+0000","last_change":"2024-09-14T06:01:36.372809+0000","last_active":"2024-09-14T06:01:56.554555+0000","last_peered":"2024-09-14T06:01:56.554555+0000","last_clean":"2024-09-14T06:01:56.554555+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T06:01:56.554555+0000","last_undegraded":"2024-09-14T06:01:56.554555+0000","last_fullsized":"2024-09-14T06:01:56.554555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:01.500172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938190000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3347,"num_read_kb":6654,"num_write":929,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"152'385","reported_seq":4935,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552090+0000","last_change":"2024-09-14T06:01:36.361089+0000","last_active":"2024-09-14T06:01:56.552090+0000","last_peered":"2024-09-14T06:01:56.552090+0000","last_clean":"2024-09-14T06:01:56.552090+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T06:01:56.552090+0000","last_undegraded":"2024-09-14T06:01:56.552090+0000","last_fullsized":"2024-09-14T06:01:56.552090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:03.218382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010238700000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":4613,"num_read_kb":34486,"num_write":364,"num_write_kb":27482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"152'680","reported_seq":2729,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861366+0000","last_change":"2024-09-14T06:01:36.375532+0000","last_active":"2024-09-14T06:01:56.861366+0000","last_peered":"2024-09-14T06:01:56.861366+0000","last_clean":"2024-09-14T06:01:56.861366+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T06:01:56.861366+0000","last_undegraded":"2024-09-14T06:01:56.861366+0000","last_fullsized":"2024-09-14T06:01:56.861366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:22.830670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069170899999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":3310,"num_read_kb":12425,"num_write":762,"num_write_kb":6088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"152'901","reported_seq":3870,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555315+0000","last_change":"2024-09-14T06:01:36.374044+0000","last_active":"2024-09-14T06:01:56.555315+0000","last_peered":"2024-09-14T06:01:56.555315+0000","last_clean":"2024-09-14T06:01:56.555315+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T06:01:56.555315+0000","last_undegraded":"2024-09-14T06:01:56.555315+0000","last_fullsized":"2024-09-14T06:01:56.555315+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:38:00.359541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022223719999999998,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":5877,"num_read_kb":27140,"num_write":1302,"num_write_kb":14124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"146'608","reported_seq":5313,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678299+0000","last_change":"2024-09-14T06:01:36.369367+0000","last_active":"2024-09-14T06:01:56.678299+0000","last_peered":"2024-09-14T06:01:56.678299+0000","last_clean":"2024-09-14T06:01:56.678299+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T06:01:56.678299+0000","last_undegraded":"2024-09-14T06:01:56.678299+0000","last_fullsized":"2024-09-14T06:01:56.678299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:15.699674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019468420000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":6117,"num_read_kb":23676,"num_write":517,"num_write_kb":12874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"151'418","reported_seq":3762,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862048+0000","last_change":"2024-09-14T06:01:55.542135+0000","last_active":"2024-09-14T06:01:56.862048+0000","last_peered":"2024-09-14T06:01:56.862048+0000","last_clean":"2024-09-14T06:01:56.862048+0000","last_became_active":"2024-09-14T06:01:55.537648+0000","last_became_peered":"2024-09-14T06:01:55.537648+0000","last_unstale":"2024-09-14T06:01:56.862048+0000","last_undegraded":"2024-09-14T06:01:56.862048+0000","last_fullsized":"2024-09-14T06:01:56.862048+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:37.382850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084296140000000002,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3697,"num_read_kb":21745,"num_write":409,"num_write_kb":13473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":2150148,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"152'627","reported_seq":4969,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862208+0000","last_change":"2024-09-14T06:01:55.538704+0000","last_active":"2024-09-14T06:01:56.862208+0000","last_peered":"2024-09-14T06:01:56.862208+0000","last_clean":"2024-09-14T06:01:56.862208+0000","last_became_active":"2024-09-14T06:01:55.529576+0000","last_became_peered":"2024-09-14T06:01:55.529576+0000","last_unstale":"2024-09-14T06:01:56.862208+0000","last_undegraded":"2024-09-14T06:01:56.862208+0000","last_fullsized":"2024-09-14T06:01:56.862208+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:02.794742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036759169999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5969,"num_read_kb":24775,"num_write":580,"num_write_kb":11404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":302,"num_bytes_recovered":1794796,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"152'634","reported_seq":6685,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862358+0000","last_change":"2024-09-14T06:01:55.540392+0000","last_active":"2024-09-14T06:01:56.862358+0000","last_peered":"2024-09-14T06:01:56.862358+0000","last_clean":"2024-09-14T06:01:56.862358+0000","last_became_active":"2024-09-14T06:01:55.534489+0000","last_became_peered":"2024-09-14T06:01:55.534489+0000","last_unstale":"2024-09-14T06:01:56.862358+0000","last_undegraded":"2024-09-14T06:01:56.862358+0000","last_fullsized":"2024-09-14T06:01:56.862358+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:46.714182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035801489999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":7304,"num_read_kb":14772,"num_write":688,"num_write_kb":6369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":2812424,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"152'955","reported_seq":4468,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861364+0000","last_change":"2024-09-14T06:01:36.375463+0000","last_active":"2024-09-14T06:01:56.861364+0000","last_peered":"2024-09-14T06:01:56.861364+0000","last_clean":"2024-09-14T06:01:56.861364+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T06:01:56.861364+0000","last_undegraded":"2024-09-14T06:01:56.861364+0000","last_fullsized":"2024-09-14T06:01:56.861364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:28.705551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063032799999999999,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":6689,"num_read_kb":19376,"num_write":1207,"num_write_kb":11822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"152'562","reported_seq":6675,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861701+0000","last_change":"2024-09-14T06:01:55.534889+0000","last_active":"2024-09-14T06:01:56.861701+0000","last_peered":"2024-09-14T06:01:56.861701+0000","last_clean":"2024-09-14T06:01:56.861701+0000","last_became_active":"2024-09-14T06:01:55.529694+0000","last_became_peered":"2024-09-14T06:01:55.529694+0000","last_unstale":"2024-09-14T06:01:56.861701+0000","last_undegraded":"2024-09-14T06:01:56.861701+0000","last_fullsized":"2024-09-14T06:01:56.861701+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:32:41.094646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007656754,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":6277,"num_read_kb":34183,"num_write":630,"num_write_kb":31053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":284,"num_bytes_recovered":12777008,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"151'731","reported_seq":6960,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554765+0000","last_change":"2024-09-14T06:01:36.362365+0000","last_active":"2024-09-14T06:01:56.554765+0000","last_peered":"2024-09-14T06:01:56.554765+0000","last_clean":"2024-09-14T06:01:56.554765+0000","last_became_active":"2024-09-14T06:01:21.321381+0000","last_became_peered":"2024-09-14T06:01:21.321381+0000","last_unstale":"2024-09-14T06:01:56.554765+0000","last_undegraded":"2024-09-14T06:01:56.554765+0000","last_fullsized":"2024-09-14T06:01:56.554765+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:07.305705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017037930000000001,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":6816,"num_read_kb":29154,"num_write":729,"num_write_kb":10847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":500,"num_bytes_recovered":4175332,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"152'466","reported_seq":6578,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861786+0000","last_change":"2024-09-14T06:01:55.536790+0000","last_active":"2024-09-14T06:01:56.861786+0000","last_peered":"2024-09-14T06:01:56.861786+0000","last_clean":"2024-09-14T06:01:56.861786+0000","last_became_active":"2024-09-14T06:01:55.529674+0000","last_became_peered":"2024-09-14T06:01:55.529674+0000","last_unstale":"2024-09-14T06:01:56.861786+0000","last_undegraded":"2024-09-14T06:01:56.861786+0000","last_fullsized":"2024-09-14T06:01:56.861786+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:07:14.178795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026632919999999998,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":5545,"num_read_kb":33709,"num_write":451,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":300,"num_bytes_recovered":8189194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":998,"num_object_clones":0,"num_object_copies":1996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":998,"num_whiteouts":994,"num_read":166943,"num_read_kb":827903,"num_write":24723,"num_write_kb":445904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3513,"num_bytes_recovered":62209517,"num_keys_recovered":216,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21304,"ondisk_log_size":21304,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41520,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330320,"statfs":{"total":96636764160,"available":96594247680,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495645,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56360,"kb_used_data":2004,"kb_used_omap":4,"kb_used_meta":54331,"kb_avail":94315480,"statfs":{"total":96636764160,"available":96579051520,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":55635632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51240,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320600,"statfs":{"total":96636764160,"available":96584294400,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41516,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330324,"statfs":{"total":96636764160,"available":96594251776,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55404,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316436,"statfs":{"total":96636764160,"available":96580030464,"internally_reserved":0,"allocated":2056192,"data_stored":982606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47668,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324172,"statfs":{"total":96636764160,"available":96587952128,"internally_reserved":0,"allocated":2650112,"data_stored":1572974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59564,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312276,"statfs":{"total":96636764160,"available":96575770624,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55996,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315844,"statfs":{"total":96636764160,"available":96579424256,"internally_reserved":0,"allocated":2654208,"data_stored":1572993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T06:01:58.846 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T06:01:58.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-14T06:01:59.169 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T06:01:59.177 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T06:01:59.177 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T06:01:59.475 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:01:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T06:01:59.492 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2024-09-14T06:01:57.515277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1002,"num_object_clones":0,"num_object_copies":2004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1002,"num_whiteouts":994,"num_read":167009,"num_read_kb":827958,"num_write":24826,"num_write_kb":447534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3515,"num_bytes_recovered":62799885,"num_keys_recovered":216,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21379,"ondisk_log_size":21379,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":409268,"kb_used_data":17208,"kb_used_omap":15,"kb_used_meta":391856,"kb_avail":754565452,"statfs":{"total":773094113280,"available":772675022848,"internally_reserved":0,"allocated":17620992,"data_stored":9041508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":401261340},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.011938"},"pg_stats":[{"pgid":"3.1f","version":"153'822","reported_seq":3050,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555490+0000","last_change":"2024-09-14T06:01:36.363763+0000","last_active":"2024-09-14T06:01:56.555490+0000","last_peered":"2024-09-14T06:01:56.555490+0000","last_clean":"2024-09-14T06:01:56.555490+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T06:01:56.555490+0000","last_undegraded":"2024-09-14T06:01:56.555490+0000","last_fullsized":"2024-09-14T06:01:56.555490+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:20.876081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019644789999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":4722,"num_read_kb":14974,"num_write":989,"num_write_kb":5443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"153'621","reported_seq":3371,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555733+0000","last_change":"2024-09-14T06:01:36.375502+0000","last_active":"2024-09-14T06:01:56.555733+0000","last_peered":"2024-09-14T06:01:56.555733+0000","last_clean":"2024-09-14T06:01:56.555733+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T06:01:56.555733+0000","last_undegraded":"2024-09-14T06:01:56.555733+0000","last_fullsized":"2024-09-14T06:01:56.555733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:17.635647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029969670000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":3552,"num_read_kb":12323,"num_write":744,"num_write_kb":12372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"152'406","reported_seq":6313,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678437+0000","last_change":"2024-09-14T06:01:36.368174+0000","last_active":"2024-09-14T06:01:56.678437+0000","last_peered":"2024-09-14T06:01:56.678437+0000","last_clean":"2024-09-14T06:01:56.678437+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T06:01:56.678437+0000","last_undegraded":"2024-09-14T06:01:56.678437+0000","last_fullsized":"2024-09-14T06:01:56.678437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:07.173657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084545099999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5603,"num_read_kb":35883,"num_write":395,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"153'594","reported_seq":4983,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678413+0000","last_change":"2024-09-14T06:01:36.368633+0000","last_active":"2024-09-14T06:01:56.678413+0000","last_peered":"2024-09-14T06:01:56.678413+0000","last_clean":"2024-09-14T06:01:56.678413+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T06:01:56.678413+0000","last_undegraded":"2024-09-14T06:01:56.678413+0000","last_fullsized":"2024-09-14T06:01:56.678413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:06.972032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012650980000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":5037,"num_read_kb":20692,"num_write":657,"num_write_kb":8689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"152'603","reported_seq":1906,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554864+0000","last_change":"2024-09-14T06:01:36.361688+0000","last_active":"2024-09-14T06:01:56.554864+0000","last_peered":"2024-09-14T06:01:56.554864+0000","last_clean":"2024-09-14T06:01:56.554864+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T06:01:56.554864+0000","last_undegraded":"2024-09-14T06:01:56.554864+0000","last_fullsized":"2024-09-14T06:01:56.554864+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:07.283206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184701,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":2669,"num_read_kb":6421,"num_write":624,"num_write_kb":6293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"152'990","reported_seq":6236,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552171+0000","last_change":"2024-09-14T06:01:36.362503+0000","last_active":"2024-09-14T06:01:56.552171+0000","last_peered":"2024-09-14T06:01:56.552171+0000","last_clean":"2024-09-14T06:01:56.552171+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T06:01:56.552171+0000","last_undegraded":"2024-09-14T06:01:56.552171+0000","last_fullsized":"2024-09-14T06:01:56.552171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":990,"log_dups_size":0,"ondisk_log_size":990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:22.103314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001987094,"stat_sum":{"num_bytes":19,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":36,"num_read":8467,"num_read_kb":44656,"num_write":1302,"num_write_kb":19849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"151'534","reported_seq":3329,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861755+0000","last_change":"2024-09-14T06:01:36.458706+0000","last_active":"2024-09-14T06:01:56.861755+0000","last_peered":"2024-09-14T06:01:56.861755+0000","last_clean":"2024-09-14T06:01:56.861755+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T06:01:56.861755+0000","last_undegraded":"2024-09-14T06:01:56.861755+0000","last_fullsized":"2024-09-14T06:01:56.861755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:08.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096831599999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3556,"num_read_kb":21733,"num_write":601,"num_write_kb":16615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"152'559","reported_seq":6311,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554241+0000","last_change":"2024-09-14T06:01:36.372778+0000","last_active":"2024-09-14T06:01:56.554241+0000","last_peered":"2024-09-14T06:01:56.554241+0000","last_clean":"2024-09-14T06:01:56.554241+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T06:01:56.554241+0000","last_undegraded":"2024-09-14T06:01:56.554241+0000","last_fullsized":"2024-09-14T06:01:56.554241+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:44:55.242255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001233916,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7305,"num_read_kb":51490,"num_write":523,"num_write_kb":14203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"152'456","reported_seq":3550,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555163+0000","last_change":"2024-09-14T06:01:36.364273+0000","last_active":"2024-09-14T06:01:56.555163+0000","last_peered":"2024-09-14T06:01:56.555163+0000","last_clean":"2024-09-14T06:01:56.555163+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T06:01:56.555163+0000","last_undegraded":"2024-09-14T06:01:56.555163+0000","last_fullsized":"2024-09-14T06:01:56.555163+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:20.309640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002476359,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":3799,"num_read_kb":21473,"num_write":380,"num_write_kb":6982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"152'1485","reported_seq":4435,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678284+0000","last_change":"2024-09-14T06:01:36.368055+0000","last_active":"2024-09-14T06:01:56.678284+0000","last_peered":"2024-09-14T06:01:56.678284+0000","last_clean":"2024-09-14T06:01:56.678284+0000","last_became_active":"2024-09-14T06:01:12.307740+0000","last_became_peered":"2024-09-14T06:01:12.307740+0000","last_unstale":"2024-09-14T06:01:56.678284+0000","last_undegraded":"2024-09-14T06:01:56.678284+0000","last_fullsized":"2024-09-14T06:01:56.678284+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1485,"log_dups_size":0,"ondisk_log_size":1485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:19.124319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073476100000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":8264,"num_read_kb":22572,"num_write":2472,"num_write_kb":21400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":246,"num_bytes_recovered":5782955,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"149'796","reported_seq":6739,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861730+0000","last_change":"2024-09-14T06:01:55.536577+0000","last_active":"2024-09-14T06:01:56.861730+0000","last_peered":"2024-09-14T06:01:56.861730+0000","last_clean":"2024-09-14T06:01:56.861730+0000","last_became_active":"2024-09-14T06:01:55.530587+0000","last_became_peered":"2024-09-14T06:01:55.530587+0000","last_unstale":"2024-09-14T06:01:56.861730+0000","last_undegraded":"2024-09-14T06:01:56.861730+0000","last_fullsized":"2024-09-14T06:01:56.861730+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:42.496860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040508719999999996,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":7663,"num_read_kb":54856,"num_write":859,"num_write_kb":20153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":314,"num_bytes_recovered":5293699,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"152'646","reported_seq":5880,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552323+0000","last_change":"2024-09-14T06:01:36.361814+0000","last_active":"2024-09-14T06:01:56.552323+0000","last_peered":"2024-09-14T06:01:56.552323+0000","last_clean":"2024-09-14T06:01:56.552323+0000","last_became_active":"2024-09-14T06:01:12.309550+0000","last_became_peered":"2024-09-14T06:01:12.309550+0000","last_unstale":"2024-09-14T06:01:56.552323+0000","last_undegraded":"2024-09-14T06:01:56.552323+0000","last_fullsized":"2024-09-14T06:01:56.552323+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:42:18.135474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017425800000000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5717,"num_read_kb":30636,"num_write":834,"num_write_kb":16055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":1542204,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":331,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861515+0000","last_change":"2024-09-14T06:01:06.338467+0000","last_active":"2024-09-14T06:01:56.861515+0000","last_peered":"2024-09-14T06:01:56.861515+0000","last_clean":"2024-09-14T06:01:56.861515+0000","last_became_active":"2024-09-14T06:01:06.337939+0000","last_became_peered":"2024-09-14T06:01:06.337939+0000","last_unstale":"2024-09-14T06:01:56.861515+0000","last_undegraded":"2024-09-14T06:01:56.861515+0000","last_fullsized":"2024-09-14T06:01:56.861515+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:06.843302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"153'1130","reported_seq":5446,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555239+0000","last_change":"2024-09-14T06:01:36.363074+0000","last_active":"2024-09-14T06:01:56.555239+0000","last_peered":"2024-09-14T06:01:56.555239+0000","last_clean":"2024-09-14T06:01:56.555239+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T06:01:56.555239+0000","last_undegraded":"2024-09-14T06:01:56.555239+0000","last_fullsized":"2024-09-14T06:01:56.555239+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1130,"log_dups_size":0,"ondisk_log_size":1130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:49.879137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001486961,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":8368,"num_read_kb":25403,"num_write":1459,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":318,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862037+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T06:01:56.862037+0000","last_peered":"2024-09-14T06:01:56.862037+0000","last_clean":"2024-09-14T06:01:56.862037+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T06:01:56.862037+0000","last_undegraded":"2024-09-14T06:01:56.862037+0000","last_fullsized":"2024-09-14T06:01:56.862037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"153'440","reported_seq":4857,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555900+0000","last_change":"2024-09-14T06:01:36.374743+0000","last_active":"2024-09-14T06:01:56.555900+0000","last_peered":"2024-09-14T06:01:56.555900+0000","last_clean":"2024-09-14T06:01:56.555900+0000","last_became_active":"2024-09-14T06:01:33.331374+0000","last_became_peered":"2024-09-14T06:01:33.331374+0000","last_unstale":"2024-09-14T06:01:56.555900+0000","last_undegraded":"2024-09-14T06:01:56.555900+0000","last_fullsized":"2024-09-14T06:01:56.555900+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:50.843210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022251139999999998,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3987,"num_read_kb":32301,"num_write":424,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":530,"num_bytes_recovered":12849230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862069+0000","last_change":"2024-09-14T06:01:55.529470+0000","last_active":"2024-09-14T06:01:56.862069+0000","last_peered":"2024-09-14T06:01:56.862069+0000","last_clean":"2024-09-14T06:01:56.862069+0000","last_became_active":"2024-09-14T06:01:55.528696+0000","last_became_peered":"2024-09-14T06:01:55.528696+0000","last_unstale":"2024-09-14T06:01:56.862069+0000","last_undegraded":"2024-09-14T06:01:56.862069+0000","last_fullsized":"2024-09-14T06:01:56.862069+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:01.366086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"151'420","reported_seq":4284,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861879+0000","last_change":"2024-09-14T06:01:36.459282+0000","last_active":"2024-09-14T06:01:56.861879+0000","last_peered":"2024-09-14T06:01:56.861879+0000","last_clean":"2024-09-14T06:01:56.861879+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T06:01:56.861879+0000","last_undegraded":"2024-09-14T06:01:56.861879+0000","last_fullsized":"2024-09-14T06:01:56.861879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:44:57.795683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010338089999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3782,"num_read_kb":24853,"num_write":451,"num_write_kb":9884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":327,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861588+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T06:01:56.861588+0000","last_peered":"2024-09-14T06:01:56.861588+0000","last_clean":"2024-09-14T06:01:56.861588+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T06:01:56.861588+0000","last_undegraded":"2024-09-14T06:01:56.861588+0000","last_fullsized":"2024-09-14T06:01:56.861588+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"153'528","reported_seq":4377,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678700+0000","last_change":"2024-09-14T06:01:36.369952+0000","last_active":"2024-09-14T06:01:56.678700+0000","last_peered":"2024-09-14T06:01:56.678700+0000","last_clean":"2024-09-14T06:01:56.678700+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T06:01:56.678700+0000","last_undegraded":"2024-09-14T06:01:56.678700+0000","last_fullsized":"2024-09-14T06:01:56.678700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:09.812466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002246255,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5158,"num_read_kb":19798,"num_write":493,"num_write_kb":8565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"153'688","reported_seq":3684,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552235+0000","last_change":"2024-09-14T06:01:36.363528+0000","last_active":"2024-09-14T06:01:56.552235+0000","last_peered":"2024-09-14T06:01:56.552235+0000","last_clean":"2024-09-14T06:01:56.552235+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T06:01:56.552235+0000","last_undegraded":"2024-09-14T06:01:56.552235+0000","last_fullsized":"2024-09-14T06:01:56.552235+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:39.780208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022285579999999998,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":33,"num_read":4014,"num_read_kb":39469,"num_write":650,"num_write_kb":15966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":320,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678167+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T06:01:56.678167+0000","last_peered":"2024-09-14T06:01:56.678167+0000","last_clean":"2024-09-14T06:01:56.678167+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T06:01:56.678167+0000","last_undegraded":"2024-09-14T06:01:56.678167+0000","last_fullsized":"2024-09-14T06:01:56.678167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"152'1013","reported_seq":3096,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861679+0000","last_change":"2024-09-14T06:01:36.458728+0000","last_active":"2024-09-14T06:01:56.861679+0000","last_peered":"2024-09-14T06:01:56.861679+0000","last_clean":"2024-09-14T06:01:56.861679+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T06:01:56.861679+0000","last_undegraded":"2024-09-14T06:01:56.861679+0000","last_fullsized":"2024-09-14T06:01:56.861679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:41.340635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095053200000000003,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":40,"num_read":4900,"num_read_kb":20186,"num_write":1454,"num_write_kb":18376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.815822+0000","last_change":"2024-09-14T06:01:45.441200+0000","last_active":"2024-09-14T06:01:56.815822+0000","last_peered":"2024-09-14T06:01:56.815822+0000","last_clean":"2024-09-14T06:01:56.815822+0000","last_became_active":"2024-09-14T06:01:45.440693+0000","last_became_peered":"2024-09-14T06:01:45.440693+0000","last_unstale":"2024-09-14T06:01:56.815822+0000","last_undegraded":"2024-09-14T06:01:56.815822+0000","last_fullsized":"2024-09-14T06:01:56.815822+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:32.396856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"152'508","reported_seq":2906,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554433+0000","last_change":"2024-09-14T06:01:36.362228+0000","last_active":"2024-09-14T06:01:56.554433+0000","last_peered":"2024-09-14T06:01:56.554433+0000","last_clean":"2024-09-14T06:01:56.554433+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T06:01:56.554433+0000","last_undegraded":"2024-09-14T06:01:56.554433+0000","last_fullsized":"2024-09-14T06:01:56.554433+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:18.683159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015877090000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":2965,"num_read_kb":24090,"num_write":468,"num_write_kb":10967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861636+0000","last_change":"2024-09-14T06:01:55.699782+0000","last_active":"2024-09-14T06:01:56.861636+0000","last_peered":"2024-09-14T06:01:56.861636+0000","last_clean":"2024-09-14T06:01:56.861636+0000","last_became_active":"2024-09-14T06:01:55.699203+0000","last_became_peered":"2024-09-14T06:01:55.699203+0000","last_unstale":"2024-09-14T06:01:56.861636+0000","last_undegraded":"2024-09-14T06:01:56.861636+0000","last_fullsized":"2024-09-14T06:01:56.861636+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:58.473556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"152'361","reported_seq":2600,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555006+0000","last_change":"2024-09-14T06:01:36.373997+0000","last_active":"2024-09-14T06:01:56.555006+0000","last_peered":"2024-09-14T06:01:56.555006+0000","last_clean":"2024-09-14T06:01:56.555006+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T06:01:56.555006+0000","last_undegraded":"2024-09-14T06:01:56.555006+0000","last_fullsized":"2024-09-14T06:01:56.555006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:15.490820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002155353,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":1854,"num_read_kb":21999,"num_write":376,"num_write_kb":9648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":319,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678186+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T06:01:56.678186+0000","last_peered":"2024-09-14T06:01:56.678186+0000","last_clean":"2024-09-14T06:01:56.678186+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T06:01:56.678186+0000","last_undegraded":"2024-09-14T06:01:56.678186+0000","last_fullsized":"2024-09-14T06:01:56.678186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":150,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.551873+0000","last_change":"2024-09-14T06:00:48.871361+0000","last_active":"2024-09-14T06:01:56.551873+0000","last_peered":"2024-09-14T06:01:56.551873+0000","last_clean":"2024-09-14T06:01:56.551873+0000","last_became_active":"2024-09-14T06:00:48.845773+0000","last_became_peered":"2024-09-14T06:00:48.845773+0000","last_unstale":"2024-09-14T06:01:56.551873+0000","last_undegraded":"2024-09-14T06:01:56.551873+0000","last_fullsized":"2024-09-14T06:01:56.551873+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:59.588543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"153'737","reported_seq":2435,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554555+0000","last_change":"2024-09-14T06:01:36.372809+0000","last_active":"2024-09-14T06:01:56.554555+0000","last_peered":"2024-09-14T06:01:56.554555+0000","last_clean":"2024-09-14T06:01:56.554555+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T06:01:56.554555+0000","last_undegraded":"2024-09-14T06:01:56.554555+0000","last_fullsized":"2024-09-14T06:01:56.554555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:01.500172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938190000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3347,"num_read_kb":6654,"num_write":929,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"152'385","reported_seq":4935,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552090+0000","last_change":"2024-09-14T06:01:36.361089+0000","last_active":"2024-09-14T06:01:56.552090+0000","last_peered":"2024-09-14T06:01:56.552090+0000","last_clean":"2024-09-14T06:01:56.552090+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T06:01:56.552090+0000","last_undegraded":"2024-09-14T06:01:56.552090+0000","last_fullsized":"2024-09-14T06:01:56.552090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:03.218382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010238700000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":4613,"num_read_kb":34486,"num_write":364,"num_write_kb":27482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"152'680","reported_seq":2729,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861366+0000","last_change":"2024-09-14T06:01:36.375532+0000","last_active":"2024-09-14T06:01:56.861366+0000","last_peered":"2024-09-14T06:01:56.861366+0000","last_clean":"2024-09-14T06:01:56.861366+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T06:01:56.861366+0000","last_undegraded":"2024-09-14T06:01:56.861366+0000","last_fullsized":"2024-09-14T06:01:56.861366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:22.830670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069170899999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":3310,"num_read_kb":12425,"num_write":762,"num_write_kb":6088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"152'901","reported_seq":3870,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555315+0000","last_change":"2024-09-14T06:01:36.374044+0000","last_active":"2024-09-14T06:01:56.555315+0000","last_peered":"2024-09-14T06:01:56.555315+0000","last_clean":"2024-09-14T06:01:56.555315+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T06:01:56.555315+0000","last_undegraded":"2024-09-14T06:01:56.555315+0000","last_fullsized":"2024-09-14T06:01:56.555315+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:38:00.359541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022223719999999998,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":5877,"num_read_kb":27140,"num_write":1302,"num_write_kb":14124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"146'608","reported_seq":5313,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678299+0000","last_change":"2024-09-14T06:01:36.369367+0000","last_active":"2024-09-14T06:01:56.678299+0000","last_peered":"2024-09-14T06:01:56.678299+0000","last_clean":"2024-09-14T06:01:56.678299+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T06:01:56.678299+0000","last_undegraded":"2024-09-14T06:01:56.678299+0000","last_fullsized":"2024-09-14T06:01:56.678299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:15.699674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019468420000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":6117,"num_read_kb":23676,"num_write":517,"num_write_kb":12874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"151'418","reported_seq":3762,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862048+0000","last_change":"2024-09-14T06:01:55.542135+0000","last_active":"2024-09-14T06:01:56.862048+0000","last_peered":"2024-09-14T06:01:56.862048+0000","last_clean":"2024-09-14T06:01:56.862048+0000","last_became_active":"2024-09-14T06:01:55.537648+0000","last_became_peered":"2024-09-14T06:01:55.537648+0000","last_unstale":"2024-09-14T06:01:56.862048+0000","last_undegraded":"2024-09-14T06:01:56.862048+0000","last_fullsized":"2024-09-14T06:01:56.862048+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:37.382850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084296140000000002,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3697,"num_read_kb":21745,"num_write":409,"num_write_kb":13473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":2150148,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"152'627","reported_seq":4969,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862208+0000","last_change":"2024-09-14T06:01:55.538704+0000","last_active":"2024-09-14T06:01:56.862208+0000","last_peered":"2024-09-14T06:01:56.862208+0000","last_clean":"2024-09-14T06:01:56.862208+0000","last_became_active":"2024-09-14T06:01:55.529576+0000","last_became_peered":"2024-09-14T06:01:55.529576+0000","last_unstale":"2024-09-14T06:01:56.862208+0000","last_undegraded":"2024-09-14T06:01:56.862208+0000","last_fullsized":"2024-09-14T06:01:56.862208+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:02.794742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036759169999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5969,"num_read_kb":24775,"num_write":580,"num_write_kb":11404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":302,"num_bytes_recovered":1794796,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"152'634","reported_seq":6685,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862358+0000","last_change":"2024-09-14T06:01:55.540392+0000","last_active":"2024-09-14T06:01:56.862358+0000","last_peered":"2024-09-14T06:01:56.862358+0000","last_clean":"2024-09-14T06:01:56.862358+0000","last_became_active":"2024-09-14T06:01:55.534489+0000","last_became_peered":"2024-09-14T06:01:55.534489+0000","last_unstale":"2024-09-14T06:01:56.862358+0000","last_undegraded":"2024-09-14T06:01:56.862358+0000","last_fullsized":"2024-09-14T06:01:56.862358+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:46.714182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035801489999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":7304,"num_read_kb":14772,"num_write":688,"num_write_kb":6369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":2812424,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"152'955","reported_seq":4468,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861364+0000","last_change":"2024-09-14T06:01:36.375463+0000","last_active":"2024-09-14T06:01:56.861364+0000","last_peered":"2024-09-14T06:01:56.861364+0000","last_clean":"2024-09-14T06:01:56.861364+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T06:01:56.861364+0000","last_undegraded":"2024-09-14T06:01:56.861364+0000","last_fullsized":"2024-09-14T06:01:56.861364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:28.705551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063032799999999999,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":6689,"num_read_kb":19376,"num_write":1207,"num_write_kb":11822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"152'562","reported_seq":6675,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861701+0000","last_change":"2024-09-14T06:01:55.534889+0000","last_active":"2024-09-14T06:01:56.861701+0000","last_peered":"2024-09-14T06:01:56.861701+0000","last_clean":"2024-09-14T06:01:56.861701+0000","last_became_active":"2024-09-14T06:01:55.529694+0000","last_became_peered":"2024-09-14T06:01:55.529694+0000","last_unstale":"2024-09-14T06:01:56.861701+0000","last_undegraded":"2024-09-14T06:01:56.861701+0000","last_fullsized":"2024-09-14T06:01:56.861701+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:32:41.094646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007656754,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":6277,"num_read_kb":34183,"num_write":630,"num_write_kb":31053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":284,"num_bytes_recovered":12777008,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"151'731","reported_seq":6960,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554765+0000","last_change":"2024-09-14T06:01:36.362365+0000","last_active":"2024-09-14T06:01:56.554765+0000","last_peered":"2024-09-14T06:01:56.554765+0000","last_clean":"2024-09-14T06:01:56.554765+0000","last_became_active":"2024-09-14T06:01:21.321381+0000","last_became_peered":"2024-09-14T06:01:21.321381+0000","last_unstale":"2024-09-14T06:01:56.554765+0000","last_undegraded":"2024-09-14T06:01:56.554765+0000","last_fullsized":"2024-09-14T06:01:56.554765+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:07.305705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017037930000000001,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":6816,"num_read_kb":29154,"num_write":729,"num_write_kb":10847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":500,"num_bytes_recovered":4175332,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"152'466","reported_seq":6578,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861786+0000","last_change":"2024-09-14T06:01:55.536790+0000","last_active":"2024-09-14T06:01:56.861786+0000","last_peered":"2024-09-14T06:01:56.861786+0000","last_clean":"2024-09-14T06:01:56.861786+0000","last_became_active":"2024-09-14T06:01:55.529674+0000","last_became_peered":"2024-09-14T06:01:55.529674+0000","last_unstale":"2024-09-14T06:01:56.861786+0000","last_undegraded":"2024-09-14T06:01:56.861786+0000","last_fullsized":"2024-09-14T06:01:56.861786+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:07:14.178795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026632919999999998,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":5545,"num_read_kb":33709,"num_write":451,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":300,"num_bytes_recovered":8189194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":998,"num_object_clones":0,"num_object_copies":1996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":998,"num_whiteouts":994,"num_read":166943,"num_read_kb":827903,"num_write":24723,"num_write_kb":445904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3513,"num_bytes_recovered":62209517,"num_keys_recovered":216,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21304,"ondisk_log_size":21304,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41520,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330320,"statfs":{"total":96636764160,"available":96594247680,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495645,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56360,"kb_used_data":2004,"kb_used_omap":4,"kb_used_meta":54331,"kb_avail":94315480,"statfs":{"total":96636764160,"available":96579051520,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":55635632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51240,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320600,"statfs":{"total":96636764160,"available":96584294400,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41516,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330324,"statfs":{"total":96636764160,"available":96594251776,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55404,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316436,"statfs":{"total":96636764160,"available":96580030464,"internally_reserved":0,"allocated":2056192,"data_stored":982606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47668,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324172,"statfs":{"total":96636764160,"available":96587952128,"internally_reserved":0,"allocated":2650112,"data_stored":1572974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59564,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312276,"statfs":{"total":96636764160,"available":96575770624,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55996,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315844,"statfs":{"total":96636764160,"available":96579424256,"internally_reserved":0,"allocated":2654208,"data_stored":1572993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T06:01:59.494 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T06:01:59.798 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:01:59.798 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T06:01:59.815 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-09-14T06:01:59.515968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1002,"num_object_clones":0,"num_object_copies":2004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1002,"num_whiteouts":994,"num_read":167009,"num_read_kb":827958,"num_write":24826,"num_write_kb":447534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3515,"num_bytes_recovered":62799885,"num_keys_recovered":216,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21379,"ondisk_log_size":21379,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":409268,"kb_used_data":17208,"kb_used_omap":15,"kb_used_meta":391856,"kb_avail":754565452,"statfs":{"total":773094113280,"available":772675022848,"internally_reserved":0,"allocated":17620992,"data_stored":9041508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":401261340},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001825"},"pg_stats":[{"pgid":"3.1f","version":"153'822","reported_seq":3050,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555490+0000","last_change":"2024-09-14T06:01:36.363763+0000","last_active":"2024-09-14T06:01:56.555490+0000","last_peered":"2024-09-14T06:01:56.555490+0000","last_clean":"2024-09-14T06:01:56.555490+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T06:01:56.555490+0000","last_undegraded":"2024-09-14T06:01:56.555490+0000","last_fullsized":"2024-09-14T06:01:56.555490+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:20.876081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019644789999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":4722,"num_read_kb":14974,"num_write":989,"num_write_kb":5443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"153'621","reported_seq":3371,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555733+0000","last_change":"2024-09-14T06:01:36.375502+0000","last_active":"2024-09-14T06:01:56.555733+0000","last_peered":"2024-09-14T06:01:56.555733+0000","last_clean":"2024-09-14T06:01:56.555733+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T06:01:56.555733+0000","last_undegraded":"2024-09-14T06:01:56.555733+0000","last_fullsized":"2024-09-14T06:01:56.555733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:17.635647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029969670000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":3552,"num_read_kb":12323,"num_write":744,"num_write_kb":12372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"152'406","reported_seq":6313,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678437+0000","last_change":"2024-09-14T06:01:36.368174+0000","last_active":"2024-09-14T06:01:56.678437+0000","last_peered":"2024-09-14T06:01:56.678437+0000","last_clean":"2024-09-14T06:01:56.678437+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T06:01:56.678437+0000","last_undegraded":"2024-09-14T06:01:56.678437+0000","last_fullsized":"2024-09-14T06:01:56.678437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:07.173657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084545099999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5603,"num_read_kb":35883,"num_write":395,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"153'594","reported_seq":4983,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678413+0000","last_change":"2024-09-14T06:01:36.368633+0000","last_active":"2024-09-14T06:01:56.678413+0000","last_peered":"2024-09-14T06:01:56.678413+0000","last_clean":"2024-09-14T06:01:56.678413+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T06:01:56.678413+0000","last_undegraded":"2024-09-14T06:01:56.678413+0000","last_fullsized":"2024-09-14T06:01:56.678413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:06.972032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012650980000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":5037,"num_read_kb":20692,"num_write":657,"num_write_kb":8689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"152'603","reported_seq":1906,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554864+0000","last_change":"2024-09-14T06:01:36.361688+0000","last_active":"2024-09-14T06:01:56.554864+0000","last_peered":"2024-09-14T06:01:56.554864+0000","last_clean":"2024-09-14T06:01:56.554864+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T06:01:56.554864+0000","last_undegraded":"2024-09-14T06:01:56.554864+0000","last_fullsized":"2024-09-14T06:01:56.554864+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:07.283206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184701,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":2669,"num_read_kb":6421,"num_write":624,"num_write_kb":6293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"152'990","reported_seq":6236,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552171+0000","last_change":"2024-09-14T06:01:36.362503+0000","last_active":"2024-09-14T06:01:56.552171+0000","last_peered":"2024-09-14T06:01:56.552171+0000","last_clean":"2024-09-14T06:01:56.552171+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T06:01:56.552171+0000","last_undegraded":"2024-09-14T06:01:56.552171+0000","last_fullsized":"2024-09-14T06:01:56.552171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":990,"log_dups_size":0,"ondisk_log_size":990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:22.103314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001987094,"stat_sum":{"num_bytes":19,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":36,"num_read":8467,"num_read_kb":44656,"num_write":1302,"num_write_kb":19849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"151'534","reported_seq":3329,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861755+0000","last_change":"2024-09-14T06:01:36.458706+0000","last_active":"2024-09-14T06:01:56.861755+0000","last_peered":"2024-09-14T06:01:56.861755+0000","last_clean":"2024-09-14T06:01:56.861755+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T06:01:56.861755+0000","last_undegraded":"2024-09-14T06:01:56.861755+0000","last_fullsized":"2024-09-14T06:01:56.861755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:08.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096831599999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3556,"num_read_kb":21733,"num_write":601,"num_write_kb":16615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"152'559","reported_seq":6311,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554241+0000","last_change":"2024-09-14T06:01:36.372778+0000","last_active":"2024-09-14T06:01:56.554241+0000","last_peered":"2024-09-14T06:01:56.554241+0000","last_clean":"2024-09-14T06:01:56.554241+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T06:01:56.554241+0000","last_undegraded":"2024-09-14T06:01:56.554241+0000","last_fullsized":"2024-09-14T06:01:56.554241+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:44:55.242255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001233916,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7305,"num_read_kb":51490,"num_write":523,"num_write_kb":14203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"152'456","reported_seq":3550,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555163+0000","last_change":"2024-09-14T06:01:36.364273+0000","last_active":"2024-09-14T06:01:56.555163+0000","last_peered":"2024-09-14T06:01:56.555163+0000","last_clean":"2024-09-14T06:01:56.555163+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T06:01:56.555163+0000","last_undegraded":"2024-09-14T06:01:56.555163+0000","last_fullsized":"2024-09-14T06:01:56.555163+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:20.309640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002476359,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":3799,"num_read_kb":21473,"num_write":380,"num_write_kb":6982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"152'1485","reported_seq":4435,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678284+0000","last_change":"2024-09-14T06:01:36.368055+0000","last_active":"2024-09-14T06:01:56.678284+0000","last_peered":"2024-09-14T06:01:56.678284+0000","last_clean":"2024-09-14T06:01:56.678284+0000","last_became_active":"2024-09-14T06:01:12.307740+0000","last_became_peered":"2024-09-14T06:01:12.307740+0000","last_unstale":"2024-09-14T06:01:56.678284+0000","last_undegraded":"2024-09-14T06:01:56.678284+0000","last_fullsized":"2024-09-14T06:01:56.678284+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1485,"log_dups_size":0,"ondisk_log_size":1485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:19.124319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073476100000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":8264,"num_read_kb":22572,"num_write":2472,"num_write_kb":21400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":246,"num_bytes_recovered":5782955,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"149'796","reported_seq":6739,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861730+0000","last_change":"2024-09-14T06:01:55.536577+0000","last_active":"2024-09-14T06:01:56.861730+0000","last_peered":"2024-09-14T06:01:56.861730+0000","last_clean":"2024-09-14T06:01:56.861730+0000","last_became_active":"2024-09-14T06:01:55.530587+0000","last_became_peered":"2024-09-14T06:01:55.530587+0000","last_unstale":"2024-09-14T06:01:56.861730+0000","last_undegraded":"2024-09-14T06:01:56.861730+0000","last_fullsized":"2024-09-14T06:01:56.861730+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:42.496860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040508719999999996,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":7663,"num_read_kb":54856,"num_write":859,"num_write_kb":20153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":314,"num_bytes_recovered":5293699,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"152'646","reported_seq":5880,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552323+0000","last_change":"2024-09-14T06:01:36.361814+0000","last_active":"2024-09-14T06:01:56.552323+0000","last_peered":"2024-09-14T06:01:56.552323+0000","last_clean":"2024-09-14T06:01:56.552323+0000","last_became_active":"2024-09-14T06:01:12.309550+0000","last_became_peered":"2024-09-14T06:01:12.309550+0000","last_unstale":"2024-09-14T06:01:56.552323+0000","last_undegraded":"2024-09-14T06:01:56.552323+0000","last_fullsized":"2024-09-14T06:01:56.552323+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:42:18.135474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017425800000000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5717,"num_read_kb":30636,"num_write":834,"num_write_kb":16055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":1542204,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":331,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861515+0000","last_change":"2024-09-14T06:01:06.338467+0000","last_active":"2024-09-14T06:01:56.861515+0000","last_peered":"2024-09-14T06:01:56.861515+0000","last_clean":"2024-09-14T06:01:56.861515+0000","last_became_active":"2024-09-14T06:01:06.337939+0000","last_became_peered":"2024-09-14T06:01:06.337939+0000","last_unstale":"2024-09-14T06:01:56.861515+0000","last_undegraded":"2024-09-14T06:01:56.861515+0000","last_fullsized":"2024-09-14T06:01:56.861515+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:06.843302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"153'1130","reported_seq":5446,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555239+0000","last_change":"2024-09-14T06:01:36.363074+0000","last_active":"2024-09-14T06:01:56.555239+0000","last_peered":"2024-09-14T06:01:56.555239+0000","last_clean":"2024-09-14T06:01:56.555239+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T06:01:56.555239+0000","last_undegraded":"2024-09-14T06:01:56.555239+0000","last_fullsized":"2024-09-14T06:01:56.555239+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1130,"log_dups_size":0,"ondisk_log_size":1130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:49.879137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001486961,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":8368,"num_read_kb":25403,"num_write":1459,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":318,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862037+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T06:01:56.862037+0000","last_peered":"2024-09-14T06:01:56.862037+0000","last_clean":"2024-09-14T06:01:56.862037+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T06:01:56.862037+0000","last_undegraded":"2024-09-14T06:01:56.862037+0000","last_fullsized":"2024-09-14T06:01:56.862037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"153'440","reported_seq":4857,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555900+0000","last_change":"2024-09-14T06:01:36.374743+0000","last_active":"2024-09-14T06:01:56.555900+0000","last_peered":"2024-09-14T06:01:56.555900+0000","last_clean":"2024-09-14T06:01:56.555900+0000","last_became_active":"2024-09-14T06:01:33.331374+0000","last_became_peered":"2024-09-14T06:01:33.331374+0000","last_unstale":"2024-09-14T06:01:56.555900+0000","last_undegraded":"2024-09-14T06:01:56.555900+0000","last_fullsized":"2024-09-14T06:01:56.555900+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:50.843210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022251139999999998,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3987,"num_read_kb":32301,"num_write":424,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":530,"num_bytes_recovered":12849230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862069+0000","last_change":"2024-09-14T06:01:55.529470+0000","last_active":"2024-09-14T06:01:56.862069+0000","last_peered":"2024-09-14T06:01:56.862069+0000","last_clean":"2024-09-14T06:01:56.862069+0000","last_became_active":"2024-09-14T06:01:55.528696+0000","last_became_peered":"2024-09-14T06:01:55.528696+0000","last_unstale":"2024-09-14T06:01:56.862069+0000","last_undegraded":"2024-09-14T06:01:56.862069+0000","last_fullsized":"2024-09-14T06:01:56.862069+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:01.366086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"151'420","reported_seq":4284,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861879+0000","last_change":"2024-09-14T06:01:36.459282+0000","last_active":"2024-09-14T06:01:56.861879+0000","last_peered":"2024-09-14T06:01:56.861879+0000","last_clean":"2024-09-14T06:01:56.861879+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T06:01:56.861879+0000","last_undegraded":"2024-09-14T06:01:56.861879+0000","last_fullsized":"2024-09-14T06:01:56.861879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:44:57.795683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010338089999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3782,"num_read_kb":24853,"num_write":451,"num_write_kb":9884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":327,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861588+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T06:01:56.861588+0000","last_peered":"2024-09-14T06:01:56.861588+0000","last_clean":"2024-09-14T06:01:56.861588+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T06:01:56.861588+0000","last_undegraded":"2024-09-14T06:01:56.861588+0000","last_fullsized":"2024-09-14T06:01:56.861588+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"153'528","reported_seq":4377,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678700+0000","last_change":"2024-09-14T06:01:36.369952+0000","last_active":"2024-09-14T06:01:56.678700+0000","last_peered":"2024-09-14T06:01:56.678700+0000","last_clean":"2024-09-14T06:01:56.678700+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T06:01:56.678700+0000","last_undegraded":"2024-09-14T06:01:56.678700+0000","last_fullsized":"2024-09-14T06:01:56.678700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:09.812466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002246255,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5158,"num_read_kb":19798,"num_write":493,"num_write_kb":8565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"153'688","reported_seq":3684,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552235+0000","last_change":"2024-09-14T06:01:36.363528+0000","last_active":"2024-09-14T06:01:56.552235+0000","last_peered":"2024-09-14T06:01:56.552235+0000","last_clean":"2024-09-14T06:01:56.552235+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T06:01:56.552235+0000","last_undegraded":"2024-09-14T06:01:56.552235+0000","last_fullsized":"2024-09-14T06:01:56.552235+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:39.780208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022285579999999998,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":33,"num_read":4014,"num_read_kb":39469,"num_write":650,"num_write_kb":15966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":320,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678167+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T06:01:56.678167+0000","last_peered":"2024-09-14T06:01:56.678167+0000","last_clean":"2024-09-14T06:01:56.678167+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T06:01:56.678167+0000","last_undegraded":"2024-09-14T06:01:56.678167+0000","last_fullsized":"2024-09-14T06:01:56.678167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"152'1013","reported_seq":3096,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861679+0000","last_change":"2024-09-14T06:01:36.458728+0000","last_active":"2024-09-14T06:01:56.861679+0000","last_peered":"2024-09-14T06:01:56.861679+0000","last_clean":"2024-09-14T06:01:56.861679+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T06:01:56.861679+0000","last_undegraded":"2024-09-14T06:01:56.861679+0000","last_fullsized":"2024-09-14T06:01:56.861679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:41.340635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095053200000000003,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":40,"num_read":4900,"num_read_kb":20186,"num_write":1454,"num_write_kb":18376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.815822+0000","last_change":"2024-09-14T06:01:45.441200+0000","last_active":"2024-09-14T06:01:56.815822+0000","last_peered":"2024-09-14T06:01:56.815822+0000","last_clean":"2024-09-14T06:01:56.815822+0000","last_became_active":"2024-09-14T06:01:45.440693+0000","last_became_peered":"2024-09-14T06:01:45.440693+0000","last_unstale":"2024-09-14T06:01:56.815822+0000","last_undegraded":"2024-09-14T06:01:56.815822+0000","last_fullsized":"2024-09-14T06:01:56.815822+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:32.396856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"152'508","reported_seq":2906,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554433+0000","last_change":"2024-09-14T06:01:36.362228+0000","last_active":"2024-09-14T06:01:56.554433+0000","last_peered":"2024-09-14T06:01:56.554433+0000","last_clean":"2024-09-14T06:01:56.554433+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T06:01:56.554433+0000","last_undegraded":"2024-09-14T06:01:56.554433+0000","last_fullsized":"2024-09-14T06:01:56.554433+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:18.683159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015877090000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":2965,"num_read_kb":24090,"num_write":468,"num_write_kb":10967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861636+0000","last_change":"2024-09-14T06:01:55.699782+0000","last_active":"2024-09-14T06:01:56.861636+0000","last_peered":"2024-09-14T06:01:56.861636+0000","last_clean":"2024-09-14T06:01:56.861636+0000","last_became_active":"2024-09-14T06:01:55.699203+0000","last_became_peered":"2024-09-14T06:01:55.699203+0000","last_unstale":"2024-09-14T06:01:56.861636+0000","last_undegraded":"2024-09-14T06:01:56.861636+0000","last_fullsized":"2024-09-14T06:01:56.861636+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:58.473556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"152'361","reported_seq":2600,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555006+0000","last_change":"2024-09-14T06:01:36.373997+0000","last_active":"2024-09-14T06:01:56.555006+0000","last_peered":"2024-09-14T06:01:56.555006+0000","last_clean":"2024-09-14T06:01:56.555006+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T06:01:56.555006+0000","last_undegraded":"2024-09-14T06:01:56.555006+0000","last_fullsized":"2024-09-14T06:01:56.555006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:15.490820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002155353,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":1854,"num_read_kb":21999,"num_write":376,"num_write_kb":9648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":319,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678186+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T06:01:56.678186+0000","last_peered":"2024-09-14T06:01:56.678186+0000","last_clean":"2024-09-14T06:01:56.678186+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T06:01:56.678186+0000","last_undegraded":"2024-09-14T06:01:56.678186+0000","last_fullsized":"2024-09-14T06:01:56.678186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":150,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.551873+0000","last_change":"2024-09-14T06:00:48.871361+0000","last_active":"2024-09-14T06:01:56.551873+0000","last_peered":"2024-09-14T06:01:56.551873+0000","last_clean":"2024-09-14T06:01:56.551873+0000","last_became_active":"2024-09-14T06:00:48.845773+0000","last_became_peered":"2024-09-14T06:00:48.845773+0000","last_unstale":"2024-09-14T06:01:56.551873+0000","last_undegraded":"2024-09-14T06:01:56.551873+0000","last_fullsized":"2024-09-14T06:01:56.551873+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:59.588543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"153'737","reported_seq":2435,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554555+0000","last_change":"2024-09-14T06:01:36.372809+0000","last_active":"2024-09-14T06:01:56.554555+0000","last_peered":"2024-09-14T06:01:56.554555+0000","last_clean":"2024-09-14T06:01:56.554555+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T06:01:56.554555+0000","last_undegraded":"2024-09-14T06:01:56.554555+0000","last_fullsized":"2024-09-14T06:01:56.554555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:01.500172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938190000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3347,"num_read_kb":6654,"num_write":929,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"152'385","reported_seq":4935,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552090+0000","last_change":"2024-09-14T06:01:36.361089+0000","last_active":"2024-09-14T06:01:56.552090+0000","last_peered":"2024-09-14T06:01:56.552090+0000","last_clean":"2024-09-14T06:01:56.552090+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T06:01:56.552090+0000","last_undegraded":"2024-09-14T06:01:56.552090+0000","last_fullsized":"2024-09-14T06:01:56.552090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:03.218382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010238700000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":4613,"num_read_kb":34486,"num_write":364,"num_write_kb":27482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"152'680","reported_seq":2729,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861366+0000","last_change":"2024-09-14T06:01:36.375532+0000","last_active":"2024-09-14T06:01:56.861366+0000","last_peered":"2024-09-14T06:01:56.861366+0000","last_clean":"2024-09-14T06:01:56.861366+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T06:01:56.861366+0000","last_undegraded":"2024-09-14T06:01:56.861366+0000","last_fullsized":"2024-09-14T06:01:56.861366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:22.830670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069170899999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":3310,"num_read_kb":12425,"num_write":762,"num_write_kb":6088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"152'901","reported_seq":3870,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555315+0000","last_change":"2024-09-14T06:01:36.374044+0000","last_active":"2024-09-14T06:01:56.555315+0000","last_peered":"2024-09-14T06:01:56.555315+0000","last_clean":"2024-09-14T06:01:56.555315+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T06:01:56.555315+0000","last_undegraded":"2024-09-14T06:01:56.555315+0000","last_fullsized":"2024-09-14T06:01:56.555315+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:38:00.359541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022223719999999998,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":5877,"num_read_kb":27140,"num_write":1302,"num_write_kb":14124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"146'608","reported_seq":5313,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678299+0000","last_change":"2024-09-14T06:01:36.369367+0000","last_active":"2024-09-14T06:01:56.678299+0000","last_peered":"2024-09-14T06:01:56.678299+0000","last_clean":"2024-09-14T06:01:56.678299+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T06:01:56.678299+0000","last_undegraded":"2024-09-14T06:01:56.678299+0000","last_fullsized":"2024-09-14T06:01:56.678299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:15.699674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019468420000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":6117,"num_read_kb":23676,"num_write":517,"num_write_kb":12874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"151'418","reported_seq":3762,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862048+0000","last_change":"2024-09-14T06:01:55.542135+0000","last_active":"2024-09-14T06:01:56.862048+0000","last_peered":"2024-09-14T06:01:56.862048+0000","last_clean":"2024-09-14T06:01:56.862048+0000","last_became_active":"2024-09-14T06:01:55.537648+0000","last_became_peered":"2024-09-14T06:01:55.537648+0000","last_unstale":"2024-09-14T06:01:56.862048+0000","last_undegraded":"2024-09-14T06:01:56.862048+0000","last_fullsized":"2024-09-14T06:01:56.862048+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:37.382850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084296140000000002,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3697,"num_read_kb":21745,"num_write":409,"num_write_kb":13473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":2150148,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"152'627","reported_seq":4969,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862208+0000","last_change":"2024-09-14T06:01:55.538704+0000","last_active":"2024-09-14T06:01:56.862208+0000","last_peered":"2024-09-14T06:01:56.862208+0000","last_clean":"2024-09-14T06:01:56.862208+0000","last_became_active":"2024-09-14T06:01:55.529576+0000","last_became_peered":"2024-09-14T06:01:55.529576+0000","last_unstale":"2024-09-14T06:01:56.862208+0000","last_undegraded":"2024-09-14T06:01:56.862208+0000","last_fullsized":"2024-09-14T06:01:56.862208+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:02.794742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036759169999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5969,"num_read_kb":24775,"num_write":580,"num_write_kb":11404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":302,"num_bytes_recovered":1794796,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"152'634","reported_seq":6685,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862358+0000","last_change":"2024-09-14T06:01:55.540392+0000","last_active":"2024-09-14T06:01:56.862358+0000","last_peered":"2024-09-14T06:01:56.862358+0000","last_clean":"2024-09-14T06:01:56.862358+0000","last_became_active":"2024-09-14T06:01:55.534489+0000","last_became_peered":"2024-09-14T06:01:55.534489+0000","last_unstale":"2024-09-14T06:01:56.862358+0000","last_undegraded":"2024-09-14T06:01:56.862358+0000","last_fullsized":"2024-09-14T06:01:56.862358+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:46.714182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035801489999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":7304,"num_read_kb":14772,"num_write":688,"num_write_kb":6369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":2812424,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"152'955","reported_seq":4468,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861364+0000","last_change":"2024-09-14T06:01:36.375463+0000","last_active":"2024-09-14T06:01:56.861364+0000","last_peered":"2024-09-14T06:01:56.861364+0000","last_clean":"2024-09-14T06:01:56.861364+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T06:01:56.861364+0000","last_undegraded":"2024-09-14T06:01:56.861364+0000","last_fullsized":"2024-09-14T06:01:56.861364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:28.705551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063032799999999999,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":6689,"num_read_kb":19376,"num_write":1207,"num_write_kb":11822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"152'562","reported_seq":6675,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861701+0000","last_change":"2024-09-14T06:01:55.534889+0000","last_active":"2024-09-14T06:01:56.861701+0000","last_peered":"2024-09-14T06:01:56.861701+0000","last_clean":"2024-09-14T06:01:56.861701+0000","last_became_active":"2024-09-14T06:01:55.529694+0000","last_became_peered":"2024-09-14T06:01:55.529694+0000","last_unstale":"2024-09-14T06:01:56.861701+0000","last_undegraded":"2024-09-14T06:01:56.861701+0000","last_fullsized":"2024-09-14T06:01:56.861701+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:32:41.094646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007656754,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":6277,"num_read_kb":34183,"num_write":630,"num_write_kb":31053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":284,"num_bytes_recovered":12777008,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"151'731","reported_seq":6960,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554765+0000","last_change":"2024-09-14T06:01:36.362365+0000","last_active":"2024-09-14T06:01:56.554765+0000","last_peered":"2024-09-14T06:01:56.554765+0000","last_clean":"2024-09-14T06:01:56.554765+0000","last_became_active":"2024-09-14T06:01:21.321381+0000","last_became_peered":"2024-09-14T06:01:21.321381+0000","last_unstale":"2024-09-14T06:01:56.554765+0000","last_undegraded":"2024-09-14T06:01:56.554765+0000","last_fullsized":"2024-09-14T06:01:56.554765+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:07.305705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017037930000000001,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":6816,"num_read_kb":29154,"num_write":729,"num_write_kb":10847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":500,"num_bytes_recovered":4175332,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"152'466","reported_seq":6578,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861786+0000","last_change":"2024-09-14T06:01:55.536790+0000","last_active":"2024-09-14T06:01:56.861786+0000","last_peered":"2024-09-14T06:01:56.861786+0000","last_clean":"2024-09-14T06:01:56.861786+0000","last_became_active":"2024-09-14T06:01:55.529674+0000","last_became_peered":"2024-09-14T06:01:55.529674+0000","last_unstale":"2024-09-14T06:01:56.861786+0000","last_undegraded":"2024-09-14T06:01:56.861786+0000","last_fullsized":"2024-09-14T06:01:56.861786+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:07:14.178795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026632919999999998,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":5545,"num_read_kb":33709,"num_write":451,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":300,"num_bytes_recovered":8189194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":998,"num_object_clones":0,"num_object_copies":1996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":998,"num_whiteouts":994,"num_read":166943,"num_read_kb":827903,"num_write":24723,"num_write_kb":445904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3513,"num_bytes_recovered":62209517,"num_keys_recovered":216,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21304,"ondisk_log_size":21304,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41520,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330320,"statfs":{"total":96636764160,"available":96594247680,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495646,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56360,"kb_used_data":2004,"kb_used_omap":4,"kb_used_meta":54331,"kb_avail":94315480,"statfs":{"total":96636764160,"available":96579051520,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":55635632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51240,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320600,"statfs":{"total":96636764160,"available":96584294400,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41516,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330324,"statfs":{"total":96636764160,"available":96594251776,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55404,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316436,"statfs":{"total":96636764160,"available":96580030464,"internally_reserved":0,"allocated":2056192,"data_stored":982606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47668,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324172,"statfs":{"total":96636764160,"available":96587952128,"internally_reserved":0,"allocated":2650112,"data_stored":1572974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59564,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312276,"statfs":{"total":96636764160,"available":96575770624,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55996,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315844,"statfs":{"total":96636764160,"available":96579424256,"internally_reserved":0,"allocated":2654208,"data_stored":1572993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T06:01:59.817 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T06:01:59.817 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T06:02:00.146 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:02:00.147 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T06:02:00.164 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2024-09-14T06:01:59.515968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1002,"num_object_clones":0,"num_object_copies":2004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1002,"num_whiteouts":994,"num_read":167009,"num_read_kb":827958,"num_write":24826,"num_write_kb":447534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3515,"num_bytes_recovered":62799885,"num_keys_recovered":216,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21379,"ondisk_log_size":21379,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":409268,"kb_used_data":17208,"kb_used_omap":15,"kb_used_meta":391856,"kb_avail":754565452,"statfs":{"total":773094113280,"available":772675022848,"internally_reserved":0,"allocated":17620992,"data_stored":9041508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":401261340},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001825"},"pg_stats":[{"pgid":"3.1f","version":"153'822","reported_seq":3050,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555490+0000","last_change":"2024-09-14T06:01:36.363763+0000","last_active":"2024-09-14T06:01:56.555490+0000","last_peered":"2024-09-14T06:01:56.555490+0000","last_clean":"2024-09-14T06:01:56.555490+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T06:01:56.555490+0000","last_undegraded":"2024-09-14T06:01:56.555490+0000","last_fullsized":"2024-09-14T06:01:56.555490+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:20.876081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019644789999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":4722,"num_read_kb":14974,"num_write":989,"num_write_kb":5443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"153'621","reported_seq":3371,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555733+0000","last_change":"2024-09-14T06:01:36.375502+0000","last_active":"2024-09-14T06:01:56.555733+0000","last_peered":"2024-09-14T06:01:56.555733+0000","last_clean":"2024-09-14T06:01:56.555733+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T06:01:56.555733+0000","last_undegraded":"2024-09-14T06:01:56.555733+0000","last_fullsized":"2024-09-14T06:01:56.555733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:17.635647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029969670000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":3552,"num_read_kb":12323,"num_write":744,"num_write_kb":12372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"152'406","reported_seq":6313,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678437+0000","last_change":"2024-09-14T06:01:36.368174+0000","last_active":"2024-09-14T06:01:56.678437+0000","last_peered":"2024-09-14T06:01:56.678437+0000","last_clean":"2024-09-14T06:01:56.678437+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T06:01:56.678437+0000","last_undegraded":"2024-09-14T06:01:56.678437+0000","last_fullsized":"2024-09-14T06:01:56.678437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:07.173657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084545099999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5603,"num_read_kb":35883,"num_write":395,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"153'594","reported_seq":4983,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678413+0000","last_change":"2024-09-14T06:01:36.368633+0000","last_active":"2024-09-14T06:01:56.678413+0000","last_peered":"2024-09-14T06:01:56.678413+0000","last_clean":"2024-09-14T06:01:56.678413+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T06:01:56.678413+0000","last_undegraded":"2024-09-14T06:01:56.678413+0000","last_fullsized":"2024-09-14T06:01:56.678413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:06.972032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012650980000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":5037,"num_read_kb":20692,"num_write":657,"num_write_kb":8689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"152'603","reported_seq":1906,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554864+0000","last_change":"2024-09-14T06:01:36.361688+0000","last_active":"2024-09-14T06:01:56.554864+0000","last_peered":"2024-09-14T06:01:56.554864+0000","last_clean":"2024-09-14T06:01:56.554864+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T06:01:56.554864+0000","last_undegraded":"2024-09-14T06:01:56.554864+0000","last_fullsized":"2024-09-14T06:01:56.554864+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:07.283206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184701,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":2669,"num_read_kb":6421,"num_write":624,"num_write_kb":6293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"152'990","reported_seq":6236,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552171+0000","last_change":"2024-09-14T06:01:36.362503+0000","last_active":"2024-09-14T06:01:56.552171+0000","last_peered":"2024-09-14T06:01:56.552171+0000","last_clean":"2024-09-14T06:01:56.552171+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T06:01:56.552171+0000","last_undegraded":"2024-09-14T06:01:56.552171+0000","last_fullsized":"2024-09-14T06:01:56.552171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":990,"log_dups_size":0,"ondisk_log_size":990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:22.103314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001987094,"stat_sum":{"num_bytes":19,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":36,"num_read":8467,"num_read_kb":44656,"num_write":1302,"num_write_kb":19849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"151'534","reported_seq":3329,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861755+0000","last_change":"2024-09-14T06:01:36.458706+0000","last_active":"2024-09-14T06:01:56.861755+0000","last_peered":"2024-09-14T06:01:56.861755+0000","last_clean":"2024-09-14T06:01:56.861755+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T06:01:56.861755+0000","last_undegraded":"2024-09-14T06:01:56.861755+0000","last_fullsized":"2024-09-14T06:01:56.861755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:08.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096831599999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3556,"num_read_kb":21733,"num_write":601,"num_write_kb":16615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"152'559","reported_seq":6311,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554241+0000","last_change":"2024-09-14T06:01:36.372778+0000","last_active":"2024-09-14T06:01:56.554241+0000","last_peered":"2024-09-14T06:01:56.554241+0000","last_clean":"2024-09-14T06:01:56.554241+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T06:01:56.554241+0000","last_undegraded":"2024-09-14T06:01:56.554241+0000","last_fullsized":"2024-09-14T06:01:56.554241+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:44:55.242255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001233916,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7305,"num_read_kb":51490,"num_write":523,"num_write_kb":14203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"152'456","reported_seq":3550,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555163+0000","last_change":"2024-09-14T06:01:36.364273+0000","last_active":"2024-09-14T06:01:56.555163+0000","last_peered":"2024-09-14T06:01:56.555163+0000","last_clean":"2024-09-14T06:01:56.555163+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T06:01:56.555163+0000","last_undegraded":"2024-09-14T06:01:56.555163+0000","last_fullsized":"2024-09-14T06:01:56.555163+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:20.309640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002476359,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":3799,"num_read_kb":21473,"num_write":380,"num_write_kb":6982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"152'1485","reported_seq":4435,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678284+0000","last_change":"2024-09-14T06:01:36.368055+0000","last_active":"2024-09-14T06:01:56.678284+0000","last_peered":"2024-09-14T06:01:56.678284+0000","last_clean":"2024-09-14T06:01:56.678284+0000","last_became_active":"2024-09-14T06:01:12.307740+0000","last_became_peered":"2024-09-14T06:01:12.307740+0000","last_unstale":"2024-09-14T06:01:56.678284+0000","last_undegraded":"2024-09-14T06:01:56.678284+0000","last_fullsized":"2024-09-14T06:01:56.678284+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1485,"log_dups_size":0,"ondisk_log_size":1485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:19.124319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073476100000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":8264,"num_read_kb":22572,"num_write":2472,"num_write_kb":21400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":246,"num_bytes_recovered":5782955,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"149'796","reported_seq":6739,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861730+0000","last_change":"2024-09-14T06:01:55.536577+0000","last_active":"2024-09-14T06:01:56.861730+0000","last_peered":"2024-09-14T06:01:56.861730+0000","last_clean":"2024-09-14T06:01:56.861730+0000","last_became_active":"2024-09-14T06:01:55.530587+0000","last_became_peered":"2024-09-14T06:01:55.530587+0000","last_unstale":"2024-09-14T06:01:56.861730+0000","last_undegraded":"2024-09-14T06:01:56.861730+0000","last_fullsized":"2024-09-14T06:01:56.861730+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:42.496860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040508719999999996,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":7663,"num_read_kb":54856,"num_write":859,"num_write_kb":20153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":314,"num_bytes_recovered":5293699,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"152'646","reported_seq":5880,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552323+0000","last_change":"2024-09-14T06:01:36.361814+0000","last_active":"2024-09-14T06:01:56.552323+0000","last_peered":"2024-09-14T06:01:56.552323+0000","last_clean":"2024-09-14T06:01:56.552323+0000","last_became_active":"2024-09-14T06:01:12.309550+0000","last_became_peered":"2024-09-14T06:01:12.309550+0000","last_unstale":"2024-09-14T06:01:56.552323+0000","last_undegraded":"2024-09-14T06:01:56.552323+0000","last_fullsized":"2024-09-14T06:01:56.552323+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:42:18.135474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017425800000000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5717,"num_read_kb":30636,"num_write":834,"num_write_kb":16055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":1542204,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":331,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861515+0000","last_change":"2024-09-14T06:01:06.338467+0000","last_active":"2024-09-14T06:01:56.861515+0000","last_peered":"2024-09-14T06:01:56.861515+0000","last_clean":"2024-09-14T06:01:56.861515+0000","last_became_active":"2024-09-14T06:01:06.337939+0000","last_became_peered":"2024-09-14T06:01:06.337939+0000","last_unstale":"2024-09-14T06:01:56.861515+0000","last_undegraded":"2024-09-14T06:01:56.861515+0000","last_fullsized":"2024-09-14T06:01:56.861515+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:06.843302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"153'1130","reported_seq":5446,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555239+0000","last_change":"2024-09-14T06:01:36.363074+0000","last_active":"2024-09-14T06:01:56.555239+0000","last_peered":"2024-09-14T06:01:56.555239+0000","last_clean":"2024-09-14T06:01:56.555239+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T06:01:56.555239+0000","last_undegraded":"2024-09-14T06:01:56.555239+0000","last_fullsized":"2024-09-14T06:01:56.555239+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1130,"log_dups_size":0,"ondisk_log_size":1130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:49.879137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001486961,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":8368,"num_read_kb":25403,"num_write":1459,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":318,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862037+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T06:01:56.862037+0000","last_peered":"2024-09-14T06:01:56.862037+0000","last_clean":"2024-09-14T06:01:56.862037+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T06:01:56.862037+0000","last_undegraded":"2024-09-14T06:01:56.862037+0000","last_fullsized":"2024-09-14T06:01:56.862037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"153'440","reported_seq":4857,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555900+0000","last_change":"2024-09-14T06:01:36.374743+0000","last_active":"2024-09-14T06:01:56.555900+0000","last_peered":"2024-09-14T06:01:56.555900+0000","last_clean":"2024-09-14T06:01:56.555900+0000","last_became_active":"2024-09-14T06:01:33.331374+0000","last_became_peered":"2024-09-14T06:01:33.331374+0000","last_unstale":"2024-09-14T06:01:56.555900+0000","last_undegraded":"2024-09-14T06:01:56.555900+0000","last_fullsized":"2024-09-14T06:01:56.555900+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:50.843210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022251139999999998,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3987,"num_read_kb":32301,"num_write":424,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":530,"num_bytes_recovered":12849230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862069+0000","last_change":"2024-09-14T06:01:55.529470+0000","last_active":"2024-09-14T06:01:56.862069+0000","last_peered":"2024-09-14T06:01:56.862069+0000","last_clean":"2024-09-14T06:01:56.862069+0000","last_became_active":"2024-09-14T06:01:55.528696+0000","last_became_peered":"2024-09-14T06:01:55.528696+0000","last_unstale":"2024-09-14T06:01:56.862069+0000","last_undegraded":"2024-09-14T06:01:56.862069+0000","last_fullsized":"2024-09-14T06:01:56.862069+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:01.366086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"151'420","reported_seq":4284,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861879+0000","last_change":"2024-09-14T06:01:36.459282+0000","last_active":"2024-09-14T06:01:56.861879+0000","last_peered":"2024-09-14T06:01:56.861879+0000","last_clean":"2024-09-14T06:01:56.861879+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T06:01:56.861879+0000","last_undegraded":"2024-09-14T06:01:56.861879+0000","last_fullsized":"2024-09-14T06:01:56.861879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:44:57.795683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010338089999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3782,"num_read_kb":24853,"num_write":451,"num_write_kb":9884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":327,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861588+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T06:01:56.861588+0000","last_peered":"2024-09-14T06:01:56.861588+0000","last_clean":"2024-09-14T06:01:56.861588+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T06:01:56.861588+0000","last_undegraded":"2024-09-14T06:01:56.861588+0000","last_fullsized":"2024-09-14T06:01:56.861588+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"153'528","reported_seq":4377,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678700+0000","last_change":"2024-09-14T06:01:36.369952+0000","last_active":"2024-09-14T06:01:56.678700+0000","last_peered":"2024-09-14T06:01:56.678700+0000","last_clean":"2024-09-14T06:01:56.678700+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T06:01:56.678700+0000","last_undegraded":"2024-09-14T06:01:56.678700+0000","last_fullsized":"2024-09-14T06:01:56.678700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:09.812466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002246255,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5158,"num_read_kb":19798,"num_write":493,"num_write_kb":8565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"153'688","reported_seq":3684,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552235+0000","last_change":"2024-09-14T06:01:36.363528+0000","last_active":"2024-09-14T06:01:56.552235+0000","last_peered":"2024-09-14T06:01:56.552235+0000","last_clean":"2024-09-14T06:01:56.552235+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T06:01:56.552235+0000","last_undegraded":"2024-09-14T06:01:56.552235+0000","last_fullsized":"2024-09-14T06:01:56.552235+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:39.780208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022285579999999998,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":33,"num_read":4014,"num_read_kb":39469,"num_write":650,"num_write_kb":15966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":320,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678167+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T06:01:56.678167+0000","last_peered":"2024-09-14T06:01:56.678167+0000","last_clean":"2024-09-14T06:01:56.678167+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T06:01:56.678167+0000","last_undegraded":"2024-09-14T06:01:56.678167+0000","last_fullsized":"2024-09-14T06:01:56.678167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"152'1013","reported_seq":3096,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861679+0000","last_change":"2024-09-14T06:01:36.458728+0000","last_active":"2024-09-14T06:01:56.861679+0000","last_peered":"2024-09-14T06:01:56.861679+0000","last_clean":"2024-09-14T06:01:56.861679+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T06:01:56.861679+0000","last_undegraded":"2024-09-14T06:01:56.861679+0000","last_fullsized":"2024-09-14T06:01:56.861679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:41.340635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095053200000000003,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":40,"num_read":4900,"num_read_kb":20186,"num_write":1454,"num_write_kb":18376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.815822+0000","last_change":"2024-09-14T06:01:45.441200+0000","last_active":"2024-09-14T06:01:56.815822+0000","last_peered":"2024-09-14T06:01:56.815822+0000","last_clean":"2024-09-14T06:01:56.815822+0000","last_became_active":"2024-09-14T06:01:45.440693+0000","last_became_peered":"2024-09-14T06:01:45.440693+0000","last_unstale":"2024-09-14T06:01:56.815822+0000","last_undegraded":"2024-09-14T06:01:56.815822+0000","last_fullsized":"2024-09-14T06:01:56.815822+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:32.396856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"152'508","reported_seq":2906,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554433+0000","last_change":"2024-09-14T06:01:36.362228+0000","last_active":"2024-09-14T06:01:56.554433+0000","last_peered":"2024-09-14T06:01:56.554433+0000","last_clean":"2024-09-14T06:01:56.554433+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T06:01:56.554433+0000","last_undegraded":"2024-09-14T06:01:56.554433+0000","last_fullsized":"2024-09-14T06:01:56.554433+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:18.683159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015877090000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":2965,"num_read_kb":24090,"num_write":468,"num_write_kb":10967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861636+0000","last_change":"2024-09-14T06:01:55.699782+0000","last_active":"2024-09-14T06:01:56.861636+0000","last_peered":"2024-09-14T06:01:56.861636+0000","last_clean":"2024-09-14T06:01:56.861636+0000","last_became_active":"2024-09-14T06:01:55.699203+0000","last_became_peered":"2024-09-14T06:01:55.699203+0000","last_unstale":"2024-09-14T06:01:56.861636+0000","last_undegraded":"2024-09-14T06:01:56.861636+0000","last_fullsized":"2024-09-14T06:01:56.861636+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:58.473556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"152'361","reported_seq":2600,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555006+0000","last_change":"2024-09-14T06:01:36.373997+0000","last_active":"2024-09-14T06:01:56.555006+0000","last_peered":"2024-09-14T06:01:56.555006+0000","last_clean":"2024-09-14T06:01:56.555006+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T06:01:56.555006+0000","last_undegraded":"2024-09-14T06:01:56.555006+0000","last_fullsized":"2024-09-14T06:01:56.555006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:15.490820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002155353,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":1854,"num_read_kb":21999,"num_write":376,"num_write_kb":9648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":319,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678186+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T06:01:56.678186+0000","last_peered":"2024-09-14T06:01:56.678186+0000","last_clean":"2024-09-14T06:01:56.678186+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T06:01:56.678186+0000","last_undegraded":"2024-09-14T06:01:56.678186+0000","last_fullsized":"2024-09-14T06:01:56.678186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":150,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.551873+0000","last_change":"2024-09-14T06:00:48.871361+0000","last_active":"2024-09-14T06:01:56.551873+0000","last_peered":"2024-09-14T06:01:56.551873+0000","last_clean":"2024-09-14T06:01:56.551873+0000","last_became_active":"2024-09-14T06:00:48.845773+0000","last_became_peered":"2024-09-14T06:00:48.845773+0000","last_unstale":"2024-09-14T06:01:56.551873+0000","last_undegraded":"2024-09-14T06:01:56.551873+0000","last_fullsized":"2024-09-14T06:01:56.551873+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:59.588543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"153'737","reported_seq":2435,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554555+0000","last_change":"2024-09-14T06:01:36.372809+0000","last_active":"2024-09-14T06:01:56.554555+0000","last_peered":"2024-09-14T06:01:56.554555+0000","last_clean":"2024-09-14T06:01:56.554555+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T06:01:56.554555+0000","last_undegraded":"2024-09-14T06:01:56.554555+0000","last_fullsized":"2024-09-14T06:01:56.554555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:01.500172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938190000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3347,"num_read_kb":6654,"num_write":929,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"152'385","reported_seq":4935,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552090+0000","last_change":"2024-09-14T06:01:36.361089+0000","last_active":"2024-09-14T06:01:56.552090+0000","last_peered":"2024-09-14T06:01:56.552090+0000","last_clean":"2024-09-14T06:01:56.552090+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T06:01:56.552090+0000","last_undegraded":"2024-09-14T06:01:56.552090+0000","last_fullsized":"2024-09-14T06:01:56.552090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:03.218382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010238700000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":4613,"num_read_kb":34486,"num_write":364,"num_write_kb":27482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"152'680","reported_seq":2729,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861366+0000","last_change":"2024-09-14T06:01:36.375532+0000","last_active":"2024-09-14T06:01:56.861366+0000","last_peered":"2024-09-14T06:01:56.861366+0000","last_clean":"2024-09-14T06:01:56.861366+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T06:01:56.861366+0000","last_undegraded":"2024-09-14T06:01:56.861366+0000","last_fullsized":"2024-09-14T06:01:56.861366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:22.830670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069170899999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":3310,"num_read_kb":12425,"num_write":762,"num_write_kb":6088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"152'901","reported_seq":3870,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555315+0000","last_change":"2024-09-14T06:01:36.374044+0000","last_active":"2024-09-14T06:01:56.555315+0000","last_peered":"2024-09-14T06:01:56.555315+0000","last_clean":"2024-09-14T06:01:56.555315+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T06:01:56.555315+0000","last_undegraded":"2024-09-14T06:01:56.555315+0000","last_fullsized":"2024-09-14T06:01:56.555315+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:38:00.359541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022223719999999998,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":5877,"num_read_kb":27140,"num_write":1302,"num_write_kb":14124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"146'608","reported_seq":5313,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678299+0000","last_change":"2024-09-14T06:01:36.369367+0000","last_active":"2024-09-14T06:01:56.678299+0000","last_peered":"2024-09-14T06:01:56.678299+0000","last_clean":"2024-09-14T06:01:56.678299+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T06:01:56.678299+0000","last_undegraded":"2024-09-14T06:01:56.678299+0000","last_fullsized":"2024-09-14T06:01:56.678299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:15.699674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019468420000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":6117,"num_read_kb":23676,"num_write":517,"num_write_kb":12874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"151'418","reported_seq":3762,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862048+0000","last_change":"2024-09-14T06:01:55.542135+0000","last_active":"2024-09-14T06:01:56.862048+0000","last_peered":"2024-09-14T06:01:56.862048+0000","last_clean":"2024-09-14T06:01:56.862048+0000","last_became_active":"2024-09-14T06:01:55.537648+0000","last_became_peered":"2024-09-14T06:01:55.537648+0000","last_unstale":"2024-09-14T06:01:56.862048+0000","last_undegraded":"2024-09-14T06:01:56.862048+0000","last_fullsized":"2024-09-14T06:01:56.862048+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:37.382850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084296140000000002,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3697,"num_read_kb":21745,"num_write":409,"num_write_kb":13473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":2150148,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"152'627","reported_seq":4969,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862208+0000","last_change":"2024-09-14T06:01:55.538704+0000","last_active":"2024-09-14T06:01:56.862208+0000","last_peered":"2024-09-14T06:01:56.862208+0000","last_clean":"2024-09-14T06:01:56.862208+0000","last_became_active":"2024-09-14T06:01:55.529576+0000","last_became_peered":"2024-09-14T06:01:55.529576+0000","last_unstale":"2024-09-14T06:01:56.862208+0000","last_undegraded":"2024-09-14T06:01:56.862208+0000","last_fullsized":"2024-09-14T06:01:56.862208+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:02.794742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036759169999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5969,"num_read_kb":24775,"num_write":580,"num_write_kb":11404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":302,"num_bytes_recovered":1794796,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"152'634","reported_seq":6685,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862358+0000","last_change":"2024-09-14T06:01:55.540392+0000","last_active":"2024-09-14T06:01:56.862358+0000","last_peered":"2024-09-14T06:01:56.862358+0000","last_clean":"2024-09-14T06:01:56.862358+0000","last_became_active":"2024-09-14T06:01:55.534489+0000","last_became_peered":"2024-09-14T06:01:55.534489+0000","last_unstale":"2024-09-14T06:01:56.862358+0000","last_undegraded":"2024-09-14T06:01:56.862358+0000","last_fullsized":"2024-09-14T06:01:56.862358+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:46.714182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035801489999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":7304,"num_read_kb":14772,"num_write":688,"num_write_kb":6369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":2812424,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"152'955","reported_seq":4468,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861364+0000","last_change":"2024-09-14T06:01:36.375463+0000","last_active":"2024-09-14T06:01:56.861364+0000","last_peered":"2024-09-14T06:01:56.861364+0000","last_clean":"2024-09-14T06:01:56.861364+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T06:01:56.861364+0000","last_undegraded":"2024-09-14T06:01:56.861364+0000","last_fullsized":"2024-09-14T06:01:56.861364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:28.705551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063032799999999999,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":6689,"num_read_kb":19376,"num_write":1207,"num_write_kb":11822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"152'562","reported_seq":6675,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861701+0000","last_change":"2024-09-14T06:01:55.534889+0000","last_active":"2024-09-14T06:01:56.861701+0000","last_peered":"2024-09-14T06:01:56.861701+0000","last_clean":"2024-09-14T06:01:56.861701+0000","last_became_active":"2024-09-14T06:01:55.529694+0000","last_became_peered":"2024-09-14T06:01:55.529694+0000","last_unstale":"2024-09-14T06:01:56.861701+0000","last_undegraded":"2024-09-14T06:01:56.861701+0000","last_fullsized":"2024-09-14T06:01:56.861701+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:32:41.094646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007656754,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":6277,"num_read_kb":34183,"num_write":630,"num_write_kb":31053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":284,"num_bytes_recovered":12777008,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"151'731","reported_seq":6960,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554765+0000","last_change":"2024-09-14T06:01:36.362365+0000","last_active":"2024-09-14T06:01:56.554765+0000","last_peered":"2024-09-14T06:01:56.554765+0000","last_clean":"2024-09-14T06:01:56.554765+0000","last_became_active":"2024-09-14T06:01:21.321381+0000","last_became_peered":"2024-09-14T06:01:21.321381+0000","last_unstale":"2024-09-14T06:01:56.554765+0000","last_undegraded":"2024-09-14T06:01:56.554765+0000","last_fullsized":"2024-09-14T06:01:56.554765+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:07.305705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017037930000000001,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":6816,"num_read_kb":29154,"num_write":729,"num_write_kb":10847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":500,"num_bytes_recovered":4175332,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"152'466","reported_seq":6578,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861786+0000","last_change":"2024-09-14T06:01:55.536790+0000","last_active":"2024-09-14T06:01:56.861786+0000","last_peered":"2024-09-14T06:01:56.861786+0000","last_clean":"2024-09-14T06:01:56.861786+0000","last_became_active":"2024-09-14T06:01:55.529674+0000","last_became_peered":"2024-09-14T06:01:55.529674+0000","last_unstale":"2024-09-14T06:01:56.861786+0000","last_undegraded":"2024-09-14T06:01:56.861786+0000","last_fullsized":"2024-09-14T06:01:56.861786+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:07:14.178795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026632919999999998,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":5545,"num_read_kb":33709,"num_write":451,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":300,"num_bytes_recovered":8189194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":998,"num_object_clones":0,"num_object_copies":1996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":998,"num_whiteouts":994,"num_read":166943,"num_read_kb":827903,"num_write":24723,"num_write_kb":445904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3513,"num_bytes_recovered":62209517,"num_keys_recovered":216,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21304,"ondisk_log_size":21304,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41520,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330320,"statfs":{"total":96636764160,"available":96594247680,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495646,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56360,"kb_used_data":2004,"kb_used_omap":4,"kb_used_meta":54331,"kb_avail":94315480,"statfs":{"total":96636764160,"available":96579051520,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":55635632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51240,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320600,"statfs":{"total":96636764160,"available":96584294400,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41516,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330324,"statfs":{"total":96636764160,"available":96594251776,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55404,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316436,"statfs":{"total":96636764160,"available":96580030464,"internally_reserved":0,"allocated":2056192,"data_stored":982606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47668,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324172,"statfs":{"total":96636764160,"available":96587952128,"internally_reserved":0,"allocated":2650112,"data_stored":1572974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59564,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312276,"statfs":{"total":96636764160,"available":96575770624,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55996,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315844,"statfs":{"total":96636764160,"available":96579424256,"internally_reserved":0,"allocated":2654208,"data_stored":1572993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T06:02:00.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T06:02:00.454 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:02:00.454 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":171,"fsid":"8db933fa-392d-4966-864a-b73b8a91dd2d","created":"2024-09-14T05:58:34.536616+0000","modified":"2024-09-14T06:01:56.545689+0000","last_up_change":"2024-09-14T05:59:39.727882+0000","last_in_change":"2024-09-14T06:01:05.316677+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T05:58:47.505149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T05:58:52.779258+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-14T05:59:04.433909+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":40,"snap_epoch":153,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ef61ed5-359d-4de3-be54-41d3a66c393a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":27,"up_from":46,"up_thru":140,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":643732088},{"type":"v1","addr":"172.21.15.6:6825","nonce":643732088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":643732088},{"type":"v1","addr":"172.21.15.6:6827","nonce":643732088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":643732088},{"type":"v1","addr":"172.21.15.6:6831","nonce":643732088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":643732088},{"type":"v1","addr":"172.21.15.6:6829","nonce":643732088}]},"public_addr":"172.21.15.6:6825/643732088","cluster_addr":"172.21.15.6:6827/643732088","heartbeat_back_addr":"172.21.15.6:6831/643732088","heartbeat_front_addr":"172.21.15.6:6829/643732088","state":["exists","up"]},{"osd":1,"uuid":"f180c483-9b53-4808-b5ec-537bf956087d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6815","nonce":1278360579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6819","nonce":1278360579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6823","nonce":1278360579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1278360579},{"type":"v1","addr":"172.21.15.6:6821","nonce":1278360579}]},"public_addr":"172.21.15.6:6815/1278360579","cluster_addr":"172.21.15.6:6819/1278360579","heartbeat_back_addr":"172.21.15.6:6823/1278360579","heartbeat_front_addr":"172.21.15.6:6821/1278360579","state":["exists","up"]},{"osd":2,"uuid":"bc59bb00-b3b0-4483-a5b1-cc5907cf660a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6809","nonce":4171349592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6811","nonce":4171349592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6817","nonce":4171349592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6813","nonce":4171349592},{"type":"v1","addr":"172.21.15.6:6814","nonce":4171349592}]},"public_addr":"172.21.15.6:6809/4171349592","cluster_addr":"172.21.15.6:6811/4171349592","heartbeat_back_addr":"172.21.15.6:6817/4171349592","heartbeat_front_addr":"172.21.15.6:6814/4171349592","state":["exists","up"]},{"osd":3,"uuid":"7aa9fc3b-29c5-4e9a-a894-e2abfb586263","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6801","nonce":3999210088}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6803","nonce":3999210088}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6807","nonce":3999210088}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3999210088},{"type":"v1","addr":"172.21.15.6:6805","nonce":3999210088}]},"public_addr":"172.21.15.6:6801/3999210088","cluster_addr":"172.21.15.6:6803/3999210088","heartbeat_back_addr":"172.21.15.6:6807/3999210088","heartbeat_front_addr":"172.21.15.6:6805/3999210088","state":["exists","up"]},{"osd":4,"uuid":"a0665f54-f53d-4536-a322-4974c2f23aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6825","nonce":575863621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6827","nonce":575863621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6831","nonce":575863621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":575863621},{"type":"v1","addr":"172.21.15.154:6829","nonce":575863621}]},"public_addr":"172.21.15.154:6825/575863621","cluster_addr":"172.21.15.154:6827/575863621","heartbeat_back_addr":"172.21.15.154:6831/575863621","heartbeat_front_addr":"172.21.15.154:6829/575863621","state":["exists","up"]},{"osd":5,"uuid":"302ab31c-c228-44da-a0d2-58505ad571cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6809","nonce":2498345645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6811","nonce":2498345645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6815","nonce":2498345645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":2498345645},{"type":"v1","addr":"172.21.15.154:6813","nonce":2498345645}]},"public_addr":"172.21.15.154:6809/2498345645","cluster_addr":"172.21.15.154:6811/2498345645","heartbeat_back_addr":"172.21.15.154:6815/2498345645","heartbeat_front_addr":"172.21.15.154:6813/2498345645","state":["exists","up"]},{"osd":6,"uuid":"1adbca34-daef-4229-b25e-40dec6800f85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6817","nonce":267756224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6819","nonce":267756224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6823","nonce":267756224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":267756224},{"type":"v1","addr":"172.21.15.154:6821","nonce":267756224}]},"public_addr":"172.21.15.154:6817/267756224","cluster_addr":"172.21.15.154:6819/267756224","heartbeat_back_addr":"172.21.15.154:6823/267756224","heartbeat_front_addr":"172.21.15.154:6821/267756224","state":["exists","up"]},{"osd":7,"uuid":"a75d9794-68bf-4e8c-bf75-448a7a783769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6801","nonce":4119173763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6803","nonce":4119173763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6807","nonce":4119173763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4119173763},{"type":"v1","addr":"172.21.15.154:6805","nonce":4119173763}]},"public_addr":"172.21.15.154:6801/4119173763","cluster_addr":"172.21.15.154:6803/4119173763","heartbeat_back_addr":"172.21.15.154:6807/4119173763","heartbeat_front_addr":"172.21.15.154:6805/4119173763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.791330+0000","dead_epoch":28},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.526550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.664242+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.327736+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.687393+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.487578+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:58:43.106833+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"1.0","osds":[4,1]}],"pg_upmap_items":[{"pgid":"3.12","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T06:02:01.472 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T06:02:01.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T06:02:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:02:01.643 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T06:02:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:02:01.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T06:02:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T06:02:01.985 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T06:02:01.986 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T06:02:02.140 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:02:02.141 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T06:02:02.141 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:02:02.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T06:02:02.460 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T06:02:02.479 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T06:02:02.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T06:02:02.631 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:02:02.631 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T06:02:02.632 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:02:02.646 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T06:02:02.938 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T06:02:02.956 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T06:02:02.956 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T06:02:03.109 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:02:03.109 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T06:02:03.109 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:02:03.124 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T06:02:03.409 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T06:02:03.427 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T06:02:03.428 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T06:02:03.570 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:02:03.571 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T06:02:03.571 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:02:03.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T06:02:03.882 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T06:02:03.901 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T06:02:03.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T06:02:04.056 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:02:04.056 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T06:02:04.056 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:02:04.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T06:02:04.370 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T06:02:04.388 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T06:02:04.389 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T06:02:04.533 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:02:04.533 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T06:02:04.533 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:02:04.548 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T06:02:04.844 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T06:02:04.864 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T06:02:04.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T06:02:05.025 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-09-14T06:02:05.025 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T06:02:05.025 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-09-14T06:02:05.041 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T06:02:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T06:02:05.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T06:02:05.694 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:02:05.694 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T06:02:05.714 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-09-14T06:02:05.517822+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1002,"num_object_clones":0,"num_object_copies":2004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1002,"num_whiteouts":994,"num_read":167009,"num_read_kb":827958,"num_write":24826,"num_write_kb":447534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3515,"num_bytes_recovered":62799885,"num_keys_recovered":216,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21438,"ondisk_log_size":21438,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":409264,"kb_used_data":17208,"kb_used_omap":15,"kb_used_meta":391856,"kb_avail":754565456,"statfs":{"total":773094113280,"available":772675026944,"internally_reserved":0,"allocated":17620992,"data_stored":9041508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":401261340},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.999180"},"pg_stats":[{"pgid":"3.1f","version":"153'822","reported_seq":3050,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555490+0000","last_change":"2024-09-14T06:01:36.363763+0000","last_active":"2024-09-14T06:01:56.555490+0000","last_peered":"2024-09-14T06:01:56.555490+0000","last_clean":"2024-09-14T06:01:56.555490+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T06:01:56.555490+0000","last_undegraded":"2024-09-14T06:01:56.555490+0000","last_fullsized":"2024-09-14T06:01:56.555490+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:20.876081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019644789999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":4722,"num_read_kb":14974,"num_write":989,"num_write_kb":5443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"153'621","reported_seq":3371,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555733+0000","last_change":"2024-09-14T06:01:36.375502+0000","last_active":"2024-09-14T06:01:56.555733+0000","last_peered":"2024-09-14T06:01:56.555733+0000","last_clean":"2024-09-14T06:01:56.555733+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T06:01:56.555733+0000","last_undegraded":"2024-09-14T06:01:56.555733+0000","last_fullsized":"2024-09-14T06:01:56.555733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:17.635647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029969670000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":3552,"num_read_kb":12323,"num_write":744,"num_write_kb":12372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"152'406","reported_seq":6313,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678437+0000","last_change":"2024-09-14T06:01:36.368174+0000","last_active":"2024-09-14T06:01:56.678437+0000","last_peered":"2024-09-14T06:01:56.678437+0000","last_clean":"2024-09-14T06:01:56.678437+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T06:01:56.678437+0000","last_undegraded":"2024-09-14T06:01:56.678437+0000","last_fullsized":"2024-09-14T06:01:56.678437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:07.173657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084545099999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5603,"num_read_kb":35883,"num_write":395,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"153'594","reported_seq":4983,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678413+0000","last_change":"2024-09-14T06:01:36.368633+0000","last_active":"2024-09-14T06:01:56.678413+0000","last_peered":"2024-09-14T06:01:56.678413+0000","last_clean":"2024-09-14T06:01:56.678413+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T06:01:56.678413+0000","last_undegraded":"2024-09-14T06:01:56.678413+0000","last_fullsized":"2024-09-14T06:01:56.678413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:06.972032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012650980000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":5037,"num_read_kb":20692,"num_write":657,"num_write_kb":8689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"152'603","reported_seq":1906,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554864+0000","last_change":"2024-09-14T06:01:36.361688+0000","last_active":"2024-09-14T06:01:56.554864+0000","last_peered":"2024-09-14T06:01:56.554864+0000","last_clean":"2024-09-14T06:01:56.554864+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T06:01:56.554864+0000","last_undegraded":"2024-09-14T06:01:56.554864+0000","last_fullsized":"2024-09-14T06:01:56.554864+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:07.283206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184701,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":2669,"num_read_kb":6421,"num_write":624,"num_write_kb":6293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"152'990","reported_seq":6236,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552171+0000","last_change":"2024-09-14T06:01:36.362503+0000","last_active":"2024-09-14T06:01:56.552171+0000","last_peered":"2024-09-14T06:01:56.552171+0000","last_clean":"2024-09-14T06:01:56.552171+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T06:01:56.552171+0000","last_undegraded":"2024-09-14T06:01:56.552171+0000","last_fullsized":"2024-09-14T06:01:56.552171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":990,"log_dups_size":0,"ondisk_log_size":990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:22.103314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001987094,"stat_sum":{"num_bytes":19,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":36,"num_read":8467,"num_read_kb":44656,"num_write":1302,"num_write_kb":19849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"151'534","reported_seq":3329,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861755+0000","last_change":"2024-09-14T06:01:36.458706+0000","last_active":"2024-09-14T06:01:56.861755+0000","last_peered":"2024-09-14T06:01:56.861755+0000","last_clean":"2024-09-14T06:01:56.861755+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T06:01:56.861755+0000","last_undegraded":"2024-09-14T06:01:56.861755+0000","last_fullsized":"2024-09-14T06:01:56.861755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:08.212658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096831599999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3556,"num_read_kb":21733,"num_write":601,"num_write_kb":16615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"152'559","reported_seq":6311,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554241+0000","last_change":"2024-09-14T06:01:36.372778+0000","last_active":"2024-09-14T06:01:56.554241+0000","last_peered":"2024-09-14T06:01:56.554241+0000","last_clean":"2024-09-14T06:01:56.554241+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T06:01:56.554241+0000","last_undegraded":"2024-09-14T06:01:56.554241+0000","last_fullsized":"2024-09-14T06:01:56.554241+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":559,"log_dups_size":0,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:44:55.242255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001233916,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7305,"num_read_kb":51490,"num_write":523,"num_write_kb":14203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"152'456","reported_seq":3551,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555316+0000","last_change":"2024-09-14T06:01:36.364273+0000","last_active":"2024-09-14T06:01:56.555316+0000","last_peered":"2024-09-14T06:01:56.555316+0000","last_clean":"2024-09-14T06:01:56.555316+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T06:01:56.555316+0000","last_undegraded":"2024-09-14T06:01:56.555316+0000","last_fullsized":"2024-09-14T06:01:56.555316+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002476359,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":3799,"num_read_kb":21473,"num_write":380,"num_write_kb":6982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"152'1485","reported_seq":4435,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678284+0000","last_change":"2024-09-14T06:01:36.368055+0000","last_active":"2024-09-14T06:01:56.678284+0000","last_peered":"2024-09-14T06:01:56.678284+0000","last_clean":"2024-09-14T06:01:56.678284+0000","last_became_active":"2024-09-14T06:01:12.307740+0000","last_became_peered":"2024-09-14T06:01:12.307740+0000","last_unstale":"2024-09-14T06:01:56.678284+0000","last_undegraded":"2024-09-14T06:01:56.678284+0000","last_fullsized":"2024-09-14T06:01:56.678284+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1485,"log_dups_size":0,"ondisk_log_size":1485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:19.124319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073476100000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":8264,"num_read_kb":22572,"num_write":2472,"num_write_kb":21400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":246,"num_bytes_recovered":5782955,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"149'796","reported_seq":6739,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861730+0000","last_change":"2024-09-14T06:01:55.536577+0000","last_active":"2024-09-14T06:01:56.861730+0000","last_peered":"2024-09-14T06:01:56.861730+0000","last_clean":"2024-09-14T06:01:56.861730+0000","last_became_active":"2024-09-14T06:01:55.530587+0000","last_became_peered":"2024-09-14T06:01:55.530587+0000","last_unstale":"2024-09-14T06:01:56.861730+0000","last_undegraded":"2024-09-14T06:01:56.861730+0000","last_fullsized":"2024-09-14T06:01:56.861730+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:42.496860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040508719999999996,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":7663,"num_read_kb":54856,"num_write":859,"num_write_kb":20153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":314,"num_bytes_recovered":5293699,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"152'646","reported_seq":5880,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552323+0000","last_change":"2024-09-14T06:01:36.361814+0000","last_active":"2024-09-14T06:01:56.552323+0000","last_peered":"2024-09-14T06:01:56.552323+0000","last_clean":"2024-09-14T06:01:56.552323+0000","last_became_active":"2024-09-14T06:01:12.309550+0000","last_became_peered":"2024-09-14T06:01:12.309550+0000","last_unstale":"2024-09-14T06:01:56.552323+0000","last_undegraded":"2024-09-14T06:01:56.552323+0000","last_fullsized":"2024-09-14T06:01:56.552323+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:42:18.135474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017425800000000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5717,"num_read_kb":30636,"num_write":834,"num_write_kb":16055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":1542204,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":331,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861515+0000","last_change":"2024-09-14T06:01:06.338467+0000","last_active":"2024-09-14T06:01:56.861515+0000","last_peered":"2024-09-14T06:01:56.861515+0000","last_clean":"2024-09-14T06:01:56.861515+0000","last_became_active":"2024-09-14T06:01:06.337939+0000","last_became_peered":"2024-09-14T06:01:06.337939+0000","last_unstale":"2024-09-14T06:01:56.861515+0000","last_undegraded":"2024-09-14T06:01:56.861515+0000","last_fullsized":"2024-09-14T06:01:56.861515+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:06.843302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"171'1159","reported_seq":5484,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:03.001106+0000","last_change":"2024-09-14T06:02:03.001106+0000","last_active":"2024-09-14T06:02:03.001106+0000","last_peered":"2024-09-14T06:02:03.001106+0000","last_clean":"2024-09-14T06:02:03.001106+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T06:02:03.001106+0000","last_undegraded":"2024-09-14T06:02:03.001106+0000","last_fullsized":"2024-09-14T06:02:03.001106+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'1159","last_scrub_stamp":"2024-09-14T06:02:03.001011+0000","last_deep_scrub":"171'1159","last_deep_scrub_stamp":"2024-09-14T06:02:03.001011+0000","last_clean_scrub_stamp":"2024-09-14T06:02:03.001011+0000","objects_scrubbed":29,"log_size":1159,"log_dups_size":0,"ondisk_log_size":1159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:33.609135+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0.001486961,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":8368,"num_read_kb":25403,"num_write":1459,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":318,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862037+0000","last_change":"2024-09-14T05:58:56.095887+0000","last_active":"2024-09-14T06:01:56.862037+0000","last_peered":"2024-09-14T06:01:56.862037+0000","last_clean":"2024-09-14T06:01:56.862037+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T06:01:56.862037+0000","last_undegraded":"2024-09-14T06:01:56.862037+0000","last_fullsized":"2024-09-14T06:01:56.862037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:25.727399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"153'440","reported_seq":4857,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555900+0000","last_change":"2024-09-14T06:01:36.374743+0000","last_active":"2024-09-14T06:01:56.555900+0000","last_peered":"2024-09-14T06:01:56.555900+0000","last_clean":"2024-09-14T06:01:56.555900+0000","last_became_active":"2024-09-14T06:01:33.331374+0000","last_became_peered":"2024-09-14T06:01:33.331374+0000","last_unstale":"2024-09-14T06:01:56.555900+0000","last_undegraded":"2024-09-14T06:01:56.555900+0000","last_fullsized":"2024-09-14T06:01:56.555900+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:50.843210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022251139999999998,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3987,"num_read_kb":32301,"num_write":424,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":530,"num_bytes_recovered":12849230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862069+0000","last_change":"2024-09-14T06:01:55.529470+0000","last_active":"2024-09-14T06:01:56.862069+0000","last_peered":"2024-09-14T06:01:56.862069+0000","last_clean":"2024-09-14T06:01:56.862069+0000","last_became_active":"2024-09-14T06:01:55.528696+0000","last_became_peered":"2024-09-14T06:01:55.528696+0000","last_unstale":"2024-09-14T06:01:56.862069+0000","last_undegraded":"2024-09-14T06:01:56.862069+0000","last_fullsized":"2024-09-14T06:01:56.862069+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:01.366086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"151'420","reported_seq":4284,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861879+0000","last_change":"2024-09-14T06:01:36.459282+0000","last_active":"2024-09-14T06:01:56.861879+0000","last_peered":"2024-09-14T06:01:56.861879+0000","last_clean":"2024-09-14T06:01:56.861879+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T06:01:56.861879+0000","last_undegraded":"2024-09-14T06:01:56.861879+0000","last_fullsized":"2024-09-14T06:01:56.861879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:44:57.795683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010338089999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3782,"num_read_kb":24853,"num_write":451,"num_write_kb":9884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":327,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861588+0000","last_change":"2024-09-14T05:59:40.760420+0000","last_active":"2024-09-14T06:01:56.861588+0000","last_peered":"2024-09-14T06:01:56.861588+0000","last_clean":"2024-09-14T06:01:56.861588+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T06:01:56.861588+0000","last_undegraded":"2024-09-14T06:01:56.861588+0000","last_fullsized":"2024-09-14T06:01:56.861588+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:24.490117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"153'528","reported_seq":4377,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678700+0000","last_change":"2024-09-14T06:01:36.369952+0000","last_active":"2024-09-14T06:01:56.678700+0000","last_peered":"2024-09-14T06:01:56.678700+0000","last_clean":"2024-09-14T06:01:56.678700+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T06:01:56.678700+0000","last_undegraded":"2024-09-14T06:01:56.678700+0000","last_fullsized":"2024-09-14T06:01:56.678700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:09.812466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002246255,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5158,"num_read_kb":19798,"num_write":493,"num_write_kb":8565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"153'688","reported_seq":3684,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552235+0000","last_change":"2024-09-14T06:01:36.363528+0000","last_active":"2024-09-14T06:01:56.552235+0000","last_peered":"2024-09-14T06:01:56.552235+0000","last_clean":"2024-09-14T06:01:56.552235+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T06:01:56.552235+0000","last_undegraded":"2024-09-14T06:01:56.552235+0000","last_fullsized":"2024-09-14T06:01:56.552235+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:39.780208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022285579999999998,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":33,"num_read":4014,"num_read_kb":39469,"num_write":650,"num_write_kb":15966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":320,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678167+0000","last_change":"2024-09-14T05:58:56.103815+0000","last_active":"2024-09-14T06:01:56.678167+0000","last_peered":"2024-09-14T06:01:56.678167+0000","last_clean":"2024-09-14T06:01:56.678167+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T06:01:56.678167+0000","last_undegraded":"2024-09-14T06:01:56.678167+0000","last_fullsized":"2024-09-14T06:01:56.678167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:01.350467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"152'1013","reported_seq":3096,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861679+0000","last_change":"2024-09-14T06:01:36.458728+0000","last_active":"2024-09-14T06:01:56.861679+0000","last_peered":"2024-09-14T06:01:56.861679+0000","last_clean":"2024-09-14T06:01:56.861679+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T06:01:56.861679+0000","last_undegraded":"2024-09-14T06:01:56.861679+0000","last_fullsized":"2024-09-14T06:01:56.861679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:41.340635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095053200000000003,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":40,"num_read":4900,"num_read_kb":20186,"num_write":1454,"num_write_kb":18376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.815822+0000","last_change":"2024-09-14T06:01:45.441200+0000","last_active":"2024-09-14T06:01:56.815822+0000","last_peered":"2024-09-14T06:01:56.815822+0000","last_clean":"2024-09-14T06:01:56.815822+0000","last_became_active":"2024-09-14T06:01:45.440693+0000","last_became_peered":"2024-09-14T06:01:45.440693+0000","last_unstale":"2024-09-14T06:01:56.815822+0000","last_undegraded":"2024-09-14T06:01:56.815822+0000","last_fullsized":"2024-09-14T06:01:56.815822+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:32.396856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"171'538","reported_seq":2945,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:02.044911+0000","last_change":"2024-09-14T06:02:02.044911+0000","last_active":"2024-09-14T06:02:02.044911+0000","last_peered":"2024-09-14T06:02:02.044911+0000","last_clean":"2024-09-14T06:02:02.044911+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T06:02:02.044911+0000","last_undegraded":"2024-09-14T06:02:02.044911+0000","last_fullsized":"2024-09-14T06:02:02.044911+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'538","last_scrub_stamp":"2024-09-14T06:02:02.044823+0000","last_deep_scrub":"171'538","last_deep_scrub_stamp":"2024-09-14T06:02:02.044823+0000","last_clean_scrub_stamp":"2024-09-14T06:02:02.044823+0000","objects_scrubbed":30,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:47.243140+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0015877090000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":2965,"num_read_kb":24090,"num_write":468,"num_write_kb":10967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861636+0000","last_change":"2024-09-14T06:01:55.699782+0000","last_active":"2024-09-14T06:01:56.861636+0000","last_peered":"2024-09-14T06:01:56.861636+0000","last_clean":"2024-09-14T06:01:56.861636+0000","last_became_active":"2024-09-14T06:01:55.699203+0000","last_became_peered":"2024-09-14T06:01:55.699203+0000","last_unstale":"2024-09-14T06:01:56.861636+0000","last_undegraded":"2024-09-14T06:01:56.861636+0000","last_fullsized":"2024-09-14T06:01:56.861636+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:58.473556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"152'361","reported_seq":2600,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555006+0000","last_change":"2024-09-14T06:01:36.373997+0000","last_active":"2024-09-14T06:01:56.555006+0000","last_peered":"2024-09-14T06:01:56.555006+0000","last_clean":"2024-09-14T06:01:56.555006+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T06:01:56.555006+0000","last_undegraded":"2024-09-14T06:01:56.555006+0000","last_fullsized":"2024-09-14T06:01:56.555006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:15.490820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002155353,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":1854,"num_read_kb":21999,"num_write":376,"num_write_kb":9648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":319,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678186+0000","last_change":"2024-09-14T05:58:56.102386+0000","last_active":"2024-09-14T06:01:56.678186+0000","last_peered":"2024-09-14T06:01:56.678186+0000","last_clean":"2024-09-14T06:01:56.678186+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T06:01:56.678186+0000","last_undegraded":"2024-09-14T06:01:56.678186+0000","last_fullsized":"2024-09-14T06:01:56.678186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:53.075389+0000","last_clean_scrub_stamp":"2024-09-14T05:58:53.075389+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:49.245091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":150,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.551873+0000","last_change":"2024-09-14T06:00:48.871361+0000","last_active":"2024-09-14T06:01:56.551873+0000","last_peered":"2024-09-14T06:01:56.551873+0000","last_clean":"2024-09-14T06:01:56.551873+0000","last_became_active":"2024-09-14T06:00:48.845773+0000","last_became_peered":"2024-09-14T06:00:48.845773+0000","last_unstale":"2024-09-14T06:01:56.551873+0000","last_undegraded":"2024-09-14T06:01:56.551873+0000","last_fullsized":"2024-09-14T06:01:56.551873+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:58:48.030250+0000","last_clean_scrub_stamp":"2024-09-14T05:58:48.030250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:59.588543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"153'737","reported_seq":2435,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554555+0000","last_change":"2024-09-14T06:01:36.372809+0000","last_active":"2024-09-14T06:01:56.554555+0000","last_peered":"2024-09-14T06:01:56.554555+0000","last_clean":"2024-09-14T06:01:56.554555+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T06:01:56.554555+0000","last_undegraded":"2024-09-14T06:01:56.554555+0000","last_fullsized":"2024-09-14T06:01:56.554555+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":737,"log_dups_size":0,"ondisk_log_size":737,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:01.500172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012938190000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3347,"num_read_kb":6654,"num_write":929,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"152'385","reported_seq":4935,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.552090+0000","last_change":"2024-09-14T06:01:36.361089+0000","last_active":"2024-09-14T06:01:56.552090+0000","last_peered":"2024-09-14T06:01:56.552090+0000","last_clean":"2024-09-14T06:01:56.552090+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T06:01:56.552090+0000","last_undegraded":"2024-09-14T06:01:56.552090+0000","last_fullsized":"2024-09-14T06:01:56.552090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:03.218382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010238700000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":4613,"num_read_kb":34486,"num_write":364,"num_write_kb":27482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"152'680","reported_seq":2729,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861366+0000","last_change":"2024-09-14T06:01:36.375532+0000","last_active":"2024-09-14T06:01:56.861366+0000","last_peered":"2024-09-14T06:01:56.861366+0000","last_clean":"2024-09-14T06:01:56.861366+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T06:01:56.861366+0000","last_undegraded":"2024-09-14T06:01:56.861366+0000","last_fullsized":"2024-09-14T06:01:56.861366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:22.830670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069170899999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":3310,"num_read_kb":12425,"num_write":762,"num_write_kb":6088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"152'901","reported_seq":3870,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.555315+0000","last_change":"2024-09-14T06:01:36.374044+0000","last_active":"2024-09-14T06:01:56.555315+0000","last_peered":"2024-09-14T06:01:56.555315+0000","last_clean":"2024-09-14T06:01:56.555315+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T06:01:56.555315+0000","last_undegraded":"2024-09-14T06:01:56.555315+0000","last_fullsized":"2024-09-14T06:01:56.555315+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:38:00.359541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022223719999999998,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":5877,"num_read_kb":27140,"num_write":1302,"num_write_kb":14124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"146'608","reported_seq":5313,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.678299+0000","last_change":"2024-09-14T06:01:36.369367+0000","last_active":"2024-09-14T06:01:56.678299+0000","last_peered":"2024-09-14T06:01:56.678299+0000","last_clean":"2024-09-14T06:01:56.678299+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T06:01:56.678299+0000","last_undegraded":"2024-09-14T06:01:56.678299+0000","last_fullsized":"2024-09-14T06:01:56.678299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:15.699674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019468420000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":6117,"num_read_kb":23676,"num_write":517,"num_write_kb":12874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"151'418","reported_seq":3762,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862048+0000","last_change":"2024-09-14T06:01:55.542135+0000","last_active":"2024-09-14T06:01:56.862048+0000","last_peered":"2024-09-14T06:01:56.862048+0000","last_clean":"2024-09-14T06:01:56.862048+0000","last_became_active":"2024-09-14T06:01:55.537648+0000","last_became_peered":"2024-09-14T06:01:55.537648+0000","last_unstale":"2024-09-14T06:01:56.862048+0000","last_undegraded":"2024-09-14T06:01:56.862048+0000","last_fullsized":"2024-09-14T06:01:56.862048+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:37.382850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084296140000000002,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3697,"num_read_kb":21745,"num_write":409,"num_write_kb":13473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":2150148,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"152'627","reported_seq":4969,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862208+0000","last_change":"2024-09-14T06:01:55.538704+0000","last_active":"2024-09-14T06:01:56.862208+0000","last_peered":"2024-09-14T06:01:56.862208+0000","last_clean":"2024-09-14T06:01:56.862208+0000","last_became_active":"2024-09-14T06:01:55.529576+0000","last_became_peered":"2024-09-14T06:01:55.529576+0000","last_unstale":"2024-09-14T06:01:56.862208+0000","last_undegraded":"2024-09-14T06:01:56.862208+0000","last_fullsized":"2024-09-14T06:01:56.862208+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:02.794742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036759169999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5969,"num_read_kb":24775,"num_write":580,"num_write_kb":11404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":302,"num_bytes_recovered":1794796,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"152'634","reported_seq":6685,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.862358+0000","last_change":"2024-09-14T06:01:55.540392+0000","last_active":"2024-09-14T06:01:56.862358+0000","last_peered":"2024-09-14T06:01:56.862358+0000","last_clean":"2024-09-14T06:01:56.862358+0000","last_became_active":"2024-09-14T06:01:55.534489+0000","last_became_peered":"2024-09-14T06:01:55.534489+0000","last_unstale":"2024-09-14T06:01:56.862358+0000","last_undegraded":"2024-09-14T06:01:56.862358+0000","last_fullsized":"2024-09-14T06:01:56.862358+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:46.714182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035801489999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":7304,"num_read_kb":14772,"num_write":688,"num_write_kb":6369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":2812424,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"152'955","reported_seq":4468,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861364+0000","last_change":"2024-09-14T06:01:36.375463+0000","last_active":"2024-09-14T06:01:56.861364+0000","last_peered":"2024-09-14T06:01:56.861364+0000","last_clean":"2024-09-14T06:01:56.861364+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T06:01:56.861364+0000","last_undegraded":"2024-09-14T06:01:56.861364+0000","last_fullsized":"2024-09-14T06:01:56.861364+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":955,"log_dups_size":0,"ondisk_log_size":955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:28.705551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063032799999999999,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":6689,"num_read_kb":19376,"num_write":1207,"num_write_kb":11822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"152'562","reported_seq":6675,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861701+0000","last_change":"2024-09-14T06:01:55.534889+0000","last_active":"2024-09-14T06:01:56.861701+0000","last_peered":"2024-09-14T06:01:56.861701+0000","last_clean":"2024-09-14T06:01:56.861701+0000","last_became_active":"2024-09-14T06:01:55.529694+0000","last_became_peered":"2024-09-14T06:01:55.529694+0000","last_unstale":"2024-09-14T06:01:56.861701+0000","last_undegraded":"2024-09-14T06:01:56.861701+0000","last_fullsized":"2024-09-14T06:01:56.861701+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:32:41.094646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007656754,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":6277,"num_read_kb":34183,"num_write":630,"num_write_kb":31053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":284,"num_bytes_recovered":12777008,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"151'731","reported_seq":6960,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.554765+0000","last_change":"2024-09-14T06:01:36.362365+0000","last_active":"2024-09-14T06:01:56.554765+0000","last_peered":"2024-09-14T06:01:56.554765+0000","last_clean":"2024-09-14T06:01:56.554765+0000","last_became_active":"2024-09-14T06:01:21.321381+0000","last_became_peered":"2024-09-14T06:01:21.321381+0000","last_unstale":"2024-09-14T06:01:56.554765+0000","last_undegraded":"2024-09-14T06:01:56.554765+0000","last_fullsized":"2024-09-14T06:01:56.554765+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:07.305705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017037930000000001,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":6816,"num_read_kb":29154,"num_write":729,"num_write_kb":10847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":500,"num_bytes_recovered":4175332,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"152'466","reported_seq":6578,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:01:56.861786+0000","last_change":"2024-09-14T06:01:55.536790+0000","last_active":"2024-09-14T06:01:56.861786+0000","last_peered":"2024-09-14T06:01:56.861786+0000","last_clean":"2024-09-14T06:01:56.861786+0000","last_became_active":"2024-09-14T06:01:55.529674+0000","last_became_peered":"2024-09-14T06:01:55.529674+0000","last_unstale":"2024-09-14T06:01:56.861786+0000","last_undegraded":"2024-09-14T06:01:56.861786+0000","last_fullsized":"2024-09-14T06:01:56.861786+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:59:05.265823+0000","last_clean_scrub_stamp":"2024-09-14T05:59:05.265823+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:07:14.178795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026632919999999998,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":5545,"num_read_kb":33709,"num_write":451,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":300,"num_bytes_recovered":8189194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":998,"num_object_clones":0,"num_object_copies":1996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":998,"num_whiteouts":994,"num_read":166943,"num_read_kb":827903,"num_write":24723,"num_write_kb":445904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3513,"num_bytes_recovered":62209517,"num_keys_recovered":216,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21363,"ondisk_log_size":21363,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509483,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41520,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330320,"statfs":{"total":96636764160,"available":96594247680,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495647,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56356,"kb_used_data":2004,"kb_used_omap":4,"kb_used_meta":54331,"kb_avail":94315484,"statfs":{"total":96636764160,"available":96579055616,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":55635632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51240,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320600,"statfs":{"total":96636764160,"available":96584294400,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542189,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41516,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330324,"statfs":{"total":96636764160,"available":96594251776,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542187,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55404,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316436,"statfs":{"total":96636764160,"available":96580030464,"internally_reserved":0,"allocated":2056192,"data_stored":982606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47668,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324172,"statfs":{"total":96636764160,"available":96587952128,"internally_reserved":0,"allocated":2650112,"data_stored":1572974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59564,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312276,"statfs":{"total":96636764160,"available":96575770624,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55996,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315844,"statfs":{"total":96636764160,"available":96579424256,"internally_reserved":0,"allocated":2654208,"data_stored":1572993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T06:02:05.719 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.719 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.719 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.719 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.719 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.719 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.720 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.720 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.720 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.720 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.720 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.720 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.720 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T05:58:53.075389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.720 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T05:58:53.075389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.721 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.721 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T05:58:53.075389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.721 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.721 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T05:58:53.075389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.721 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.721 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.721 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T05:58:53.075389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.721 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.721 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T05:58:53.075389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.722 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T05:58:53.075389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.722 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.722 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T05:58:53.075389+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=53, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.722 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T05:58:48.030250+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.722 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.722 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.722 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.722 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.723 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.723 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.723 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.723 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.723 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.723 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.723 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.723 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T05:59:05.265823+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=59, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=6, tm_min=2, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T06:02:05.723 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T06:02:25.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T06:02:26.048 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-09-14T06:02:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-09-14T06:02:26.067 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2024-09-14T06:02:25.523865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":1002,"num_object_clones":0,"num_object_copies":2004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1002,"num_whiteouts":994,"num_read":167009,"num_read_kb":827958,"num_write":24826,"num_write_kb":447534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3515,"num_bytes_recovered":62799885,"num_keys_recovered":216,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22380,"ondisk_log_size":22380,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":413368,"kb_used_data":17208,"kb_used_omap":15,"kb_used_meta":396016,"kb_avail":754561352,"statfs":{"total":773094113280,"available":772670824448,"internally_reserved":0,"allocated":17620992,"data_stored":9041508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15588,"internal_metadata":405521180},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003759"},"pg_stats":[{"pgid":"3.1f","version":"171'857","reported_seq":3094,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:06.140673+0000","last_change":"2024-09-14T06:02:06.140673+0000","last_active":"2024-09-14T06:02:06.140673+0000","last_peered":"2024-09-14T06:02:06.140673+0000","last_clean":"2024-09-14T06:02:06.140673+0000","last_became_active":"2024-09-14T05:59:43.762472+0000","last_became_peered":"2024-09-14T05:59:43.762472+0000","last_unstale":"2024-09-14T06:02:06.140673+0000","last_undegraded":"2024-09-14T06:02:06.140673+0000","last_fullsized":"2024-09-14T06:02:06.140673+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'857","last_scrub_stamp":"2024-09-14T06:02:06.140476+0000","last_deep_scrub":"171'857","last_deep_scrub_stamp":"2024-09-14T06:02:06.140476+0000","last_clean_scrub_stamp":"2024-09-14T06:02:06.140476+0000","objects_scrubbed":35,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:10.545612+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0.0019644789999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":4722,"num_read_kb":14974,"num_write":989,"num_write_kb":5443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":1526782,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"171'643","reported_seq":3401,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:09.294956+0000","last_change":"2024-09-14T06:02:09.294956+0000","last_active":"2024-09-14T06:02:09.294956+0000","last_peered":"2024-09-14T06:02:09.294956+0000","last_clean":"2024-09-14T06:02:09.294956+0000","last_became_active":"2024-09-14T05:59:06.293871+0000","last_became_peered":"2024-09-14T05:59:06.293871+0000","last_unstale":"2024-09-14T06:02:09.294956+0000","last_undegraded":"2024-09-14T06:02:09.294956+0000","last_fullsized":"2024-09-14T06:02:09.294956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'643","last_scrub_stamp":"2024-09-14T06:02:09.294730+0000","last_deep_scrub":"171'643","last_deep_scrub_stamp":"2024-09-14T06:02:09.294730+0000","last_clean_scrub_stamp":"2024-09-14T06:02:09.294730+0000","objects_scrubbed":22,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:40.737534+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0029969670000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":3552,"num_read_kb":12323,"num_write":744,"num_write_kb":12372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"171'443","reported_seq":6359,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:10.517109+0000","last_change":"2024-09-14T06:02:10.517109+0000","last_active":"2024-09-14T06:02:10.517109+0000","last_peered":"2024-09-14T06:02:10.517109+0000","last_clean":"2024-09-14T06:02:10.517109+0000","last_became_active":"2024-09-14T05:59:06.311506+0000","last_became_peered":"2024-09-14T05:59:06.311506+0000","last_unstale":"2024-09-14T06:02:10.517109+0000","last_undegraded":"2024-09-14T06:02:10.517109+0000","last_fullsized":"2024-09-14T06:02:10.517109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'443","last_scrub_stamp":"2024-09-14T06:02:10.516959+0000","last_deep_scrub":"171'443","last_deep_scrub_stamp":"2024-09-14T06:02:10.516959+0000","last_clean_scrub_stamp":"2024-09-14T06:02:10.516959+0000","objects_scrubbed":37,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:18.048114+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.00084545099999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":5603,"num_read_kb":35883,"num_write":395,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"171'625","reported_seq":5023,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:09.487760+0000","last_change":"2024-09-14T06:02:09.487760+0000","last_active":"2024-09-14T06:02:09.487760+0000","last_peered":"2024-09-14T06:02:09.487760+0000","last_clean":"2024-09-14T06:02:09.487760+0000","last_became_active":"2024-09-14T05:59:06.314294+0000","last_became_peered":"2024-09-14T05:59:06.314294+0000","last_unstale":"2024-09-14T06:02:09.487760+0000","last_undegraded":"2024-09-14T06:02:09.487760+0000","last_fullsized":"2024-09-14T06:02:09.487760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'625","last_scrub_stamp":"2024-09-14T06:02:09.487514+0000","last_deep_scrub":"171'625","last_deep_scrub_stamp":"2024-09-14T06:02:09.487514+0000","last_clean_scrub_stamp":"2024-09-14T06:02:09.487514+0000","objects_scrubbed":31,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:54.633384+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.0012650980000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":30,"num_read":5037,"num_read_kb":20692,"num_write":657,"num_write_kb":8689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"171'627","reported_seq":1939,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:07.126911+0000","last_change":"2024-09-14T06:02:07.126776+0000","last_active":"2024-09-14T06:02:07.126911+0000","last_peered":"2024-09-14T06:02:07.126911+0000","last_clean":"2024-09-14T06:02:07.126911+0000","last_became_active":"2024-09-14T05:59:40.758879+0000","last_became_peered":"2024-09-14T05:59:40.758879+0000","last_unstale":"2024-09-14T06:02:07.126911+0000","last_undegraded":"2024-09-14T06:02:07.126911+0000","last_fullsized":"2024-09-14T06:02:07.126911+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'627","last_scrub_stamp":"2024-09-14T06:02:07.126547+0000","last_deep_scrub":"171'627","last_deep_scrub_stamp":"2024-09-14T06:02:07.126547+0000","last_clean_scrub_stamp":"2024-09-14T06:02:07.126547+0000","objects_scrubbed":24,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:19.230690+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.001184701,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":2669,"num_read_kb":6421,"num_write":624,"num_write_kb":6293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":683415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"171'1027","reported_seq":6282,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:08.497709+0000","last_change":"2024-09-14T06:02:08.497709+0000","last_active":"2024-09-14T06:02:08.497709+0000","last_peered":"2024-09-14T06:02:08.497709+0000","last_clean":"2024-09-14T06:02:08.497709+0000","last_became_active":"2024-09-14T05:59:06.305259+0000","last_became_peered":"2024-09-14T05:59:06.305259+0000","last_unstale":"2024-09-14T06:02:08.497709+0000","last_undegraded":"2024-09-14T06:02:08.497709+0000","last_fullsized":"2024-09-14T06:02:08.497709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'1027","last_scrub_stamp":"2024-09-14T06:02:08.497475+0000","last_deep_scrub":"171'1027","last_deep_scrub_stamp":"2024-09-14T06:02:08.497475+0000","last_clean_scrub_stamp":"2024-09-14T06:02:08.497475+0000","objects_scrubbed":37,"log_size":1027,"log_dups_size":0,"ondisk_log_size":1027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:09:42.658497+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0.001987094,"stat_sum":{"num_bytes":19,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":36,"num_read":8467,"num_read_kb":44656,"num_write":1302,"num_write_kb":19849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"171'566","reported_seq":3370,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:07.048899+0000","last_change":"2024-09-14T06:02:07.048899+0000","last_active":"2024-09-14T06:02:07.048899+0000","last_peered":"2024-09-14T06:02:07.048899+0000","last_clean":"2024-09-14T06:02:07.048899+0000","last_became_active":"2024-09-14T05:59:06.293024+0000","last_became_peered":"2024-09-14T05:59:06.293024+0000","last_unstale":"2024-09-14T06:02:07.048899+0000","last_undegraded":"2024-09-14T06:02:07.048899+0000","last_fullsized":"2024-09-14T06:02:07.048899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'566","last_scrub_stamp":"2024-09-14T06:02:07.048642+0000","last_deep_scrub":"171'566","last_deep_scrub_stamp":"2024-09-14T06:02:07.048642+0000","last_clean_scrub_stamp":"2024-09-14T06:02:07.048642+0000","objects_scrubbed":32,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:51.760611+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.00096831599999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3556,"num_read_kb":21733,"num_write":601,"num_write_kb":16615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"171'592","reported_seq":6353,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:08.304286+0000","last_change":"2024-09-14T06:02:08.304286+0000","last_active":"2024-09-14T06:02:08.304286+0000","last_peered":"2024-09-14T06:02:08.304286+0000","last_clean":"2024-09-14T06:02:08.304286+0000","last_became_active":"2024-09-14T05:59:43.760811+0000","last_became_peered":"2024-09-14T05:59:43.760811+0000","last_unstale":"2024-09-14T06:02:08.304286+0000","last_undegraded":"2024-09-14T06:02:08.304286+0000","last_fullsized":"2024-09-14T06:02:08.304286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'592","last_scrub_stamp":"2024-09-14T06:02:08.304092+0000","last_deep_scrub":"171'592","last_deep_scrub_stamp":"2024-09-14T06:02:08.304092+0000","last_clean_scrub_stamp":"2024-09-14T06:02:08.304092+0000","objects_scrubbed":33,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:30:01.549067+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.001233916,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":7305,"num_read_kb":51490,"num_write":523,"num_write_kb":14203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":673113,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"171'483","reported_seq":3587,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:04.042998+0000","last_change":"2024-09-14T06:02:04.042998+0000","last_active":"2024-09-14T06:02:04.042998+0000","last_peered":"2024-09-14T06:02:04.042998+0000","last_clean":"2024-09-14T06:02:04.042998+0000","last_became_active":"2024-09-14T05:59:40.762347+0000","last_became_peered":"2024-09-14T05:59:40.762347+0000","last_unstale":"2024-09-14T06:02:04.042998+0000","last_undegraded":"2024-09-14T06:02:04.042998+0000","last_fullsized":"2024-09-14T06:02:04.042998+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'483","last_scrub_stamp":"2024-09-14T06:02:04.042906+0000","last_deep_scrub":"171'483","last_deep_scrub_stamp":"2024-09-14T06:02:04.042906+0000","last_clean_scrub_stamp":"2024-09-14T06:02:04.042906+0000","objects_scrubbed":27,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:15:27.277665+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0.002476359,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":3799,"num_read_kb":21473,"num_write":380,"num_write_kb":6982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":296341,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"171'1512","reported_seq":4471,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:08.530969+0000","last_change":"2024-09-14T06:02:08.530969+0000","last_active":"2024-09-14T06:02:08.530969+0000","last_peered":"2024-09-14T06:02:08.530969+0000","last_clean":"2024-09-14T06:02:08.530969+0000","last_became_active":"2024-09-14T06:01:12.307740+0000","last_became_peered":"2024-09-14T06:01:12.307740+0000","last_unstale":"2024-09-14T06:02:08.530969+0000","last_undegraded":"2024-09-14T06:02:08.530969+0000","last_fullsized":"2024-09-14T06:02:08.530969+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'1512","last_scrub_stamp":"2024-09-14T06:02:08.530745+0000","last_deep_scrub":"171'1512","last_deep_scrub_stamp":"2024-09-14T06:02:08.530745+0000","last_clean_scrub_stamp":"2024-09-14T06:02:08.530745+0000","objects_scrubbed":27,"log_size":1512,"log_dups_size":0,"ondisk_log_size":1512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:17.185699+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.00073476100000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":8264,"num_read_kb":22572,"num_write":2472,"num_write_kb":21400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":246,"num_bytes_recovered":5782955,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"171'830","reported_seq":6782,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:11.483670+0000","last_change":"2024-09-14T06:02:11.483670+0000","last_active":"2024-09-14T06:02:11.483670+0000","last_peered":"2024-09-14T06:02:11.483670+0000","last_clean":"2024-09-14T06:02:11.483670+0000","last_became_active":"2024-09-14T06:01:55.530587+0000","last_became_peered":"2024-09-14T06:01:55.530587+0000","last_unstale":"2024-09-14T06:02:11.483670+0000","last_undegraded":"2024-09-14T06:02:11.483670+0000","last_fullsized":"2024-09-14T06:02:11.483670+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'830","last_scrub_stamp":"2024-09-14T06:02:11.483459+0000","last_deep_scrub":"171'830","last_deep_scrub_stamp":"2024-09-14T06:02:11.483459+0000","last_clean_scrub_stamp":"2024-09-14T06:02:11.483459+0000","objects_scrubbed":34,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:18.552778+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.0040508719999999996,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":7663,"num_read_kb":54856,"num_write":859,"num_write_kb":20153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":314,"num_bytes_recovered":5293699,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"171'672","reported_seq":5915,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:07.460759+0000","last_change":"2024-09-14T06:02:07.460759+0000","last_active":"2024-09-14T06:02:07.460759+0000","last_peered":"2024-09-14T06:02:07.460759+0000","last_clean":"2024-09-14T06:02:07.460759+0000","last_became_active":"2024-09-14T06:01:12.309550+0000","last_became_peered":"2024-09-14T06:01:12.309550+0000","last_unstale":"2024-09-14T06:02:07.460759+0000","last_undegraded":"2024-09-14T06:02:07.460759+0000","last_fullsized":"2024-09-14T06:02:07.460759+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'672","last_scrub_stamp":"2024-09-14T06:02:07.460575+0000","last_deep_scrub":"171'672","last_deep_scrub_stamp":"2024-09-14T06:02:07.460575+0000","last_clean_scrub_stamp":"2024-09-14T06:02:07.460575+0000","objects_scrubbed":26,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:20.335534+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0017425800000000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5717,"num_read_kb":30636,"num_write":834,"num_write_kb":16055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":1542204,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":339,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:06.203763+0000","last_change":"2024-09-14T06:02:06.203763+0000","last_active":"2024-09-14T06:02:06.203763+0000","last_peered":"2024-09-14T06:02:06.203763+0000","last_clean":"2024-09-14T06:02:06.203763+0000","last_became_active":"2024-09-14T06:01:06.337939+0000","last_became_peered":"2024-09-14T06:01:06.337939+0000","last_unstale":"2024-09-14T06:02:06.203763+0000","last_undegraded":"2024-09-14T06:02:06.203763+0000","last_fullsized":"2024-09-14T06:02:06.203763+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T06:02:06.203581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T06:02:06.203581+0000","last_clean_scrub_stamp":"2024-09-14T06:02:06.203581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:00:56.843118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010498389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"171'1159","reported_seq":5484,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:03.001106+0000","last_change":"2024-09-14T06:02:03.001106+0000","last_active":"2024-09-14T06:02:03.001106+0000","last_peered":"2024-09-14T06:02:03.001106+0000","last_clean":"2024-09-14T06:02:03.001106+0000","last_became_active":"2024-09-14T05:59:43.762126+0000","last_became_peered":"2024-09-14T05:59:43.762126+0000","last_unstale":"2024-09-14T06:02:03.001106+0000","last_undegraded":"2024-09-14T06:02:03.001106+0000","last_fullsized":"2024-09-14T06:02:03.001106+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'1159","last_scrub_stamp":"2024-09-14T06:02:03.001011+0000","last_deep_scrub":"171'1159","last_deep_scrub_stamp":"2024-09-14T06:02:03.001011+0000","last_clean_scrub_stamp":"2024-09-14T06:02:03.001011+0000","objects_scrubbed":29,"log_size":1159,"log_dups_size":0,"ondisk_log_size":1159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:33.609135+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0.001486961,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":8368,"num_read_kb":25403,"num_write":1459,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":338222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":326,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:03.947982+0000","last_change":"2024-09-14T06:02:03.947982+0000","last_active":"2024-09-14T06:02:03.947982+0000","last_peered":"2024-09-14T06:02:03.947982+0000","last_clean":"2024-09-14T06:02:03.947982+0000","last_became_active":"2024-09-14T05:58:54.097151+0000","last_became_peered":"2024-09-14T05:58:54.097151+0000","last_unstale":"2024-09-14T06:02:03.947982+0000","last_undegraded":"2024-09-14T06:02:03.947982+0000","last_fullsized":"2024-09-14T06:02:03.947982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T06:02:03.947910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T06:02:03.947910+0000","last_clean_scrub_stamp":"2024-09-14T06:02:03.947910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:40.499411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013693729999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"171'469","reported_seq":4895,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:04.365310+0000","last_change":"2024-09-14T06:02:04.365310+0000","last_active":"2024-09-14T06:02:04.365310+0000","last_peered":"2024-09-14T06:02:04.365310+0000","last_clean":"2024-09-14T06:02:04.365310+0000","last_became_active":"2024-09-14T06:01:33.331374+0000","last_became_peered":"2024-09-14T06:01:33.331374+0000","last_unstale":"2024-09-14T06:02:04.365310+0000","last_undegraded":"2024-09-14T06:02:04.365310+0000","last_fullsized":"2024-09-14T06:02:04.365310+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'469","last_scrub_stamp":"2024-09-14T06:02:04.365207+0000","last_deep_scrub":"171'469","last_deep_scrub_stamp":"2024-09-14T06:02:04.365207+0000","last_clean_scrub_stamp":"2024-09-14T06:02:04.365207+0000","objects_scrubbed":29,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:11.432063+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0022251139999999998,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":3987,"num_read_kb":32301,"num_write":424,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":530,"num_bytes_recovered":12849230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":112,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:08.441916+0000","last_change":"2024-09-14T06:02:08.441916+0000","last_active":"2024-09-14T06:02:08.441916+0000","last_peered":"2024-09-14T06:02:08.441916+0000","last_clean":"2024-09-14T06:02:08.441916+0000","last_became_active":"2024-09-14T06:01:55.528696+0000","last_became_peered":"2024-09-14T06:01:55.528696+0000","last_unstale":"2024-09-14T06:02:08.441916+0000","last_undegraded":"2024-09-14T06:02:08.441916+0000","last_fullsized":"2024-09-14T06:02:08.441916+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T06:02:08.441753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T06:02:08.441753+0000","last_clean_scrub_stamp":"2024-09-14T06:02:08.441753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:42.356976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010651079999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"171'453","reported_seq":4326,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:06.028786+0000","last_change":"2024-09-14T06:02:06.028786+0000","last_active":"2024-09-14T06:02:06.028786+0000","last_peered":"2024-09-14T06:02:06.028786+0000","last_clean":"2024-09-14T06:02:06.028786+0000","last_became_active":"2024-09-14T05:59:06.282674+0000","last_became_peered":"2024-09-14T05:59:06.282674+0000","last_unstale":"2024-09-14T06:02:06.028786+0000","last_undegraded":"2024-09-14T06:02:06.028786+0000","last_fullsized":"2024-09-14T06:02:06.028786+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'453","last_scrub_stamp":"2024-09-14T06:02:06.028562+0000","last_deep_scrub":"171'453","last_deep_scrub_stamp":"2024-09-14T06:02:06.028562+0000","last_clean_scrub_stamp":"2024-09-14T06:02:06.028562+0000","objects_scrubbed":33,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:51.510737+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.0010338089999999999,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3782,"num_read_kb":24853,"num_write":451,"num_write_kb":9884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":335,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:02.921631+0000","last_change":"2024-09-14T06:02:02.921631+0000","last_active":"2024-09-14T06:02:02.921631+0000","last_peered":"2024-09-14T06:02:02.921631+0000","last_clean":"2024-09-14T06:02:02.921631+0000","last_became_active":"2024-09-14T05:59:40.759795+0000","last_became_peered":"2024-09-14T05:59:40.759795+0000","last_unstale":"2024-09-14T06:02:02.921631+0000","last_undegraded":"2024-09-14T06:02:02.921631+0000","last_fullsized":"2024-09-14T06:02:02.921631+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T06:02:02.921425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T06:02:02.921425+0000","last_clean_scrub_stamp":"2024-09-14T06:02:02.921425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:53:18.471459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013062589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"171'554","reported_seq":4412,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:06.534483+0000","last_change":"2024-09-14T06:02:06.534483+0000","last_active":"2024-09-14T06:02:06.534483+0000","last_peered":"2024-09-14T06:02:06.534483+0000","last_clean":"2024-09-14T06:02:06.534483+0000","last_became_active":"2024-09-14T05:59:06.297818+0000","last_became_peered":"2024-09-14T05:59:06.297818+0000","last_unstale":"2024-09-14T06:02:06.534483+0000","last_undegraded":"2024-09-14T06:02:06.534483+0000","last_fullsized":"2024-09-14T06:02:06.534483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'554","last_scrub_stamp":"2024-09-14T06:02:06.534343+0000","last_deep_scrub":"171'554","last_deep_scrub_stamp":"2024-09-14T06:02:06.534343+0000","last_clean_scrub_stamp":"2024-09-14T06:02:06.534343+0000","objects_scrubbed":26,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:02.211761+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.002246255,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5158,"num_read_kb":19798,"num_write":493,"num_write_kb":8565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"171'721","reported_seq":3726,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:05.519810+0000","last_change":"2024-09-14T06:02:05.519810+0000","last_active":"2024-09-14T06:02:05.519810+0000","last_peered":"2024-09-14T06:02:05.519810+0000","last_clean":"2024-09-14T06:02:05.519810+0000","last_became_active":"2024-09-14T05:59:40.764939+0000","last_became_peered":"2024-09-14T05:59:40.764939+0000","last_unstale":"2024-09-14T06:02:05.519810+0000","last_undegraded":"2024-09-14T06:02:05.519810+0000","last_fullsized":"2024-09-14T06:02:05.519810+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'721","last_scrub_stamp":"2024-09-14T06:02:05.519590+0000","last_deep_scrub":"171'721","last_deep_scrub_stamp":"2024-09-14T06:02:05.519590+0000","last_clean_scrub_stamp":"2024-09-14T06:02:05.519590+0000","objects_scrubbed":34,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:08:56.299524+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.0022285579999999998,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":33,"num_read":4014,"num_read_kb":39469,"num_write":650,"num_write_kb":15966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":606682,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"171'3","reported_seq":329,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:04.435746+0000","last_change":"2024-09-14T06:02:04.435746+0000","last_active":"2024-09-14T06:02:04.435746+0000","last_peered":"2024-09-14T06:02:04.435746+0000","last_clean":"2024-09-14T06:02:04.435746+0000","last_became_active":"2024-09-14T05:58:54.098717+0000","last_became_peered":"2024-09-14T05:58:54.098717+0000","last_unstale":"2024-09-14T06:02:04.435746+0000","last_undegraded":"2024-09-14T06:02:04.435746+0000","last_fullsized":"2024-09-14T06:02:04.435746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'3","last_scrub_stamp":"2024-09-14T06:02:04.435567+0000","last_deep_scrub":"171'3","last_deep_scrub_stamp":"2024-09-14T06:02:04.435567+0000","last_clean_scrub_stamp":"2024-09-14T06:02:04.435567+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:06:43.373002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0029466499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"171'1053","reported_seq":3145,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:04.972554+0000","last_change":"2024-09-14T06:02:04.972554+0000","last_active":"2024-09-14T06:02:04.972554+0000","last_peered":"2024-09-14T06:02:04.972554+0000","last_clean":"2024-09-14T06:02:04.972554+0000","last_became_active":"2024-09-14T05:59:06.280750+0000","last_became_peered":"2024-09-14T05:59:06.280750+0000","last_unstale":"2024-09-14T06:02:04.972554+0000","last_undegraded":"2024-09-14T06:02:04.972554+0000","last_fullsized":"2024-09-14T06:02:04.972554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'1053","last_scrub_stamp":"2024-09-14T06:02:04.972334+0000","last_deep_scrub":"171'1053","last_deep_scrub_stamp":"2024-09-14T06:02:04.972334+0000","last_clean_scrub_stamp":"2024-09-14T06:02:04.972334+0000","objects_scrubbed":40,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:18.106435+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.00095053200000000003,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":40,"num_read":4900,"num_read_kb":20186,"num_write":1454,"num_write_kb":18376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":178,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:03.035557+0000","last_change":"2024-09-14T06:02:03.035557+0000","last_active":"2024-09-14T06:02:03.035557+0000","last_peered":"2024-09-14T06:02:03.035557+0000","last_clean":"2024-09-14T06:02:03.035557+0000","last_became_active":"2024-09-14T06:01:45.440693+0000","last_became_peered":"2024-09-14T06:01:45.440693+0000","last_unstale":"2024-09-14T06:02:03.035557+0000","last_undegraded":"2024-09-14T06:02:03.035557+0000","last_fullsized":"2024-09-14T06:02:03.035557+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T06:02:03.035463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T06:02:03.035463+0000","last_clean_scrub_stamp":"2024-09-14T06:02:03.035463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:34:44.212624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"171'538","reported_seq":2945,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:02.044911+0000","last_change":"2024-09-14T06:02:02.044911+0000","last_active":"2024-09-14T06:02:02.044911+0000","last_peered":"2024-09-14T06:02:02.044911+0000","last_clean":"2024-09-14T06:02:02.044911+0000","last_became_active":"2024-09-14T05:59:40.758449+0000","last_became_peered":"2024-09-14T05:59:40.758449+0000","last_unstale":"2024-09-14T06:02:02.044911+0000","last_undegraded":"2024-09-14T06:02:02.044911+0000","last_fullsized":"2024-09-14T06:02:02.044911+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'538","last_scrub_stamp":"2024-09-14T06:02:02.044823+0000","last_deep_scrub":"171'538","last_deep_scrub_stamp":"2024-09-14T06:02:02.044823+0000","last_clean_scrub_stamp":"2024-09-14T06:02:02.044823+0000","objects_scrubbed":30,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:47.243140+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0015877090000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":2965,"num_read_kb":24090,"num_write":468,"num_write_kb":10967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":166306,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:05.464735+0000","last_change":"2024-09-14T06:02:05.464735+0000","last_active":"2024-09-14T06:02:05.464735+0000","last_peered":"2024-09-14T06:02:05.464735+0000","last_clean":"2024-09-14T06:02:05.464735+0000","last_became_active":"2024-09-14T06:01:55.699203+0000","last_became_peered":"2024-09-14T06:01:55.699203+0000","last_unstale":"2024-09-14T06:02:05.464735+0000","last_undegraded":"2024-09-14T06:02:05.464735+0000","last_fullsized":"2024-09-14T06:02:05.464735+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T06:02:05.464437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T06:02:05.464437+0000","last_clean_scrub_stamp":"2024-09-14T06:02:05.464437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:12.157392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"171'390","reported_seq":2638,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:05.356189+0000","last_change":"2024-09-14T06:02:05.356189+0000","last_active":"2024-09-14T06:02:05.356189+0000","last_peered":"2024-09-14T06:02:05.356189+0000","last_clean":"2024-09-14T06:02:05.356189+0000","last_became_active":"2024-09-14T05:59:06.294615+0000","last_became_peered":"2024-09-14T05:59:06.294615+0000","last_unstale":"2024-09-14T06:02:05.356189+0000","last_undegraded":"2024-09-14T06:02:05.356189+0000","last_fullsized":"2024-09-14T06:02:05.356189+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'390","last_scrub_stamp":"2024-09-14T06:02:05.356016+0000","last_deep_scrub":"171'390","last_deep_scrub_stamp":"2024-09-14T06:02:05.356016+0000","last_clean_scrub_stamp":"2024-09-14T06:02:05.356016+0000","objects_scrubbed":29,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:42.755309+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.002155353,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":1854,"num_read_kb":21999,"num_write":376,"num_write_kb":9648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"171'2","reported_seq":328,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:05.447138+0000","last_change":"2024-09-14T06:02:05.447138+0000","last_active":"2024-09-14T06:02:05.447138+0000","last_peered":"2024-09-14T06:02:05.447138+0000","last_clean":"2024-09-14T06:02:05.447138+0000","last_became_active":"2024-09-14T05:58:54.100504+0000","last_became_peered":"2024-09-14T05:58:54.100504+0000","last_unstale":"2024-09-14T06:02:05.447138+0000","last_undegraded":"2024-09-14T06:02:05.447138+0000","last_fullsized":"2024-09-14T06:02:05.447138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'2","last_scrub_stamp":"2024-09-14T06:02:05.446935+0000","last_deep_scrub":"171'2","last_deep_scrub_stamp":"2024-09-14T06:02:05.446935+0000","last_clean_scrub_stamp":"2024-09-14T06:02:05.446935+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:23.041414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015244340000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"171'74","reported_seq":160,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:04.480278+0000","last_change":"2024-09-14T06:02:04.480278+0000","last_active":"2024-09-14T06:02:04.480278+0000","last_peered":"2024-09-14T06:02:04.480278+0000","last_clean":"2024-09-14T06:02:04.480278+0000","last_became_active":"2024-09-14T06:00:48.845773+0000","last_became_peered":"2024-09-14T06:00:48.845773+0000","last_unstale":"2024-09-14T06:02:04.480278+0000","last_undegraded":"2024-09-14T06:02:04.480278+0000","last_fullsized":"2024-09-14T06:02:04.480278+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'74","last_scrub_stamp":"2024-09-14T06:02:04.480092+0000","last_deep_scrub":"171'74","last_deep_scrub_stamp":"2024-09-14T06:02:04.480092+0000","last_clean_scrub_stamp":"2024-09-14T06:02:04.480092+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:25:38.752108+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"171'768","reported_seq":2475,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:06.366343+0000","last_change":"2024-09-14T06:02:06.366343+0000","last_active":"2024-09-14T06:02:06.366343+0000","last_peered":"2024-09-14T06:02:06.366343+0000","last_clean":"2024-09-14T06:02:06.366343+0000","last_became_active":"2024-09-14T05:59:06.292000+0000","last_became_peered":"2024-09-14T05:59:06.292000+0000","last_unstale":"2024-09-14T06:02:06.366343+0000","last_undegraded":"2024-09-14T06:02:06.366343+0000","last_fullsized":"2024-09-14T06:02:06.366343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'768","last_scrub_stamp":"2024-09-14T06:02:06.366145+0000","last_deep_scrub":"171'768","last_deep_scrub_stamp":"2024-09-14T06:02:06.366145+0000","last_clean_scrub_stamp":"2024-09-14T06:02:06.366145+0000","objects_scrubbed":31,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:33.252286+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.0012938190000000001,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3347,"num_read_kb":6654,"num_write":929,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"171'412","reported_seq":4971,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:06.471305+0000","last_change":"2024-09-14T06:02:06.471305+0000","last_active":"2024-09-14T06:02:06.471305+0000","last_peered":"2024-09-14T06:02:06.471305+0000","last_clean":"2024-09-14T06:02:06.471305+0000","last_became_active":"2024-09-14T05:59:06.307387+0000","last_became_peered":"2024-09-14T05:59:06.307387+0000","last_unstale":"2024-09-14T06:02:06.471305+0000","last_undegraded":"2024-09-14T06:02:06.471305+0000","last_fullsized":"2024-09-14T06:02:06.471305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'412","last_scrub_stamp":"2024-09-14T06:02:06.471225+0000","last_deep_scrub":"171'412","last_deep_scrub_stamp":"2024-09-14T06:02:06.471225+0000","last_clean_scrub_stamp":"2024-09-14T06:02:06.471225+0000","objects_scrubbed":27,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:25:03.431093+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0010238700000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":4613,"num_read_kb":34486,"num_write":364,"num_write_kb":27482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"171'710","reported_seq":2768,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:07.263969+0000","last_change":"2024-09-14T06:02:07.263969+0000","last_active":"2024-09-14T06:02:07.263969+0000","last_peered":"2024-09-14T06:02:07.263969+0000","last_clean":"2024-09-14T06:02:07.263969+0000","last_became_active":"2024-09-14T05:59:06.298473+0000","last_became_peered":"2024-09-14T05:59:06.298473+0000","last_unstale":"2024-09-14T06:02:07.263969+0000","last_undegraded":"2024-09-14T06:02:07.263969+0000","last_fullsized":"2024-09-14T06:02:07.263969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'710","last_scrub_stamp":"2024-09-14T06:02:07.263763+0000","last_deep_scrub":"171'710","last_deep_scrub_stamp":"2024-09-14T06:02:07.263763+0000","last_clean_scrub_stamp":"2024-09-14T06:02:07.263763+0000","objects_scrubbed":30,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:58:24.778405+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.00069170899999999999,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":29,"num_read":3310,"num_read_kb":12425,"num_write":762,"num_write_kb":6088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"171'926","reported_seq":3904,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:07.320177+0000","last_change":"2024-09-14T06:02:07.320177+0000","last_active":"2024-09-14T06:02:07.320177+0000","last_peered":"2024-09-14T06:02:07.320177+0000","last_clean":"2024-09-14T06:02:07.320177+0000","last_became_active":"2024-09-14T05:59:40.767939+0000","last_became_peered":"2024-09-14T05:59:40.767939+0000","last_unstale":"2024-09-14T06:02:07.320177+0000","last_undegraded":"2024-09-14T06:02:07.320177+0000","last_fullsized":"2024-09-14T06:02:07.320177+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'926","last_scrub_stamp":"2024-09-14T06:02:07.319988+0000","last_deep_scrub":"171'926","last_deep_scrub_stamp":"2024-09-14T06:02:07.319988+0000","last_clean_scrub_stamp":"2024-09-14T06:02:07.319988+0000","objects_scrubbed":25,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:48.819714+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.0022223719999999998,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":5877,"num_read_kb":27140,"num_write":1302,"num_write_kb":14124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":157712,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"171'645","reported_seq":5359,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:07.530144+0000","last_change":"2024-09-14T06:02:07.530144+0000","last_active":"2024-09-14T06:02:07.530144+0000","last_peered":"2024-09-14T06:02:07.530144+0000","last_clean":"2024-09-14T06:02:07.530144+0000","last_became_active":"2024-09-14T05:59:06.297612+0000","last_became_peered":"2024-09-14T05:59:06.297612+0000","last_unstale":"2024-09-14T06:02:07.530144+0000","last_undegraded":"2024-09-14T06:02:07.530144+0000","last_fullsized":"2024-09-14T06:02:07.530144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'645","last_scrub_stamp":"2024-09-14T06:02:07.529989+0000","last_deep_scrub":"171'645","last_deep_scrub_stamp":"2024-09-14T06:02:07.529989+0000","last_clean_scrub_stamp":"2024-09-14T06:02:07.529989+0000","objects_scrubbed":37,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:27.140624+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.0019468420000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":6117,"num_read_kb":23676,"num_write":517,"num_write_kb":12874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"171'450","reported_seq":3803,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:09.512104+0000","last_change":"2024-09-14T06:02:09.512104+0000","last_active":"2024-09-14T06:02:09.512104+0000","last_peered":"2024-09-14T06:02:09.512104+0000","last_clean":"2024-09-14T06:02:09.512104+0000","last_became_active":"2024-09-14T06:01:55.537648+0000","last_became_peered":"2024-09-14T06:01:55.537648+0000","last_unstale":"2024-09-14T06:02:09.512104+0000","last_undegraded":"2024-09-14T06:02:09.512104+0000","last_fullsized":"2024-09-14T06:02:09.512104+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'450","last_scrub_stamp":"2024-09-14T06:02:09.511946+0000","last_deep_scrub":"171'450","last_deep_scrub_stamp":"2024-09-14T06:02:09.511946+0000","last_clean_scrub_stamp":"2024-09-14T06:02:09.511946+0000","objects_scrubbed":32,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:50:27.773239+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0084296140000000002,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3697,"num_read_kb":21745,"num_write":409,"num_write_kb":13473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":2150148,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"171'656","reported_seq":5007,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:06.517962+0000","last_change":"2024-09-14T06:02:06.517962+0000","last_active":"2024-09-14T06:02:06.517962+0000","last_peered":"2024-09-14T06:02:06.517962+0000","last_clean":"2024-09-14T06:02:06.517962+0000","last_became_active":"2024-09-14T06:01:55.529576+0000","last_became_peered":"2024-09-14T06:01:55.529576+0000","last_unstale":"2024-09-14T06:02:06.517962+0000","last_undegraded":"2024-09-14T06:02:06.517962+0000","last_fullsized":"2024-09-14T06:02:06.517962+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'656","last_scrub_stamp":"2024-09-14T06:02:06.517790+0000","last_deep_scrub":"171'656","last_deep_scrub_stamp":"2024-09-14T06:02:06.517790+0000","last_clean_scrub_stamp":"2024-09-14T06:02:06.517790+0000","objects_scrubbed":29,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:30.353137+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.0036759169999999999,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":5969,"num_read_kb":24775,"num_write":580,"num_write_kb":11404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":302,"num_bytes_recovered":1794796,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"171'666","reported_seq":6726,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:12.507782+0000","last_change":"2024-09-14T06:02:12.507782+0000","last_active":"2024-09-14T06:02:12.507782+0000","last_peered":"2024-09-14T06:02:12.507782+0000","last_clean":"2024-09-14T06:02:12.507782+0000","last_became_active":"2024-09-14T06:01:55.534489+0000","last_became_peered":"2024-09-14T06:01:55.534489+0000","last_unstale":"2024-09-14T06:02:12.507782+0000","last_undegraded":"2024-09-14T06:02:12.507782+0000","last_fullsized":"2024-09-14T06:02:12.507782+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'666","last_scrub_stamp":"2024-09-14T06:02:12.507582+0000","last_deep_scrub":"171'666","last_deep_scrub_stamp":"2024-09-14T06:02:12.507582+0000","last_clean_scrub_stamp":"2024-09-14T06:02:12.507582+0000","objects_scrubbed":32,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:49.669379+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.0035801489999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":7304,"num_read_kb":14772,"num_write":688,"num_write_kb":6369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":2812424,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"171'999","reported_seq":4521,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:05.265451+0000","last_change":"2024-09-14T06:02:05.265451+0000","last_active":"2024-09-14T06:02:05.265451+0000","last_peered":"2024-09-14T06:02:05.265451+0000","last_clean":"2024-09-14T06:02:05.265451+0000","last_became_active":"2024-09-14T05:59:43.765983+0000","last_became_peered":"2024-09-14T05:59:43.765983+0000","last_unstale":"2024-09-14T06:02:05.265451+0000","last_undegraded":"2024-09-14T06:02:05.265451+0000","last_fullsized":"2024-09-14T06:02:05.265451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'999","last_scrub_stamp":"2024-09-14T06:02:05.265208+0000","last_deep_scrub":"171'999","last_deep_scrub_stamp":"2024-09-14T06:02:05.265208+0000","last_clean_scrub_stamp":"2024-09-14T06:02:05.265208+0000","objects_scrubbed":44,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:33.291626+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0.00063032799999999999,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":6689,"num_read_kb":19376,"num_write":1207,"num_write_kb":11822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":393954,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"171'598","reported_seq":6720,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:07.526564+0000","last_change":"2024-09-14T06:02:07.526564+0000","last_active":"2024-09-14T06:02:07.526564+0000","last_peered":"2024-09-14T06:02:07.526564+0000","last_clean":"2024-09-14T06:02:07.526564+0000","last_became_active":"2024-09-14T06:01:55.529694+0000","last_became_peered":"2024-09-14T06:01:55.529694+0000","last_unstale":"2024-09-14T06:02:07.526564+0000","last_undegraded":"2024-09-14T06:02:07.526564+0000","last_fullsized":"2024-09-14T06:02:07.526564+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'598","last_scrub_stamp":"2024-09-14T06:02:07.526432+0000","last_deep_scrub":"171'598","last_deep_scrub_stamp":"2024-09-14T06:02:07.526432+0000","last_clean_scrub_stamp":"2024-09-14T06:02:07.526432+0000","objects_scrubbed":36,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:05.262797+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.007656754,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":6277,"num_read_kb":34183,"num_write":630,"num_write_kb":31053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":284,"num_bytes_recovered":12777008,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"171'767","reported_seq":7005,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:05.068353+0000","last_change":"2024-09-14T06:02:05.068353+0000","last_active":"2024-09-14T06:02:05.068353+0000","last_peered":"2024-09-14T06:02:05.068353+0000","last_clean":"2024-09-14T06:02:05.068353+0000","last_became_active":"2024-09-14T06:01:21.321381+0000","last_became_peered":"2024-09-14T06:01:21.321381+0000","last_unstale":"2024-09-14T06:02:05.068353+0000","last_undegraded":"2024-09-14T06:02:05.068353+0000","last_fullsized":"2024-09-14T06:02:05.068353+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'767","last_scrub_stamp":"2024-09-14T06:02:05.068271+0000","last_deep_scrub":"171'767","last_deep_scrub_stamp":"2024-09-14T06:02:05.068271+0000","last_clean_scrub_stamp":"2024-09-14T06:02:05.068271+0000","objects_scrubbed":36,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:54.705771+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0.0017037930000000001,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":6816,"num_read_kb":29154,"num_write":729,"num_write_kb":10847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":500,"num_bytes_recovered":4175332,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"171'490","reported_seq":6610,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-14T06:02:10.518605+0000","last_change":"2024-09-14T06:02:10.518605+0000","last_active":"2024-09-14T06:02:10.518605+0000","last_peered":"2024-09-14T06:02:10.518605+0000","last_clean":"2024-09-14T06:02:10.518605+0000","last_became_active":"2024-09-14T06:01:55.529674+0000","last_became_peered":"2024-09-14T06:01:55.529674+0000","last_unstale":"2024-09-14T06:02:10.518605+0000","last_undegraded":"2024-09-14T06:02:10.518605+0000","last_fullsized":"2024-09-14T06:02:10.518605+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"171'490","last_scrub_stamp":"2024-09-14T06:02:10.518429+0000","last_deep_scrub":"171'490","last_deep_scrub_stamp":"2024-09-14T06:02:10.518429+0000","last_clean_scrub_stamp":"2024-09-14T06:02:10.518429+0000","objects_scrubbed":24,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:00:08.644868+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0026632919999999998,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":5545,"num_read_kb":33709,"num_write":451,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":300,"num_bytes_recovered":8189194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":998,"num_object_clones":0,"num_object_copies":1996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":998,"num_whiteouts":994,"num_read":166943,"num_read_kb":827903,"num_write":24723,"num_write_kb":445904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3513,"num_bytes_recovered":62209517,"num_keys_recovered":216,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22301,"ondisk_log_size":22301,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41508,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330332,"statfs":{"total":96636764160,"available":96594259968,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":46,"seq":197568495651,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60516,"kb_used_data":2004,"kb_used_omap":4,"kb_used_meta":58491,"kb_avail":94311324,"statfs":{"total":96636764160,"available":96574795776,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4432,"internal_metadata":59895472},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542192,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51236,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320604,"statfs":{"total":96636764160,"available":96584298496,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542193,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41508,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330332,"statfs":{"total":96636764160,"available":96594259968,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542191,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55400,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316440,"statfs":{"total":96636764160,"available":96580034560,"internally_reserved":0,"allocated":2056192,"data_stored":982606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542192,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47660,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324180,"statfs":{"total":96636764160,"available":96587960320,"internally_reserved":0,"allocated":2650112,"data_stored":1572974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542191,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59556,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312284,"statfs":{"total":96636764160,"available":96575778816,"internally_reserved":0,"allocated":2052096,"data_stored":982587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55984,"kb_used_data":2592,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315856,"statfs":{"total":96636764160,"available":96579436544,"internally_reserved":0,"allocated":2654208,"data_stored":1572993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T06:02:26.070 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T06:02:26.413 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T06:02:26.414 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T06:02:26.414 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T06:02:26.414 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T06:02:26.507 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T06:02:26.508 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T06:02:26.508 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T06:02:26.595 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T06:02:26.596 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T06:02:26.596 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T06:02:26.688 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T06:02:26.688 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T06:02:26.688 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T06:02:32.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-14T06:02:32.789 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T06:02:32.790 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T06:02:32.790 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T06:02:32.860 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T06:02:32.860 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T06:02:32.860 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T06:02:32.961 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T06:02:32.961 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T06:02:32.961 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T06:02:33.045 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T06:02:33.045 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T06:02:33.045 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T06:02:37.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-14T06:02:37.987 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-14T06:02:39.147 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T06:02:39.147 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T06:02:39.148 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T06:02:39.148 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T06:02:39.177 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T06:02:39.177 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T06:02:39.178 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T06:02:39.209 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T06:02:39.209 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T06:02:39.209 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T06:02:39.209 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T06:02:39.245 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T06:02:39.246 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T06:02:39.246 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T06:02:39.304 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T06:02:39.304 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T06:02:39.304 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T06:02:39.320 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T06:02:39.320 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T06:02:39.321 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-14T06:02:39.367 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-14T06:02:39.367 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T06:02:39.724 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-14T06:02:39.724 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T06:02:39.942 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-14T06:02:39.942 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T06:02:40.106 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi006.front.sepia.ceph.com 2024-09-14T06:02:40.106 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T06:02:40.292 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T06:02:40.293 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T06:02:40.565 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T06:02:40.565 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T06:02:40.801 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T06:02:40.801 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T06:02:40.983 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T06:02:40.983 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T06:02:41.161 INFO:tasks.ceph:Archiving mon data... 2024-09-14T06:02:41.162 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900350/data/mon.a.tgz 2024-09-14T06:02:41.163 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-09-14T06:02:41.169 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.vhzAk1sO67 2024-09-14T06:02:41.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vhzAk1sO67 2024-09-14T06:02:41.320 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.vhzAk1sO67 2024-09-14T06:02:41.388 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.vhzAk1sO67 is 412KB 2024-09-14T06:02:41.448 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.vhzAk1sO67 2024-09-14T06:02:41.454 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900350/data/mon.c.tgz 2024-09-14T06:02:41.454 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-09-14T06:02:41.503 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.DuQE6iTPD4 2024-09-14T06:02:41.503 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.DuQE6iTPD4 2024-09-14T06:02:41.693 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.DuQE6iTPD4 2024-09-14T06:02:41.759 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.DuQE6iTPD4 is 571KB 2024-09-14T06:02:41.825 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.DuQE6iTPD4 2024-09-14T06:02:41.830 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900350/data/mon.b.tgz 2024-09-14T06:02:41.830 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-14T06:02:41.836 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.kkj6kXrdXG 2024-09-14T06:02:41.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.kkj6kXrdXG 2024-09-14T06:02:42.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.kkj6kXrdXG 2024-09-14T06:02:42.082 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.kkj6kXrdXG is 571KB 2024-09-14T06:02:42.144 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.kkj6kXrdXG 2024-09-14T06:02:42.150 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T06:02:42.150 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T06:02:42.152 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T06:02:42.213 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T06:02:42.255 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T06:02:42.255 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T06:02:42.257 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900350/remote/smithi006/crash 2024-09-14T06:02:42.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T06:02:42.272 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900350/remote/smithi154/crash 2024-09-14T06:02:42.273 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T06:02:42.311 INFO:tasks.ceph:Compressing logs... 2024-09-14T06:02:42.311 DEBUG:teuthology.orchestra.run.smithi006:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T06:02:42.320 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T06:02:42.350 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42880.log 2024-09-14T06:02:42.350 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41093.log 2024-09-14T06:02:42.351 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43268.log 2024-09-14T06:02:42.351 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42880.log.gz 2024-09-14T06:02:42.352 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36715.log 2024-09-14T06:02:42.352 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43502.log 2024-09-14T06:02:42.352 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41093.log.gz 2024-09-14T06:02:42.352 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43268.log.gz 2024-09-14T06:02:42.352 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36715.log.gz 2024-09-14T06:02:42.353 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41899.log 2024-09-14T06:02:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38391.log 2024-09-14T06:02:42.354 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43502.log.gz 2024-09-14T06:02:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41899.log.gz 2024-09-14T06:02:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T06:02:42.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40986.log 2024-09-14T06:02:42.356 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38391.log.gz 2024-09-14T06:02:42.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38072.log 2024-09-14T06:02:42.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43069.log 2024-09-14T06:02:42.356 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40986.log.gz 2024-09-14T06:02:42.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38072.log.gz 2024-09-14T06:02:42.356 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31887.log 2024-09-14T06:02:42.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33013.log 2024-09-14T06:02:42.356 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43069.log.gz 2024-09-14T06:02:42.362 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31887.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.31887.log.gz 2024-09-14T06:02:42.362 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43084.log 2024-09-14T06:02:42.362 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33013.log.gz 2024-09-14T06:02:42.362 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40273.log 2024-09-14T06:02:42.362 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32325.log 2024-09-14T06:02:42.362 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43084.log.gz 2024-09-14T06:02:42.362 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40273.log.gz 2024-09-14T06:02:42.362 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32199.log 2024-09-14T06:02:42.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40845.log 2024-09-14T06:02:42.363 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32325.log.gz 2024-09-14T06:02:42.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38782.log 2024-09-14T06:02:42.363 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32199.log.gz 2024-09-14T06:02:42.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40845.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T06:02:42.363 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40845.log.gz 2024-09-14T06:02:42.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41279.log 2024-09-14T06:02:42.363 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38782.log.gz 2024-09-14T06:02:42.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38665.log 2024-09-14T06:02:42.363 INFO:teuthology.orchestra.run.smithi006.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T06:02:42.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39895.log 2024-09-14T06:02:42.363 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41279.log.gz 2024-09-14T06:02:42.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36376.log 2024-09-14T06:02:42.364 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38665.log.gz 2024-09-14T06:02:42.364 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35382.log 2024-09-14T06:02:42.364 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39895.log.gz 2024-09-14T06:02:42.364 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41134.log 2024-09-14T06:02:42.364 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36376.log.gz 2024-09-14T06:02:42.364 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43632.log 2024-09-14T06:02:42.364 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35382.log.gz 2024-09-14T06:02:42.364 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5/var/log/ceph/ceph-client.admin.41134.log: --verbose -- /var/log/ceph/ceph-client.admin.38995.log 2024-09-14T06:02:42.371 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41134.log.gz 2024-09-14T06:02:42.371 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43632.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.43632.log.gz -5 2024-09-14T06:02:42.371 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40246.log 2024-09-14T06:02:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41928.log 2024-09-14T06:02:42.372 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38995.log.gz 2024-09-14T06:02:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43736.log 2024-09-14T06:02:42.372 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40246.log.gz 2024-09-14T06:02:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43346.log 2024-09-14T06:02:42.372 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41928.log.gz 2024-09-14T06:02:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43736.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21457.log 2024-09-14T06:02:42.372 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43736.log.gz 2024-09-14T06:02:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37168.log 2024-09-14T06:02:42.372 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43346.log.gz 2024-09-14T06:02:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.tmp-client.admin.21457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32776.log 2024-09-14T06:02:42.372 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21457.log.gz 2024-09-14T06:02:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39205.log 2024-09-14T06:02:42.373 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37168.log.gz 2024-09-14T06:02:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40105.log 2024-09-14T06:02:42.373 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32776.log.gz 2024-09-14T06:02:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41929.log 2024-09-14T06:02:42.373 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39205.log.gz 2024-09-14T06:02:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:gzip/var/log/ceph/ceph-client.admin.40105.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41786.log 2024-09-14T06:02:42.373 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40105.log.gz 2024-09-14T06:02:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35341.log 2024-09-14T06:02:42.373 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41929.log.gz 2024-09-14T06:02:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41786.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.33039.log 2024-09-14T06:02:42.373 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41786.log.gz 2024-09-14T06:02:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43606.log 2024-09-14T06:02:42.373 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35341.log.gz 2024-09-14T06:02:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/objectstore_tool.33039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37818.log 2024-09-14T06:02:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43398.log 2024-09-14T06:02:42.374 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43606.log.gz 2024-09-14T06:02:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37818.log.gz 2024-09-14T06:02:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43788.log 2024-09-14T06:02:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31286.log 2024-09-14T06:02:42.374 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43398.log.gz 2024-09-14T06:02:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42205.log 2024-09-14T06:02:42.374 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43788.log.gz 2024-09-14T06:02:42.374 INFO:teuthology.orchestra.run.smithi006.stderr: 94.8% -- replaced with /var/log/ceph/objectstore_tool.33039.log.gz 2024-09-14T06:02:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31286.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31286.log.gz 2024-09-14T06:02:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T06:02:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42205.log.gz 2024-09-14T06:02:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33634.log 2024-09-14T06:02:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose --/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.43067.log 2024-09-14T06:02:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.33634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41509.log 0.0% 2024-09-14T06:02:42.375 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33634.log.gz 2024-09-14T06:02:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42866.log 2024-09-14T06:02:42.385 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43067.log.gz 2024-09-14T06:02:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31691.log 2024-09-14T06:02:42.386 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41509.log.gz 2024-09-14T06:02:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42866.log.gz 2024-09-14T06:02:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42774.log 2024-09-14T06:02:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37464.log 2024-09-14T06:02:42.386 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31691.log.gz 2024-09-14T06:02:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40584.log 2024-09-14T06:02:42.386 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42774.log.gz 2024-09-14T06:02:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36989.log 2024-09-14T06:02:42.386 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37464.log.gz 2024-09-14T06:02:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40584.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T06:02:42.386 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40584.log.gz 2024-09-14T06:02:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37339.log 2024-09-14T06:02:42.387 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36989.log.gz 2024-09-14T06:02:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40651.log 2024-09-14T06:02:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37339.log.gz 2024-09-14T06:02:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43372.log 2024-09-14T06:02:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31139.log 2024-09-14T06:02:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40651.log.gz 2024-09-14T06:02:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43372.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43372.log.gz -5 2024-09-14T06:02:42.387 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37690.log 2024-09-14T06:02:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37591.log 2024-09-14T06:02:42.387 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31139.log.gz 2024-09-14T06:02:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37690.log.gz 2024-09-14T06:02:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35036.log 2024-09-14T06:02:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30929.log 2024-09-14T06:02:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37591.log.gz 2024-09-14T06:02:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35036.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.35036.log.gz -5 2024-09-14T06:02:42.388 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40522.log 2024-09-14T06:02:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41620.log 2024-09-14T06:02:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.30929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30929.log.gz 2024-09-14T06:02:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39500.log 2024-09-14T06:02:42.388 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40522.log.gz 2024-09-14T06:02:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31497.log 2024-09-14T06:02:42.388 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41620.log.gz 2024-09-14T06:02:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39500.log.gz 2024-09-14T06:02:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34465.log 2024-09-14T06:02:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31288.log 2024-09-14T06:02:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31497.log.gz 2024-09-14T06:02:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34465.log.gz 2024-09-14T06:02:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40129.log 2024-09-14T06:02:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41873.log 2024-09-14T06:02:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31288.log.gz 2024-09-14T06:02:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40129.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.40129.log.gz 2024-09-14T06:02:42.389 INFO:teuthology.orchestra.run.smithi006.stderr: /var/log/ceph/ceph-client.admin.43088.log 2024-09-14T06:02:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41550.log 2024-09-14T06:02:42.389 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41873.log.gz 2024-09-14T06:02:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz 2024-09-14T06:02:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31905.log 2024-09-14T06:02:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42540.log 2024-09-14T06:02:42.389 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41550.log.gz 2024-09-14T06:02:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31905.log.gz 2024-09-14T06:02:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31290.log 2024-09-14T06:02:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37542.log 2024-09-14T06:02:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42540.log.gz 2024-09-14T06:02:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31185.log 0.0% 2024-09-14T06:02:42.390 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31290.log.gz 2024-09-14T06:02:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42865.log 2024-09-14T06:02:42.390 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37542.log.gz 2024-09-14T06:02:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31185.log.gz 2024-09-14T06:02:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34896.log 2024-09-14T06:02:42.402 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26516.log 2024-09-14T06:02:42.402 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26468.log 2024-09-14T06:02:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26516.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T06:02:42.403 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26516.log.gz 2024-09-14T06:02:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26468.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-14T06:02:42.403 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26468.log.gz 2024-09-14T06:02:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T06:02:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T06:02:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T06:02:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26420.log 2024-09-14T06:02:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26348.log 2024-09-14T06:02:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26420.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26420.log.gz 2024-09-14T06:02:42.403 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.26372.log 2024-09-14T06:02:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26348.log.gz 2024-09-14T06:02:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26396.log 2024-09-14T06:02:42.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26372.log.gz 2024-09-14T06:02:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T06:02:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26396.log.gz 2024-09-14T06:02:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose 85.6% -- /var/log/ceph/ceph-client.admin.26492.log 2024-09-14T06:02:42.404 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T06:02:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26444.log 2024-09-14T06:02:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26492.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26492.log.gz 2024-09-14T06:02:42.404 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T06:02:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26444.log.gz 2024-09-14T06:02:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T06:02:42.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mon.b.log: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T06:02:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41180.log 2024-09-14T06:02:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42865.log.gz 2024-09-14T06:02:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26249.log 2024-09-14T06:02:42.425 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34896.log.gz 2024-09-14T06:02:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42696.log 2024-09-14T06:02:42.425 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41180.log.gz 2024-09-14T06:02:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.26249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26249.log.gz 2024-09-14T06:02:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37770.log 2024-09-14T06:02:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31707.log 2024-09-14T06:02:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42696.log.gz 2024-09-14T06:02:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37770.log.gz 2024-09-14T06:02:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39306.log 2024-09-14T06:02:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42878.log 2024-09-14T06:02:42.426 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31707.log.gz 2024-09-14T06:02:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39491.log 2024-09-14T06:02:42.426 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39306.log.gz 2024-09-14T06:02:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31476.log 2024-09-14T06:02:42.426 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42878.log.gz 2024-09-14T06:02:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39491.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.39491.log.gz -5 2024-09-14T06:02:42.426 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31906.log 2024-09-14T06:02:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36492.log 2024-09-14T06:02:42.426 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31476.log.gz 2024-09-14T06:02:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40766.log 2024-09-14T06:02:42.427 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31906.log.gz 2024-09-14T06:02:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43082.log 2024-09-14T06:02:42.427 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36492.log.gz 2024-09-14T06:02:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40766.log.gz 2024-09-14T06:02:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38967.log 2024-09-14T06:02:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:gzip/var/log/ceph/ceph-client.admin.43082.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31273.log 2024-09-14T06:02:42.427 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43082.log.gz 2024-09-14T06:02:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40011.log 2024-09-14T06:02:42.427 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38967.log.gz 2024-09-14T06:02:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43476.log 2024-09-14T06:02:42.427 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31273.log.gz 2024-09-14T06:02:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41691.log 2024-09-14T06:02:42.428 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40011.log.gz 2024-09-14T06:02:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43424.log 2024-09-14T06:02:42.428 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43476.log.gz 2024-09-14T06:02:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.41691.log: -- /var/log/ceph/ceph-client.admin.38257.log 2024-09-14T06:02:42.428 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41691.log.gz 2024-09-14T06:02:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39896.log 2024-09-14T06:02:42.428 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43424.log.gz 2024-09-14T06:02:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31689.log 2024-09-14T06:02:42.428 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38257.log.gz 2024-09-14T06:02:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39718.log 2024-09-14T06:02:42.428 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39896.log.gz 2024-09-14T06:02:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31689.log.gz 2024-09-14T06:02:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35125.log 2024-09-14T06:02:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T06:02:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39718.log.gz 2024-09-14T06:02:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39383.log 2024-09-14T06:02:42.429 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35125.log.gz 2024-09-14T06:02:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41410.log 2024-09-14T06:02:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39383.log.gz 2024-09-14T06:02:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42301.log 2024-09-14T06:02:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31276.log 2024-09-14T06:02:42.429 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41410.log.gz 2024-09-14T06:02:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35167.log 2024-09-14T06:02:42.429 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42301.log.gz 2024-09-14T06:02:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42156.log 2024-09-14T06:02:42.429 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31276.log.gz 2024-09-14T06:02:42.430 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43083.log 2024-09-14T06:02:42.430 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35167.log.gz 2024-09-14T06:02:42.430 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36309.log 2024-09-14T06:02:42.430 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42156.log.gz 2024-09-14T06:02:42.430 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2024-09-14T06:02:42.430 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43083.log.gz 2024-09-14T06:02:42.430 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43580.log 2024-09-14T06:02:42.430 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36309.log.gz 2024-09-14T06:02:42.430 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31690.log 2024-09-14T06:02:42.430 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2024-09-14T06:02:42.430 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40333.log 2024-09-14T06:02:42.430 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43580.log.gz 2024-09-14T06:02:42.430 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31690.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.31690.log.gz 2024-09-14T06:02:42.431 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/objectstore_tool.33252.log 2024-09-14T06:02:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31705.log 2024-09-14T06:02:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40333.log.gz 2024-09-14T06:02:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/objectstore_tool.33252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36672.log 2024-09-14T06:02:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42410.log 2024-09-14T06:02:42.431 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31705.log.gz 2024-09-14T06:02:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37367.log 2024-09-14T06:02:42.431 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36672.log.gz 2024-09-14T06:02:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43072.log 2024-09-14T06:02:42.431 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42410.log.gz 2024-09-14T06:02:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37371.log 2024-09-14T06:02:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37367.log.gz 2024-09-14T06:02:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32700.log 2024-09-14T06:02:42.432 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43072.log.gz 2024-09-14T06:02:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38860.log 2024-09-14T06:02:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37371.log: /var/log/ceph/ceph-client.admin.32700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37371.log.gz 2024-09-14T06:02:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38542.log 2024-09-14T06:02:42.432 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32700.log.gz 2024-09-14T06:02:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31499.log 2024-09-14T06:02:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38860.log: /var/log/ceph/ceph-client.admin.38542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36862.log 2024-09-14T06:02:42.432 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38860.log.gz 2024-09-14T06:02:42.432 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38542.log.gz 2024-09-14T06:02:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31499.log.gzgzip 2024-09-14T06:02:42.432 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40428.log 2024-09-14T06:02:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42488.log 2024-09-14T06:02:42.432 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36862.log.gz 2024-09-14T06:02:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32704.log 2024-09-14T06:02:42.433 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40428.log.gz 2024-09-14T06:02:42.433 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42488.log.gz 2024-09-14T06:02:42.433 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39984.log 2024-09-14T06:02:42.433 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32704.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T06:02:42.433 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32704.log.gz 2024-09-14T06:02:42.433 INFO:teuthology.orchestra.run.smithi006.stderr: 95.2% -- replaced with /var/log/ceph/objectstore_tool.33252.log.gz 2024-09-14T06:02:42.433 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39647.log 2024-09-14T06:02:42.433 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39984.log.gz 2024-09-14T06:02:42.433 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38307.log 2024-09-14T06:02:42.433 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31283.log 2024-09-14T06:02:42.433 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39647.log.gz 2024-09-14T06:02:42.433 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38307.log.gz 2024-09-14T06:02:42.433 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42436.log 2024-09-14T06:02:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39219.log 2024-09-14T06:02:42.434 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31283.log.gz 2024-09-14T06:02:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40982.log 2024-09-14T06:02:42.434 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42436.log.gz 2024-09-14T06:02:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37069.log 2024-09-14T06:02:42.434 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39219.log.gz 2024-09-14T06:02:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38175.log 2024-09-14T06:02:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40982.log: /var/log/ceph/ceph-client.admin.37069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40982.log.gz 2024-09-14T06:02:42.434 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37069.log.gz 2024-09-14T06:02:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34055.log 2024-09-14T06:02:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37984.log 2024-09-14T06:02:42.434 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38175.log.gz 2024-09-14T06:02:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38341.log 2024-09-14T06:02:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34055.log.gz 2024-09-14T06:02:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31477.log 2024-09-14T06:02:42.435 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37984.log.gz 2024-09-14T06:02:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31891.log 2024-09-14T06:02:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38341.log: /var/log/ceph/ceph-client.admin.31477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36614.log 2024-09-14T06:02:42.435 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38341.log.gz 2024-09-14T06:02:42.435 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31477.log.gz 2024-09-14T06:02:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31891.log.gz 2024-09-14T06:02:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38706.log 2024-09-14T06:02:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40609.log 2024-09-14T06:02:42.435 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36614.log.gz 2024-09-14T06:02:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42618.log 2024-09-14T06:02:42.435 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38706.log.gz 2024-09-14T06:02:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40609.log.gz 2024-09-14T06:02:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43710.log 2024-09-14T06:02:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35206.log 2024-09-14T06:02:42.436 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42618.log.gz 2024-09-14T06:02:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38855.log 2024-09-14T06:02:42.436 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43710.log.gz 2024-09-14T06:02:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35206.log.gz 2024-09-14T06:02:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36648.log 2024-09-14T06:02:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38855.log.gz 2024-09-14T06:02:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42870.log 2024-09-14T06:02:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32452.log 2024-09-14T06:02:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36648.log.gz 2024-09-14T06:02:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37842.log 2024-09-14T06:02:42.436 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42870.log.gz 2024-09-14T06:02:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32452.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37209.log 2024-09-14T06:02:42.437 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32452.log.gz 2024-09-14T06:02:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32095.log 2024-09-14T06:02:42.437 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37842.log.gz 2024-09-14T06:02:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32624.log 2024-09-14T06:02:42.437 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37209.log.gz 2024-09-14T06:02:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T06:02:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32095.log.gz 2024-09-14T06:02:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32624.log.gz 2024-09-14T06:02:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39136.log 2024-09-14T06:02:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37424.log 2024-09-14T06:02:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42879.log 2024-09-14T06:02:42.437 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39136.log.gz 2024-09-14T06:02:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37424.log.gz 2024-09-14T06:02:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39496.log 2024-09-14T06:02:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39272.log 2024-09-14T06:02:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42879.log.gz 2024-09-14T06:02:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39496.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42592.log 2024-09-14T06:02:42.438 INFO:teuthology.orchestra.run.smithi006.stderr: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T06:02:42.438 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39496.log.gz 2024-09-14T06:02:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39272.log.gz 2024-09-14T06:02:42.445 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.4.log: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T06:02:42.458 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32121.log 2024-09-14T06:02:42.458 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42384.log 2024-09-14T06:02:42.458 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42592.log.gz 2024-09-14T06:02:42.458 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35451.log 2024-09-14T06:02:42.458 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32121.log.gz 2024-09-14T06:02:42.458 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40484.log 2024-09-14T06:02:42.458 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42384.log.gz 2024-09-14T06:02:42.458 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32538.log 2024-09-14T06:02:42.458 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35451.log: /var/log/ceph/ceph-client.admin.40484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35451.log.gz 2024-09-14T06:02:42.458 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40484.log.gz 2024-09-14T06:02:42.458 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42462.log 2024-09-14T06:02:42.458 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43528.log 2024-09-14T06:02:42.459 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32538.log.gz 2024-09-14T06:02:42.459 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43658.log 2024-09-14T06:02:42.459 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42462.log.gz 2024-09-14T06:02:42.459 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43528.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.43528.log.gz -- 2024-09-14T06:02:42.459 INFO:teuthology.orchestra.run.smithi006.stderr: /var/log/ceph/ceph-client.admin.40053.log 2024-09-14T06:02:42.459 INFO:teuthology.orchestra.run.smithi006.stderr:gzip/var/log/ceph/ceph-client.admin.43658.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36455.log 2024-09-14T06:02:42.459 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43658.log.gz 2024-09-14T06:02:42.459 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36958.log 2024-09-14T06:02:42.459 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40053.log.gz 2024-09-14T06:02:42.459 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36455.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.32764.log 2024-09-14T06:02:42.459 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36455.log.gz 2024-09-14T06:02:42.459 INFO:teuthology.orchestra.run.smithi006.stderr:gzip/var/log/ceph/ceph-client.admin.36958.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39454.log 2024-09-14T06:02:42.459 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36958.log.gz 2024-09-14T06:02:42.459 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/objectstore_tool.32764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32147.log 2024-09-14T06:02:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31706.log 2024-09-14T06:02:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39454.log.gz 2024-09-14T06:02:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32147.log.gz 2024-09-14T06:02:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31291.log 2024-09-14T06:02:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31706.log: 94.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43762.log 2024-09-14T06:02:42.460 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/objectstore_tool.32764.log.gz 2024-09-14T06:02:42.460 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31706.log.gz 2024-09-14T06:02:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31291.log.gz 2024-09-14T06:02:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35066.log 2024-09-14T06:02:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36808.log 2024-09-14T06:02:42.460 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43762.log.gz 2024-09-14T06:02:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39797.log 2024-09-14T06:02:42.460 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35066.log.gz 2024-09-14T06:02:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39412.log 2024-09-14T06:02:42.461 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36808.log.gz 2024-09-14T06:02:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43062.log 2024-09-14T06:02:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39797.log: /var/log/ceph/ceph-client.admin.39412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39797.log.gz 2024-09-14T06:02:42.461 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39412.log.gz 2024-09-14T06:02:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43320.log 2024-09-14T06:02:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32599.log 2024-09-14T06:02:42.461 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43062.log.gz 2024-09-14T06:02:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43294.log 2024-09-14T06:02:42.461 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43320.log.gz 2024-09-14T06:02:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37308.log 2024-09-14T06:02:42.461 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32599.log.gz 2024-09-14T06:02:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43294.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37870.log 2024-09-14T06:02:42.461 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43294.log.gz 2024-09-14T06:02:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41717.log 2024-09-14T06:02:42.462 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37308.log.gz 2024-09-14T06:02:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40717.log 2024-09-14T06:02:42.462 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37870.log.gz 2024-09-14T06:02:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41717.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T06:02:42.462 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41717.log.gz 2024-09-14T06:02:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37794.log 2024-09-14T06:02:42.462 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40717.log.gz 2024-09-14T06:02:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42040.log 2024-09-14T06:02:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39605.log 2024-09-14T06:02:42.462 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0%/var/log/ceph/ceph-client.admin.42040.log: -- replaced with /var/log/ceph/ceph-client.admin.37794.log.gz 2024-09-14T06:02:42.462 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42040.log.gz 2024-09-14T06:02:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40079.log 2024-09-14T06:02:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36409.log 2024-09-14T06:02:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39605.log.gz 2024-09-14T06:02:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40079.log.gz 2024-09-14T06:02:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41616.log 2024-09-14T06:02:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36409.log.gz 2024-09-14T06:02:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43450.log 2024-09-14T06:02:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43554.log 2024-09-14T06:02:42.463 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41616.log.gz 2024-09-14T06:02:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43450.log.gz 2024-09-14T06:02:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31487.log 2024-09-14T06:02:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38398.log 2024-09-14T06:02:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43554.log.gz 2024-09-14T06:02:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31487.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38042.log 2024-09-14T06:02:42.464 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31487.log.gz 2024-09-14T06:02:42.464 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38398.log.gz 2024-09-14T06:02:42.464 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41447.log 2024-09-14T06:02:42.464 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35239.log 2024-09-14T06:02:42.464 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38042.log.gz 2024-09-14T06:02:42.464 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41447.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42107.log 2024-09-14T06:02:42.464 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41447.log.gz 2024-09-14T06:02:42.464 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.35239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35239.log.gz 2024-09-14T06:02:42.464 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39042.log 2024-09-14T06:02:42.464 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39770.log 2024-09-14T06:02:42.464 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42107.log.gz 2024-09-14T06:02:42.464 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39042.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32225.log 2024-09-14T06:02:42.464 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39042.log.gz 2024-09-14T06:02:42.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39770.log.gz 2024-09-14T06:02:42.465 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37746.log 2024-09-14T06:02:42.465 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31704.log 2024-09-14T06:02:42.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32225.log.gz 2024-09-14T06:02:42.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37746.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36912.log 2024-09-14T06:02:42.465 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37746.log.gz 2024-09-14T06:02:42.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31704.log.gz 2024-09-14T06:02:42.465 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39960.log 2024-09-14T06:02:42.465 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38589.log 2024-09-14T06:02:42.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36912.log.gz 2024-09-14T06:02:42.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39960.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31237.log 2024-09-14T06:02:42.465 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39960.log.gz 2024-09-14T06:02:42.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38589.log.gz 2024-09-14T06:02:42.466 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32323.log 2024-09-14T06:02:42.466 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39091.log 2024-09-14T06:02:42.466 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31237.log: /var/log/ceph/ceph-client.admin.32323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31237.log.gz 2024-09-14T06:02:42.466 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32323.log.gz 2024-09-14T06:02:42.466 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26396.log 2024-09-14T06:02:42.466 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37504.log 2024-09-14T06:02:42.466 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39091.log: /var/log/ceph/ceph-client.admin.26396.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39091.log.gz 2024-09-14T06:02:42.466 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26396.log.gz 2024-09-14T06:02:42.466 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31289.log 2024-09-14T06:02:42.466 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T06:02:42.466 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37504.log.gz 2024-09-14T06:02:42.466 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31480.log 2024-09-14T06:02:42.466 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31289.log.gz 2024-09-14T06:02:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.audit.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T06:02:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31114.log 2024-09-14T06:02:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38829.log 2024-09-14T06:02:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31480.log: /var/log/ceph/ceph-client.admin.31114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31480.log.gz 2024-09-14T06:02:42.479 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31114.log.gz 2024-09-14T06:02:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40792.log 2024-09-14T06:02:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36911.log 2024-09-14T06:02:42.479 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38829.log: /var/log/ceph/ceph-client.admin.40792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38829.log.gz 2024-09-14T06:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40792.log.gz 2024-09-14T06:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32251.log 2024-09-14T06:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37259.log 2024-09-14T06:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36911.log: /var/log/ceph/ceph-client.admin.32251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36911.log.gz 2024-09-14T06:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32251.log.gz 2024-09-14T06:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40932.log 2024-09-14T06:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37259.log.gz 2024-09-14T06:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31484.log 2024-09-14T06:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39671.log 2024-09-14T06:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40932.log: /var/log/ceph/ceph-client.admin.31484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40932.log.gz 2024-09-14T06:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31484.log.gz 2024-09-14T06:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31679.log 2024-09-14T06:02:42.480 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37718.log 2024-09-14T06:02:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39671.log: /var/log/ceph/ceph-client.admin.31679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39671.log.gz 2024-09-14T06:02:42.481 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31679.log.gz 2024-09-14T06:02:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37917.log 2024-09-14T06:02:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31907.log 2024-09-14T06:02:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37718.log: /var/log/ceph/ceph-client.admin.37917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37718.log.gz 2024-09-14T06:02:42.481 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37917.log.gz 2024-09-14T06:02:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39175.log 2024-09-14T06:02:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26492.log 2024-09-14T06:02:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31907.log.gz 2024-09-14T06:02:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39175.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.39175.log.gz --verbose -- /var/log/ceph/ceph-client.admin.39714.log 2024-09-14T06:02:42.481 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-09-14T06:02:42.481 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.26492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26492.log.gz 2024-09-14T06:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37234.log 2024-09-14T06:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42722.log 2024-09-14T06:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39714.log: /var/log/ceph/ceph-client.admin.37234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39714.log.gz 2024-09-14T06:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37234.log.gz 2024-09-14T06:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41275.log 2024-09-14T06:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41827.log 2024-09-14T06:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42722.log.gz 2024-09-14T06:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40394.log 2024-09-14T06:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41275.log.gz 2024-09-14T06:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41827.log.gz 2024-09-14T06:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31159.log 2024-09-14T06:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43814.log 2024-09-14T06:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40394.log: /var/log/ceph/ceph-client.admin.31159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40394.log.gz 2024-09-14T06:02:42.482 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31159.log.gz 2024-09-14T06:02:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39822.log 2024-09-14T06:02:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38781.log 2024-09-14T06:02:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43814.log.gz 2024-09-14T06:02:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.39822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39822.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37027.log 2024-09-14T06:02:42.483 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-09-14T06:02:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38781.log.gz 2024-09-14T06:02:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37866.log 2024-09-14T06:02:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38492.log 2024-09-14T06:02:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37027.log.gz 2024-09-14T06:02:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37866.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38399.log 2024-09-14T06:02:42.483 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37866.log.gz 2024-09-14T06:02:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38492.log.gz 2024-09-14T06:02:42.483 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42871.log 2024-09-14T06:02:42.484 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31089.log 2024-09-14T06:02:42.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38399.log.gz 2024-09-14T06:02:42.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42871.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42353.log 2024-09-14T06:02:42.484 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42871.log.gz 2024-09-14T06:02:42.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31089.log.gz 2024-09-14T06:02:42.484 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32281.log 2024-09-14T06:02:42.484 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37097.log 2024-09-14T06:02:42.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42353.log.gz 2024-09-14T06:02:42.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32281.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38133.log 2024-09-14T06:02:42.484 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32281.log.gz 2024-09-14T06:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37097.log.gz 2024-09-14T06:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32314.log 2024-09-14T06:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42514.log 2024-09-14T06:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38133.log: /var/log/ceph/ceph-client.0.32314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38133.log.gz 2024-09-14T06:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42248.log 2024-09-14T06:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.32314.log.gz/var/log/ceph/ceph-client.admin.42514.log: 2024-09-14T06:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42514.log.gz 2024-09-14T06:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38593.log 2024-09-14T06:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42327.log 2024-09-14T06:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42248.log: /var/log/ceph/ceph-client.admin.38593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42248.log.gz 2024-09-14T06:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38593.log.gz 2024-09-14T06:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43892.log 2024-09-14T06:02:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36530.log 2024-09-14T06:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42327.log: /var/log/ceph/ceph-client.admin.43892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42327.log.gz 2024-09-14T06:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43892.log.gz 2024-09-14T06:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31498.log 2024-09-14T06:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37628.log 2024-09-14T06:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36530.log: /var/log/ceph/ceph-client.admin.31498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36530.log.gz 2024-09-14T06:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31498.log.gz 2024-09-14T06:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38752.log 2024-09-14T06:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37283.log 2024-09-14T06:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37628.log: /var/log/ceph/ceph-client.admin.38752.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37628.log.gz 2024-09-14T06:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38752.log.gz 2024-09-14T06:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31930.log 2024-09-14T06:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38518.log 2024-09-14T06:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37283.log.gz 2024-09-14T06:02:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38232.log 2024-09-14T06:02:42.493 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31930.log.gz 2024-09-14T06:02:42.493 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38518.log.gz 2024-09-14T06:02:42.493 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40891.log 2024-09-14T06:02:42.493 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.34040.log 2024-09-14T06:02:42.493 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.38232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38232.log.gz 2024-09-14T06:02:42.493 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40891.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43684.log 2024-09-14T06:02:42.493 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40891.log.gz 2024-09-14T06:02:42.494 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/objectstore_tool.34040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32493.log 2024-09-14T06:02:42.495 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43684.log.gz 2024-09-14T06:02:42.495 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42800.log 2024-09-14T06:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32493.log: 95.3% -- replaced with /var/log/ceph/objectstore_tool.34040.log.gz 2024-09-14T06:02:42.496 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32493.log.gz 2024-09-14T06:02:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36775.log 2024-09-14T06:02:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31935.log 2024-09-14T06:02:42.498 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42800.log.gz 2024-09-14T06:02:42.498 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36775.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40167.log 2024-09-14T06:02:42.498 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36775.log.gz 2024-09-14T06:02:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.31935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31935.log.gz 2024-09-14T06:02:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41368.log 2024-09-14T06:02:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.40167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40167.log.gz 2024-09-14T06:02:42.499 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42644.log 2024-09-14T06:02:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36719.log 2024-09-14T06:02:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41368.log.gz 2024-09-14T06:02:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42644.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34993.log 2024-09-14T06:02:42.501 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42644.log.gz 2024-09-14T06:02:42.501 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36719.log.gz 2024-09-14T06:02:42.501 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42670.log 2024-09-14T06:02:42.501 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42566.log 2024-09-14T06:02:42.502 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34993.log: /var/log/ceph/ceph-client.admin.42670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34993.log.gz 2024-09-14T06:02:42.502 INFO:teuthology.orchestra.run.smithi006.stderr: 27.5% -- replaced with /var/log/ceph/ceph-client.admin.42670.log.gz 2024-09-14T06:02:42.502 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31898.log 2024-09-14T06:02:42.503 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32173.log 2024-09-14T06:02:42.503 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42566.log: /var/log/ceph/ceph-client.admin.31898.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42566.log.gz 2024-09-14T06:02:42.504 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31898.log.gz 2024-09-14T06:02:42.504 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41342.log 2024-09-14T06:02:42.504 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36525.log 2024-09-14T06:02:42.505 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.32173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32173.log.gz 2024-09-14T06:02:42.505 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41342.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34920.log 2024-09-14T06:02:42.505 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41342.log.gz 2024-09-14T06:02:42.505 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.36525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36525.log.gz 2024-09-14T06:02:42.505 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31211.log 2024-09-14T06:02:42.507 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42826.log 2024-09-14T06:02:42.507 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.34920.log: /var/log/ceph/ceph-client.admin.31211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34920.log.gz 2024-09-14T06:02:42.507 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31211.log.gz 2024-09-14T06:02:42.507 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41245.log 2024-09-14T06:02:42.507 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43866.log 2024-09-14T06:02:42.507 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42826.log.gz 2024-09-14T06:02:42.508 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.41245.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42877.log 2024-09-14T06:02:42.508 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41245.log.gz 2024-09-14T06:02:42.508 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43866.log.gz 2024-09-14T06:02:42.508 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35875.log 2024-09-14T06:02:42.510 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43840.log 2024-09-14T06:02:42.510 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42877.log: /var/log/ceph/ceph-client.admin.35875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42877.log.gz 2024-09-14T06:02:42.510 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35875.log.gz 2024-09-14T06:02:42.510 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42748.log 2024-09-14T06:02:42.510 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42081.log 2024-09-14T06:02:42.510 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43840.log.gz 2024-09-14T06:02:42.511 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42748.log.gz 2024-09-14T06:02:42.511 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42081.log.gz 2024-09-14T06:02:42.585 INFO:teuthology.orchestra.run.smithi006.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T06:02:42.595 INFO:teuthology.orchestra.run.smithi154.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T06:02:42.725 INFO:teuthology.orchestra.run.smithi006.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T06:02:42.771 INFO:teuthology.orchestra.run.smithi006.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T06:02:42.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-14T06:02:43.442 INFO:teuthology.orchestra.run.smithi154.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T06:02:44.258 INFO:teuthology.orchestra.run.smithi006.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T06:02:45.055 INFO:teuthology.orchestra.run.smithi006.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T06:02:45.305 INFO:teuthology.orchestra.run.smithi006.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T06:02:45.306 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-09-14T06:02:45.306 INFO:teuthology.orchestra.run.smithi006.stderr:real 0m2.984s 2024-09-14T06:02:45.306 INFO:teuthology.orchestra.run.smithi006.stderr:user 0m8.359s 2024-09-14T06:02:45.306 INFO:teuthology.orchestra.run.smithi006.stderr:sys 0m0.339s 2024-09-14T06:02:45.337 INFO:teuthology.orchestra.run.smithi154.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T06:02:45.500 INFO:teuthology.orchestra.run.smithi154.stderr: 95.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T06:02:46.048 INFO:teuthology.orchestra.run.smithi154.stderr: 95.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T06:02:46.049 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-09-14T06:02:46.049 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m3.691s 2024-09-14T06:02:46.049 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m10.673s 2024-09-14T06:02:46.050 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m0.410s 2024-09-14T06:02:46.050 INFO:tasks.ceph:Archiving logs... 2024-09-14T06:02:46.050 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900350/remote/smithi006/log 2024-09-14T06:02:46.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T06:02:47.061 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900350/remote/smithi154/log 2024-09-14T06:02:47.062 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T06:02:48.220 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T06:02:48.229 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T06:02:48.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T06:02:48.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T06:02:48.304 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T06:02:48.313 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T06:02:48.313 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T06:02:48.315 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T06:02:48.327 INFO:teuthology.orchestra.run.smithi006.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T06:02:48.327 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================== 2024-09-14T06:02:48.327 INFO:teuthology.orchestra.run.smithi006.stdout:*hv01.front.sepi 67.205.162.81 3 u 6 64 177 0.076 -0.074 0.284 2024-09-14T06:02:48.327 INFO:teuthology.orchestra.run.smithi006.stdout: hv02.front.sepi 63.231.80.2 3 u 6 64 177 0.079 -1.055 0.289 2024-09-14T06:02:48.327 INFO:teuthology.orchestra.run.smithi006.stdout: hv03.front.sepi 74.6.168.72 3 u 65 64 77 0.088 -0.326 0.228 2024-09-14T06:02:48.327 INFO:teuthology.orchestra.run.smithi006.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T06:02:48.330 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T06:02:48.330 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-09-14T06:02:48.330 INFO:teuthology.orchestra.run.smithi154.stdout:*hv01.front.sepi 67.205.162.81 3 u 2 64 177 0.254 -0.313 1.667 2024-09-14T06:02:48.330 INFO:teuthology.orchestra.run.smithi154.stdout:+hv02.front.sepi 63.231.80.2 3 u 4 64 177 0.125 -0.963 1.681 2024-09-14T06:02:48.330 INFO:teuthology.orchestra.run.smithi154.stdout:+hv03.front.sepi 74.6.168.72 3 u 3 64 177 0.128 -0.469 1.651 2024-09-14T06:02:48.331 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T06:02:48.331 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T06:02:48.340 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T06:02:48.341 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T06:02:48.350 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T06:02:48.406 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T06:02:48.415 INFO:teuthology.task.internal:Duration was 863.525328 seconds 2024-09-14T06:02:48.415 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T06:02:48.423 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T06:02:48.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T06:02:48.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T06:02:48.465 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T06:02:48.465 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2024-09-14T06:02:48.465 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T06:02:48.516 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T06:02:48.516 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T06:02:48.525 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T06:02:48.526 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T06:02:48.560 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T06:02:48.597 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T06:02:48.598 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T06:02:48.632 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T06:02:48.708 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T06:02:48.718 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T06:02:48.719 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T06:02:48.730 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T06:02:48.741 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T06:02:48.751 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T06:02:48.776 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T06:02:48.788 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2024-09-14T06:02:48.792 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-09-14T06:02:48.817 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T06:02:48.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T06:02:48.851 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T06:02:48.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T06:02:48.862 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T06:02:48.873 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T06:02:48.874 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900350/remote/smithi006 2024-09-14T06:02:48.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T06:02:48.920 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900350/remote/smithi154 2024-09-14T06:02:48.920 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T06:02:48.942 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T06:02:48.942 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T06:02:48.956 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T06:02:48.987 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T06:02:48.998 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T06:02:48.998 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T06:02:49.021 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T06:02:49.021 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T06:02:49.024 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T06:02:49.027 INFO:teuthology.orchestra.run.smithi006.stdout: 658635 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 06:02 /home/ubuntu/cephtest 2024-09-14T06:02:49.035 INFO:teuthology.orchestra.run.smithi154.stdout: 658615 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 06:02 /home/ubuntu/cephtest 2024-09-14T06:02:49.036 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T06:02:49.046 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T06:02:49.070 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough} duration: 863.5253283977509 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T06:02:49.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T06:02:49.159 INFO:teuthology.run:pass